[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:13:16.304123  5112 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.254.62:37501
I20260709 13:13:16.305685  5112 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:13:16.306725  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 13:13:16.324654  5112 server_base.cc:1061] running on GCE node
W20260709 13:13:16.323700  5119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:16.323673  5121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:16.323820  5118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:17.511291  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:17.511528  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:17.511682  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783602797511667 us; error 0 us; skew 500 ppm
I20260709 13:13:17.512463  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:17.519101  5112 webserver.cc:533] Webserver started at http://127.4.254.62:35065/ using document root <none> and password file <none>
I20260709 13:13:17.519925  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:17.520113  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:17.520505  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:17.530165  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/master-0-root/instance:
uuid: "7ef0f4d6578540d7ae3a02640e5572df"
format_stamp: "Formatted at 2026-07-09 13:13:17 on dist-test-slave-k73n"
I20260709 13:13:17.538450  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:13:17.543583  5127 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:17.544715  5112 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:13:17.545099  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/master-0-root
uuid: "7ef0f4d6578540d7ae3a02640e5572df"
format_stamp: "Formatted at 2026-07-09 13:13:17 on dist-test-slave-k73n"
I20260709 13:13:17.545498  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:17.594228  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:17.595814  5112 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:13:17.596310  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:17.667554  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.62:37501
I20260709 13:13:17.667636  5178 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.62:37501 every 8 connection(s)
I20260709 13:13:17.675709  5179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.697376  5179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df: Bootstrap starting.
I20260709 13:13:17.703197  5179 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.704998  5179 log.cc:826] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df: Log is configured to *not* fsync() on all Append() calls
I20260709 13:13:17.709530  5179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df: No bootstrap required, opened a new log
I20260709 13:13:17.730182  5179 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ef0f4d6578540d7ae3a02640e5572df" member_type: VOTER }
I20260709 13:13:17.730751  5179 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.730945  5179 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ef0f4d6578540d7ae3a02640e5572df, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.731756  5179 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ef0f4d6578540d7ae3a02640e5572df" member_type: VOTER }
I20260709 13:13:17.732213  5179 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:17.732460  5179 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:17.732743  5179 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.736773  5179 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ef0f4d6578540d7ae3a02640e5572df" member_type: VOTER }
I20260709 13:13:17.737566  5179 leader_election.cc:304] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ef0f4d6578540d7ae3a02640e5572df; no voters: 
I20260709 13:13:17.739226  5179 leader_election.cc:290] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:17.739578  5182 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.741899  5182 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [term 1 LEADER]: Becoming Leader. State: Replica: 7ef0f4d6578540d7ae3a02640e5572df, State: Running, Role: LEADER
I20260709 13:13:17.742874  5182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ef0f4d6578540d7ae3a02640e5572df" member_type: VOTER }
I20260709 13:13:17.743885  5179 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:17.755228  5184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ef0f4d6578540d7ae3a02640e5572df. Latest consensus state: current_term: 1 leader_uuid: "7ef0f4d6578540d7ae3a02640e5572df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ef0f4d6578540d7ae3a02640e5572df" member_type: VOTER } }
I20260709 13:13:17.755445  5183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ef0f4d6578540d7ae3a02640e5572df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ef0f4d6578540d7ae3a02640e5572df" member_type: VOTER } }
I20260709 13:13:17.756047  5184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:17.756319  5183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:17.759068  5192 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:17.772112  5192 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:17.774358  5112 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:17.788829  5192 catalog_manager.cc:1383] Generated new cluster ID: 7b426f33977f4136af37613dfa683c6f
I20260709 13:13:17.789153  5192 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:17.808374  5192 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:17.810508  5192 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:17.833745  5192 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df: Generated new TSK 0
I20260709 13:13:17.834681  5192 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:17.840579  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:17.848830  5201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:17.850194  5202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:17.853618  5204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:17.854436  5112 server_base.cc:1061] running on GCE node
I20260709 13:13:17.855211  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:17.855396  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:17.855623  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783602797855587 us; error 0 us; skew 500 ppm
I20260709 13:13:17.856226  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:17.860776  5112 webserver.cc:533] Webserver started at http://127.4.254.1:40193/ using document root <none> and password file <none>
I20260709 13:13:17.861387  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:17.861589  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:17.861900  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:17.863013  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-0-root/instance:
uuid: "1dc332e386344125994c22b5d0f7555a"
format_stamp: "Formatted at 2026-07-09 13:13:17 on dist-test-slave-k73n"
I20260709 13:13:17.868729  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:13:17.873039  5209 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:17.873908  5112 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:17.874209  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-0-root
uuid: "1dc332e386344125994c22b5d0f7555a"
format_stamp: "Formatted at 2026-07-09 13:13:17 on dist-test-slave-k73n"
I20260709 13:13:17.874541  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:17.898626  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:17.899983  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:17.902751  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:17.907363  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:17.907641  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:17.907914  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:17.908105  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:18.008894  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.1:38309
I20260709 13:13:18.008968  5271 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.1:38309 every 8 connection(s)
I20260709 13:13:18.015924  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:18.028426  5276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:18.030256  5277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:18.035574  5279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:18.039475  5112 server_base.cc:1061] running on GCE node
I20260709 13:13:18.040655  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:18.041023  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:18.041376  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783602798041349 us; error 0 us; skew 500 ppm
I20260709 13:13:18.042428  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:18.045667  5112 webserver.cc:533] Webserver started at http://127.4.254.2:41685/ using document root <none> and password file <none>
I20260709 13:13:18.046286  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:18.046515  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:18.046805  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:18.047919  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-1-root/instance:
uuid: "10fb48f8cec840f089638a321d7bf76d"
format_stamp: "Formatted at 2026-07-09 13:13:18 on dist-test-slave-k73n"
I20260709 13:13:18.051972  5272 heartbeater.cc:344] Connected to a master server at 127.4.254.62:37501
I20260709 13:13:18.052452  5272 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:18.053826  5272 heartbeater.cc:507] Master 127.4.254.62:37501 requested a full tablet report, sending...
I20260709 13:13:18.054565  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.008s
I20260709 13:13:18.057459  5144 ts_manager.cc:194] Registered new tserver with Master: 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309)
I20260709 13:13:18.059304  5284 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:18.060583  5144 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60590
I20260709 13:13:18.060593  5112 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:13:18.061067  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-1-root
uuid: "10fb48f8cec840f089638a321d7bf76d"
format_stamp: "Formatted at 2026-07-09 13:13:18 on dist-test-slave-k73n"
I20260709 13:13:18.061375  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:18.083776  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:18.085026  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:18.087641  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:18.091008  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:18.091182  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:18.091486  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:18.091646  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:18.193172  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.2:46725
I20260709 13:13:18.193316  5346 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.2:46725 every 8 connection(s)
I20260709 13:13:18.199939  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:18.211716  5350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:18.218293  5112 server_base.cc:1061] running on GCE node
W20260709 13:13:18.220189  5351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:18.221308  5347 heartbeater.cc:344] Connected to a master server at 127.4.254.62:37501
I20260709 13:13:18.221674  5347 heartbeater.cc:461] Registering TS with master...
W20260709 13:13:18.221719  5353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:18.222667  5347 heartbeater.cc:507] Master 127.4.254.62:37501 requested a full tablet report, sending...
I20260709 13:13:18.222877  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:18.223127  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:18.223325  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783602798223306 us; error 0 us; skew 500 ppm
I20260709 13:13:18.224084  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:18.224984  5144 ts_manager.cc:194] Registered new tserver with Master: 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:18.226749  5144 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60596
I20260709 13:13:18.228585  5112 webserver.cc:533] Webserver started at http://127.4.254.3:38675/ using document root <none> and password file <none>
I20260709 13:13:18.229249  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:18.229485  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:18.229803  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:18.230901  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-2-root/instance:
uuid: "e182017b4b5e4f1c9e6c6989020d1849"
format_stamp: "Formatted at 2026-07-09 13:13:18 on dist-test-slave-k73n"
I20260709 13:13:18.235466  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:13:18.238942  5358 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:18.239768  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:18.240168  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-2-root
uuid: "e182017b4b5e4f1c9e6c6989020d1849"
format_stamp: "Formatted at 2026-07-09 13:13:18 on dist-test-slave-k73n"
I20260709 13:13:18.240459  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602796139571-5112-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:18.260074  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:18.261464  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:18.262923  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:18.265244  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:18.265462  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:18.265704  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:18.265874  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:18.356806  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.3:37453
I20260709 13:13:18.356904  5420 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.3:37453 every 8 connection(s)
I20260709 13:13:18.374120  5421 heartbeater.cc:344] Connected to a master server at 127.4.254.62:37501
I20260709 13:13:18.374581  5421 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:18.375473  5421 heartbeater.cc:507] Master 127.4.254.62:37501 requested a full tablet report, sending...
I20260709 13:13:18.377676  5144 ts_manager.cc:194] Registered new tserver with Master: e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:18.378080  5112 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016146362s
I20260709 13:13:18.379494  5144 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60600
I20260709 13:13:18.428323  5144 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60606:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:18.431924  5144 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:18.539901  5310 tablet_service.cc:1511] Processing CreateTablet for tablet 00621849ced84e9083de347b47f346a2 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:18.540515  5312 tablet_service.cc:1511] Processing CreateTablet for tablet 282ec7bc6a044b2cb9f7bac253919e89 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:18.541620  5310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00621849ced84e9083de347b47f346a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.543220  5309 tablet_service.cc:1511] Processing CreateTablet for tablet 19d5334bc97c422690add0b18acdbaae (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:18.544632  5309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d5334bc97c422690add0b18acdbaae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.546538  5311 tablet_service.cc:1511] Processing CreateTablet for tablet 00dd189c1562429b88dcbe7f563a1453 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:18.546953  5386 tablet_service.cc:1511] Processing CreateTablet for tablet 282ec7bc6a044b2cb9f7bac253919e89 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:18.548770  5312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282ec7bc6a044b2cb9f7bac253919e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.554543  5383 tablet_service.cc:1511] Processing CreateTablet for tablet 19d5334bc97c422690add0b18acdbaae (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:18.557176  5311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dd189c1562429b88dcbe7f563a1453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.555656  5385 tablet_service.cc:1511] Processing CreateTablet for tablet 00dd189c1562429b88dcbe7f563a1453 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:18.557638  5386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282ec7bc6a044b2cb9f7bac253919e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.557264  5384 tablet_service.cc:1511] Processing CreateTablet for tablet 00621849ced84e9083de347b47f346a2 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:18.565888  5382 tablet_service.cc:1511] Processing CreateTablet for tablet 99f2d3afcf20497290dbf499b1a445a1 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:18.556502  5308 tablet_service.cc:1511] Processing CreateTablet for tablet 99f2d3afcf20497290dbf499b1a445a1 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:18.569082  5308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f2d3afcf20497290dbf499b1a445a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.570034  5383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d5334bc97c422690add0b18acdbaae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.571373  5384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00621849ced84e9083de347b47f346a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.572803  5382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f2d3afcf20497290dbf499b1a445a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.574465  5385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dd189c1562429b88dcbe7f563a1453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.598291  5237 tablet_service.cc:1511] Processing CreateTablet for tablet 282ec7bc6a044b2cb9f7bac253919e89 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:18.603672  5234 tablet_service.cc:1511] Processing CreateTablet for tablet 19d5334bc97c422690add0b18acdbaae (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:18.607018  5237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282ec7bc6a044b2cb9f7bac253919e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.609539  5233 tablet_service.cc:1511] Processing CreateTablet for tablet 99f2d3afcf20497290dbf499b1a445a1 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:18.610176  5232 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0e9746ac064c5eb89e2239cf4b5801 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:18.608119  5235 tablet_service.cc:1511] Processing CreateTablet for tablet 00621849ced84e9083de347b47f346a2 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:18.608940  5236 tablet_service.cc:1511] Processing CreateTablet for tablet 00dd189c1562429b88dcbe7f563a1453 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:18.617477  5307 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0e9746ac064c5eb89e2239cf4b5801 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:18.620038  5307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0e9746ac064c5eb89e2239cf4b5801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.615792  5234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d5334bc97c422690add0b18acdbaae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.623944  5232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0e9746ac064c5eb89e2239cf4b5801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.625612  5233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f2d3afcf20497290dbf499b1a445a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.632472  5381 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0e9746ac064c5eb89e2239cf4b5801 (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:18.633878  5381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0e9746ac064c5eb89e2239cf4b5801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.634920  5236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dd189c1562429b88dcbe7f563a1453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.639034  5235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00621849ced84e9083de347b47f346a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.651650  5306 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbd8e3a9a1242ac8e45d6692bebd44b (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:18.652583  5231 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbd8e3a9a1242ac8e45d6692bebd44b (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:18.655428  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbd8e3a9a1242ac8e45d6692bebd44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.660465  5306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbd8e3a9a1242ac8e45d6692bebd44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.760128  5380 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbd8e3a9a1242ac8e45d6692bebd44b (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:18.761464  5380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbd8e3a9a1242ac8e45d6692bebd44b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:18.771209  5191 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:18.777477  5439 tablet_bootstrap.cc:492] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d: Bootstrap starting.
I20260709 13:13:18.786118  5230 tablet_service.cc:1511] Processing CreateTablet for tablet 095e0258c7d44eb2ae7c90863c9636fe (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:18.787474  5230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095e0258c7d44eb2ae7c90863c9636fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.813297  5441 tablet_bootstrap.cc:492] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849: Bootstrap starting.
I20260709 13:13:18.815641  5440 tablet_bootstrap.cc:492] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a: Bootstrap starting.
I20260709 13:13:18.838418  5312 tablet_service.cc:1511] Processing CreateTablet for tablet 095e0258c7d44eb2ae7c90863c9636fe (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:18.840688  5312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095e0258c7d44eb2ae7c90863c9636fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.845729  5310 tablet_service.cc:1511] Processing CreateTablet for tablet 10f2c5f6d4364a198313b0827fdbab7d (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:18.848074  5310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f2c5f6d4364a198313b0827fdbab7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.849960  5232 tablet_service.cc:1511] Processing CreateTablet for tablet 10f2c5f6d4364a198313b0827fdbab7d (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:18.851205  5232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f2c5f6d4364a198313b0827fdbab7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.854948  5380 tablet_service.cc:1511] Processing CreateTablet for tablet 095e0258c7d44eb2ae7c90863c9636fe (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:18.855237  5385 tablet_service.cc:1511] Processing CreateTablet for tablet 10f2c5f6d4364a198313b0827fdbab7d (DEFAULT_TABLE table=test-workload [id=694cac660afa42acb7dbe3c69e6b9f43]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:18.856180  5380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095e0258c7d44eb2ae7c90863c9636fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.872385  5439 tablet_bootstrap.cc:654] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.873904  5385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f2c5f6d4364a198313b0827fdbab7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.875607  5440 tablet_bootstrap.cc:654] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.888001  5439 tablet_bootstrap.cc:492] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d: No bootstrap required, opened a new log
I20260709 13:13:18.888510  5439 ts_tablet_manager.cc:1403] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d: Time spent bootstrapping tablet: real 0.123s	user 0.010s	sys 0.008s
I20260709 13:13:18.895287  5441 tablet_bootstrap.cc:654] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.895602  5439 raft_consensus.cc:359] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:18.896404  5439 raft_consensus.cc:385] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.896736  5439 raft_consensus.cc:740] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.897548  5439 consensus_queue.cc:260] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:18.902261  5440 tablet_bootstrap.cc:492] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a: No bootstrap required, opened a new log
I20260709 13:13:18.902842  5440 ts_tablet_manager.cc:1403] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a: Time spent bootstrapping tablet: real 0.107s	user 0.007s	sys 0.007s
I20260709 13:13:18.907078  5441 tablet_bootstrap.cc:492] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849: No bootstrap required, opened a new log
I20260709 13:13:18.907013  5440 raft_consensus.cc:359] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:18.907778  5441 ts_tablet_manager.cc:1403] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849: Time spent bootstrapping tablet: real 0.101s	user 0.000s	sys 0.016s
I20260709 13:13:18.908093  5440 raft_consensus.cc:385] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.908520  5440 raft_consensus.cc:740] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.909686  5440 consensus_queue.cc:260] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:18.910815  5441 raft_consensus.cc:359] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:18.911566  5441 raft_consensus.cc:385] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.911916  5441 raft_consensus.cc:740] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.912672  5441 consensus_queue.cc:260] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:18.914867  5347 heartbeater.cc:499] Master 127.4.254.62:37501 was elected leader, sending a full tablet report...
I20260709 13:13:18.915697  5439 ts_tablet_manager.cc:1434] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.015s
I20260709 13:13:18.917379  5439 tablet_bootstrap.cc:492] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d: Bootstrap starting.
I20260709 13:13:18.918838  5421 heartbeater.cc:499] Master 127.4.254.62:37501 was elected leader, sending a full tablet report...
I20260709 13:13:18.919909  5441 ts_tablet_manager.cc:1434] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:13:18.920888  5441 tablet_bootstrap.cc:492] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849: Bootstrap starting.
I20260709 13:13:18.924624  5439 tablet_bootstrap.cc:654] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.927242  5441 tablet_bootstrap.cc:654] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.935384  5272 heartbeater.cc:499] Master 127.4.254.62:37501 was elected leader, sending a full tablet report...
I20260709 13:13:18.938819  5441 tablet_bootstrap.cc:492] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849: No bootstrap required, opened a new log
I20260709 13:13:18.939285  5441 ts_tablet_manager.cc:1403] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.002s
I20260709 13:13:18.939888  5439 tablet_bootstrap.cc:492] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d: No bootstrap required, opened a new log
I20260709 13:13:18.940323  5439 ts_tablet_manager.cc:1403] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 13:13:18.942291  5441 raft_consensus.cc:359] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:18.942998  5441 raft_consensus.cc:385] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.943320  5441 raft_consensus.cc:740] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.943161  5439 raft_consensus.cc:359] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:18.943980  5439 raft_consensus.cc:385] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.944334  5439 raft_consensus.cc:740] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.944084  5441 consensus_queue.cc:260] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:18.945106  5439 consensus_queue.cc:260] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:18.946513  5441 ts_tablet_manager.cc:1434] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:13:18.947382  5441 tablet_bootstrap.cc:492] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849: Bootstrap starting.
I20260709 13:13:18.947505  5439 ts_tablet_manager.cc:1434] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:13:18.946633  5440 ts_tablet_manager.cc:1434] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.010s
I20260709 13:13:18.948452  5439 tablet_bootstrap.cc:492] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d: Bootstrap starting.
I20260709 13:13:18.949388  5440 tablet_bootstrap.cc:492] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a: Bootstrap starting.
I20260709 13:13:18.954501  5441 tablet_bootstrap.cc:654] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.955246  5439 tablet_bootstrap.cc:654] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.966297  5441 tablet_bootstrap.cc:492] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849: No bootstrap required, opened a new log
I20260709 13:13:18.966763  5441 ts_tablet_manager.cc:1403] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:13:18.967203  5439 tablet_bootstrap.cc:492] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d: No bootstrap required, opened a new log
I20260709 13:13:18.967687  5439 ts_tablet_manager.cc:1403] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
W20260709 13:13:18.969611  5348 tablet.cc:2406] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:18.969607  5441 raft_consensus.cc:359] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:18.970420  5441 raft_consensus.cc:385] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.970767  5441 raft_consensus.cc:740] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.970616  5439 raft_consensus.cc:359] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:18.971405  5439 raft_consensus.cc:385] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.971776  5439 raft_consensus.cc:740] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.971575  5441 consensus_queue.cc:260] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:18.972797  5439 consensus_queue.cc:260] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:18.974059  5441 ts_tablet_manager.cc:1434] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:18.975011  5441 tablet_bootstrap.cc:492] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849: Bootstrap starting.
I20260709 13:13:18.975672  5439 ts_tablet_manager.cc:1434] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:13:18.976647  5439 tablet_bootstrap.cc:492] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d: Bootstrap starting.
I20260709 13:13:18.981417  5441 tablet_bootstrap.cc:654] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.982995  5439 tablet_bootstrap.cc:654] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.994483  5441 tablet_bootstrap.cc:492] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849: No bootstrap required, opened a new log
I20260709 13:13:18.994874  5439 tablet_bootstrap.cc:492] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d: No bootstrap required, opened a new log
I20260709 13:13:18.994956  5441 ts_tablet_manager.cc:1403] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.010s
I20260709 13:13:18.995425  5439 ts_tablet_manager.cc:1403] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.012s
I20260709 13:13:18.999234  5441 raft_consensus.cc:359] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:18.999950  5441 raft_consensus.cc:385] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.000232  5441 raft_consensus.cc:740] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.001765  5439 raft_consensus.cc:359] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.002470  5439 raft_consensus.cc:385] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.002759  5439 raft_consensus.cc:740] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.003461  5439 consensus_queue.cc:260] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.005419  5440 tablet_bootstrap.cc:654] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.005601  5439 ts_tablet_manager.cc:1434] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.006s
I20260709 13:13:19.006561  5439 tablet_bootstrap.cc:492] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d: Bootstrap starting.
I20260709 13:13:19.012771  5439 tablet_bootstrap.cc:654] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.013417  5441 consensus_queue.cc:260] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.015848  5441 ts_tablet_manager.cc:1434] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:13:19.016708  5441 tablet_bootstrap.cc:492] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849: Bootstrap starting.
I20260709 13:13:19.022871  5441 tablet_bootstrap.cc:654] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.029938  5440 tablet_bootstrap.cc:492] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a: No bootstrap required, opened a new log
I20260709 13:13:19.030915  5440 ts_tablet_manager.cc:1403] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a: Time spent bootstrapping tablet: real 0.082s	user 0.019s	sys 0.003s
I20260709 13:13:19.034643  5440 raft_consensus.cc:359] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.035419  5440 raft_consensus.cc:385] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.035729  5440 raft_consensus.cc:740] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.036780  5440 consensus_queue.cc:260] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.039776  5441 tablet_bootstrap.cc:492] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849: No bootstrap required, opened a new log
I20260709 13:13:19.040298  5441 ts_tablet_manager.cc:1403] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.011s
I20260709 13:13:19.043154  5441 raft_consensus.cc:359] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.043879  5441 raft_consensus.cc:385] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.044239  5441 raft_consensus.cc:740] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.045071  5441 consensus_queue.cc:260] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.048362  5441 ts_tablet_manager.cc:1434] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:19.049175  5441 tablet_bootstrap.cc:492] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849: Bootstrap starting.
I20260709 13:13:19.051247  5440 ts_tablet_manager.cc:1434] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 13:13:19.052196  5440 tablet_bootstrap.cc:492] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a: Bootstrap starting.
I20260709 13:13:19.055794  5441 tablet_bootstrap.cc:654] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.056555  5439 tablet_bootstrap.cc:492] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d: No bootstrap required, opened a new log
I20260709 13:13:19.056990  5439 ts_tablet_manager.cc:1403] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.009s
I20260709 13:13:19.060426  5440 tablet_bootstrap.cc:654] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.061640  5439 raft_consensus.cc:359] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.062399  5439 raft_consensus.cc:385] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.062727  5439 raft_consensus.cc:740] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.063586  5439 consensus_queue.cc:260] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.065824  5439 ts_tablet_manager.cc:1434] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:19.066627  5439 tablet_bootstrap.cc:492] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d: Bootstrap starting.
I20260709 13:13:19.072891  5439 tablet_bootstrap.cc:654] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.074585  5440 tablet_bootstrap.cc:492] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a: No bootstrap required, opened a new log
I20260709 13:13:19.075043  5440 ts_tablet_manager.cc:1403] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.002s
I20260709 13:13:19.077986  5440 raft_consensus.cc:359] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.078672  5440 raft_consensus.cc:385] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.079394  5445 raft_consensus.cc:493] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.079856  5445 raft_consensus.cc:515] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.081986  5441 tablet_bootstrap.cc:492] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849: No bootstrap required, opened a new log
I20260709 13:13:19.082715  5441 ts_tablet_manager.cc:1403] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.004s
I20260709 13:13:19.084908  5445 leader_election.cc:290] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:19.078963  5440 raft_consensus.cc:740] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.091642  5440 consensus_queue.cc:260] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.095289  5441 raft_consensus.cc:359] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.096011  5441 raft_consensus.cc:385] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.096143  5440 ts_tablet_manager.cc:1434] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:13:19.096311  5441 raft_consensus.cc:740] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.097097  5441 consensus_queue.cc:260] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.101526  5440 tablet_bootstrap.cc:492] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a: Bootstrap starting.
I20260709 13:13:19.106199  5441 ts_tablet_manager.cc:1434] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.005s
I20260709 13:13:19.107125  5441 tablet_bootstrap.cc:492] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849: Bootstrap starting.
I20260709 13:13:19.115213  5440 tablet_bootstrap.cc:654] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.133236  5445 raft_consensus.cc:493] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.133823  5445 raft_consensus.cc:515] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.135672  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f2d3afcf20497290dbf499b1a445a1" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a" is_pre_election: true
I20260709 13:13:19.136440  5247 raft_consensus.cc:2468] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 0.
I20260709 13:13:19.136603  5445 leader_election.cc:290] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:19.138125  5286 leader_election.cc:304] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:19.138463  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a" is_pre_election: true
I20260709 13:13:19.139037  5445 raft_consensus.cc:2804] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.139410  5445 raft_consensus.cc:493] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.139806  5445 raft_consensus.cc:3060] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.139182  5247 raft_consensus.cc:2468] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 0.
I20260709 13:13:19.142040  5439 tablet_bootstrap.cc:492] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d: No bootstrap required, opened a new log
I20260709 13:13:19.141968  5286 leader_election.cc:304] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:19.142653  5439 ts_tablet_manager.cc:1403] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d: Time spent bootstrapping tablet: real 0.076s	user 0.026s	sys 0.007s
I20260709 13:13:19.148296  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f2d3afcf20497290dbf499b1a445a1" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849" is_pre_election: true
I20260709 13:13:19.148950  5396 raft_consensus.cc:2468] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 0.
I20260709 13:13:19.150445  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849" is_pre_election: true
W20260709 13:13:19.154053  5285 leader_election.cc:343] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.158252  5445 raft_consensus.cc:515] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.159183  5441 tablet_bootstrap.cc:654] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.154374  5439 raft_consensus.cc:359] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.160583  5439 raft_consensus.cc:385] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.160897  5439 raft_consensus.cc:740] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.162484  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f2d3afcf20497290dbf499b1a445a1" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:19.162098  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f2d3afcf20497290dbf499b1a445a1" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:19.167796  5247 raft_consensus.cc:3060] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.168172  5395 raft_consensus.cc:3060] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.169181  5439 consensus_queue.cc:260] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.161041  5445 leader_election.cc:290] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:19.177695  5445 raft_consensus.cc:2804] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.178043  5445 raft_consensus.cc:493] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.178390  5445 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.180773  5247 raft_consensus.cc:2468] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 1.
I20260709 13:13:19.183259  5286 leader_election.cc:304] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:19.184705  5441 tablet_bootstrap.cc:492] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849: No bootstrap required, opened a new log
I20260709 13:13:19.185503  5439 ts_tablet_manager.cc:1434] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.003s
I20260709 13:13:19.185276  5465 raft_consensus.cc:2804] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.186499  5439 tablet_bootstrap.cc:492] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d: Bootstrap starting.
I20260709 13:13:19.187399  5441 ts_tablet_manager.cc:1403] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849: Time spent bootstrapping tablet: real 0.080s	user 0.006s	sys 0.009s
I20260709 13:13:19.190585  5441 raft_consensus.cc:359] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.193364  5441 raft_consensus.cc:385] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.193643  5439 tablet_bootstrap.cc:654] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.194667  5395 raft_consensus.cc:2468] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 1.
I20260709 13:13:19.196025  5440 tablet_bootstrap.cc:492] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a: No bootstrap required, opened a new log
I20260709 13:13:19.196499  5440 ts_tablet_manager.cc:1403] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a: Time spent bootstrapping tablet: real 0.100s	user 0.014s	sys 0.015s
I20260709 13:13:19.199939  5440 raft_consensus.cc:359] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:19.200848  5440 raft_consensus.cc:385] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.201014  5445 raft_consensus.cc:515] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.201434  5440 raft_consensus.cc:740] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.202499  5440 consensus_queue.cc:260] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:19.203786  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:19.203992  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:19.204334  5247 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.204631  5445 leader_election.cc:290] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:19.205106  5445 raft_consensus.cc:493] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.205497  5440 ts_tablet_manager.cc:1434] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 13:13:19.205544  5445 raft_consensus.cc:515] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.206682  5440 tablet_bootstrap.cc:492] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a: Bootstrap starting.
I20260709 13:13:19.208566  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00621849ced84e9083de347b47f346a2" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849" is_pre_election: true
I20260709 13:13:19.209048  5465 raft_consensus.cc:697] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Becoming Leader. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:19.209120  5396 raft_consensus.cc:2468] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 0.
I20260709 13:13:19.210485  5285 leader_election.cc:304] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:19.210160  5465 consensus_queue.cc:237] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.211418  5463 raft_consensus.cc:2804] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.211799  5463 raft_consensus.cc:493] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.212162  5463 raft_consensus.cc:3060] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.214192  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00621849ced84e9083de347b47f346a2" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a" is_pre_election: true
I20260709 13:13:19.194152  5441 raft_consensus.cc:740] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.215633  5441 consensus_queue.cc:260] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.216588  5395 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:19.216696  5286 leader_election.cc:343] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.221866  5247 raft_consensus.cc:2468] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 1.
I20260709 13:13:19.223047  5286 leader_election.cc:304] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:19.224081  5467 raft_consensus.cc:2804] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.224143  5447 raft_consensus.cc:493] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.226097  5441 ts_tablet_manager.cc:1434] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:13:19.226168  5447 raft_consensus.cc:515] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.227113  5441 tablet_bootstrap.cc:492] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849: Bootstrap starting.
I20260709 13:13:19.229370  5447 leader_election.cc:290] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:19.232842  5467 raft_consensus.cc:697] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Becoming Leader. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:19.233737  5440 tablet_bootstrap.cc:654] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.233835  5467 consensus_queue.cc:237] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.231137  5463 raft_consensus.cc:515] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.237407  5447 raft_consensus.cc:493] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.239436  5447 raft_consensus.cc:515] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.242844  5445 leader_election.cc:290] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:19.244127  5395 raft_consensus.cc:2468] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 1.
I20260709 13:13:19.245520  5447 leader_election.cc:290] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:19.249459  5446 raft_consensus.cc:493] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.248138  5142 catalog_manager.cc:5697] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d reported cstate change: term changed from 0 to 1, leader changed from <none> to 10fb48f8cec840f089638a321d7bf76d (127.4.254.2). New cstate: current_term: 1 leader_uuid: "10fb48f8cec840f089638a321d7bf76d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.250403  5446 raft_consensus.cc:515] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.260787  5446 leader_election.cc:290] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:19.263134  5439 tablet_bootstrap.cc:492] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d: No bootstrap required, opened a new log
I20260709 13:13:19.260253  5463 leader_election.cc:290] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:19.266165  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00621849ced84e9083de347b47f346a2" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:19.273787  5439 ts_tablet_manager.cc:1403] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.011s
I20260709 13:13:19.284917  5441 tablet_bootstrap.cc:654] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.300052  5439 raft_consensus.cc:359] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.312817  5439 raft_consensus.cc:385] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.317010  5439 raft_consensus.cc:740] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.318763  5439 consensus_queue.cc:260] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.322906  5439 ts_tablet_manager.cc:1434] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.004s
I20260709 13:13:19.324024  5439 tablet_bootstrap.cc:492] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d: Bootstrap starting.
W20260709 13:13:19.332105  5286 leader_election.cc:343] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.346495  5467 raft_consensus.cc:493] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.347010  5467 raft_consensus.cc:515] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:19.351951  5470 raft_consensus.cc:493] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.353255  5322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d" is_pre_election: true
I20260709 13:13:19.353873  5467 leader_election.cc:290] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:19.353933  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00621849ced84e9083de347b47f346a2" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:19.353710  5470 raft_consensus.cc:515] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:19.357352  5441 tablet_bootstrap.cc:492] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849: No bootstrap required, opened a new log
I20260709 13:13:19.357820  5441 ts_tablet_manager.cc:1403] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849: Time spent bootstrapping tablet: real 0.131s	user 0.008s	sys 0.012s
I20260709 13:13:19.358204  5395 raft_consensus.cc:3060] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.355173  5322 raft_consensus.cc:2468] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 0.
I20260709 13:13:19.358309  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a" is_pre_election: true
I20260709 13:13:19.361277  5440 tablet_bootstrap.cc:492] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a: No bootstrap required, opened a new log
I20260709 13:13:19.361311  5247 raft_consensus.cc:2468] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 0.
I20260709 13:13:19.363462  5361 leader_election.cc:304] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:19.364985  5447 raft_consensus.cc:2804] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.358682  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd8e3a9a1242ac8e45d6692bebd44b" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d" is_pre_election: true
I20260709 13:13:19.365229  5440 ts_tablet_manager.cc:1403] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a: Time spent bootstrapping tablet: real 0.159s	user 0.018s	sys 0.044s
I20260709 13:13:19.365368  5447 raft_consensus.cc:493] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.365926  5447 raft_consensus.cc:3060] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:19.366945  5361 leader_election.cc:343] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.367761  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849" is_pre_election: true
I20260709 13:13:19.368903  5441 raft_consensus.cc:359] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.370383  5470 leader_election.cc:290] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:19.370623  5439 tablet_bootstrap.cc:654] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.368299  5396 raft_consensus.cc:2468] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 0.
I20260709 13:13:19.371337  5441 raft_consensus.cc:385] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.371981  5441 raft_consensus.cc:740] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.373158  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d" is_pre_election: true
I20260709 13:13:19.373160  5441 consensus_queue.cc:260] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.371177  5286 leader_election.cc:304] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:19.374085  5321 raft_consensus.cc:2468] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 0.
I20260709 13:13:19.376870  5467 raft_consensus.cc:2804] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.377236  5467 raft_consensus.cc:493] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.377413  5361 leader_election.cc:304] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:19.377583  5467 raft_consensus.cc:3060] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.379689  5441 ts_tablet_manager.cc:1434] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:13:19.380400  5441 tablet_bootstrap.cc:492] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849: Bootstrap starting.
I20260709 13:13:19.381320  5470 raft_consensus.cc:2804] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.385963  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a" is_pre_election: true
I20260709 13:13:19.385636  5470 raft_consensus.cc:493] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.386974  5470 raft_consensus.cc:3060] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.384964  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd8e3a9a1242ac8e45d6692bebd44b" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a" is_pre_election: true
I20260709 13:13:19.387593  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a" is_pre_election: true
I20260709 13:13:19.390555  5247 raft_consensus.cc:2468] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 0.
I20260709 13:13:19.386976  5245 raft_consensus.cc:2468] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 0.
I20260709 13:13:19.405261  5395 raft_consensus.cc:2468] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 1.
W20260709 13:13:19.407575  5360 leader_election.cc:343] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.407119  5447 raft_consensus.cc:515] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.411470  5467 raft_consensus.cc:515] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:19.410943  5360 leader_election.cc:304] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e182017b4b5e4f1c9e6c6989020d1849; no voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a
I20260709 13:13:19.415386  5467 leader_election.cc:290] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:19.417480  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:19.419235  5483 raft_consensus.cc:2749] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:19.420506  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:19.421635  5245 raft_consensus.cc:3060] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.411621  5440 raft_consensus.cc:359] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.421540  5285 leader_election.cc:304] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, e182017b4b5e4f1c9e6c6989020d1849; no voters: 1dc332e386344125994c22b5d0f7555a
I20260709 13:13:19.423497  5440 raft_consensus.cc:385] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.423775  5447 leader_election.cc:290] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:19.424274  5440 raft_consensus.cc:740] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.424633  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d" is_pre_election: true
I20260709 13:13:19.421392  5247 raft_consensus.cc:3060] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.425251  5321 raft_consensus.cc:2468] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 0.
I20260709 13:13:19.426111  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:19.426787  5467 raft_consensus.cc:2804] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.428380  5467 raft_consensus.cc:697] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Becoming Leader. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:19.427951  5212 leader_election.cc:304] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:19.431064  5467 consensus_queue.cc:237] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.428678  5440 consensus_queue.cc:260] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.434633  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849" is_pre_election: true
I20260709 13:13:19.432770  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:19.436208  5396 raft_consensus.cc:2393] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1dc332e386344125994c22b5d0f7555a in current term 1: Already voted for candidate e182017b4b5e4f1c9e6c6989020d1849 in this term.
I20260709 13:13:19.436430  5321 raft_consensus.cc:3060] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.441594  5441 tablet_bootstrap.cc:654] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.439424  5245 raft_consensus.cc:2468] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 1.
I20260709 13:13:19.442107  5439 tablet_bootstrap.cc:492] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d: No bootstrap required, opened a new log
I20260709 13:13:19.442611  5439 ts_tablet_manager.cc:1403] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.007s
I20260709 13:13:19.441675  5470 raft_consensus.cc:515] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:19.445412  5286 leader_election.cc:304] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:19.446230  5463 raft_consensus.cc:2804] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.446971  5463 raft_consensus.cc:697] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Becoming Leader. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:19.447947  5470 leader_election.cc:290] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:19.447772  5463 consensus_queue.cc:237] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:19.448669  5395 raft_consensus.cc:2393] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10fb48f8cec840f089638a321d7bf76d in current term 1: Already voted for candidate e182017b4b5e4f1c9e6c6989020d1849 in this term.
I20260709 13:13:19.448549  5439 raft_consensus.cc:359] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.449572  5439 raft_consensus.cc:385] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.449940  5439 raft_consensus.cc:740] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.452919  5470 raft_consensus.cc:493] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.454090  5439 consensus_queue.cc:260] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.454496  5470 raft_consensus.cc:515] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.456081  5439 ts_tablet_manager.cc:1434] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:13:19.456911  5439 tablet_bootstrap.cc:492] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d: Bootstrap starting.
I20260709 13:13:19.456991  5470 leader_election.cc:290] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:19.460695  5322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:19.460999  5440 ts_tablet_manager.cc:1434] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.009s
I20260709 13:13:19.467504  5440 tablet_bootstrap.cc:492] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a: Bootstrap starting.
I20260709 13:13:19.467458  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a" is_pre_election: true
I20260709 13:13:19.465545  5445 raft_consensus.cc:493] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.466449  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:19.472335  5441 tablet_bootstrap.cc:492] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849: No bootstrap required, opened a new log
I20260709 13:13:19.472730  5441 ts_tablet_manager.cc:1403] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.004s
I20260709 13:13:19.470134  5445 raft_consensus.cc:515] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.470324  5246 raft_consensus.cc:2468] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 0.
I20260709 13:13:19.475237  5445 leader_election.cc:290] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:19.475507  5360 leader_election.cc:304] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:19.469339  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d" is_pre_election: true
I20260709 13:13:19.469986  5247 raft_consensus.cc:2468] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 1.
I20260709 13:13:19.475781  5441 raft_consensus.cc:359] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.517905  5446 raft_consensus.cc:2764] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:13:19.518118  5441 raft_consensus.cc:385] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.518432  5441 raft_consensus.cc:740] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.477051  5245 raft_consensus.cc:2393] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e182017b4b5e4f1c9e6c6989020d1849 in current term 1: Already voted for candidate 10fb48f8cec840f089638a321d7bf76d in this term.
I20260709 13:13:19.491057  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a" is_pre_election: true
I20260709 13:13:19.519088  5321 raft_consensus.cc:2468] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 1.
I20260709 13:13:19.519874  5441 consensus_queue.cc:260] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.518821  5440 tablet_bootstrap.cc:654] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.518666  5360 leader_election.cc:304] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:19.489593  5470 raft_consensus.cc:2804] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.526316  5441 ts_tablet_manager.cc:1434] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.001s
I20260709 13:13:19.527109  5483 raft_consensus.cc:2804] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.527405  5360 leader_election.cc:304] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e182017b4b5e4f1c9e6c6989020d1849; no voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a
I20260709 13:13:19.525357  5470 raft_consensus.cc:493] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.490890  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849" is_pre_election: true
I20260709 13:13:19.530256  5470 raft_consensus.cc:3060] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.525283  5320 raft_consensus.cc:2468] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 0.
I20260709 13:13:19.533746  5447 raft_consensus.cc:2749] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:19.529873  5246 raft_consensus.cc:2468] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 0.
I20260709 13:13:19.533967  5483 raft_consensus.cc:697] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Becoming Leader. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Running, Role: LEADER
I20260709 13:13:19.539929  5286 leader_election.cc:304] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:19.540761  5445 raft_consensus.cc:2804] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.540320  5483 consensus_queue.cc:237] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.541780  5445 raft_consensus.cc:493] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.542207  5445 raft_consensus.cc:3060] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.547485  5470 raft_consensus.cc:515] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.549008  5395 raft_consensus.cc:2393] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10fb48f8cec840f089638a321d7bf76d in current term 1: Already voted for candidate e182017b4b5e4f1c9e6c6989020d1849 in this term.
I20260709 13:13:19.551054  5470 leader_election.cc:290] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:19.551169  5439 tablet_bootstrap.cc:654] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.552210  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:19.553771  5246 raft_consensus.cc:3060] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.555183  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:19.557292  5440 tablet_bootstrap.cc:492] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a: No bootstrap required, opened a new log
I20260709 13:13:19.558117  5440 ts_tablet_manager.cc:1403] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a: Time spent bootstrapping tablet: real 0.091s	user 0.018s	sys 0.002s
I20260709 13:13:19.563313  5440 raft_consensus.cc:359] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.564385  5440 raft_consensus.cc:385] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.564971  5440 raft_consensus.cc:740] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.566177  5445 raft_consensus.cc:515] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.566488  5440 consensus_queue.cc:260] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.566816  5439 tablet_bootstrap.cc:492] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d: No bootstrap required, opened a new log
I20260709 13:13:19.567276  5320 raft_consensus.cc:2393] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e182017b4b5e4f1c9e6c6989020d1849 in current term 1: Already voted for candidate 10fb48f8cec840f089638a321d7bf76d in this term.
I20260709 13:13:19.570505  5439 ts_tablet_manager.cc:1403] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d: Time spent bootstrapping tablet: real 0.114s	user 0.003s	sys 0.011s
I20260709 13:13:19.570194  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:19.570235  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:19.572063  5440 ts_tablet_manager.cc:1434] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:13:19.572993  5285 leader_election.cc:304] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d; no voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849
I20260709 13:13:19.574054  5246 raft_consensus.cc:2468] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 1.
I20260709 13:13:19.575035  5463 raft_consensus.cc:2749] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:19.576220  5440 tablet_bootstrap.cc:492] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a: Bootstrap starting.
I20260709 13:13:19.573117  5439 raft_consensus.cc:359] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.578224  5439 raft_consensus.cc:385] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.578575  5439 raft_consensus.cc:740] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.579316  5439 consensus_queue.cc:260] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.568470  5445 leader_election.cc:290] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 1 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:19.582123  5439 ts_tablet_manager.cc:1434] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:13:19.583590  5440 tablet_bootstrap.cc:654] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.586378  5142 catalog_manager.cc:5697] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d reported cstate change: term changed from 0 to 1, leader changed from <none> to 10fb48f8cec840f089638a321d7bf76d (127.4.254.2). New cstate: current_term: 1 leader_uuid: "10fb48f8cec840f089638a321d7bf76d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.588362  5142 catalog_manager.cc:5697] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d reported cstate change: term changed from 0 to 1, leader changed from <none> to 10fb48f8cec840f089638a321d7bf76d (127.4.254.2). New cstate: current_term: 1 leader_uuid: "10fb48f8cec840f089638a321d7bf76d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.589603  5360 leader_election.cc:304] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:19.590031  5142 catalog_manager.cc:5697] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d reported cstate change: term changed from 0 to 1, leader changed from <none> to 10fb48f8cec840f089638a321d7bf76d (127.4.254.2). New cstate: current_term: 1 leader_uuid: "10fb48f8cec840f089638a321d7bf76d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:19.590731  5483 raft_consensus.cc:2804] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.591403  5483 raft_consensus.cc:697] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Becoming Leader. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Running, Role: LEADER
I20260709 13:13:19.592585  5483 consensus_queue.cc:237] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.603215  5440 tablet_bootstrap.cc:492] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a: No bootstrap required, opened a new log
I20260709 13:13:19.603700  5440 ts_tablet_manager.cc:1403] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.006s
I20260709 13:13:19.606523  5440 raft_consensus.cc:359] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.607208  5440 raft_consensus.cc:385] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.607507  5440 raft_consensus.cc:740] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.608212  5440 consensus_queue.cc:260] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.610493  5143 catalog_manager.cc:5697] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 reported cstate change: term changed from 0 to 1, leader changed from <none> to e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "e182017b4b5e4f1c9e6c6989020d1849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:19.615013  5440 ts_tablet_manager.cc:1434] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:13:19.618412  5440 tablet_bootstrap.cc:492] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a: Bootstrap starting.
I20260709 13:13:19.623195  5470 raft_consensus.cc:493] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.623816  5470 raft_consensus.cc:515] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.626462  5470 leader_election.cc:290] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:19.627466  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f2c5f6d4364a198313b0827fdbab7d" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d" is_pre_election: true
I20260709 13:13:19.628101  5320 raft_consensus.cc:2468] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 0.
I20260709 13:13:19.628254  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f2c5f6d4364a198313b0827fdbab7d" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a" is_pre_election: true
I20260709 13:13:19.629280  5361 leader_election.cc:304] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
W20260709 13:13:19.629987  5360 leader_election.cc:343] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.631120  5470 raft_consensus.cc:2804] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.631603  5470 raft_consensus.cc:493] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.632041  5470 raft_consensus.cc:3060] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.635838  5440 tablet_bootstrap.cc:654] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.639038  5470 raft_consensus.cc:515] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.639142  5143 catalog_manager.cc:5697] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 reported cstate change: term changed from 0 to 1, leader changed from <none> to e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "e182017b4b5e4f1c9e6c6989020d1849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:19.641726  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f2c5f6d4364a198313b0827fdbab7d" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a"
W20260709 13:13:19.643064  5360 leader_election.cc:343] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.643990  5470 leader_election.cc:290] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:19.645429  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f2c5f6d4364a198313b0827fdbab7d" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:19.645967  5320 raft_consensus.cc:3060] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.646642  5440 tablet_bootstrap.cc:492] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a: No bootstrap required, opened a new log
I20260709 13:13:19.647082  5440 ts_tablet_manager.cc:1403] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.007s
I20260709 13:13:19.649494  5440 raft_consensus.cc:359] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.650179  5440 raft_consensus.cc:385] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.650485  5440 raft_consensus.cc:740] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.651161  5440 consensus_queue.cc:260] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.652976  5440 ts_tablet_manager.cc:1434] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:13:19.653798  5440 tablet_bootstrap.cc:492] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a: Bootstrap starting.
I20260709 13:13:19.653936  5320 raft_consensus.cc:2468] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 1.
I20260709 13:13:19.655035  5361 leader_election.cc:304] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, e182017b4b5e4f1c9e6c6989020d1849; no voters: 1dc332e386344125994c22b5d0f7555a
I20260709 13:13:19.656111  5470 raft_consensus.cc:2804] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.656579  5470 raft_consensus.cc:697] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Becoming Leader. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Running, Role: LEADER
I20260709 13:13:19.657431  5470 consensus_queue.cc:237] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.659749  5440 tablet_bootstrap.cc:654] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.670879  5445 consensus_queue.cc:1048] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:19.678941  5445 consensus_queue.cc:1048] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:19.710469  5440 tablet_bootstrap.cc:492] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a: No bootstrap required, opened a new log
I20260709 13:13:19.710916  5440 ts_tablet_manager.cc:1403] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.035s
I20260709 13:13:19.713943  5440 raft_consensus.cc:359] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.714601  5440 raft_consensus.cc:385] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.714862  5440 raft_consensus.cc:740] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.715473  5440 consensus_queue.cc:260] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.718036  5440 ts_tablet_manager.cc:1434] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 13:13:19.709724  5143 catalog_manager.cc:5697] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 reported cstate change: term changed from 0 to 1, leader changed from <none> to e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "e182017b4b5e4f1c9e6c6989020d1849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:19.724571  5471 consensus_queue.cc:1048] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:19.730276  5467 consensus_queue.cc:1048] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.743937  5470 raft_consensus.cc:493] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.744429  5470 raft_consensus.cc:515] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.747773  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095e0258c7d44eb2ae7c90863c9636fe" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a" is_pre_election: true
I20260709 13:13:19.748564  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095e0258c7d44eb2ae7c90863c9636fe" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d" is_pre_election: true
I20260709 13:13:19.748593  5247 raft_consensus.cc:2468] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 0.
I20260709 13:13:19.749593  5320 raft_consensus.cc:2468] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 0.
I20260709 13:13:19.750569  5360 leader_election.cc:304] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:19.751329  5470 leader_election.cc:290] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:19.751724  5483 raft_consensus.cc:2804] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.752211  5483 raft_consensus.cc:493] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.752671  5483 raft_consensus.cc:3060] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.760499  5446 raft_consensus.cc:493] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.760969  5446 raft_consensus.cc:515] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.761463  5483 raft_consensus.cc:515] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.763058  5446 leader_election.cc:290] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:19.764513  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd8e3a9a1242ac8e45d6692bebd44b" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d" is_pre_election: true
I20260709 13:13:19.764627  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd8e3a9a1242ac8e45d6692bebd44b" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849" is_pre_election: true
I20260709 13:13:19.765178  5320 raft_consensus.cc:2468] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 0.
I20260709 13:13:19.765997  5483 leader_election.cc:290] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:19.766747  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095e0258c7d44eb2ae7c90863c9636fe" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:19.766784  5212 leader_election.cc:304] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:19.767424  5247 raft_consensus.cc:3060] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.767681  5446 raft_consensus.cc:2804] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.768008  5446 raft_consensus.cc:493] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.768344  5446 raft_consensus.cc:3060] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.772840  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095e0258c7d44eb2ae7c90863c9636fe" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:19.773591  5320 raft_consensus.cc:3060] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.774178  5247 raft_consensus.cc:2468] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 1.
I20260709 13:13:19.765193  5395 raft_consensus.cc:2468] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 0.
I20260709 13:13:19.775367  5360 leader_election.cc:304] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:19.774788  5446 raft_consensus.cc:515] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.776866  5483 raft_consensus.cc:2804] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.778270  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd8e3a9a1242ac8e45d6692bebd44b" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:19.778653  5483 raft_consensus.cc:697] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Becoming Leader. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Running, Role: LEADER
I20260709 13:13:19.778837  5321 raft_consensus.cc:3060] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:19.779047  5191 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:19.777627  5446 leader_election.cc:290] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 1 election: Requested vote from peers 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:19.779765  5483 consensus_queue.cc:237] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.782918  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd8e3a9a1242ac8e45d6692bebd44b" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:19.783667  5395 raft_consensus.cc:3060] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.785260  5320 raft_consensus.cc:2468] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 1.
I20260709 13:13:19.786455  5321 raft_consensus.cc:2468] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 1.
I20260709 13:13:19.789521  5212 leader_election.cc:304] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:19.790577  5446 raft_consensus.cc:2804] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.791183  5446 raft_consensus.cc:697] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 1 LEADER]: Becoming Leader. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Running, Role: LEADER
I20260709 13:13:19.792410  5446 consensus_queue.cc:237] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:19.791224  5395 raft_consensus.cc:2468] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 1.
I20260709 13:13:19.799553  5143 catalog_manager.cc:5697] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 reported cstate change: term changed from 0 to 1, leader changed from <none> to e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "e182017b4b5e4f1c9e6c6989020d1849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:19.809031  5144 catalog_manager.cc:5697] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1dc332e386344125994c22b5d0f7555a (127.4.254.1). New cstate: current_term: 1 leader_uuid: "1dc332e386344125994c22b5d0f7555a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.885000  5467 consensus_queue.cc:1048] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:19.897725  5465 consensus_queue.cc:1048] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.943704  5247 raft_consensus.cc:3060] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.949273  5465 consensus_queue.cc:1048] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.959400  5467 consensus_queue.cc:1048] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.990844  5320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
mode: GRACEFUL
new_leader_uuid: "1dc332e386344125994c22b5d0f7555a"
 from {username='slave'} at 127.0.0.1:55184
I20260709 13:13:19.991426  5320 raft_consensus.cc:606] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Received request to transfer leadership to TS 1dc332e386344125994c22b5d0f7555a
I20260709 13:13:20.005263  5395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453"
dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
mode: GRACEFUL
new_leader_uuid: "1dc332e386344125994c22b5d0f7555a"
 from {username='slave'} at 127.0.0.1:47896
I20260709 13:13:20.005887  5395 raft_consensus.cc:606] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Received request to transfer leadership to TS 1dc332e386344125994c22b5d0f7555a
I20260709 13:13:20.010761  5320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00621849ced84e9083de347b47f346a2"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
mode: GRACEFUL
new_leader_uuid: "1dc332e386344125994c22b5d0f7555a"
 from {username='slave'} at 127.0.0.1:55184
I20260709 13:13:20.011247  5320 raft_consensus.cc:606] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Received request to transfer leadership to TS 1dc332e386344125994c22b5d0f7555a
I20260709 13:13:20.015784  5320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
mode: GRACEFUL
new_leader_uuid: "1dc332e386344125994c22b5d0f7555a"
 from {username='slave'} at 127.0.0.1:55184
I20260709 13:13:20.016251  5320 raft_consensus.cc:606] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Received request to transfer leadership to TS 1dc332e386344125994c22b5d0f7555a
I20260709 13:13:20.021319  5446 raft_consensus.cc:493] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.021807  5446 raft_consensus.cc:515] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.023747  5446 leader_election.cc:290] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:20.023850  5395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801"
dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
mode: GRACEFUL
new_leader_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:47896
I20260709 13:13:20.024443  5395 raft_consensus.cc:606] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Received request to transfer leadership to TS 10fb48f8cec840f089638a321d7bf76d
I20260709 13:13:20.025010  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f2c5f6d4364a198313b0827fdbab7d" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10fb48f8cec840f089638a321d7bf76d" is_pre_election: true
I20260709 13:13:20.025010  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f2c5f6d4364a198313b0827fdbab7d" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849" is_pre_election: true
I20260709 13:13:20.025913  5320 raft_consensus.cc:2393] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1dc332e386344125994c22b5d0f7555a in current term 1: Already voted for candidate e182017b4b5e4f1c9e6c6989020d1849 in this term.
I20260709 13:13:20.026881  5212 leader_election.cc:304] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a; no voters: 10fb48f8cec840f089638a321d7bf76d, e182017b4b5e4f1c9e6c6989020d1849
I20260709 13:13:20.027774  5446 raft_consensus.cc:3060] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.034838  5483 consensus_queue.cc:1048] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.036737  5446 raft_consensus.cc:2749] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:20.047731  5247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dbd8e3a9a1242ac8e45d6692bebd44b"
dest_uuid: "1dc332e386344125994c22b5d0f7555a"
mode: GRACEFUL
new_leader_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:43602
I20260709 13:13:20.048338  5247 raft_consensus.cc:606] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 1 LEADER]: Received request to transfer leadership to TS 10fb48f8cec840f089638a321d7bf76d
I20260709 13:13:20.052245  5483 consensus_queue.cc:1048] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.056123  5470 consensus_queue.cc:1048] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.060801  5396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "095e0258c7d44eb2ae7c90863c9636fe"
dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
mode: GRACEFUL
new_leader_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:47896
I20260709 13:13:20.061408  5396 raft_consensus.cc:606] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Received request to transfer leadership to TS 10fb48f8cec840f089638a321d7bf76d
I20260709 13:13:20.069321  5520 consensus_queue.cc:1048] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.072958  5520 raft_consensus.cc:993] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849: : Instructing follower 1dc332e386344125994c22b5d0f7555a to start an election
I20260709 13:13:20.073436  5520 raft_consensus.cc:1081] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Signalling peer 1dc332e386344125994c22b5d0f7555a to start an election
I20260709 13:13:20.076049  5246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453"
dest_uuid: "1dc332e386344125994c22b5d0f7555a"
 from {username='slave'} at 127.0.0.1:43596
I20260709 13:13:20.076602  5246 raft_consensus.cc:493] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.076978  5246 raft_consensus.cc:3060] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.087860  5246 raft_consensus.cc:515] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.110749  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:20.111459  5321 raft_consensus.cc:3060] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.134279  5520 consensus_queue.cc:1048] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:13:20.149711  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:20.150315  5396 raft_consensus.cc:3055] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.150671  5396 raft_consensus.cc:740] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Running, Role: LEADER
I20260709 13:13:20.151482  5396 consensus_queue.cc:260] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.152752  5396 raft_consensus.cc:3060] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.159467  5396 raft_consensus.cc:2468] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 2.
I20260709 13:13:20.162972  5246 leader_election.cc:290] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 2 election: Requested vote from peers 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
W20260709 13:13:20.164444  5361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:46725, user_credentials={real_user=slave}} blocked reactor thread for 77471.3us
I20260709 13:13:20.166831  5210 leader_election.cc:304] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:20.167029  5321 raft_consensus.cc:2468] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 2.
I20260709 13:13:20.167723  5470 consensus_queue.cc:1048] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.168551  5446 raft_consensus.cc:2804] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:20.169010  5446 raft_consensus.cc:697] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Becoming Leader. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Running, Role: LEADER
I20260709 13:13:20.169812  5446 consensus_queue.cc:237] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.182243  5520 raft_consensus.cc:993] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849: : Instructing follower 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:20.182773  5470 raft_consensus.cc:1081] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Signalling peer 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:20.179071  5143 catalog_manager.cc:5697] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a reported cstate change: term changed from 1 to 2, leader changed from e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3) to 1dc332e386344125994c22b5d0f7555a (127.4.254.1). New cstate: current_term: 2 leader_uuid: "1dc332e386344125994c22b5d0f7555a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.184248  5321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:55164
I20260709 13:13:20.184698  5321 raft_consensus.cc:493] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.184998  5321 raft_consensus.cc:3060] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.190335  5321 raft_consensus.cc:515] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.193377  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:20.193660  5321 leader_election.cc:290] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 2 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:20.193881  5247 raft_consensus.cc:3060] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.195041  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:20.195573  5396 raft_consensus.cc:3055] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.195914  5396 raft_consensus.cc:740] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Running, Role: LEADER
I20260709 13:13:20.196779  5396 consensus_queue.cc:260] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.197999  5396 raft_consensus.cc:3060] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.200624  5247 raft_consensus.cc:2468] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 2.
I20260709 13:13:20.201896  5286 leader_election.cc:304] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:20.202731  5467 raft_consensus.cc:2804] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:20.203202  5467 raft_consensus.cc:697] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Becoming Leader. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:20.203979  5467 consensus_queue.cc:237] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.204393  5396 raft_consensus.cc:2468] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 2.
I20260709 13:13:20.210863  5141 catalog_manager.cc:5697] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d reported cstate change: term changed from 1 to 2, leader changed from e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3) to 10fb48f8cec840f089638a321d7bf76d (127.4.254.2). New cstate: current_term: 2 leader_uuid: "10fb48f8cec840f089638a321d7bf76d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.254168  5470 consensus_queue.cc:1048] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.267912  5470 consensus_queue.cc:1048] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.270375  5520 raft_consensus.cc:993] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849: : Instructing follower 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:20.270821  5483 raft_consensus.cc:1081] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Signalling peer 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:20.281589  5321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "095e0258c7d44eb2ae7c90863c9636fe"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:55164
I20260709 13:13:20.282230  5321 raft_consensus.cc:493] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.282636  5321 raft_consensus.cc:3060] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.288837  5463 raft_consensus.cc:993] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d: : Instructing follower 1dc332e386344125994c22b5d0f7555a to start an election
I20260709 13:13:20.289389  5463 raft_consensus.cc:1081] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Signalling peer 1dc332e386344125994c22b5d0f7555a to start an election
I20260709 13:13:20.291268  5245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae"
dest_uuid: "1dc332e386344125994c22b5d0f7555a"
 from {username='slave'} at 127.0.0.1:43584
I20260709 13:13:20.291873  5245 raft_consensus.cc:493] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.292304  5245 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.300519  5245 raft_consensus.cc:515] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.303567  5465 raft_consensus.cc:993] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d: : Instructing follower 1dc332e386344125994c22b5d0f7555a to start an election
I20260709 13:13:20.304069  5465 raft_consensus.cc:1081] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Signalling peer 1dc332e386344125994c22b5d0f7555a to start an election
I20260709 13:13:20.307145  5247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89"
dest_uuid: "1dc332e386344125994c22b5d0f7555a"
 from {username='slave'} at 127.0.0.1:43584
I20260709 13:13:20.307686  5247 raft_consensus.cc:493] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.308064  5247 raft_consensus.cc:3060] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.312076  5322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:20.312660  5322 raft_consensus.cc:3055] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.312994  5322 raft_consensus.cc:740] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:20.313719  5245 leader_election.cc:290] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 2 election: Requested vote from peers 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:20.313905  5322 consensus_queue.cc:260] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.314855  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:20.315187  5322 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.312949  5321 raft_consensus.cc:515] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.315392  5395 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.318717  5247 raft_consensus.cc:515] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:20.322360  5395 raft_consensus.cc:2468] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 2.
I20260709 13:13:20.322968  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:20.323562  5319 raft_consensus.cc:3055] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.323900  5319 raft_consensus.cc:740] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:20.324065  5210 leader_election.cc:304] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:20.323678  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:20.324718  5319 consensus_queue.cc:260] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:20.325304  5446 raft_consensus.cc:2804] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:20.325753  5446 raft_consensus.cc:697] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Becoming Leader. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Running, Role: LEADER
I20260709 13:13:20.325881  5319 raft_consensus.cc:3060] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.326538  5446 consensus_queue.cc:237] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.327132  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095e0258c7d44eb2ae7c90863c9636fe" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:20.327725  5245 raft_consensus.cc:3060] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.329392  5320 raft_consensus.cc:1240] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Rejecting Update request from peer e182017b4b5e4f1c9e6c6989020d1849 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:20.331985  5321 leader_election.cc:290] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 2 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:20.334367  5486 consensus_queue.cc:1048] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:20.337210  5524 consensus_queue.cc:1059] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:13:20.338052  5524 raft_consensus.cc:3055] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.338376  5524 raft_consensus.cc:740] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Running, Role: LEADER
I20260709 13:13:20.339433  5245 raft_consensus.cc:2468] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 2.
I20260709 13:13:20.339192  5524 consensus_queue.cc:260] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.340458  5524 raft_consensus.cc:3060] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.340732  5286 leader_election.cc:304] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:20.341640  5463 raft_consensus.cc:2804] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:20.342175  5463 raft_consensus.cc:697] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Becoming Leader. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:20.343124  5463 consensus_queue.cc:237] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.324962  5394 raft_consensus.cc:3060] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.349977  5319 raft_consensus.cc:2468] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 2.
I20260709 13:13:20.354940  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095e0258c7d44eb2ae7c90863c9636fe" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:20.356552  5245 raft_consensus.cc:1240] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Rejecting Update request from peer e182017b4b5e4f1c9e6c6989020d1849 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:20.348217  5247 leader_election.cc:290] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 2 election: Requested vote from peers e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:20.362247  5446 consensus_queue.cc:1048] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.374725  5142 catalog_manager.cc:5697] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d reported cstate change: term changed from 1 to 2, leader changed from e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3) to 10fb48f8cec840f089638a321d7bf76d (127.4.254.2). New cstate: current_term: 2 leader_uuid: "10fb48f8cec840f089638a321d7bf76d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.376459  5395 raft_consensus.cc:2468] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 2.
I20260709 13:13:20.377931  5212 leader_election.cc:304] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:20.378813  5446 raft_consensus.cc:2804] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:20.379529  5446 raft_consensus.cc:697] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Becoming Leader. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Running, Role: LEADER
I20260709 13:13:20.380388  5394 raft_consensus.cc:2468] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 2.
I20260709 13:13:20.380328  5446 consensus_queue.cc:237] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:20.386633  5486 raft_consensus.cc:993] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a: : Instructing follower 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:20.388545  5322 raft_consensus.cc:2468] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 2.
I20260709 13:13:20.397006  5486 raft_consensus.cc:1081] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 1 LEADER]: Signalling peer 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:20.406824  5142 catalog_manager.cc:5697] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a reported cstate change: term changed from 1 to 2, leader changed from 10fb48f8cec840f089638a321d7bf76d (127.4.254.2) to 1dc332e386344125994c22b5d0f7555a (127.4.254.1). New cstate: current_term: 2 leader_uuid: "1dc332e386344125994c22b5d0f7555a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.408989  5322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dbd8e3a9a1242ac8e45d6692bebd44b"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:55176
I20260709 13:13:20.408576  5142 catalog_manager.cc:5697] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a reported cstate change: term changed from 1 to 2, leader changed from 10fb48f8cec840f089638a321d7bf76d (127.4.254.2) to 1dc332e386344125994c22b5d0f7555a (127.4.254.1). New cstate: current_term: 2 leader_uuid: "1dc332e386344125994c22b5d0f7555a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.409720  5322 raft_consensus.cc:493] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.410166  5322 raft_consensus.cc:3060] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.421792  5322 raft_consensus.cc:515] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.423836  5322 leader_election.cc:290] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 2 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:20.424844  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd8e3a9a1242ac8e45d6692bebd44b" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:20.425858  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd8e3a9a1242ac8e45d6692bebd44b" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:20.426431  5247 raft_consensus.cc:3055] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.426752  5247 raft_consensus.cc:740] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Running, Role: LEADER
I20260709 13:13:20.427512  5247 consensus_queue.cc:260] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.428573  5247 raft_consensus.cc:3060] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:20.429221  5486 consensus_queue.cc:1175] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e182017b4b5e4f1c9e6c6989020d1849" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:13:20.435058  5247 raft_consensus.cc:2468] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 2.
I20260709 13:13:20.436164  5286 leader_election.cc:304] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: e182017b4b5e4f1c9e6c6989020d1849
I20260709 13:13:20.436940  5463 raft_consensus.cc:2804] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:20.437412  5463 raft_consensus.cc:697] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Becoming Leader. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:20.438112  5463 consensus_queue.cc:237] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.445308  5141 catalog_manager.cc:5697] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d reported cstate change: term changed from 1 to 2, leader changed from 1dc332e386344125994c22b5d0f7555a (127.4.254.1) to 10fb48f8cec840f089638a321d7bf76d (127.4.254.2). New cstate: current_term: 2 leader_uuid: "10fb48f8cec840f089638a321d7bf76d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.530305  5467 raft_consensus.cc:993] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d: : Instructing follower 1dc332e386344125994c22b5d0f7555a to start an election
I20260709 13:13:20.530773  5463 raft_consensus.cc:1081] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Signalling peer 1dc332e386344125994c22b5d0f7555a to start an election
I20260709 13:13:20.532253  5247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00621849ced84e9083de347b47f346a2"
dest_uuid: "1dc332e386344125994c22b5d0f7555a"
 from {username='slave'} at 127.0.0.1:43584
I20260709 13:13:20.532799  5247 raft_consensus.cc:493] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.533164  5247 raft_consensus.cc:3060] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.539551  5247 raft_consensus.cc:515] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.541481  5247 leader_election.cc:290] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 2 election: Requested vote from peers 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:20.542393  5322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00621849ced84e9083de347b47f346a2" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:20.542577  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00621849ced84e9083de347b47f346a2" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:20.542945  5322 raft_consensus.cc:3055] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.543171  5396 raft_consensus.cc:3060] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.543296  5322 raft_consensus.cc:740] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:20.544153  5322 consensus_queue.cc:260] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.545346  5322 raft_consensus.cc:3060] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.548846  5396 raft_consensus.cc:2468] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 2.
I20260709 13:13:20.549829  5210 leader_election.cc:304] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:20.550523  5486 raft_consensus.cc:2804] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:20.550942  5486 raft_consensus.cc:697] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Becoming Leader. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Running, Role: LEADER
I20260709 13:13:20.551631  5486 consensus_queue.cc:237] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:20.552207  5322 raft_consensus.cc:2468] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 2.
I20260709 13:13:20.558579  5141 catalog_manager.cc:5697] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a reported cstate change: term changed from 1 to 2, leader changed from 10fb48f8cec840f089638a321d7bf76d (127.4.254.2) to 1dc332e386344125994c22b5d0f7555a (127.4.254.1). New cstate: current_term: 2 leader_uuid: "1dc332e386344125994c22b5d0f7555a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.609344  5247 raft_consensus.cc:1275] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.610760  5463 consensus_queue.cc:1048] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.621243  5396 raft_consensus.cc:1275] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.622583  5465 consensus_queue.cc:1048] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.694515  5396 raft_consensus.cc:1275] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Refusing update from remote peer 1dc332e386344125994c22b5d0f7555a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.695708  5486 consensus_queue.cc:1048] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.703064  5322 raft_consensus.cc:1275] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Refusing update from remote peer 1dc332e386344125994c22b5d0f7555a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.704845  5486 consensus_queue.cc:1048] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.782742  5396 raft_consensus.cc:1275] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.784336  5465 consensus_queue.cc:1048] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.794862  5247 raft_consensus.cc:1275] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.797833  5467 consensus_queue.cc:1048] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:20.837463  5396 raft_consensus.cc:1275] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Refusing update from remote peer 1dc332e386344125994c22b5d0f7555a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.838653  5534 consensus_queue.cc:1048] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.848479  5322 raft_consensus.cc:1275] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Refusing update from remote peer 1dc332e386344125994c22b5d0f7555a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.850180  5486 consensus_queue.cc:1048] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.901162  5247 raft_consensus.cc:1275] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.902283  5465 consensus_queue.cc:1048] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.910012  5396 raft_consensus.cc:3060] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.916360  5396 raft_consensus.cc:1275] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.917440  5463 consensus_queue.cc:1048] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.939332  5322 raft_consensus.cc:1275] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Refusing update from remote peer 1dc332e386344125994c22b5d0f7555a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.940455  5486 consensus_queue.cc:1048] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.948062  5396 raft_consensus.cc:1275] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Refusing update from remote peer 1dc332e386344125994c22b5d0f7555a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.949362  5486 consensus_queue.cc:1048] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:21.102403  5322 raft_consensus.cc:1275] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Refusing update from remote peer 1dc332e386344125994c22b5d0f7555a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:21.103668  5532 consensus_queue.cc:1048] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:21.111263  5396 raft_consensus.cc:1275] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Refusing update from remote peer 1dc332e386344125994c22b5d0f7555a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:21.112478  5534 consensus_queue.cc:1048] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.095199  5112 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:13:23.096026  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:23.114588  5245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae"
dest_uuid: "1dc332e386344125994c22b5d0f7555a"
mode: GRACEFUL
new_leader_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
 from {username='slave'} at 127.0.0.1:43608
I20260709 13:13:23.115100  5245 raft_consensus.cc:606] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Received request to transfer leadership to TS e182017b4b5e4f1c9e6c6989020d1849
I20260709 13:13:23.125113  5322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
mode: GRACEFUL
new_leader_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
 from {username='slave'} at 127.0.0.1:55192
I20260709 13:13:23.125672  5322 raft_consensus.cc:606] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Received request to transfer leadership to TS e182017b4b5e4f1c9e6c6989020d1849
I20260709 13:13:23.126751  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:23.127211  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:23.409032  5534 raft_consensus.cc:993] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a: : Instructing follower e182017b4b5e4f1c9e6c6989020d1849 to start an election
I20260709 13:13:23.409489  5534 raft_consensus.cc:1081] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Signalling peer e182017b4b5e4f1c9e6c6989020d1849 to start an election
I20260709 13:13:23.410804  5394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae"
dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
 from {username='slave'} at 127.0.0.1:47886
I20260709 13:13:23.411211  5394 raft_consensus.cc:493] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:23.411456  5394 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.415740  5394 raft_consensus.cc:515] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:23.417245  5394 leader_election.cc:290] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 3 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:23.418190  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:23.418229  5322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:23.418848  5322 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.418841  5245 raft_consensus.cc:3055] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:23.419287  5245 raft_consensus.cc:740] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Running, Role: LEADER
I20260709 13:13:23.419956  5245 consensus_queue.cc:260] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:23.420845  5245 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.424057  5322 raft_consensus.cc:2468] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 3.
I20260709 13:13:23.425200  5361 leader_election.cc:304] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:23.425916  5545 raft_consensus.cc:2804] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:23.426009  5245 raft_consensus.cc:2468] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 3.
I20260709 13:13:23.427109  5545 raft_consensus.cc:697] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 3 LEADER]: Becoming Leader. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Running, Role: LEADER
I20260709 13:13:23.427872  5545 consensus_queue.cc:237] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:23.435740  5143 catalog_manager.cc:5697] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 reported cstate change: term changed from 2 to 3, leader changed from 1dc332e386344125994c22b5d0f7555a (127.4.254.1) to e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "e182017b4b5e4f1c9e6c6989020d1849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.509769  5463 raft_consensus.cc:993] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d: : Instructing follower e182017b4b5e4f1c9e6c6989020d1849 to start an election
I20260709 13:13:23.510186  5553 raft_consensus.cc:1081] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Signalling peer e182017b4b5e4f1c9e6c6989020d1849 to start an election
I20260709 13:13:23.511586  5394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801"
dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
 from {username='slave'} at 127.0.0.1:47880
I20260709 13:13:23.512032  5394 raft_consensus.cc:493] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:23.512277  5394 raft_consensus.cc:3060] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.516402  5394 raft_consensus.cc:515] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:23.517828  5394 leader_election.cc:290] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 3 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:23.518675  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:23.518824  5322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:23.519196  5245 raft_consensus.cc:3060] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.519351  5322 raft_consensus.cc:3055] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:23.519724  5322 raft_consensus.cc:740] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:23.520325  5322 consensus_queue.cc:260] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:23.521449  5322 raft_consensus.cc:3060] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.526175  5245 raft_consensus.cc:2468] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 3.
I20260709 13:13:23.527415  5360 leader_election.cc:304] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:23.528350  5545 raft_consensus.cc:2804] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:23.528654  5322 raft_consensus.cc:2468] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 3.
I20260709 13:13:23.528842  5545 raft_consensus.cc:697] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 LEADER]: Becoming Leader. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Running, Role: LEADER
I20260709 13:13:23.530362  5545 consensus_queue.cc:237] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:23.537029  5143 catalog_manager.cc:5697] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 reported cstate change: term changed from 2 to 3, leader changed from 10fb48f8cec840f089638a321d7bf76d (127.4.254.2) to e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "e182017b4b5e4f1c9e6c6989020d1849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.840847  5245 raft_consensus.cc:1275] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Refusing update from remote peer e182017b4b5e4f1c9e6c6989020d1849: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:23.842209  5545 consensus_queue.cc:1048] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:23.855078  5322 raft_consensus.cc:1275] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Refusing update from remote peer e182017b4b5e4f1c9e6c6989020d1849: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:23.856729  5557 consensus_queue.cc:1048] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:23.984980  5245 raft_consensus.cc:1275] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Refusing update from remote peer e182017b4b5e4f1c9e6c6989020d1849: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:23.986203  5557 consensus_queue.cc:1048] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:23.995523  5322 raft_consensus.cc:1275] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Refusing update from remote peer e182017b4b5e4f1c9e6c6989020d1849: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:23.996691  5545 consensus_queue.cc:1048] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:24.128006  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:24.137344  5245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89"
dest_uuid: "1dc332e386344125994c22b5d0f7555a"
mode: GRACEFUL
new_leader_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:43602
I20260709 13:13:24.137871  5245 raft_consensus.cc:606] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Received request to transfer leadership to TS 10fb48f8cec840f089638a321d7bf76d
I20260709 13:13:24.142189  5245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453"
dest_uuid: "1dc332e386344125994c22b5d0f7555a"
mode: GRACEFUL
new_leader_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:43602
I20260709 13:13:24.142683  5245 raft_consensus.cc:606] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Received request to transfer leadership to TS 10fb48f8cec840f089638a321d7bf76d
I20260709 13:13:24.147320  5245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00621849ced84e9083de347b47f346a2"
dest_uuid: "1dc332e386344125994c22b5d0f7555a"
mode: GRACEFUL
new_leader_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:43602
I20260709 13:13:24.147781  5245 raft_consensus.cc:606] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Received request to transfer leadership to TS 10fb48f8cec840f089638a321d7bf76d
I20260709 13:13:24.151961  5394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae"
dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
mode: GRACEFUL
new_leader_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:47896
I20260709 13:13:24.152421  5394 raft_consensus.cc:606] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 3 LEADER]: Received request to transfer leadership to TS 10fb48f8cec840f089638a321d7bf76d
I20260709 13:13:24.158965  5394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801"
dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
mode: GRACEFUL
new_leader_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:47896
I20260709 13:13:24.159613  5394 raft_consensus.cc:606] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 LEADER]: Received request to transfer leadership to TS 10fb48f8cec840f089638a321d7bf76d
I20260709 13:13:24.161819  5534 raft_consensus.cc:993] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a: : Instructing follower 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:24.162205  5563 raft_consensus.cc:1081] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Signalling peer 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:24.163621  5322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:55176
I20260709 13:13:24.164141  5322 raft_consensus.cc:493] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:24.164444  5322 raft_consensus.cc:3060] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:24.168658  5322 raft_consensus.cc:515] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:24.170665  5322 leader_election.cc:290] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 3 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:24.170882  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:24.171434  5245 raft_consensus.cc:3055] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:24.171561  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:24.171778  5245 raft_consensus.cc:740] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Running, Role: LEADER
I20260709 13:13:24.172084  5394 raft_consensus.cc:3060] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:24.172538  5245 consensus_queue.cc:260] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:24.173635  5245 raft_consensus.cc:3060] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:24.177525  5394 raft_consensus.cc:2468] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 3.
I20260709 13:13:24.178570  5285 leader_election.cc:304] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:24.179196  5245 raft_consensus.cc:2468] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 3.
I20260709 13:13:24.179352  5553 raft_consensus.cc:2804] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:24.180889  5553 raft_consensus.cc:697] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 3 LEADER]: Becoming Leader. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:24.181607  5553 consensus_queue.cc:237] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:24.187803  5143 catalog_manager.cc:5697] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d reported cstate change: term changed from 2 to 3, leader changed from 1dc332e386344125994c22b5d0f7555a (127.4.254.1) to 10fb48f8cec840f089638a321d7bf76d (127.4.254.2). New cstate: current_term: 3 leader_uuid: "10fb48f8cec840f089638a321d7bf76d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:24.207722  5534 raft_consensus.cc:993] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a: : Instructing follower 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:24.208177  5563 raft_consensus.cc:1081] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Signalling peer 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:24.209622  5322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00621849ced84e9083de347b47f346a2"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:55176
I20260709 13:13:24.210139  5322 raft_consensus.cc:493] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:24.210458  5322 raft_consensus.cc:3060] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:24.214845  5322 raft_consensus.cc:515] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:24.216379  5322 leader_election.cc:290] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 3 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:24.217331  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00621849ced84e9083de347b47f346a2" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:24.217501  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00621849ced84e9083de347b47f346a2" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:24.217854  5245 raft_consensus.cc:3055] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:24.218030  5396 raft_consensus.cc:3060] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:24.218168  5245 raft_consensus.cc:740] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Running, Role: LEADER
I20260709 13:13:24.218883  5245 consensus_queue.cc:260] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:24.219755  5245 raft_consensus.cc:3060] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:24.222738  5396 raft_consensus.cc:2468] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 3.
I20260709 13:13:24.223735  5285 leader_election.cc:304] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:24.224323  5245 raft_consensus.cc:2468] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 3.
I20260709 13:13:24.224509  5553 raft_consensus.cc:2804] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:24.224984  5553 raft_consensus.cc:697] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 3 LEADER]: Becoming Leader. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:24.225814  5553 consensus_queue.cc:237] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:24.231856  5143 catalog_manager.cc:5697] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d reported cstate change: term changed from 2 to 3, leader changed from 1dc332e386344125994c22b5d0f7555a (127.4.254.1) to 10fb48f8cec840f089638a321d7bf76d (127.4.254.2). New cstate: current_term: 3 leader_uuid: "10fb48f8cec840f089638a321d7bf76d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:24.430840  5547 raft_consensus.cc:993] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849: : Instructing follower 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:24.431321  5545 raft_consensus.cc:1081] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 3 LEADER]: Signalling peer 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:24.432854  5322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:55164
I20260709 13:13:24.433494  5322 raft_consensus.cc:493] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:24.433877  5322 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.438488  5322 raft_consensus.cc:515] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:24.440527  5322 leader_election.cc:290] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 4 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:24.441256  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:24.441654  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:24.442034  5245 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.442163  5396 raft_consensus.cc:3055] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:24.442584  5396 raft_consensus.cc:740] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Running, Role: LEADER
I20260709 13:13:24.443325  5396 consensus_queue.cc:260] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:24.444223  5396 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.446779  5245 raft_consensus.cc:2468] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 4.
I20260709 13:13:24.447820  5286 leader_election.cc:304] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:24.448513  5553 raft_consensus.cc:2804] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:24.448905  5553 raft_consensus.cc:697] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 4 LEADER]: Becoming Leader. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:24.449237  5396 raft_consensus.cc:2468] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 4.
I20260709 13:13:24.449636  5553 consensus_queue.cc:237] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:24.455215  5143 catalog_manager.cc:5697] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d reported cstate change: term changed from 3 to 4, leader changed from e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3) to 10fb48f8cec840f089638a321d7bf76d (127.4.254.2). New cstate: current_term: 4 leader_uuid: "10fb48f8cec840f089638a321d7bf76d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:24.471237  5547 raft_consensus.cc:993] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849: : Instructing follower 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:24.471673  5545 raft_consensus.cc:1081] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 LEADER]: Signalling peer 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:24.473192  5322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:55164
I20260709 13:13:24.473749  5322 raft_consensus.cc:493] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:24.474120  5322 raft_consensus.cc:3060] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.479379  5322 raft_consensus.cc:515] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:24.480921  5322 leader_election.cc:290] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 4 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:24.481653  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:24.481992  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e9746ac064c5eb89e2239cf4b5801" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:24.482240  5245 raft_consensus.cc:3060] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.482580  5396 raft_consensus.cc:3055] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:24.482842  5396 raft_consensus.cc:740] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Running, Role: LEADER
I20260709 13:13:24.483541  5396 consensus_queue.cc:260] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:24.484400  5396 raft_consensus.cc:3060] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.486992  5245 raft_consensus.cc:2468] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 4.
I20260709 13:13:24.487946  5286 leader_election.cc:304] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, 1dc332e386344125994c22b5d0f7555a; no voters: 
I20260709 13:13:24.488616  5553 raft_consensus.cc:2804] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:24.489143  5553 raft_consensus.cc:697] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 4 LEADER]: Becoming Leader. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:24.489089  5396 raft_consensus.cc:2468] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 4.
I20260709 13:13:24.490111  5553 consensus_queue.cc:237] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:24.495976  5143 catalog_manager.cc:5697] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d reported cstate change: term changed from 3 to 4, leader changed from e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3) to 10fb48f8cec840f089638a321d7bf76d (127.4.254.2). New cstate: current_term: 4 leader_uuid: "10fb48f8cec840f089638a321d7bf76d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:24.533887  5534 raft_consensus.cc:993] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a: : Instructing follower 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:24.534363  5563 raft_consensus.cc:1081] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Signalling peer 10fb48f8cec840f089638a321d7bf76d to start an election
I20260709 13:13:24.535840  5322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
 from {username='slave'} at 127.0.0.1:55176
I20260709 13:13:24.536252  5322 raft_consensus.cc:493] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:24.536499  5322 raft_consensus.cc:3060] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:24.540571  5322 raft_consensus.cc:515] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:24.542243  5322 leader_election.cc:290] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 3 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:24.542973  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:24.543401  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd189c1562429b88dcbe7f563a1453" candidate_uuid: "10fb48f8cec840f089638a321d7bf76d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:24.543522  5245 raft_consensus.cc:3055] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:24.543861  5245 raft_consensus.cc:740] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Running, Role: LEADER
I20260709 13:13:24.543919  5396 raft_consensus.cc:3060] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:24.544595  5245 consensus_queue.cc:260] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:24.545827  5245 raft_consensus.cc:3060] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:24.549049  5396 raft_consensus.cc:2468] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 3.
I20260709 13:13:24.550158  5285 leader_election.cc:304] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10fb48f8cec840f089638a321d7bf76d, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:24.550446  5245 raft_consensus.cc:2468] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10fb48f8cec840f089638a321d7bf76d in term 3.
I20260709 13:13:24.550983  5553 raft_consensus.cc:2804] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:24.551553  5553 raft_consensus.cc:697] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 3 LEADER]: Becoming Leader. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:24.552328  5553 consensus_queue.cc:237] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:24.559065  5143 catalog_manager.cc:5697] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d reported cstate change: term changed from 2 to 3, leader changed from 1dc332e386344125994c22b5d0f7555a (127.4.254.1) to 10fb48f8cec840f089638a321d7bf76d (127.4.254.2). New cstate: current_term: 3 leader_uuid: "10fb48f8cec840f089638a321d7bf76d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:24.654630  5245 raft_consensus.cc:1275] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:24.655905  5553 consensus_queue.cc:1048] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:24.664639  5396 raft_consensus.cc:1275] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:24.667224  5553 consensus_queue.cc:1048] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:24.749642  5245 raft_consensus.cc:1275] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:24.750795  5463 consensus_queue.cc:1048] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:24.759099  5394 raft_consensus.cc:1275] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:24.760433  5564 consensus_queue.cc:1048] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:24.951697  5247 raft_consensus.cc:1275] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:24.952950  5564 consensus_queue.cc:1048] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:24.954398  5394 raft_consensus.cc:1275] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 4 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:24.955657  5564 consensus_queue.cc:1048] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:24.971122  5247 raft_consensus.cc:1275] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:24.972466  5564 consensus_queue.cc:1048] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:24.980338  5394 raft_consensus.cc:1275] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 4 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:24.983385  5463 consensus_queue.cc:1048] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:25.078869  5394 raft_consensus.cc:1275] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:25.080084  5553 consensus_queue.cc:1048] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:25.087810  5245 raft_consensus.cc:1275] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Refusing update from remote peer 10fb48f8cec840f089638a321d7bf76d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:25.089279  5564 consensus_queue.cc:1048] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:27.169070  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:27.176476  5322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00621849ced84e9083de347b47f346a2"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
mode: GRACEFUL
new_leader_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
 from {username='slave'} at 127.0.0.1:55192
I20260709 13:13:27.177209  5322 raft_consensus.cc:606] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 3 LEADER]: Received request to transfer leadership to TS e182017b4b5e4f1c9e6c6989020d1849
I20260709 13:13:27.179675  5322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "095e0258c7d44eb2ae7c90863c9636fe"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
mode: GRACEFUL
new_leader_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
 from {username='slave'} at 127.0.0.1:55192
I20260709 13:13:27.180099  5322 raft_consensus.cc:606] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Received request to transfer leadership to TS e182017b4b5e4f1c9e6c6989020d1849
I20260709 13:13:27.182159  5322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dbd8e3a9a1242ac8e45d6692bebd44b"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
mode: GRACEFUL
new_leader_uuid: "1dc332e386344125994c22b5d0f7555a"
 from {username='slave'} at 127.0.0.1:55192
I20260709 13:13:27.182554  5322 raft_consensus.cc:606] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Received request to transfer leadership to TS 1dc332e386344125994c22b5d0f7555a
I20260709 13:13:27.184764  5322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
mode: GRACEFUL
new_leader_uuid: "1dc332e386344125994c22b5d0f7555a"
 from {username='slave'} at 127.0.0.1:55192
I20260709 13:13:27.185268  5322 raft_consensus.cc:606] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 4 LEADER]: Received request to transfer leadership to TS 1dc332e386344125994c22b5d0f7555a
I20260709 13:13:27.187427  5322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89"
dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
mode: GRACEFUL
new_leader_uuid: "1dc332e386344125994c22b5d0f7555a"
 from {username='slave'} at 127.0.0.1:55192
I20260709 13:13:27.187805  5322 raft_consensus.cc:606] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 3 LEADER]: Received request to transfer leadership to TS 1dc332e386344125994c22b5d0f7555a
I20260709 13:13:27.188637  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:27.189049  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:27.297446  5582 raft_consensus.cc:993] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d: : Instructing follower 1dc332e386344125994c22b5d0f7555a to start an election
I20260709 13:13:27.297986  5582 raft_consensus.cc:1081] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Signalling peer 1dc332e386344125994c22b5d0f7555a to start an election
I20260709 13:13:27.299499  5247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dbd8e3a9a1242ac8e45d6692bebd44b"
dest_uuid: "1dc332e386344125994c22b5d0f7555a"
 from {username='slave'} at 127.0.0.1:43584
I20260709 13:13:27.299921  5247 raft_consensus.cc:493] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.300179  5247 raft_consensus.cc:3060] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.304720  5247 raft_consensus.cc:515] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:27.306718  5247 leader_election.cc:290] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 3 election: Requested vote from peers 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:27.307497  5322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd8e3a9a1242ac8e45d6692bebd44b" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:27.307937  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd8e3a9a1242ac8e45d6692bebd44b" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:27.308310  5322 raft_consensus.cc:3055] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:27.308512  5396 raft_consensus.cc:3060] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.308669  5322 raft_consensus.cc:740] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:27.309525  5322 consensus_queue.cc:260] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:27.310415  5322 raft_consensus.cc:3060] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.313437  5396 raft_consensus.cc:2468] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 3.
I20260709 13:13:27.314621  5210 leader_election.cc:304] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:27.314777  5322 raft_consensus.cc:2468] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 3.
I20260709 13:13:27.316452  5585 raft_consensus.cc:2804] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:27.317310  5585 raft_consensus.cc:697] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 3 LEADER]: Becoming Leader. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Running, Role: LEADER
I20260709 13:13:27.318204  5585 consensus_queue.cc:237] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:27.324482  5142 catalog_manager.cc:5697] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a reported cstate change: term changed from 2 to 3, leader changed from 10fb48f8cec840f089638a321d7bf76d (127.4.254.2) to 1dc332e386344125994c22b5d0f7555a (127.4.254.1). New cstate: current_term: 3 leader_uuid: "1dc332e386344125994c22b5d0f7555a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.532366  5564 raft_consensus.cc:993] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d: : Instructing follower e182017b4b5e4f1c9e6c6989020d1849 to start an election
I20260709 13:13:27.532788  5582 raft_consensus.cc:1081] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Signalling peer e182017b4b5e4f1c9e6c6989020d1849 to start an election
I20260709 13:13:27.534361  5396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "095e0258c7d44eb2ae7c90863c9636fe"
dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
 from {username='slave'} at 127.0.0.1:47880
I20260709 13:13:27.534870  5396 raft_consensus.cc:493] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.535177  5396 raft_consensus.cc:3060] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.539635  5396 raft_consensus.cc:515] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:27.541334  5396 leader_election.cc:290] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 3 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:27.542269  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095e0258c7d44eb2ae7c90863c9636fe" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:27.542332  5322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095e0258c7d44eb2ae7c90863c9636fe" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:27.542958  5247 raft_consensus.cc:3060] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.542990  5322 raft_consensus.cc:3055] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:27.543453  5322 raft_consensus.cc:740] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:27.544185  5322 consensus_queue.cc:260] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:27.545325  5322 raft_consensus.cc:3060] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.549216  5247 raft_consensus.cc:2468] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 3.
I20260709 13:13:27.550555  5360 leader_election.cc:304] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:27.551067  5322 raft_consensus.cc:2468] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 3.
I20260709 13:13:27.551399  5584 raft_consensus.cc:2804] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:27.552537  5584 raft_consensus.cc:697] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 3 LEADER]: Becoming Leader. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Running, Role: LEADER
I20260709 13:13:27.553449  5584 consensus_queue.cc:237] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:27.560513  5142 catalog_manager.cc:5697] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 reported cstate change: term changed from 2 to 3, leader changed from 10fb48f8cec840f089638a321d7bf76d (127.4.254.2) to e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "e182017b4b5e4f1c9e6c6989020d1849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:27.590129  5564 raft_consensus.cc:993] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d: : Instructing follower e182017b4b5e4f1c9e6c6989020d1849 to start an election
I20260709 13:13:27.590646  5582 raft_consensus.cc:1081] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 3 LEADER]: Signalling peer e182017b4b5e4f1c9e6c6989020d1849 to start an election
I20260709 13:13:27.592124  5396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00621849ced84e9083de347b47f346a2"
dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
 from {username='slave'} at 127.0.0.1:47880
I20260709 13:13:27.592515  5396 raft_consensus.cc:493] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.592741  5396 raft_consensus.cc:3060] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:27.596613  5396 raft_consensus.cc:515] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:27.598186  5396 leader_election.cc:290] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 4 election: Requested vote from peers 1dc332e386344125994c22b5d0f7555a (127.4.254.1:38309), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:27.599006  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00621849ced84e9083de347b47f346a2" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1dc332e386344125994c22b5d0f7555a"
I20260709 13:13:27.599095  5322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00621849ced84e9083de347b47f346a2" candidate_uuid: "e182017b4b5e4f1c9e6c6989020d1849" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:27.599685  5247 raft_consensus.cc:3060] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:27.599733  5322 raft_consensus.cc:3055] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:27.600119  5322 raft_consensus.cc:740] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:27.600775  5322 consensus_queue.cc:260] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:27.601655  5322 raft_consensus.cc:3060] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:27.603996  5247 raft_consensus.cc:2468] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 4.
I20260709 13:13:27.604969  5360 leader_election.cc:304] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:27.605818  5584 raft_consensus.cc:2804] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:27.605903  5322 raft_consensus.cc:2468] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e182017b4b5e4f1c9e6c6989020d1849 in term 4.
I20260709 13:13:27.606418  5584 raft_consensus.cc:697] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 4 LEADER]: Becoming Leader. State: Replica: e182017b4b5e4f1c9e6c6989020d1849, State: Running, Role: LEADER
I20260709 13:13:27.607540  5584 consensus_queue.cc:237] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:27.614656  5142 catalog_manager.cc:5697] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 reported cstate change: term changed from 3 to 4, leader changed from 10fb48f8cec840f089638a321d7bf76d (127.4.254.2) to e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3). New cstate: current_term: 4 leader_uuid: "e182017b4b5e4f1c9e6c6989020d1849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:27.679193  5564 raft_consensus.cc:993] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d: : Instructing follower 1dc332e386344125994c22b5d0f7555a to start an election
I20260709 13:13:27.679625  5564 raft_consensus.cc:1081] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 3 LEADER]: Signalling peer 1dc332e386344125994c22b5d0f7555a to start an election
I20260709 13:13:27.681342  5247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89"
dest_uuid: "1dc332e386344125994c22b5d0f7555a"
 from {username='slave'} at 127.0.0.1:43584
I20260709 13:13:27.681892  5247 raft_consensus.cc:493] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.682190  5247 raft_consensus.cc:3060] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:27.686180  5247 raft_consensus.cc:515] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:27.687601  5247 leader_election.cc:290] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 4 election: Requested vote from peers e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453), 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725)
I20260709 13:13:27.688467  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:27.688624  5322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282ec7bc6a044b2cb9f7bac253919e89" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:27.688946  5396 raft_consensus.cc:3060] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:27.689147  5322 raft_consensus.cc:3055] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:27.689487  5322 raft_consensus.cc:740] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:27.690122  5322 consensus_queue.cc:260] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:27.690965  5322 raft_consensus.cc:3060] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:27.694049  5396 raft_consensus.cc:2468] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 4.
I20260709 13:13:27.695312  5210 leader_election.cc:304] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:27.696235  5595 raft_consensus.cc:993] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d: : Instructing follower 1dc332e386344125994c22b5d0f7555a to start an election
I20260709 13:13:27.696338  5585 raft_consensus.cc:2804] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:27.696568  5322 raft_consensus.cc:2468] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 4.
I20260709 13:13:27.697173  5585 raft_consensus.cc:697] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 4 LEADER]: Becoming Leader. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Running, Role: LEADER
I20260709 13:13:27.698792  5564 raft_consensus.cc:1081] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 4 LEADER]: Signalling peer 1dc332e386344125994c22b5d0f7555a to start an election
I20260709 13:13:27.698570  5585 consensus_queue.cc:237] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } }
I20260709 13:13:27.701306  5247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae"
dest_uuid: "1dc332e386344125994c22b5d0f7555a"
 from {username='slave'} at 127.0.0.1:43584
I20260709 13:13:27.701833  5247 raft_consensus.cc:493] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.702214  5247 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:27.707437  5247 raft_consensus.cc:515] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:27.708248  5142 catalog_manager.cc:5697] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a reported cstate change: term changed from 3 to 4, leader changed from 10fb48f8cec840f089638a321d7bf76d (127.4.254.2) to 1dc332e386344125994c22b5d0f7555a (127.4.254.1). New cstate: current_term: 4 leader_uuid: "1dc332e386344125994c22b5d0f7555a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.708920  5247 leader_election.cc:290] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 5 election: Requested vote from peers 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725), e182017b4b5e4f1c9e6c6989020d1849 (127.4.254.3:37453)
I20260709 13:13:27.709836  5322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "10fb48f8cec840f089638a321d7bf76d"
I20260709 13:13:27.709962  5396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d5334bc97c422690add0b18acdbaae" candidate_uuid: "1dc332e386344125994c22b5d0f7555a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e182017b4b5e4f1c9e6c6989020d1849"
I20260709 13:13:27.710340  5322 raft_consensus.cc:3055] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:27.710502  5396 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:27.710695  5322 raft_consensus.cc:740] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 10fb48f8cec840f089638a321d7bf76d, State: Running, Role: LEADER
I20260709 13:13:27.711501  5322 consensus_queue.cc:260] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:27.712354  5322 raft_consensus.cc:3060] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:27.715585  5396 raft_consensus.cc:2468] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 5.
I20260709 13:13:27.716663  5210 leader_election.cc:304] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc332e386344125994c22b5d0f7555a, e182017b4b5e4f1c9e6c6989020d1849; no voters: 
I20260709 13:13:27.717613  5585 raft_consensus.cc:2804] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:27.718073  5322 raft_consensus.cc:2468] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc332e386344125994c22b5d0f7555a in term 5.
I20260709 13:13:27.718091  5585 raft_consensus.cc:697] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 5 LEADER]: Becoming Leader. State: Replica: 1dc332e386344125994c22b5d0f7555a, State: Running, Role: LEADER
I20260709 13:13:27.719221  5585 consensus_queue.cc:237] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } }
I20260709 13:13:27.726490  5142 catalog_manager.cc:5697] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a reported cstate change: term changed from 4 to 5, leader changed from 10fb48f8cec840f089638a321d7bf76d (127.4.254.2) to 1dc332e386344125994c22b5d0f7555a (127.4.254.1). New cstate: current_term: 5 leader_uuid: "1dc332e386344125994c22b5d0f7555a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.789954  5322 raft_consensus.cc:1275] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Refusing update from remote peer 1dc332e386344125994c22b5d0f7555a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:27.791024  5585 consensus_queue.cc:1048] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:27.800483  5396 raft_consensus.cc:1275] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Refusing update from remote peer 1dc332e386344125994c22b5d0f7555a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:27.802578  5586 consensus_queue.cc:1048] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:28.023988  5322 raft_consensus.cc:1275] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 4 FOLLOWER]: Refusing update from remote peer e182017b4b5e4f1c9e6c6989020d1849: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:28.025257  5584 consensus_queue.cc:1048] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:28.033876  5247 raft_consensus.cc:1275] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Refusing update from remote peer e182017b4b5e4f1c9e6c6989020d1849: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:28.035387  5584 consensus_queue.cc:1048] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:28.137161  5247 raft_consensus.cc:1275] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Refusing update from remote peer e182017b4b5e4f1c9e6c6989020d1849: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:28.138301  5584 consensus_queue.cc:1048] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc332e386344125994c22b5d0f7555a" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:28.146690  5322 raft_consensus.cc:1275] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Refusing update from remote peer e182017b4b5e4f1c9e6c6989020d1849: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:28.148093  5592 consensus_queue.cc:1048] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:28.178223  5396 raft_consensus.cc:1275] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 4 FOLLOWER]: Refusing update from remote peer 1dc332e386344125994c22b5d0f7555a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:28.179344  5586 consensus_queue.cc:1048] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e182017b4b5e4f1c9e6c6989020d1849" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:28.187880  5322 raft_consensus.cc:1275] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 4 FOLLOWER]: Refusing update from remote peer 1dc332e386344125994c22b5d0f7555a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:28.189061  5585 consensus_queue.cc:1048] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10fb48f8cec840f089638a321d7bf76d" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:28.190037  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:28.198742  5112 tablet_server.cc:179] TabletServer@127.4.254.1:0 shutting down...
I20260709 13:13:28.243436  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:28.244055  5112 tablet_replica.cc:333] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a: stopping tablet replica
I20260709 13:13:28.244752  5112 raft_consensus.cc:2243] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.245311  5112 raft_consensus.cc:2272] T 10f2c5f6d4364a198313b0827fdbab7d P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.247505  5112 tablet_replica.cc:333] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a: stopping tablet replica
I20260709 13:13:28.248052  5112 raft_consensus.cc:2243] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.248452  5112 raft_consensus.cc:2272] T 095e0258c7d44eb2ae7c90863c9636fe P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.250371  5112 tablet_replica.cc:333] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a: stopping tablet replica
I20260709 13:13:28.250885  5112 raft_consensus.cc:2243] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.251569  5112 raft_consensus.cc:2272] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.253904  5112 tablet_replica.cc:333] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a: stopping tablet replica
I20260709 13:13:28.254415  5112 raft_consensus.cc:2243] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.254809  5112 raft_consensus.cc:2272] T 00621849ced84e9083de347b47f346a2 P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.256507  5112 tablet_replica.cc:333] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a: stopping tablet replica
I20260709 13:13:28.256990  5112 raft_consensus.cc:2243] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.257740  5112 pending_rounds.cc:70] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a: Trying to abort 1 pending ops.
I20260709 13:13:28.258028  5112 pending_rounds.cc:77] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a: Aborting op as it isn't in flight: id { term: 5 index: 5 } timestamp: 7305637100426932224 op_type: NO_OP noop_request { }
I20260709 13:13:28.258482  5112 raft_consensus.cc:2889] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 5 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:28.258777  5112 raft_consensus.cc:2272] T 19d5334bc97c422690add0b18acdbaae P 1dc332e386344125994c22b5d0f7555a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.260733  5112 tablet_replica.cc:333] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a: stopping tablet replica
I20260709 13:13:28.261264  5112 raft_consensus.cc:2243] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.261612  5112 raft_consensus.cc:2272] T 00dd189c1562429b88dcbe7f563a1453 P 1dc332e386344125994c22b5d0f7555a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.263063  5112 tablet_replica.cc:333] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a: stopping tablet replica
I20260709 13:13:28.263460  5112 raft_consensus.cc:2243] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.264074  5112 raft_consensus.cc:2272] T 282ec7bc6a044b2cb9f7bac253919e89 P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.265961  5112 tablet_replica.cc:333] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a: stopping tablet replica
I20260709 13:13:28.266340  5112 raft_consensus.cc:2243] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.266700  5112 raft_consensus.cc:2272] T 3b0e9746ac064c5eb89e2239cf4b5801 P 1dc332e386344125994c22b5d0f7555a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.268152  5112 tablet_replica.cc:333] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a: stopping tablet replica
I20260709 13:13:28.268613  5112 raft_consensus.cc:2243] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.268978  5112 raft_consensus.cc:2272] T 99f2d3afcf20497290dbf499b1a445a1 P 1dc332e386344125994c22b5d0f7555a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.358978  5112 tablet_server.cc:196] TabletServer@127.4.254.1:0 shutdown complete.
I20260709 13:13:28.376513  5112 tablet_server.cc:179] TabletServer@127.4.254.2:0 shutting down...
I20260709 13:13:28.401616  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:28.402208  5112 tablet_replica.cc:333] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d: stopping tablet replica
I20260709 13:13:28.402806  5112 raft_consensus.cc:2243] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.403251  5112 raft_consensus.cc:2272] T 0dbd8e3a9a1242ac8e45d6692bebd44b P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.405233  5112 tablet_replica.cc:333] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d: stopping tablet replica
I20260709 13:13:28.405730  5112 raft_consensus.cc:2243] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.406129  5112 raft_consensus.cc:2272] T 095e0258c7d44eb2ae7c90863c9636fe P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.408069  5112 tablet_replica.cc:333] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d: stopping tablet replica
I20260709 13:13:28.408533  5112 raft_consensus.cc:2243] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.408917  5112 raft_consensus.cc:2272] T 10f2c5f6d4364a198313b0827fdbab7d P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.410485  5112 tablet_replica.cc:333] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d: stopping tablet replica
I20260709 13:13:28.410959  5112 raft_consensus.cc:2243] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.411645  5112 raft_consensus.cc:2272] T 99f2d3afcf20497290dbf499b1a445a1 P 10fb48f8cec840f089638a321d7bf76d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.413278  5112 tablet_replica.cc:333] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d: stopping tablet replica
I20260709 13:13:28.413725  5112 raft_consensus.cc:2243] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.414470  5112 raft_consensus.cc:2272] T 3b0e9746ac064c5eb89e2239cf4b5801 P 10fb48f8cec840f089638a321d7bf76d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.416013  5112 tablet_replica.cc:333] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d: stopping tablet replica
I20260709 13:13:28.416468  5112 raft_consensus.cc:2243] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.416833  5112 raft_consensus.cc:2272] T 282ec7bc6a044b2cb9f7bac253919e89 P 10fb48f8cec840f089638a321d7bf76d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.418709  5112 tablet_replica.cc:333] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d: stopping tablet replica
I20260709 13:13:28.419165  5112 raft_consensus.cc:2243] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.419893  5112 raft_consensus.cc:2272] T 00dd189c1562429b88dcbe7f563a1453 P 10fb48f8cec840f089638a321d7bf76d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.421392  5112 tablet_replica.cc:333] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d: stopping tablet replica
I20260709 13:13:28.421813  5112 raft_consensus.cc:2243] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.422158  5112 raft_consensus.cc:2272] T 19d5334bc97c422690add0b18acdbaae P 10fb48f8cec840f089638a321d7bf76d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.423637  5112 tablet_replica.cc:333] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d: stopping tablet replica
I20260709 13:13:28.424054  5112 raft_consensus.cc:2243] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.424427  5112 raft_consensus.cc:2272] T 00621849ced84e9083de347b47f346a2 P 10fb48f8cec840f089638a321d7bf76d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.451009  5112 tablet_server.cc:196] TabletServer@127.4.254.2:0 shutdown complete.
I20260709 13:13:28.467808  5112 tablet_server.cc:179] TabletServer@127.4.254.3:0 shutting down...
W20260709 13:13:28.479163  5361 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.254.2:46725: connect: Connection refused (error 111)
W20260709 13:13:28.484210  5361 consensus_peers.cc:597] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 -> Peer 10fb48f8cec840f089638a321d7bf76d (127.4.254.2:46725): Couldn't send request to peer 10fb48f8cec840f089638a321d7bf76d. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:46725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.495136  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:28.495750  5112 tablet_replica.cc:333] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849: stopping tablet replica
I20260709 13:13:28.496351  5112 raft_consensus.cc:2243] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.497097  5112 raft_consensus.cc:2272] T 10f2c5f6d4364a198313b0827fdbab7d P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.499065  5112 tablet_replica.cc:333] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849: stopping tablet replica
I20260709 13:13:28.499675  5112 raft_consensus.cc:2243] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.500419  5112 raft_consensus.cc:2272] T 095e0258c7d44eb2ae7c90863c9636fe P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.502851  5112 tablet_replica.cc:333] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849: stopping tablet replica
I20260709 13:13:28.503404  5112 raft_consensus.cc:2243] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.503902  5112 raft_consensus.cc:2272] T 3b0e9746ac064c5eb89e2239cf4b5801 P e182017b4b5e4f1c9e6c6989020d1849 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.505802  5112 tablet_replica.cc:333] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849: stopping tablet replica
I20260709 13:13:28.506340  5112 raft_consensus.cc:2243] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.506796  5112 raft_consensus.cc:2272] T 0dbd8e3a9a1242ac8e45d6692bebd44b P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.508908  5112 tablet_replica.cc:333] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849: stopping tablet replica
I20260709 13:13:28.509521  5112 raft_consensus.cc:2243] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.509954  5112 raft_consensus.cc:2272] T 19d5334bc97c422690add0b18acdbaae P e182017b4b5e4f1c9e6c6989020d1849 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.511703  5112 tablet_replica.cc:333] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849: stopping tablet replica
I20260709 13:13:28.512207  5112 raft_consensus.cc:2243] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.512704  5112 raft_consensus.cc:2272] T 00dd189c1562429b88dcbe7f563a1453 P e182017b4b5e4f1c9e6c6989020d1849 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.514415  5112 tablet_replica.cc:333] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849: stopping tablet replica
I20260709 13:13:28.514861  5112 raft_consensus.cc:2243] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.515532  5112 raft_consensus.cc:2272] T 00621849ced84e9083de347b47f346a2 P e182017b4b5e4f1c9e6c6989020d1849 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.517198  5112 tablet_replica.cc:333] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849: stopping tablet replica
I20260709 13:13:28.517627  5112 raft_consensus.cc:2243] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.517990  5112 raft_consensus.cc:2272] T 282ec7bc6a044b2cb9f7bac253919e89 P e182017b4b5e4f1c9e6c6989020d1849 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.519801  5112 tablet_replica.cc:333] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849: stopping tablet replica
I20260709 13:13:28.520217  5112 raft_consensus.cc:2243] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.520571  5112 raft_consensus.cc:2272] T 99f2d3afcf20497290dbf499b1a445a1 P e182017b4b5e4f1c9e6c6989020d1849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.545068  5112 tablet_server.cc:196] TabletServer@127.4.254.3:0 shutdown complete.
I20260709 13:13:28.561048  5112 master.cc:562] Master@127.4.254.62:37501 shutting down...
I20260709 13:13:28.694885  5112 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.695469  5112 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.695827  5112 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7ef0f4d6578540d7ae3a02640e5572df: stopping tablet replica
I20260709 13:13:28.715939  5112 master.cc:584] Master@127.4.254.62:37501 shutdown complete.
10fb48f8cec840f089638a321d7bf76d  4
1dc332e386344125994c22b5d0f7555a  4
e182017b4b5e4f1c9e6c6989020d1849  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12452 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:13:28.754015  5112 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.254.62:38309
I20260709 13:13:28.755151  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:28.760774  5614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:28.761093  5615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:28.762001  5617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:28.762427  5112 server_base.cc:1061] running on GCE node
I20260709 13:13:28.763339  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:28.763515  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:28.763736  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783602808763687 us; error 0 us; skew 500 ppm
I20260709 13:13:28.764263  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:28.766623  5112 webserver.cc:533] Webserver started at http://127.4.254.62:36671/ using document root <none> and password file <none>
I20260709 13:13:28.767104  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:28.767263  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:28.767578  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:28.768688  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/master-0-root/instance:
uuid: "341ca2519bca466d994078d930588feb"
format_stamp: "Formatted at 2026-07-09 13:13:28 on dist-test-slave-k73n"
I20260709 13:13:28.772933  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 13:13:28.775930  5622 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:28.776612  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:28.776901  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/master-0-root
uuid: "341ca2519bca466d994078d930588feb"
format_stamp: "Formatted at 2026-07-09 13:13:28 on dist-test-slave-k73n"
I20260709 13:13:28.777206  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:28.807569  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:28.808780  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:28.845085  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.62:38309
I20260709 13:13:28.845242  5673 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.62:38309 every 8 connection(s)
I20260709 13:13:28.848876  5674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.857969  5674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb: Bootstrap starting.
I20260709 13:13:28.863106  5674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.867096  5674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb: No bootstrap required, opened a new log
I20260709 13:13:28.869227  5674 raft_consensus.cc:359] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "341ca2519bca466d994078d930588feb" member_type: VOTER }
I20260709 13:13:28.869613  5674 raft_consensus.cc:385] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.869851  5674 raft_consensus.cc:740] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 341ca2519bca466d994078d930588feb, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.870417  5674 consensus_queue.cc:260] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "341ca2519bca466d994078d930588feb" member_type: VOTER }
I20260709 13:13:28.870854  5674 raft_consensus.cc:399] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:28.871074  5674 raft_consensus.cc:493] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:28.871340  5674 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.875223  5674 raft_consensus.cc:515] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "341ca2519bca466d994078d930588feb" member_type: VOTER }
I20260709 13:13:28.875722  5674 leader_election.cc:304] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 341ca2519bca466d994078d930588feb; no voters: 
I20260709 13:13:28.876762  5674 leader_election.cc:290] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:28.877198  5677 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:28.878614  5677 raft_consensus.cc:697] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [term 1 LEADER]: Becoming Leader. State: Replica: 341ca2519bca466d994078d930588feb, State: Running, Role: LEADER
I20260709 13:13:28.879298  5677 consensus_queue.cc:237] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "341ca2519bca466d994078d930588feb" member_type: VOTER }
I20260709 13:13:28.879884  5674 sys_catalog.cc:565] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:28.884465  5679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 341ca2519bca466d994078d930588feb. Latest consensus state: current_term: 1 leader_uuid: "341ca2519bca466d994078d930588feb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "341ca2519bca466d994078d930588feb" member_type: VOTER } }
I20260709 13:13:28.884490  5678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "341ca2519bca466d994078d930588feb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "341ca2519bca466d994078d930588feb" member_type: VOTER } }
I20260709 13:13:28.885532  5679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:28.885545  5678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:28.888638  5685 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:28.893703  5685 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:28.896217  5112 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:28.902190  5685 catalog_manager.cc:1383] Generated new cluster ID: e0a1628acdfa4fa58b8dcbd33352dfcf
I20260709 13:13:28.902446  5685 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:28.914039  5685 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:28.915206  5685 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:28.933461  5685 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb: Generated new TSK 0
I20260709 13:13:28.934041  5685 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:28.963675  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:28.969535  5695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:28.970880  5696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:28.971976  5698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:28.972545  5112 server_base.cc:1061] running on GCE node
I20260709 13:13:28.973381  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:28.973572  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:28.973742  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783602808973709 us; error 0 us; skew 500 ppm
I20260709 13:13:28.974262  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:28.976351  5112 webserver.cc:533] Webserver started at http://127.4.254.1:46691/ using document root <none> and password file <none>
I20260709 13:13:28.976814  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:28.976998  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:28.977283  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:28.978271  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-0-root/instance:
uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
format_stamp: "Formatted at 2026-07-09 13:13:28 on dist-test-slave-k73n"
I20260709 13:13:28.982816  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:28.985888  5703 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:28.986547  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:13:28.986836  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-0-root
uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
format_stamp: "Formatted at 2026-07-09 13:13:28 on dist-test-slave-k73n"
I20260709 13:13:28.987107  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:28.996193  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:28.997443  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:28.998801  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:29.000908  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:29.001075  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.001390  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:29.001561  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.040395  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.1:37823
I20260709 13:13:29.040511  5765 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.1:37823 every 8 connection(s)
I20260709 13:13:29.045192  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:29.052554  5770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:29.053654  5771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:29.056218  5773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:29.056573  5112 server_base.cc:1061] running on GCE node
I20260709 13:13:29.057806  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:29.058022  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:29.058208  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783602809058190 us; error 0 us; skew 500 ppm
I20260709 13:13:29.058724  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:29.061301  5112 webserver.cc:533] Webserver started at http://127.4.254.2:39541/ using document root <none> and password file <none>
I20260709 13:13:29.061923  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:29.062172  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:29.062470  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:29.062896  5766 heartbeater.cc:344] Connected to a master server at 127.4.254.62:38309
I20260709 13:13:29.063301  5766 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:29.064016  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-1-root/instance:
uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
format_stamp: "Formatted at 2026-07-09 13:13:29 on dist-test-slave-k73n"
I20260709 13:13:29.064169  5766 heartbeater.cc:507] Master 127.4.254.62:38309 requested a full tablet report, sending...
I20260709 13:13:29.066577  5639 ts_manager.cc:194] Registered new tserver with Master: ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823)
I20260709 13:13:29.068924  5639 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59962
I20260709 13:13:29.069608  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:13:29.073325  5778 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.074036  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:29.074317  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-1-root
uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
format_stamp: "Formatted at 2026-07-09 13:13:29 on dist-test-slave-k73n"
I20260709 13:13:29.074572  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:29.097098  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:29.098322  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:29.099743  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:29.101827  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:29.102007  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.102281  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:29.102438  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.140638  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.2:36979
I20260709 13:13:29.140733  5840 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.2:36979 every 8 connection(s)
I20260709 13:13:29.145375  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:29.152325  5844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:29.154804  5845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:29.156337  5847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:29.156886  5841 heartbeater.cc:344] Connected to a master server at 127.4.254.62:38309
I20260709 13:13:29.157495  5841 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:29.158397  5841 heartbeater.cc:507] Master 127.4.254.62:38309 requested a full tablet report, sending...
I20260709 13:13:29.159157  5112 server_base.cc:1061] running on GCE node
I20260709 13:13:29.160076  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:29.160323  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:29.160518  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783602809160498 us; error 0 us; skew 500 ppm
I20260709 13:13:29.160652  5639 ts_manager.cc:194] Registered new tserver with Master: eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:29.161240  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:29.162459  5639 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59974
I20260709 13:13:29.165581  5112 webserver.cc:533] Webserver started at http://127.4.254.3:43387/ using document root <none> and password file <none>
I20260709 13:13:29.166026  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:29.166178  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:29.166375  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:29.167395  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-2-root/instance:
uuid: "0efd05f9c0644d4499af913d22b6b823"
format_stamp: "Formatted at 2026-07-09 13:13:29 on dist-test-slave-k73n"
I20260709 13:13:29.171532  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:29.174544  5852 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.175231  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:29.175529  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-2-root
uuid: "0efd05f9c0644d4499af913d22b6b823"
format_stamp: "Formatted at 2026-07-09 13:13:29 on dist-test-slave-k73n"
I20260709 13:13:29.175813  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602796139571-5112-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:29.192056  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:29.193198  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:29.194569  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:29.196614  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:29.196849  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.197090  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:29.197288  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:13:29.236622  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.3:38097
I20260709 13:13:29.236737  5914 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.3:38097 every 8 connection(s)
I20260709 13:13:29.250195  5915 heartbeater.cc:344] Connected to a master server at 127.4.254.62:38309
I20260709 13:13:29.250530  5915 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:29.251179  5915 heartbeater.cc:507] Master 127.4.254.62:38309 requested a full tablet report, sending...
I20260709 13:13:29.253028  5639 ts_manager.cc:194] Registered new tserver with Master: 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:29.253181  5112 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013466048s
I20260709 13:13:29.254740  5639 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59990
I20260709 13:13:29.277278  5639 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59996:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:29.279999  5639 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:29.358186  5806 tablet_service.cc:1511] Processing CreateTablet for tablet 8d39a3e326b748bcae7ed3655f7808f3 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:29.358503  5805 tablet_service.cc:1511] Processing CreateTablet for tablet e7e6e8de5a484ee0a55578fb18216ab8 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:29.359676  5806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d39a3e326b748bcae7ed3655f7808f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.361367  5804 tablet_service.cc:1511] Processing CreateTablet for tablet 0c557673688a4726ab294b8f53337fc2 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:29.362710  5804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c557673688a4726ab294b8f53337fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.365489  5805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e6e8de5a484ee0a55578fb18216ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.378991  5803 tablet_service.cc:1511] Processing CreateTablet for tablet e30c770d46a44d0fb5d96eb046c464d3 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:29.380388  5803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30c770d46a44d0fb5d96eb046c464d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.381923  5880 tablet_service.cc:1511] Processing CreateTablet for tablet 8d39a3e326b748bcae7ed3655f7808f3 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:29.383252  5880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d39a3e326b748bcae7ed3655f7808f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.383488  5874 tablet_service.cc:1511] Processing CreateTablet for tablet c3d869fcf1b946be8e0b4cdc1700cbad (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:29.384732  5874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d869fcf1b946be8e0b4cdc1700cbad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.384581  5731 tablet_service.cc:1511] Processing CreateTablet for tablet 8d39a3e326b748bcae7ed3655f7808f3 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:29.385869  5731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d39a3e326b748bcae7ed3655f7808f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.386317  5879 tablet_service.cc:1511] Processing CreateTablet for tablet e7e6e8de5a484ee0a55578fb18216ab8 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:29.387655  5879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e6e8de5a484ee0a55578fb18216ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.387936  5873 tablet_service.cc:1511] Processing CreateTablet for tablet ff07cf8ab33d4ba4a6803c2416d7c5a0 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:29.389209  5873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff07cf8ab33d4ba4a6803c2416d7c5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.389485  5730 tablet_service.cc:1511] Processing CreateTablet for tablet e7e6e8de5a484ee0a55578fb18216ab8 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:29.390184  5878 tablet_service.cc:1511] Processing CreateTablet for tablet 0c557673688a4726ab294b8f53337fc2 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:29.390829  5730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e6e8de5a484ee0a55578fb18216ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.391512  5878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c557673688a4726ab294b8f53337fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.393824  5729 tablet_service.cc:1511] Processing CreateTablet for tablet 0c557673688a4726ab294b8f53337fc2 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:29.394274  5877 tablet_service.cc:1511] Processing CreateTablet for tablet e30c770d46a44d0fb5d96eb046c464d3 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:29.394276  5872 tablet_service.cc:1511] Processing CreateTablet for tablet 50dc05011a0345a59c00b22bdc1f0b4f (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:29.395159  5729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c557673688a4726ab294b8f53337fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.395567  5877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30c770d46a44d0fb5d96eb046c464d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.399863  5726 tablet_service.cc:1511] Processing CreateTablet for tablet d2e18282a42a4a23826d5a5f90ce831e (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:29.400247  5875 tablet_service.cc:1511] Processing CreateTablet for tablet d2e18282a42a4a23826d5a5f90ce831e (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:29.407269  5798 tablet_service.cc:1511] Processing CreateTablet for tablet 50dc05011a0345a59c00b22bdc1f0b4f (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:29.407992  5876 tablet_service.cc:1511] Processing CreateTablet for tablet 20f34fa88da342b2a101928690d11819 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:29.400779  5871 tablet_service.cc:1511] Processing CreateTablet for tablet 6111fdb849fd49db876e4cff832cdb99 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:29.399770  5727 tablet_service.cc:1511] Processing CreateTablet for tablet 20f34fa88da342b2a101928690d11819 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:29.401329  5872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50dc05011a0345a59c00b22bdc1f0b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.401533  5726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e18282a42a4a23826d5a5f90ce831e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.402505  5725 tablet_service.cc:1511] Processing CreateTablet for tablet c3d869fcf1b946be8e0b4cdc1700cbad (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:29.403158  5722 tablet_service.cc:1511] Processing CreateTablet for tablet 6111fdb849fd49db876e4cff832cdb99 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:29.403487  5800 tablet_service.cc:1511] Processing CreateTablet for tablet c3d869fcf1b946be8e0b4cdc1700cbad (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:29.404253  5802 tablet_service.cc:1511] Processing CreateTablet for tablet 20f34fa88da342b2a101928690d11819 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:29.405258  5799 tablet_service.cc:1511] Processing CreateTablet for tablet ff07cf8ab33d4ba4a6803c2416d7c5a0 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:29.406015  5801 tablet_service.cc:1511] Processing CreateTablet for tablet d2e18282a42a4a23826d5a5f90ce831e (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:29.408574  5798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50dc05011a0345a59c00b22bdc1f0b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.413645  5724 tablet_service.cc:1511] Processing CreateTablet for tablet ff07cf8ab33d4ba4a6803c2416d7c5a0 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:29.416554  5723 tablet_service.cc:1511] Processing CreateTablet for tablet 50dc05011a0345a59c00b22bdc1f0b4f (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:29.417268  5800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d869fcf1b946be8e0b4cdc1700cbad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.414857  5797 tablet_service.cc:1511] Processing CreateTablet for tablet 6111fdb849fd49db876e4cff832cdb99 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:29.413846  5728 tablet_service.cc:1511] Processing CreateTablet for tablet e30c770d46a44d0fb5d96eb046c464d3 (DEFAULT_TABLE table=test-workload [id=a653e58c805a470bb1360a9b6d6c324b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:29.419118  5727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f34fa88da342b2a101928690d11819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.421674  5799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff07cf8ab33d4ba4a6803c2416d7c5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.422444  5797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6111fdb849fd49db876e4cff832cdb99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.426061  5722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6111fdb849fd49db876e4cff832cdb99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.437676  5723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50dc05011a0345a59c00b22bdc1f0b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.441805  5728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30c770d46a44d0fb5d96eb046c464d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.445544  5875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e18282a42a4a23826d5a5f90ce831e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.445739  5724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff07cf8ab33d4ba4a6803c2416d7c5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.448531  5876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f34fa88da342b2a101928690d11819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.449537  5871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6111fdb849fd49db876e4cff832cdb99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.453563  5725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d869fcf1b946be8e0b4cdc1700cbad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.457733  5801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e18282a42a4a23826d5a5f90ce831e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.468772  5930 tablet_bootstrap.cc:492] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb: Bootstrap starting.
I20260709 13:13:29.473263  5802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f34fa88da342b2a101928690d11819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.548151  5931 tablet_bootstrap.cc:492] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823: Bootstrap starting.
I20260709 13:13:29.552233  5930 tablet_bootstrap.cc:654] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.569362  5931 tablet_bootstrap.cc:654] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.582798  5932 tablet_bootstrap.cc:492] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52: Bootstrap starting.
I20260709 13:13:29.585457  5931 tablet_bootstrap.cc:492] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823: No bootstrap required, opened a new log
I20260709 13:13:29.585922  5931 ts_tablet_manager.cc:1403] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.009s
I20260709 13:13:29.588094  5931 raft_consensus.cc:359] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.588680  5931 raft_consensus.cc:385] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.588954  5931 raft_consensus.cc:740] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.589737  5931 consensus_queue.cc:260] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.591471  5930 tablet_bootstrap.cc:492] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb: No bootstrap required, opened a new log
I20260709 13:13:29.591660  5932 tablet_bootstrap.cc:654] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.592077  5930 ts_tablet_manager.cc:1403] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.005s
I20260709 13:13:29.595903  5931 ts_tablet_manager.cc:1434] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:13:29.595582  5930 raft_consensus.cc:359] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:29.596215  5932 tablet_bootstrap.cc:492] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52: No bootstrap required, opened a new log
I20260709 13:13:29.596262  5930 raft_consensus.cc:385] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.596635  5915 heartbeater.cc:499] Master 127.4.254.62:38309 was elected leader, sending a full tablet report...
I20260709 13:13:29.596844  5931 tablet_bootstrap.cc:492] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823: Bootstrap starting.
I20260709 13:13:29.596691  5930 raft_consensus.cc:740] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.596756  5932 ts_tablet_manager.cc:1403] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.007s
I20260709 13:13:29.597707  5930 consensus_queue.cc:260] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:29.600015  5932 raft_consensus.cc:359] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.600747  5932 raft_consensus.cc:385] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.601042  5932 raft_consensus.cc:740] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.601883  5932 consensus_queue.cc:260] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.605342  5931 tablet_bootstrap.cc:654] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.606105  5766 heartbeater.cc:499] Master 127.4.254.62:38309 was elected leader, sending a full tablet report...
I20260709 13:13:29.607322  5932 ts_tablet_manager.cc:1434] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:29.608393  5932 tablet_bootstrap.cc:492] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52: Bootstrap starting.
I20260709 13:13:29.615372  5932 tablet_bootstrap.cc:654] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.617592  5938 raft_consensus.cc:493] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.618250  5938 raft_consensus.cc:515] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.624257  5938 leader_election.cc:290] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:29.630640  5841 heartbeater.cc:499] Master 127.4.254.62:38309 was elected leader, sending a full tablet report...
I20260709 13:13:29.634609  5930 ts_tablet_manager.cc:1434] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent starting tablet: real 0.042s	user 0.013s	sys 0.009s
I20260709 13:13:29.643826  5930 tablet_bootstrap.cc:492] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb: Bootstrap starting.
I20260709 13:13:29.654307  5930 tablet_bootstrap.cc:654] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.654928  5931 tablet_bootstrap.cc:492] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823: No bootstrap required, opened a new log
I20260709 13:13:29.655414  5931 ts_tablet_manager.cc:1403] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.030s
I20260709 13:13:29.658681  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" is_pre_election: true
I20260709 13:13:29.658550  5931 raft_consensus.cc:359] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.659377  5931 raft_consensus.cc:385] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.659675  5931 raft_consensus.cc:740] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Initialized, Role: FOLLOWER
W20260709 13:13:29.660490  5704 leader_election.cc:343] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.660563  5931 consensus_queue.cc:260] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.664945  5931 ts_tablet_manager.cc:1434] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:13:29.665940  5931 tablet_bootstrap.cc:492] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823: Bootstrap starting.
I20260709 13:13:29.671409  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823" is_pre_election: true
I20260709 13:13:29.672518  5931 tablet_bootstrap.cc:654] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:29.672915  5705 leader_election.cc:343] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.673404  5705 leader_election.cc:304] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52; no voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb
I20260709 13:13:29.674252  5932 tablet_bootstrap.cc:492] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52: No bootstrap required, opened a new log
I20260709 13:13:29.674252  5938 raft_consensus.cc:2749] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.675043  5932 ts_tablet_manager.cc:1403] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.007s
I20260709 13:13:29.677467  5930 tablet_bootstrap.cc:492] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb: No bootstrap required, opened a new log
I20260709 13:13:29.677874  5931 tablet_bootstrap.cc:492] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823: No bootstrap required, opened a new log
I20260709 13:13:29.677915  5930 ts_tablet_manager.cc:1403] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.004s
I20260709 13:13:29.677881  5932 raft_consensus.cc:359] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.678505  5931 ts_tablet_manager.cc:1403] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:13:29.678810  5932 raft_consensus.cc:385] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.679184  5932 raft_consensus.cc:740] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.679859  5932 consensus_queue.cc:260] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.681159  5930 raft_consensus.cc:359] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.681267  5931 raft_consensus.cc:359] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.681970  5930 raft_consensus.cc:385] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.682077  5931 raft_consensus.cc:385] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.681994  5932 ts_tablet_manager.cc:1434] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:13:29.682499  5930 raft_consensus.cc:740] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.682570  5931 raft_consensus.cc:740] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.683362  5932 tablet_bootstrap.cc:492] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52: Bootstrap starting.
I20260709 13:13:29.683578  5931 consensus_queue.cc:260] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.686655  5931 ts_tablet_manager.cc:1434] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:29.687768  5931 tablet_bootstrap.cc:492] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823: Bootstrap starting.
I20260709 13:13:29.690117  5932 tablet_bootstrap.cc:654] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.693177  5930 consensus_queue.cc:260] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.695443  5930 ts_tablet_manager.cc:1434] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:13:29.696370  5930 tablet_bootstrap.cc:492] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb: Bootstrap starting.
I20260709 13:13:29.698796  5931 tablet_bootstrap.cc:654] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.702706  5930 tablet_bootstrap.cc:654] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.708719  5931 tablet_bootstrap.cc:492] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823: No bootstrap required, opened a new log
I20260709 13:13:29.709190  5930 tablet_bootstrap.cc:492] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb: No bootstrap required, opened a new log
I20260709 13:13:29.709252  5931 ts_tablet_manager.cc:1403] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.002s
I20260709 13:13:29.709724  5930 ts_tablet_manager.cc:1403] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.002s
I20260709 13:13:29.709741  5932 tablet_bootstrap.cc:492] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52: No bootstrap required, opened a new log
I20260709 13:13:29.710335  5932 ts_tablet_manager.cc:1403] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.003s
I20260709 13:13:29.711966  5930 raft_consensus.cc:359] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.712517  5930 raft_consensus.cc:385] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.712870  5930 raft_consensus.cc:740] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.712421  5931 raft_consensus.cc:359] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.713308  5931 raft_consensus.cc:385] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.713270  5932 raft_consensus.cc:359] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.713713  5931 raft_consensus.cc:740] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.713595  5930 consensus_queue.cc:260] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.714099  5932 raft_consensus.cc:385] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.714438  5932 raft_consensus.cc:740] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.715588  5930 ts_tablet_manager.cc:1434] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:29.715216  5932 consensus_queue.cc:260] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.716667  5930 tablet_bootstrap.cc:492] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb: Bootstrap starting.
I20260709 13:13:29.717564  5932 ts_tablet_manager.cc:1434] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:29.717633  5931 consensus_queue.cc:260] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.718710  5932 tablet_bootstrap.cc:492] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52: Bootstrap starting.
I20260709 13:13:29.719996  5931 ts_tablet_manager.cc:1434] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:13:29.721035  5931 tablet_bootstrap.cc:492] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823: Bootstrap starting.
I20260709 13:13:29.723378  5930 tablet_bootstrap.cc:654] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.725875  5932 tablet_bootstrap.cc:654] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.727885  5931 tablet_bootstrap.cc:654] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.732846  5937 raft_consensus.cc:493] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.733345  5937 raft_consensus.cc:515] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.734843  5930 tablet_bootstrap.cc:492] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb: No bootstrap required, opened a new log
I20260709 13:13:29.735265  5930 ts_tablet_manager.cc:1403] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:13:29.738554  5930 raft_consensus.cc:359] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.739915  5935 raft_consensus.cc:493] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.740290  5937 leader_election.cc:290] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:29.740475  5935 raft_consensus.cc:515] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.742404  5932 tablet_bootstrap.cc:492] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52: No bootstrap required, opened a new log
I20260709 13:13:29.743027  5932 ts_tablet_manager.cc:1403] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.012s
I20260709 13:13:29.747041  5932 raft_consensus.cc:359] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.748073  5932 raft_consensus.cc:385] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.748488  5932 raft_consensus.cc:740] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.748787  5935 leader_election.cc:290] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:29.749718  5932 consensus_queue.cc:260] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.752388  5935 raft_consensus.cc:493] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.753615  5935 raft_consensus.cc:515] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.754709  5932 ts_tablet_manager.cc:1434] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.004s
I20260709 13:13:29.758062  5932 tablet_bootstrap.cc:492] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52: Bootstrap starting.
I20260709 13:13:29.758759  5935 leader_election.cc:290] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:29.761279  5930 raft_consensus.cc:385] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.762214  5930 raft_consensus.cc:740] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.764566  5938 raft_consensus.cc:493] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.770897  5938 raft_consensus.cc:515] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.772142  5930 consensus_queue.cc:260] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.775028  5938 leader_election.cc:290] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:29.775314  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c557673688a4726ab294b8f53337fc2" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" is_pre_election: true
I20260709 13:13:29.775043  5930 ts_tablet_manager.cc:1434] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:13:29.780490  5931 tablet_bootstrap.cc:492] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823: No bootstrap required, opened a new log
I20260709 13:13:29.781153  5931 ts_tablet_manager.cc:1403] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.040s
I20260709 13:13:29.780583  5930 tablet_bootstrap.cc:492] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb: Bootstrap starting.
I20260709 13:13:29.778195  5816 raft_consensus.cc:2468] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 0.
I20260709 13:13:29.784051  5931 raft_consensus.cc:359] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.784322  5704 leader_election.cc:304] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:29.784832  5931 raft_consensus.cc:385] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.785178  5931 raft_consensus.cc:740] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.786850  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c557673688a4726ab294b8f53337fc2" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823" is_pre_election: true
I20260709 13:13:29.778065  5938 raft_consensus.cc:493] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.788241  5956 raft_consensus.cc:2804] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.788589  5890 raft_consensus.cc:2468] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 0.
I20260709 13:13:29.788695  5956 raft_consensus.cc:493] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.789335  5956 raft_consensus.cc:3060] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.788026  5938 raft_consensus.cc:515] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.791682  5931 consensus_queue.cc:260] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.793712  5938 leader_election.cc:290] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:29.794813  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50dc05011a0345a59c00b22bdc1f0b4f" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823" is_pre_election: true
I20260709 13:13:29.802114  5956 raft_consensus.cc:515] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.796689  5937 raft_consensus.cc:493] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.804248  5937 raft_consensus.cc:515] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:29.796482  5931 ts_tablet_manager.cc:1434] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:13:29.798764  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50dc05011a0345a59c00b22bdc1f0b4f" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" is_pre_election: true
I20260709 13:13:29.805855  5889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c557673688a4726ab294b8f53337fc2" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:29.802372  5890 raft_consensus.cc:2468] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 0.
I20260709 13:13:29.806272  5937 leader_election.cc:290] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097), ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823)
I20260709 13:13:29.806473  5889 raft_consensus.cc:3060] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.807124  5815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d869fcf1b946be8e0b4cdc1700cbad" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" is_pre_election: true
I20260709 13:13:29.787024  5932 tablet_bootstrap.cc:654] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.808297  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c557673688a4726ab294b8f53337fc2" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:29.808513  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" is_pre_election: true
I20260709 13:13:29.808846  5816 raft_consensus.cc:3060] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:29.810196  5853 leader_election.cc:343] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.810500  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c557673688a4726ab294b8f53337fc2" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" is_pre_election: true
W20260709 13:13:29.810899  5853 leader_election.cc:343] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.811309  5741 raft_consensus.cc:2393] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eac2aed77b3d4cdb8afdc9395c47b4fb in current term 1: Already voted for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in this term.
I20260709 13:13:29.812415  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" is_pre_election: true
I20260709 13:13:29.814061  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d869fcf1b946be8e0b4cdc1700cbad" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" is_pre_election: true
I20260709 13:13:29.814968  5705 leader_election.cc:304] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52; no voters: 
I20260709 13:13:29.815780  5816 raft_consensus.cc:2468] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 1.
I20260709 13:13:29.816429  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" is_pre_election: true
W20260709 13:13:29.816671  5853 leader_election.cc:343] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.817018  5741 raft_consensus.cc:2468] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 0.
I20260709 13:13:29.817085  5853 leader_election.cc:304] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823; no voters: ae3a4d60c7b64c9abe8c889c0c252a52, eac2aed77b3d4cdb8afdc9395c47b4fb
I20260709 13:13:29.815780  5930 tablet_bootstrap.cc:654] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.817896  5931 tablet_bootstrap.cc:492] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823: Bootstrap starting.
I20260709 13:13:29.817984  5953 raft_consensus.cc:2749] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.819741  5958 raft_consensus.cc:2804] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.820194  5958 raft_consensus.cc:493] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.820739  5853 leader_election.cc:304] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52; no voters: eac2aed77b3d4cdb8afdc9395c47b4fb
I20260709 13:13:29.821884  5953 raft_consensus.cc:2804] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.822234  5953 raft_consensus.cc:493] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.822533  5953 raft_consensus.cc:3060] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:29.825300  5779 leader_election.cc:343] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.824766  5958 raft_consensus.cc:3060] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.824934  5956 leader_election.cc:290] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
W20260709 13:13:29.828423  5704 leader_election.cc:343] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.833384  5953 raft_consensus.cc:515] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.834041  5704 leader_election.cc:304] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:29.834800  5956 raft_consensus.cc:2804] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.835402  5953 leader_election.cc:290] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:29.836295  5956 raft_consensus.cc:697] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Becoming Leader. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:29.836436  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:29.836853  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:29.837023  5741 raft_consensus.cc:3060] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.837446  5956 consensus_queue.cc:237] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
W20260709 13:13:29.838214  5853 leader_election.cc:343] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.840420  5938 raft_consensus.cc:493] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.831604  5889 raft_consensus.cc:2468] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 1.
I20260709 13:13:29.840865  5938 raft_consensus.cc:515] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.832795  5931 tablet_bootstrap.cc:654] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.842761  5938 leader_election.cc:290] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:29.845952  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" is_pre_election: true
I20260709 13:13:29.846588  5958 raft_consensus.cc:515] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
W20260709 13:13:29.847229  5704 leader_election.cc:343] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.849339  5958 leader_election.cc:290] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:29.852159  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50dc05011a0345a59c00b22bdc1f0b4f" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:29.853632  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50dc05011a0345a59c00b22bdc1f0b4f" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
W20260709 13:13:29.853904  5704 leader_election.cc:343] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.854218  5890 raft_consensus.cc:3060] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.852869  5889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823" is_pre_election: true
I20260709 13:13:29.856738  5930 tablet_bootstrap.cc:492] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb: No bootstrap required, opened a new log
I20260709 13:13:29.857383  5930 ts_tablet_manager.cc:1403] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.013s
I20260709 13:13:29.860473  5888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c557673688a4726ab294b8f53337fc2" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823" is_pre_election: true
I20260709 13:13:29.860497  5930 raft_consensus.cc:359] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.861413  5930 raft_consensus.cc:385] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.861471  5888 raft_consensus.cc:2393] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eac2aed77b3d4cdb8afdc9395c47b4fb in current term 1: Already voted for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in this term.
I20260709 13:13:29.863178  5931 tablet_bootstrap.cc:492] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823: No bootstrap required, opened a new log
I20260709 13:13:29.861951  5637 catalog_manager.cc:5697] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.863107  5780 leader_election.cc:304] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:29.863775  5931 ts_tablet_manager.cc:1403] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823: Time spent bootstrapping tablet: real 0.046s	user 0.006s	sys 0.011s
W20260709 13:13:29.863894  5705 leader_election.cc:343] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.864320  5705 leader_election.cc:304] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52; no voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb
I20260709 13:13:29.865391  5937 raft_consensus.cc:2749] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.866060  5956 raft_consensus.cc:2749] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.863109  5887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823" is_pre_election: true
I20260709 13:13:29.863523  5930 raft_consensus.cc:740] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.867159  5931 raft_consensus.cc:359] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.867856  5931 raft_consensus.cc:385] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.867633  5930 consensus_queue.cc:260] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
W20260709 13:13:29.868112  5780 leader_election.cc:343] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.868214  5931 raft_consensus.cc:740] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.868613  5780 leader_election.cc:304] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:29.869161  5931 consensus_queue.cc:260] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.869740  5937 raft_consensus.cc:2749] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.869928  5930 ts_tablet_manager.cc:1434] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:29.870946  5930 tablet_bootstrap.cc:492] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb: Bootstrap starting.
I20260709 13:13:29.871562  5741 raft_consensus.cc:2468] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 1.
I20260709 13:13:29.879505  5853 leader_election.cc:304] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52; no voters: eac2aed77b3d4cdb8afdc9395c47b4fb
I20260709 13:13:29.880614  5953 raft_consensus.cc:2804] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.880995  5953 raft_consensus.cc:697] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Becoming Leader. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:29.873384  5931 ts_tablet_manager.cc:1434] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:29.881807  5953 consensus_queue.cc:237] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.883373  5932 tablet_bootstrap.cc:492] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52: No bootstrap required, opened a new log
I20260709 13:13:29.876178  5930 tablet_bootstrap.cc:654] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.883849  5932 ts_tablet_manager.cc:1403] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.019s
I20260709 13:13:29.887257  5931 tablet_bootstrap.cc:492] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823: Bootstrap starting.
I20260709 13:13:29.887076  5932 raft_consensus.cc:359] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.888077  5932 raft_consensus.cc:385] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.888468  5890 raft_consensus.cc:2468] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 1.
I20260709 13:13:29.888574  5932 raft_consensus.cc:740] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.890138  5705 leader_election.cc:304] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52; no voters: eac2aed77b3d4cdb8afdc9395c47b4fb
I20260709 13:13:29.891132  5956 raft_consensus.cc:2804] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.891603  5956 raft_consensus.cc:697] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Becoming Leader. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:29.891744  5932 consensus_queue.cc:260] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.892422  5956 consensus_queue.cc:237] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.894219  5932 ts_tablet_manager.cc:1434] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 13:13:29.895205  5932 tablet_bootstrap.cc:492] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52: Bootstrap starting.
I20260709 13:13:29.897265  5931 tablet_bootstrap.cc:654] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:29.900138  5687 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:29.903419  5930 tablet_bootstrap.cc:492] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb: No bootstrap required, opened a new log
I20260709 13:13:29.904078  5930 ts_tablet_manager.cc:1403] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.004s
I20260709 13:13:29.906065  5932 tablet_bootstrap.cc:654] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.905982  5937 raft_consensus.cc:493] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.906560  5937 raft_consensus.cc:515] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.908093  5930 raft_consensus.cc:359] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.908702  5937 leader_election.cc:290] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:29.909040  5930 raft_consensus.cc:385] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.909883  5930 raft_consensus.cc:740] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.910432  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" is_pre_election: true
I20260709 13:13:29.910825  5930 consensus_queue.cc:260] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
W20260709 13:13:29.912664  5779 leader_election.cc:343] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.914804  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823" is_pre_election: true
I20260709 13:13:29.915608  5890 raft_consensus.cc:2468] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 0.
I20260709 13:13:29.917459  5780 leader_election.cc:304] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:29.917778  5953 raft_consensus.cc:493] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.918196  5953 raft_consensus.cc:515] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.921028  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" is_pre_election: true
I20260709 13:13:29.921689  5741 raft_consensus.cc:2468] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 0.
I20260709 13:13:29.921749  5937 raft_consensus.cc:2804] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.922310  5937 raft_consensus.cc:493] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.922739  5937 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.922904  5853 leader_election.cc:304] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52; no voters: 
I20260709 13:13:29.923705  5935 raft_consensus.cc:2804] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.924054  5935 raft_consensus.cc:493] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.924116  5953 leader_election.cc:290] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:29.924454  5935 raft_consensus.cc:3060] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.932161  5930 ts_tablet_manager.cc:1434] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent starting tablet: real 0.028s	user 0.013s	sys 0.004s
I20260709 13:13:29.931881  5638 catalog_manager.cc:5697] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "0efd05f9c0644d4499af913d22b6b823" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:29.933472  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" is_pre_election: true
W20260709 13:13:29.934906  5853 leader_election.cc:343] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.938488  5935 raft_consensus.cc:515] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.941308  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:29.941859  5741 raft_consensus.cc:3060] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.942615  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
W20260709 13:13:29.943969  5853 leader_election.cc:343] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.933483  5930 tablet_bootstrap.cc:492] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb: Bootstrap starting.
I20260709 13:13:29.944551  5935 leader_election.cc:290] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:29.948319  5741 raft_consensus.cc:2468] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 1.
I20260709 13:13:29.951228  5853 leader_election.cc:304] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52; no voters: eac2aed77b3d4cdb8afdc9395c47b4fb
I20260709 13:13:29.951901  5937 raft_consensus.cc:515] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.954704  5931 tablet_bootstrap.cc:492] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823: No bootstrap required, opened a new log
I20260709 13:13:29.955269  5931 ts_tablet_manager.cc:1403] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823: Time spent bootstrapping tablet: real 0.068s	user 0.034s	sys 0.032s
I20260709 13:13:29.955721  5932 tablet_bootstrap.cc:492] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52: No bootstrap required, opened a new log
I20260709 13:13:29.956182  5932 ts_tablet_manager.cc:1403] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.003s
I20260709 13:13:29.958452  5931 raft_consensus.cc:359] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.959017  5932 raft_consensus.cc:359] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.959285  5931 raft_consensus.cc:385] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.959317  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:29.959748  5932 raft_consensus.cc:385] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.960033  5890 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.960064  5932 raft_consensus.cc:740] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.961024  5932 consensus_queue.cc:260] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.962504  5937 leader_election.cc:290] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:29.963584  5932 ts_tablet_manager.cc:1434] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:29.964138  5930 tablet_bootstrap.cc:654] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.964520  5932 tablet_bootstrap.cc:492] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52: Bootstrap starting.
I20260709 13:13:29.964576  5637 catalog_manager.cc:5697] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.960103  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:29.968107  5741 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.967290  5890 raft_consensus.cc:2468] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 1.
I20260709 13:13:29.971244  5932 tablet_bootstrap.cc:654] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.971992  5780 leader_election.cc:304] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:29.972975  5937 raft_consensus.cc:2804] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.973165  5931 raft_consensus.cc:740] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.973495  5937 raft_consensus.cc:697] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 LEADER]: Becoming Leader. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Running, Role: LEADER
I20260709 13:13:29.974187  5931 consensus_queue.cc:260] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.975023  5741 raft_consensus.cc:2468] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 1.
I20260709 13:13:29.975282  5953 raft_consensus.cc:2804] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.974324  5937 consensus_queue.cc:237] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:29.983038  5931 ts_tablet_manager.cc:1434] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:13:29.985823  5931 tablet_bootstrap.cc:492] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823: Bootstrap starting.
I20260709 13:13:29.993229  5953 raft_consensus.cc:697] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Becoming Leader. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:29.994383  5953 consensus_queue.cc:237] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.004290  5930 tablet_bootstrap.cc:492] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb: No bootstrap required, opened a new log
I20260709 13:13:30.004776  5930 ts_tablet_manager.cc:1403] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent bootstrapping tablet: real 0.072s	user 0.007s	sys 0.011s
I20260709 13:13:30.003863  5636 catalog_manager.cc:5697] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2). New cstate: current_term: 1 leader_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.006853  5931 tablet_bootstrap.cc:654] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.007807  5930 raft_consensus.cc:359] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.008551  5930 raft_consensus.cc:385] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.008864  5930 raft_consensus.cc:740] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.009770  5930 consensus_queue.cc:260] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.012965  5930 ts_tablet_manager.cc:1434] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:30.014245  5930 tablet_bootstrap.cc:492] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb: Bootstrap starting.
I20260709 13:13:30.018525  5931 tablet_bootstrap.cc:492] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823: No bootstrap required, opened a new log
I20260709 13:13:30.019022  5931 ts_tablet_manager.cc:1403] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.002s
I20260709 13:13:30.021046  5930 tablet_bootstrap.cc:654] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.021781  5931 raft_consensus.cc:359] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:30.022522  5931 raft_consensus.cc:385] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.022831  5931 raft_consensus.cc:740] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.012305  5638 catalog_manager.cc:5697] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "0efd05f9c0644d4499af913d22b6b823" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:30.023716  5931 consensus_queue.cc:260] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:30.025964  5931 ts_tablet_manager.cc:1434] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:30.026793  5931 tablet_bootstrap.cc:492] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823: Bootstrap starting.
I20260709 13:13:30.032006  5931 tablet_bootstrap.cc:654] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.035122  5937 raft_consensus.cc:493] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.035749  5937 raft_consensus.cc:515] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.036783  5932 tablet_bootstrap.cc:492] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52: No bootstrap required, opened a new log
I20260709 13:13:30.037557  5932 ts_tablet_manager.cc:1403] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent bootstrapping tablet: real 0.073s	user 0.033s	sys 0.038s
I20260709 13:13:30.039624  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" is_pre_election: true
W20260709 13:13:30.041687  5779 leader_election.cc:343] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.041710  5932 raft_consensus.cc:359] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.042877  5932 raft_consensus.cc:385] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.043267  5932 raft_consensus.cc:740] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.044751  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823" is_pre_election: true
I20260709 13:13:30.044394  5932 consensus_queue.cc:260] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
W20260709 13:13:30.046657  5780 leader_election.cc:343] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.047263  5780 leader_election.cc:304] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:30.051367  5969 raft_consensus.cc:2749] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.052382  5937 leader_election.cc:290] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:30.052834  5932 ts_tablet_manager.cc:1434] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 13:13:30.054168  5932 tablet_bootstrap.cc:492] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52: Bootstrap starting.
I20260709 13:13:30.072109  5932 tablet_bootstrap.cc:654] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.072572  5931 tablet_bootstrap.cc:492] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823: No bootstrap required, opened a new log
I20260709 13:13:30.072974  5931 ts_tablet_manager.cc:1403] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.027s
I20260709 13:13:30.073619  5930 tablet_bootstrap.cc:492] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb: No bootstrap required, opened a new log
I20260709 13:13:30.074084  5930 ts_tablet_manager.cc:1403] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.036s
I20260709 13:13:30.075083  5931 raft_consensus.cc:359] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.075836  5931 raft_consensus.cc:385] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.076117  5931 raft_consensus.cc:740] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.076790  5930 raft_consensus.cc:359] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.076936  5931 consensus_queue.cc:260] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.077494  5930 raft_consensus.cc:385] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.077797  5930 raft_consensus.cc:740] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.078428  5932 tablet_bootstrap.cc:492] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52: No bootstrap required, opened a new log
I20260709 13:13:30.078876  5931 ts_tablet_manager.cc:1434] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:30.078423  5930 consensus_queue.cc:260] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.079106  5932 ts_tablet_manager.cc:1403] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.008s
I20260709 13:13:30.079854  5931 tablet_bootstrap.cc:492] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823: Bootstrap starting.
I20260709 13:13:30.080570  5930 ts_tablet_manager.cc:1434] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:30.081780  5930 tablet_bootstrap.cc:492] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb: Bootstrap starting.
I20260709 13:13:30.081872  5932 raft_consensus.cc:359] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.082623  5932 raft_consensus.cc:385] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.082916  5932 raft_consensus.cc:740] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.084702  5932 consensus_queue.cc:260] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.085883  5931 tablet_bootstrap.cc:654] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.087744  5930 tablet_bootstrap.cc:654] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.095583  5932 ts_tablet_manager.cc:1434] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.004s
I20260709 13:13:30.096681  5931 tablet_bootstrap.cc:492] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823: No bootstrap required, opened a new log
I20260709 13:13:30.097180  5931 ts_tablet_manager.cc:1403] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:13:30.099681  5931 raft_consensus.cc:359] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.100306  5931 raft_consensus.cc:385] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.100584  5931 raft_consensus.cc:740] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.100678  5932 tablet_bootstrap.cc:492] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52: Bootstrap starting.
I20260709 13:13:30.102397  5931 consensus_queue.cc:260] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.103464  5930 tablet_bootstrap.cc:492] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb: No bootstrap required, opened a new log
I20260709 13:13:30.103928  5930 ts_tablet_manager.cc:1403] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.012s
I20260709 13:13:30.104602  5931 ts_tablet_manager.cc:1434] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:13:30.106350  5930 raft_consensus.cc:359] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.107028  5932 tablet_bootstrap.cc:654] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.107010  5930 raft_consensus.cc:385] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.107506  5930 raft_consensus.cc:740] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.108196  5930 consensus_queue.cc:260] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.110479  5930 ts_tablet_manager.cc:1434] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:13:30.111596  5930 tablet_bootstrap.cc:492] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb: Bootstrap starting.
I20260709 13:13:30.113341  5932 tablet_bootstrap.cc:492] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52: No bootstrap required, opened a new log
I20260709 13:13:30.113742  5932 ts_tablet_manager.cc:1403] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:13:30.116230  5932 raft_consensus.cc:359] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.116852  5932 raft_consensus.cc:385] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.117117  5932 raft_consensus.cc:740] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.117239  5930 tablet_bootstrap.cc:654] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.117944  5932 consensus_queue.cc:260] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.119932  5932 ts_tablet_manager.cc:1434] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:30.120765  5932 tablet_bootstrap.cc:492] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52: Bootstrap starting.
I20260709 13:13:30.126253  5932 tablet_bootstrap.cc:654] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.127099  5930 tablet_bootstrap.cc:492] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb: No bootstrap required, opened a new log
I20260709 13:13:30.127517  5930 ts_tablet_manager.cc:1403] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:13:30.129490  5930 raft_consensus.cc:359] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.130004  5930 raft_consensus.cc:385] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.130270  5930 raft_consensus.cc:740] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.130846  5930 consensus_queue.cc:260] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.132604  5930 ts_tablet_manager.cc:1434] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:13:30.134824  5953 raft_consensus.cc:493] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.135274  5953 raft_consensus.cc:515] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.135934  5932 tablet_bootstrap.cc:492] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52: No bootstrap required, opened a new log
I20260709 13:13:30.136363  5932 ts_tablet_manager.cc:1403] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 13:13:30.137243  5953 leader_election.cc:290] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:30.138720  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f34fa88da342b2a101928690d11819" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" is_pre_election: true
I20260709 13:13:30.138986  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f34fa88da342b2a101928690d11819" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" is_pre_election: true
I20260709 13:13:30.138934  5932 raft_consensus.cc:359] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:30.139360  5741 raft_consensus.cc:2468] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 0.
I20260709 13:13:30.139652  5932 raft_consensus.cc:385] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.139633  5816 raft_consensus.cc:2468] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 0.
I20260709 13:13:30.140062  5932 raft_consensus.cc:740] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.140914  5853 leader_election.cc:304] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.140725  5932 consensus_queue.cc:260] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:30.141680  5953 raft_consensus.cc:2804] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.141868  5937 raft_consensus.cc:493] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.142074  5953 raft_consensus.cc:493] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.142431  5953 raft_consensus.cc:3060] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.142336  5937 raft_consensus.cc:515] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.144345  5937 leader_election.cc:290] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:30.144615  5932 ts_tablet_manager.cc:1434] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:30.145861  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823" is_pre_election: true
I20260709 13:13:30.146427  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" is_pre_election: true
I20260709 13:13:30.147138  5741 raft_consensus.cc:2393] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eac2aed77b3d4cdb8afdc9395c47b4fb in current term 1: Already voted for candidate 0efd05f9c0644d4499af913d22b6b823 in this term.
I20260709 13:13:30.148221  5779 leader_election.cc:304] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:30.149312  5937 raft_consensus.cc:3060] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.149024  5953 raft_consensus.cc:515] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.151086  5953 leader_election.cc:290] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:30.153647  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f34fa88da342b2a101928690d11819" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:30.154150  5816 raft_consensus.cc:3060] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.155723  5937 raft_consensus.cc:2749] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.157781  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f34fa88da342b2a101928690d11819" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:30.158223  5741 raft_consensus.cc:3060] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.159000  5816 raft_consensus.cc:2468] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 1.
I20260709 13:13:30.159907  5853 leader_election.cc:304] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.160552  5953 raft_consensus.cc:2804] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.161056  5953 raft_consensus.cc:697] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Becoming Leader. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:30.161911  5953 consensus_queue.cc:237] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.164012  5741 raft_consensus.cc:2468] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 1.
I20260709 13:13:30.165607  5937 raft_consensus.cc:493] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.166137  5937 raft_consensus.cc:515] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.167870  5937 leader_election.cc:290] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:30.168853  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d869fcf1b946be8e0b4cdc1700cbad" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823" is_pre_election: true
I20260709 13:13:30.169376  5890 raft_consensus.cc:2468] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 0.
I20260709 13:13:30.170233  5780 leader_election.cc:304] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.169793  5638 catalog_manager.cc:5697] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "0efd05f9c0644d4499af913d22b6b823" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:30.170996  5937 raft_consensus.cc:2804] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.171293  5937 raft_consensus.cc:493] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.171564  5937 raft_consensus.cc:3060] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.172470  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d869fcf1b946be8e0b4cdc1700cbad" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" is_pre_election: true
I20260709 13:13:30.172956  5741 raft_consensus.cc:2468] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 0.
I20260709 13:13:30.177510  5937 raft_consensus.cc:515] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.179486  5937 leader_election.cc:290] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:30.180166  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d869fcf1b946be8e0b4cdc1700cbad" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:30.180449  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d869fcf1b946be8e0b4cdc1700cbad" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:30.180716  5741 raft_consensus.cc:3060] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.180986  5890 raft_consensus.cc:3060] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.181607  5953 raft_consensus.cc:493] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.182014  5953 raft_consensus.cc:515] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.183638  5953 leader_election.cc:290] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:30.184250  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" is_pre_election: true
I20260709 13:13:30.184724  5740 raft_consensus.cc:2468] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 0.
I20260709 13:13:30.185817  5853 leader_election.cc:304] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52; no voters: 
I20260709 13:13:30.186443  5953 raft_consensus.cc:2804] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.186789  5953 raft_consensus.cc:493] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.186678  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" is_pre_election: true
I20260709 13:13:30.187168  5953 raft_consensus.cc:3060] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.187150  5890 raft_consensus.cc:2468] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 1.
I20260709 13:13:30.187337  5816 raft_consensus.cc:2468] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 0.
I20260709 13:13:30.187150  5741 raft_consensus.cc:2468] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 1.
I20260709 13:13:30.188704  5780 leader_election.cc:304] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.189491  5937 raft_consensus.cc:2804] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.189851  5937 raft_consensus.cc:697] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 LEADER]: Becoming Leader. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Running, Role: LEADER
I20260709 13:13:30.190577  5937 consensus_queue.cc:237] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.192816  5953 raft_consensus.cc:515] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.195379  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:30.195652  5953 leader_election.cc:290] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:30.195887  5741 raft_consensus.cc:3060] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.196681  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:30.197188  5816 raft_consensus.cc:3060] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.198686  5638 catalog_manager.cc:5697] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2). New cstate: current_term: 1 leader_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.201426  5816 raft_consensus.cc:2468] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 1.
I20260709 13:13:30.202118  5741 raft_consensus.cc:2468] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 1.
I20260709 13:13:30.202498  5853 leader_election.cc:304] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.203205  5953 raft_consensus.cc:2804] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.203572  5953 raft_consensus.cc:697] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Becoming Leader. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:30.204252  5953 consensus_queue.cc:237] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.211742  5638 catalog_manager.cc:5697] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "0efd05f9c0644d4499af913d22b6b823" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:30.299618  5956 consensus_queue.cc:1048] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.311147  5958 consensus_queue.cc:1048] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.314248  5953 consensus_queue.cc:1048] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.327766  5935 consensus_queue.cc:1048] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.346810  5937 raft_consensus.cc:493] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.347211  5937 raft_consensus.cc:515] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.348737  5937 leader_election.cc:290] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:30.349398  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50dc05011a0345a59c00b22bdc1f0b4f" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" is_pre_election: true
I20260709 13:13:30.349682  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50dc05011a0345a59c00b22bdc1f0b4f" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823" is_pre_election: true
I20260709 13:13:30.350329  5890 raft_consensus.cc:2393] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eac2aed77b3d4cdb8afdc9395c47b4fb in current term 1: Already voted for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in this term.
I20260709 13:13:30.351150  5780 leader_election.cc:304] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:30.351780  5937 raft_consensus.cc:3060] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.356348  5937 raft_consensus.cc:2749] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.384184  5935 raft_consensus.cc:493] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.384685  5935 raft_consensus.cc:515] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:30.386276  5935 leader_election.cc:290] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823)
I20260709 13:13:30.387099  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" is_pre_election: true
I20260709 13:13:30.387233  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" is_pre_election: true
I20260709 13:13:30.387638  5816 raft_consensus.cc:2468] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 0.
I20260709 13:13:30.387778  5741 raft_consensus.cc:2468] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 0.
I20260709 13:13:30.388612  5853 leader_election.cc:304] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.389308  5935 raft_consensus.cc:2804] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.389617  5935 raft_consensus.cc:493] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.389882  5935 raft_consensus.cc:3060] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.394276  5935 raft_consensus.cc:515] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:30.395732  5935 leader_election.cc:290] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823)
I20260709 13:13:30.396534  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:30.396744  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:30.397177  5816 raft_consensus.cc:3060] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.397275  5741 raft_consensus.cc:3060] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.397800  5958 raft_consensus.cc:493] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.398248  5958 raft_consensus.cc:515] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.399430  5938 consensus_queue.cc:1048] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.400246  5958 leader_election.cc:290] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:30.402158  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" is_pre_election: true
I20260709 13:13:30.402319  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823" is_pre_election: true
I20260709 13:13:30.402771  5814 raft_consensus.cc:2468] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 0.
I20260709 13:13:30.402833  5890 raft_consensus.cc:2468] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 0.
I20260709 13:13:30.404075  5704 leader_election.cc:304] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.403589  5816 raft_consensus.cc:2468] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 1.
I20260709 13:13:30.405530  5958 raft_consensus.cc:2804] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.405900  5958 raft_consensus.cc:493] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.406400  5958 raft_consensus.cc:3060] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.406168  5853 leader_election.cc:304] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.407945  5935 raft_consensus.cc:2804] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.408851  5935 raft_consensus.cc:697] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Becoming Leader. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:30.409708  5935 consensus_queue.cc:237] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:30.413515  5958 raft_consensus.cc:515] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.403589  5741 raft_consensus.cc:2468] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 1.
I20260709 13:13:30.416706  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:30.417282  5816 raft_consensus.cc:3060] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.418005  5958 leader_election.cc:290] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:30.418717  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:30.419502  5890 raft_consensus.cc:3060] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.423377  5816 raft_consensus.cc:2468] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 1.
I20260709 13:13:30.424597  5704 leader_election.cc:304] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.426062  5958 raft_consensus.cc:2804] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.426663  5958 raft_consensus.cc:697] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Becoming Leader. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:30.427635  5958 consensus_queue.cc:237] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.430075  5890 raft_consensus.cc:2468] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 1.
I20260709 13:13:30.438455  5638 catalog_manager.cc:5697] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "0efd05f9c0644d4499af913d22b6b823" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.440201  5958 consensus_queue.cc:1048] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.442524  5637 catalog_manager.cc:5697] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.454238  5937 raft_consensus.cc:493] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.454762  5937 raft_consensus.cc:515] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.457060  5937 leader_election.cc:290] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:30.458649  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" is_pre_election: true
I20260709 13:13:30.459038  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efd05f9c0644d4499af913d22b6b823" is_pre_election: true
I20260709 13:13:30.459448  5741 raft_consensus.cc:2393] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eac2aed77b3d4cdb8afdc9395c47b4fb in current term 1: Already voted for candidate 0efd05f9c0644d4499af913d22b6b823 in this term.
I20260709 13:13:30.461943  5780 leader_election.cc:304] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:30.463080  5969 raft_consensus.cc:3060] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.466295  5937 consensus_queue.cc:1048] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.470335  5969 raft_consensus.cc:2749] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.481828  5935 consensus_queue.cc:1048] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.483127  5969 consensus_queue.cc:1048] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.514176  5974 consensus_queue.cc:1048] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:30.517678  5890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
mode: GRACEFUL
new_leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:39376
I20260709 13:13:30.518441  5890 raft_consensus.cc:606] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Received request to transfer leadership to TS ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:30.532979  5816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8"
dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
mode: GRACEFUL
new_leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:34156
I20260709 13:13:30.533470  5816 raft_consensus.cc:606] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 LEADER]: Received request to transfer leadership to TS ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:30.540216  5890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
mode: GRACEFUL
new_leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:39376
I20260709 13:13:30.540648  5890 raft_consensus.cc:606] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Received request to transfer leadership to TS ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:30.544660  5890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20f34fa88da342b2a101928690d11819"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
mode: GRACEFUL
new_leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:39376
I20260709 13:13:30.545060  5890 raft_consensus.cc:606] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Received request to transfer leadership to TS ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:30.549408  5890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
mode: GRACEFUL
new_leader_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
 from {username='slave'} at 127.0.0.1:39376
I20260709 13:13:30.549827  5890 raft_consensus.cc:606] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Received request to transfer leadership to TS eac2aed77b3d4cdb8afdc9395c47b4fb
I20260709 13:13:30.556656  5890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
mode: GRACEFUL
new_leader_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
 from {username='slave'} at 127.0.0.1:39376
I20260709 13:13:30.557194  5890 raft_consensus.cc:606] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Received request to transfer leadership to TS eac2aed77b3d4cdb8afdc9395c47b4fb
I20260709 13:13:30.568498  5741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50dc05011a0345a59c00b22bdc1f0b4f"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
mode: GRACEFUL
new_leader_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
 from {username='slave'} at 127.0.0.1:60764
I20260709 13:13:30.568989  5741 raft_consensus.cc:606] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Received request to transfer leadership to TS eac2aed77b3d4cdb8afdc9395c47b4fb
I20260709 13:13:30.573534  5741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
mode: GRACEFUL
new_leader_uuid: "0efd05f9c0644d4499af913d22b6b823"
 from {username='slave'} at 127.0.0.1:60764
I20260709 13:13:30.574002  5741 raft_consensus.cc:606] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Received request to transfer leadership to TS 0efd05f9c0644d4499af913d22b6b823
I20260709 13:13:30.596882  5974 consensus_queue.cc:1048] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.606875  5935 consensus_queue.cc:1048] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.613790  5953 raft_consensus.cc:993] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823: : Instructing follower ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:30.614266  5935 raft_consensus.cc:1081] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Signalling peer ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:30.615692  5741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20f34fa88da342b2a101928690d11819"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:60756
I20260709 13:13:30.616132  5741 raft_consensus.cc:493] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.616428  5741 raft_consensus.cc:3060] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.620780  5741 raft_consensus.cc:515] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.622722  5741 leader_election.cc:290] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 2 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:30.623034  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f34fa88da342b2a101928690d11819" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:30.623272  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f34fa88da342b2a101928690d11819" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:30.623611  5816 raft_consensus.cc:3060] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.623778  5890 raft_consensus.cc:3055] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.624114  5890 raft_consensus.cc:740] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:30.624886  5890 consensus_queue.cc:260] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.626129  5890 raft_consensus.cc:3060] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.630173  5816 raft_consensus.cc:2468] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 2.
I20260709 13:13:30.631259  5704 leader_election.cc:304] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.631917  5958 raft_consensus.cc:2804] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:30.632414  5958 raft_consensus.cc:697] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Becoming Leader. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:30.632346  5890 raft_consensus.cc:2468] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 2.
I20260709 13:13:30.633363  5958 consensus_queue.cc:237] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.639240  5935 consensus_queue.cc:1048] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.639773  5638 catalog_manager.cc:5697] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 reported cstate change: term changed from 1 to 2, leader changed from 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3) to ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.650247  5974 consensus_queue.cc:1048] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.657296  5953 raft_consensus.cc:993] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823: : Instructing follower eac2aed77b3d4cdb8afdc9395c47b4fb to start an election
I20260709 13:13:30.657738  5953 raft_consensus.cc:1081] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Signalling peer eac2aed77b3d4cdb8afdc9395c47b4fb to start an election
I20260709 13:13:30.659281  5816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e"
dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
 from {username='slave'} at 127.0.0.1:34148
I20260709 13:13:30.659822  5816 raft_consensus.cc:493] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.660174  5816 raft_consensus.cc:3060] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.664767  5816 raft_consensus.cc:515] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.666761  5816 leader_election.cc:290] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 2 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:30.667109  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:30.667337  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:30.667683  5741 raft_consensus.cc:3060] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.667917  5890 raft_consensus.cc:3055] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.668169  5890 raft_consensus.cc:740] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:30.668768  5890 consensus_queue.cc:260] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.669646  5890 raft_consensus.cc:3060] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.673075  5741 raft_consensus.cc:2468] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 2.
I20260709 13:13:30.674124  5779 leader_election.cc:304] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.674597  5890 raft_consensus.cc:2468] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 2.
I20260709 13:13:30.674804  5937 raft_consensus.cc:2804] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:30.675279  5937 raft_consensus.cc:697] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 LEADER]: Becoming Leader. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Running, Role: LEADER
I20260709 13:13:30.676066  5937 consensus_queue.cc:237] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.681783  5638 catalog_manager.cc:5697] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb reported cstate change: term changed from 1 to 2, leader changed from 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3) to eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2). New cstate: current_term: 2 leader_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.684207  5937 consensus_queue.cc:1048] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.695853  5969 consensus_queue.cc:1048] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.726229  5974 raft_consensus.cc:993] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823: : Instructing follower eac2aed77b3d4cdb8afdc9395c47b4fb to start an election
I20260709 13:13:30.726643  5953 raft_consensus.cc:1081] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Signalling peer eac2aed77b3d4cdb8afdc9395c47b4fb to start an election
I20260709 13:13:30.727921  5816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0"
dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
 from {username='slave'} at 127.0.0.1:34148
I20260709 13:13:30.728380  5816 raft_consensus.cc:493] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.728689  5816 raft_consensus.cc:3060] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.733103  5816 raft_consensus.cc:515] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.734612  5816 leader_election.cc:290] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 2 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:30.735387  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:30.735596  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:30.735945  5741 raft_consensus.cc:3060] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.736109  5890 raft_consensus.cc:3055] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.736624  5890 raft_consensus.cc:740] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:30.737432  5890 consensus_queue.cc:260] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.738337  5890 raft_consensus.cc:3060] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.740525  5741 raft_consensus.cc:2468] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 2.
I20260709 13:13:30.741446  5779 leader_election.cc:304] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.742101  5937 raft_consensus.cc:2804] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:30.742481  5937 raft_consensus.cc:697] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 LEADER]: Becoming Leader. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Running, Role: LEADER
I20260709 13:13:30.743101  5890 raft_consensus.cc:2468] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 2.
I20260709 13:13:30.743211  5937 consensus_queue.cc:237] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.749397  5637 catalog_manager.cc:5697] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb reported cstate change: term changed from 1 to 2, leader changed from 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3) to eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2). New cstate: current_term: 2 leader_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.898162  5938 consensus_queue.cc:1048] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.911442  5938 consensus_queue.cc:1048] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.919193  5956 raft_consensus.cc:993] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52: : Instructing follower 0efd05f9c0644d4499af913d22b6b823 to start an election
I20260709 13:13:30.919646  5956 raft_consensus.cc:1081] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Signalling peer 0efd05f9c0644d4499af913d22b6b823 to start an election
I20260709 13:13:30.921080  5890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
 from {username='slave'} at 127.0.0.1:39356
I20260709 13:13:30.921629  5890 raft_consensus.cc:493] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.921995  5890 raft_consensus.cc:3060] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.924927  5956 raft_consensus.cc:993] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52: : Instructing follower eac2aed77b3d4cdb8afdc9395c47b4fb to start an election
I20260709 13:13:30.925441  5938 raft_consensus.cc:1081] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Signalling peer eac2aed77b3d4cdb8afdc9395c47b4fb to start an election
I20260709 13:13:30.927058  5816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50dc05011a0345a59c00b22bdc1f0b4f"
dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
 from {username='slave'} at 127.0.0.1:34140
I20260709 13:13:30.927558  5816 raft_consensus.cc:493] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.927877  5816 raft_consensus.cc:3060] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.928699  5890 raft_consensus.cc:515] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.931221  5890 leader_election.cc:290] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 2 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:30.932250  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:30.932812  5814 raft_consensus.cc:3060] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.932991  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:30.933599  5741 raft_consensus.cc:3055] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.933504  5816 raft_consensus.cc:515] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.933931  5741 raft_consensus.cc:740] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:30.934710  5741 consensus_queue.cc:260] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.935909  5741 raft_consensus.cc:3060] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.936519  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50dc05011a0345a59c00b22bdc1f0b4f" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:30.936875  5816 leader_election.cc:290] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 2 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:30.937045  5890 raft_consensus.cc:3060] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.939363  5814 raft_consensus.cc:2468] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 2.
I20260709 13:13:30.941736  5853 leader_election.cc:304] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.942582  5953 raft_consensus.cc:2804] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:30.943043  5953 raft_consensus.cc:697] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 2 LEADER]: Becoming Leader. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:30.943250  5741 raft_consensus.cc:2468] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 2.
I20260709 13:13:30.943881  5890 raft_consensus.cc:2468] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 2.
I20260709 13:13:30.943861  5953 consensus_queue.cc:237] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.945089  5780 leader_election.cc:304] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.945892  6013 raft_consensus.cc:2804] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:30.946396  6013 raft_consensus.cc:697] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 LEADER]: Becoming Leader. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Running, Role: LEADER
I20260709 13:13:30.947155  6013 consensus_queue.cc:237] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.947741  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50dc05011a0345a59c00b22bdc1f0b4f" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:30.948097  5969 raft_consensus.cc:993] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb: : Instructing follower ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:30.948246  5741 raft_consensus.cc:3055] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.948511  5969 raft_consensus.cc:1081] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 LEADER]: Signalling peer ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:30.948647  5741 raft_consensus.cc:740] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:30.949527  5741 consensus_queue.cc:260] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.950241  5740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:60750
I20260709 13:13:30.950676  5741 raft_consensus.cc:3060] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.950767  5740 raft_consensus.cc:493] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.951201  5740 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.955977  5741 raft_consensus.cc:2468] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 2.
I20260709 13:13:30.956656  5638 catalog_manager.cc:5697] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb reported cstate change: term changed from 1 to 2, leader changed from ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1) to eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2). New cstate: current_term: 2 leader_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.956600  5740 raft_consensus.cc:515] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.959671  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:30.960202  5814 raft_consensus.cc:3055] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.960647  5814 raft_consensus.cc:740] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Running, Role: LEADER
I20260709 13:13:30.960249  5740 leader_election.cc:290] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 2 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:30.960883  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:30.961198  5637 catalog_manager.cc:5697] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 reported cstate change: term changed from 1 to 2, leader changed from ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1) to 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "0efd05f9c0644d4499af913d22b6b823" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:30.962072  5890 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.961448  5814 consensus_queue.cc:260] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.963081  5814 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.969511  5814 raft_consensus.cc:2468] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 2.
I20260709 13:13:30.971596  5704 leader_election.cc:304] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:30.972229  5938 raft_consensus.cc:2804] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:30.972635  5938 raft_consensus.cc:697] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Becoming Leader. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:30.973003  5890 raft_consensus.cc:2468] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 2.
I20260709 13:13:30.973436  5938 consensus_queue.cc:237] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:30.979382  5953 consensus_queue.cc:1048] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.981463  5637 catalog_manager.cc:5697] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 reported cstate change: term changed from 1 to 2, leader changed from eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2) to ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.986555  5935 raft_consensus.cc:993] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823: : Instructing follower ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:30.986999  5974 raft_consensus.cc:1081] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Signalling peer ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:30.989939  5741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:60756
I20260709 13:13:30.990535  5741 raft_consensus.cc:493] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.990885  5741 raft_consensus.cc:3060] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.991379  5974 consensus_queue.cc:1048] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.997301  5741 raft_consensus.cc:515] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:30.998236  5740 raft_consensus.cc:1240] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Rejecting Update request from peer 0efd05f9c0644d4499af913d22b6b823 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:30.999707  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:31.000296  5816 raft_consensus.cc:3060] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.002595  5974 consensus_queue.cc:1059] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.003348  5974 raft_consensus.cc:3055] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:31.003656  5974 raft_consensus.cc:740] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:31.005340  5974 consensus_queue.cc:260] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:31.006093  5974 raft_consensus.cc:3060] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.006239  5816 raft_consensus.cc:2468] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 2.
I20260709 13:13:31.007336  5704 leader_election.cc:304] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:31.008309  5890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:31.008955  5741 leader_election.cc:290] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 2 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:31.009392  5938 raft_consensus.cc:2804] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:31.009876  5938 raft_consensus.cc:697] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Becoming Leader. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:31.010703  5938 consensus_queue.cc:237] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:31.017884  5638 catalog_manager.cc:5697] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 reported cstate change: term changed from 1 to 2, leader changed from 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3) to ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:31.018448  5890 raft_consensus.cc:2468] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 2.
I20260709 13:13:31.118906  5953 raft_consensus.cc:993] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823: : Instructing follower ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:31.119400  5974 raft_consensus.cc:1081] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Signalling peer ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:31.120829  5741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:60756
I20260709 13:13:31.120846  5816 raft_consensus.cc:1275] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.121336  5741 raft_consensus.cc:493] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:31.121627  5741 raft_consensus.cc:3060] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.122171  5938 consensus_queue.cc:1048] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.126663  5741 raft_consensus.cc:515] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:31.128366  5741 leader_election.cc:290] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 2 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:31.129899  5887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:31.130169  5890 raft_consensus.cc:1275] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.130424  5887 raft_consensus.cc:3055] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:31.130800  5887 raft_consensus.cc:740] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:31.131558  5887 consensus_queue.cc:260] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:31.132721  5887 raft_consensus.cc:3060] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.133906  5956 consensus_queue.cc:1048] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.138935  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:31.140635  5814 raft_consensus.cc:3060] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.142958  5890 raft_consensus.cc:1275] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Refusing update from remote peer eac2aed77b3d4cdb8afdc9395c47b4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.144316  5937 consensus_queue.cc:1048] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.145601  5887 raft_consensus.cc:2468] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 2.
I20260709 13:13:31.146806  5705 leader_election.cc:304] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52; no voters: 
I20260709 13:13:31.147294  5814 raft_consensus.cc:2468] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 2.
I20260709 13:13:31.147586  5958 raft_consensus.cc:2804] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:31.148049  5958 raft_consensus.cc:697] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Becoming Leader. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:31.148839  5958 consensus_queue.cc:237] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:31.153887  5741 raft_consensus.cc:1275] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Refusing update from remote peer eac2aed77b3d4cdb8afdc9395c47b4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.155135  6013 consensus_queue.cc:1048] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.161432  5637 catalog_manager.cc:5697] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 reported cstate change: term changed from 1 to 2, leader changed from 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3) to ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.224134  5887 raft_consensus.cc:1275] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Refusing update from remote peer eac2aed77b3d4cdb8afdc9395c47b4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.225296  6013 consensus_queue.cc:1048] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.232021  5741 raft_consensus.cc:1275] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Refusing update from remote peer eac2aed77b3d4cdb8afdc9395c47b4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.233618  5937 consensus_queue.cc:1048] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.359431  5814 raft_consensus.cc:1275] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.360707  5958 consensus_queue.cc:1048] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.367522  5887 raft_consensus.cc:1275] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.369969  5956 consensus_queue.cc:1048] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.401374  5741 raft_consensus.cc:1275] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Refusing update from remote peer 0efd05f9c0644d4499af913d22b6b823: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.402535  5974 consensus_queue.cc:1048] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.405818  5814 raft_consensus.cc:1275] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Refusing update from remote peer 0efd05f9c0644d4499af913d22b6b823: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.406658  5887 raft_consensus.cc:1275] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Refusing update from remote peer eac2aed77b3d4cdb8afdc9395c47b4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.407307  5953 consensus_queue.cc:1048] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.408030  5937 consensus_queue.cc:1048] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.421636  5741 raft_consensus.cc:1275] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Refusing update from remote peer eac2aed77b3d4cdb8afdc9395c47b4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.423281  5937 consensus_queue.cc:1048] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.468557  5890 raft_consensus.cc:1275] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.469849  5956 consensus_queue.cc:1048] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.476779  5814 raft_consensus.cc:1275] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.478134  5956 consensus_queue.cc:1048] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.619076  5814 raft_consensus.cc:1275] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.620299  5956 consensus_queue.cc:1048] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.628429  5890 raft_consensus.cc:1275] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.629581  5938 consensus_queue.cc:1048] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.603674  5112 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:13:33.604420  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:33.618888  5741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
mode: GRACEFUL
new_leader_uuid: "0efd05f9c0644d4499af913d22b6b823"
 from {username='slave'} at 127.0.0.1:60772
I20260709 13:13:33.619354  5741 raft_consensus.cc:606] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Received request to transfer leadership to TS 0efd05f9c0644d4499af913d22b6b823
I20260709 13:13:33.621423  5741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
mode: GRACEFUL
new_leader_uuid: "0efd05f9c0644d4499af913d22b6b823"
 from {username='slave'} at 127.0.0.1:60772
I20260709 13:13:33.621831  5741 raft_consensus.cc:606] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Received request to transfer leadership to TS 0efd05f9c0644d4499af913d22b6b823
I20260709 13:13:33.622738  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:33.623183  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:33.638284  5956 raft_consensus.cc:993] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52: : Instructing follower 0efd05f9c0644d4499af913d22b6b823 to start an election
I20260709 13:13:33.638783  6026 raft_consensus.cc:1081] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Signalling peer 0efd05f9c0644d4499af913d22b6b823 to start an election
I20260709 13:13:33.640360  5890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
 from {username='slave'} at 127.0.0.1:39356
I20260709 13:13:33.640914  5890 raft_consensus.cc:493] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.641297  5890 raft_consensus.cc:3060] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.654309  5890 raft_consensus.cc:515] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:33.657428  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:33.657706  5890 leader_election.cc:290] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 3 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:33.658061  5741 raft_consensus.cc:3055] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:33.658371  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:33.658958  5814 raft_consensus.cc:3060] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.658407  5741 raft_consensus.cc:740] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:33.659937  5741 consensus_queue.cc:260] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:33.661115  5741 raft_consensus.cc:3060] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.667567  5741 raft_consensus.cc:2468] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 3.
I20260709 13:13:33.668951  5853 leader_election.cc:304] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52; no voters: 
I20260709 13:13:33.669835  6019 raft_consensus.cc:2804] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:33.670305  5814 raft_consensus.cc:2468] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 3.
I20260709 13:13:33.672178  6019 raft_consensus.cc:697] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Becoming Leader. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:33.673048  6019 consensus_queue.cc:237] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:34.575439  5740 raft_consensus.cc:1275] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Refusing update from remote peer 0efd05f9c0644d4499af913d22b6b823: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:34.578544  6034 consensus_queue.cc:1048] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:34.587983  5814 raft_consensus.cc:1275] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Refusing update from remote peer 0efd05f9c0644d4499af913d22b6b823: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:34.589779  6019 consensus_queue.cc:1048] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:34.632249  5637 catalog_manager.cc:5697] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 reported cstate change: term changed from 2 to 3, leader changed from ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1) to 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "0efd05f9c0644d4499af913d22b6b823" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.648065  6029 raft_consensus.cc:993] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52: : Instructing follower 0efd05f9c0644d4499af913d22b6b823 to start an election
I20260709 13:13:34.648506  6029 raft_consensus.cc:1081] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Signalling peer 0efd05f9c0644d4499af913d22b6b823 to start an election
I20260709 13:13:34.650104  5888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
 from {username='slave'} at 127.0.0.1:39356
I20260709 13:13:34.650818  5888 raft_consensus.cc:493] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:34.651264  5888 raft_consensus.cc:3060] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.659991  5888 raft_consensus.cc:515] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:34.662185  5888 leader_election.cc:290] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 3 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823)
I20260709 13:13:34.662866  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:34.663583  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:34.664175  5741 raft_consensus.cc:3055] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:34.664470  5741 raft_consensus.cc:740] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:34.664683  5814 raft_consensus.cc:3060] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.665292  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:34.665197  5741 consensus_queue.cc:260] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:34.665972  5741 raft_consensus.cc:3060] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.671277  5814 raft_consensus.cc:2468] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 3.
I20260709 13:13:34.672765  5853 leader_election.cc:304] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:34.673691  6034 raft_consensus.cc:2804] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:34.673841  5741 raft_consensus.cc:2468] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 3.
I20260709 13:13:34.674238  6034 raft_consensus.cc:697] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Becoming Leader. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:34.675180  6034 consensus_queue.cc:237] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:34.681097  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:34.684412  5638 catalog_manager.cc:5697] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 reported cstate change: term changed from 2 to 3, leader changed from ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1) to 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "0efd05f9c0644d4499af913d22b6b823" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.689751  5741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
mode: GRACEFUL
new_leader_uuid: "0efd05f9c0644d4499af913d22b6b823"
 from {username='slave'} at 127.0.0.1:60772
I20260709 13:13:34.690199  5741 raft_consensus.cc:606] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Received request to transfer leadership to TS 0efd05f9c0644d4499af913d22b6b823
I20260709 13:13:34.691396  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:13:34.691802  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:13:34.710008  5670 debug-util.cc:398] Leaking SignalData structure 0x7b08000510e0 after lost signal to thread 5115
W20260709 13:13:34.710853  5670 debug-util.cc:398] Leaking SignalData structure 0x7b08000517c0 after lost signal to thread 5673
W20260709 13:13:34.711637  5670 debug-util.cc:398] Leaking SignalData structure 0x7b080012e820 after lost signal to thread 5765
W20260709 13:13:34.712409  5670 debug-util.cc:398] Leaking SignalData structure 0x7b08000988e0 after lost signal to thread 5840
W20260709 13:13:34.713097  5670 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9fa0 after lost signal to thread 5914
I20260709 13:13:34.903504  6033 raft_consensus.cc:993] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52: : Instructing follower 0efd05f9c0644d4499af913d22b6b823 to start an election
I20260709 13:13:34.903954  6026 raft_consensus.cc:1081] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Signalling peer 0efd05f9c0644d4499af913d22b6b823 to start an election
I20260709 13:13:34.905522  5888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
 from {username='slave'} at 127.0.0.1:39356
I20260709 13:13:34.905992  5888 raft_consensus.cc:493] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:34.906370  5888 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.910825  5888 raft_consensus.cc:515] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:34.912504  5888 leader_election.cc:290] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 3 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:34.913654  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:34.913731  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:34.914103  5741 raft_consensus.cc:3055] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:34.914359  5814 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.914443  5741 raft_consensus.cc:740] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:34.915231  5741 consensus_queue.cc:260] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:34.915966  5741 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.920065  5741 raft_consensus.cc:2468] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 3.
I20260709 13:13:34.921114  5853 leader_election.cc:304] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52; no voters: 
I20260709 13:13:34.921522  5814 raft_consensus.cc:2468] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 3.
I20260709 13:13:34.921861  6034 raft_consensus.cc:2804] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:34.922436  6034 raft_consensus.cc:697] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Becoming Leader. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:34.923266  6034 consensus_queue.cc:237] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:34.935199  5638 catalog_manager.cc:5697] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 reported cstate change: term changed from 2 to 3, leader changed from ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1) to 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "0efd05f9c0644d4499af913d22b6b823" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:35.116714  5741 raft_consensus.cc:1275] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Refusing update from remote peer 0efd05f9c0644d4499af913d22b6b823: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:35.118052  6034 consensus_queue.cc:1048] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:35.127128  5814 raft_consensus.cc:1275] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Refusing update from remote peer 0efd05f9c0644d4499af913d22b6b823: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:35.128575  6043 consensus_queue.cc:1048] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:35.357095  5814 raft_consensus.cc:1275] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Refusing update from remote peer 0efd05f9c0644d4499af913d22b6b823: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:35.358520  6043 consensus_queue.cc:1048] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:35.366683  5741 raft_consensus.cc:1275] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Refusing update from remote peer 0efd05f9c0644d4499af913d22b6b823: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:35.368104  6034 consensus_queue.cc:1048] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:35.692616  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:35.701592  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:35.722599  5888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
mode: GRACEFUL
new_leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:34750
I20260709 13:13:35.723204  5888 raft_consensus.cc:606] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 2 LEADER]: Received request to transfer leadership to TS ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:35.724601  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:13:35.725324  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:35.934051  6043 raft_consensus.cc:993] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823: : Instructing follower ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:35.934510  6034 raft_consensus.cc:1081] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 2 LEADER]: Signalling peer ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:35.935842  5741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:60756
I20260709 13:13:35.936273  5741 raft_consensus.cc:493] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.936554  5741 raft_consensus.cc:3060] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.940435  5741 raft_consensus.cc:515] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:35.941813  5741 leader_election.cc:290] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 3 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:35.943517  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:35.943849  5888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:35.944140  5814 raft_consensus.cc:3060] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.944397  5888 raft_consensus.cc:3055] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:35.944749  5888 raft_consensus.cc:740] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:35.945503  5888 consensus_queue.cc:260] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:35.946396  5888 raft_consensus.cc:3060] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.950790  5888 raft_consensus.cc:2468] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 3.
I20260709 13:13:35.951500  5814 raft_consensus.cc:2468] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 3.
I20260709 13:13:35.952021  5705 leader_election.cc:304] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52; no voters: 
I20260709 13:13:35.952786  6026 raft_consensus.cc:2804] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:35.953748  6026 raft_consensus.cc:697] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 LEADER]: Becoming Leader. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:35.954612  6026 consensus_queue.cc:237] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:35.962378  5638 catalog_manager.cc:5697] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 reported cstate change: term changed from 2 to 3, leader changed from 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3) to ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1). New cstate: current_term: 3 leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.399916  5888 raft_consensus.cc:1275] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:36.402287  6026 consensus_queue.cc:1048] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:36.432263  5814 raft_consensus.cc:1275] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:36.434197  6057 consensus_queue.cc:1048] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:36.726258  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:36.738566  5888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
mode: GRACEFUL
new_leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:39376
I20260709 13:13:36.739252  5888 raft_consensus.cc:606] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Received request to transfer leadership to TS ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:36.744251  5888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
mode: GRACEFUL
new_leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:39376
I20260709 13:13:36.744791  5888 raft_consensus.cc:606] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Received request to transfer leadership to TS ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:36.751955  5888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
mode: GRACEFUL
new_leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:39376
I20260709 13:13:36.752461  5888 raft_consensus.cc:606] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Received request to transfer leadership to TS ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:36.760074  5814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e"
dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
mode: GRACEFUL
new_leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:34156
I20260709 13:13:36.760548  5814 raft_consensus.cc:606] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 LEADER]: Received request to transfer leadership to TS ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:36.765111  5814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3d869fcf1b946be8e0b4cdc1700cbad"
dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
mode: GRACEFUL
new_leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:34156
I20260709 13:13:36.765615  5814 raft_consensus.cc:606] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 LEADER]: Received request to transfer leadership to TS ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:36.769902  5814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0"
dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
mode: GRACEFUL
new_leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:34156
I20260709 13:13:36.770308  5814 raft_consensus.cc:606] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 LEADER]: Received request to transfer leadership to TS ae3a4d60c7b64c9abe8c889c0c252a52
I20260709 13:13:36.777486  5741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
mode: GRACEFUL
new_leader_uuid: "0efd05f9c0644d4499af913d22b6b823"
 from {username='slave'} at 127.0.0.1:60764
I20260709 13:13:36.777920  5741 raft_consensus.cc:606] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 LEADER]: Received request to transfer leadership to TS 0efd05f9c0644d4499af913d22b6b823
I20260709 13:13:36.802987  6067 raft_consensus.cc:993] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52: : Instructing follower 0efd05f9c0644d4499af913d22b6b823 to start an election
I20260709 13:13:36.803452  6057 raft_consensus.cc:1081] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 LEADER]: Signalling peer 0efd05f9c0644d4499af913d22b6b823 to start an election
I20260709 13:13:36.804934  5888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
 from {username='slave'} at 127.0.0.1:39356
I20260709 13:13:36.805500  5888 raft_consensus.cc:493] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:36.805804  5888 raft_consensus.cc:3060] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.811497  5888 raft_consensus.cc:515] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:36.813103  5888 leader_election.cc:290] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 4 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:36.814055  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:36.814438  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6111fdb849fd49db876e4cff832cdb99" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:36.814685  5741 raft_consensus.cc:3055] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:36.815017  5814 raft_consensus.cc:3060] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.815022  5741 raft_consensus.cc:740] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:36.815994  5741 consensus_queue.cc:260] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:36.816900  5741 raft_consensus.cc:3060] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.821302  5741 raft_consensus.cc:2468] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 4.
I20260709 13:13:36.822198  5814 raft_consensus.cc:2468] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 4.
I20260709 13:13:36.822450  5853 leader_election.cc:304] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52; no voters: 
I20260709 13:13:36.823380  6034 raft_consensus.cc:2804] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:36.824321  6034 raft_consensus.cc:697] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 4 LEADER]: Becoming Leader. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:36.825361  6034 consensus_queue.cc:237] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:36.832026  5638 catalog_manager.cc:5697] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 reported cstate change: term changed from 3 to 4, leader changed from ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1) to 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3). New cstate: current_term: 4 leader_uuid: "0efd05f9c0644d4499af913d22b6b823" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.882223  6074 raft_consensus.cc:993] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb: : Instructing follower ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:36.882777  6031 raft_consensus.cc:1081] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 LEADER]: Signalling peer ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:36.884385  5741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3d869fcf1b946be8e0b4cdc1700cbad"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:60750
I20260709 13:13:36.884810  5741 raft_consensus.cc:493] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:36.885105  5741 raft_consensus.cc:3060] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:36.889286  5741 raft_consensus.cc:515] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:36.890874  5741 leader_election.cc:290] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 2 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:36.891748  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d869fcf1b946be8e0b4cdc1700cbad" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:36.891960  5888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d869fcf1b946be8e0b4cdc1700cbad" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:36.892343  5814 raft_consensus.cc:3055] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:36.892508  5888 raft_consensus.cc:3060] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:36.892692  5814 raft_consensus.cc:740] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Running, Role: LEADER
I20260709 13:13:36.893581  5814 consensus_queue.cc:260] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:36.894917  5814 raft_consensus.cc:3060] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:36.897722  5888 raft_consensus.cc:2468] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 2.
I20260709 13:13:36.898819  5705 leader_election.cc:304] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52; no voters: 
I20260709 13:13:36.899528  6057 raft_consensus.cc:2804] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:36.899963  6057 raft_consensus.cc:697] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Becoming Leader. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:36.900754  6057 consensus_queue.cc:237] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:36.901688  5814 raft_consensus.cc:2468] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 2.
I20260709 13:13:36.908830  5638 catalog_manager.cc:5697] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 reported cstate change: term changed from 1 to 2, leader changed from eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2) to ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.059712  6074 raft_consensus.cc:993] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb: : Instructing follower ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:37.065317  6031 raft_consensus.cc:1081] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 LEADER]: Signalling peer ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:37.067823  5740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:60750
I20260709 13:13:37.068459  5740 raft_consensus.cc:493] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.068845  5740 raft_consensus.cc:3060] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:37.071928  6076 raft_consensus.cc:993] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823: : Instructing follower ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:37.072446  6076 raft_consensus.cc:1081] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Signalling peer ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:37.074326  6034 raft_consensus.cc:993] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823: : Instructing follower ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:37.074632  5741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:60756
I20260709 13:13:37.074846  6034 raft_consensus.cc:1081] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Signalling peer ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:37.075157  5741 raft_consensus.cc:493] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.075485  5741 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:37.076639  5739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:60756
I20260709 13:13:37.077167  5739 raft_consensus.cc:493] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.077486  5739 raft_consensus.cc:3060] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:37.078819  5740 raft_consensus.cc:515] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:37.082072  5740 leader_election.cc:290] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 3 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:37.082784  5888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:37.083511  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:37.083714  5888 raft_consensus.cc:3060] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:37.084091  5814 raft_consensus.cc:3055] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:37.084420  5814 raft_consensus.cc:740] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Running, Role: LEADER
I20260709 13:13:37.085225  5814 consensus_queue.cc:260] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:37.086385  5814 raft_consensus.cc:3060] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:37.087285  5739 raft_consensus.cc:515] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:37.091712  5816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:37.092252  5816 raft_consensus.cc:3060] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:37.092128  5889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30c770d46a44d0fb5d96eb046c464d3" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:37.092409  5814 raft_consensus.cc:2468] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 3.
I20260709 13:13:37.092819  5889 raft_consensus.cc:3055] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:37.093209  5889 raft_consensus.cc:740] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:37.082664  5741 raft_consensus.cc:515] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:37.094182  5889 consensus_queue.cc:260] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:37.095387  5889 raft_consensus.cc:3060] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:37.096490  5888 raft_consensus.cc:2468] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 3.
I20260709 13:13:37.097864  5704 leader_election.cc:304] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:37.098204  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:37.098701  5814 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:37.098735  6057 raft_consensus.cc:2804] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:37.099244  6057 raft_consensus.cc:697] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 LEADER]: Becoming Leader. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:37.100144  6057 consensus_queue.cc:237] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:37.103853  5741 leader_election.cc:290] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 4 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:37.106302  5814 raft_consensus.cc:2468] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 4.
I20260709 13:13:37.107542  5704 leader_election.cc:304] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:37.108011  5739 leader_election.cc:290] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 4 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:37.108404  6067 raft_consensus.cc:2804] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:37.109567  5888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:37.110263  5888 raft_consensus.cc:3055] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:37.110420  5889 raft_consensus.cc:2468] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 4.
I20260709 13:13:37.110770  5888 raft_consensus.cc:740] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:37.111774  5705 leader_election.cc:304] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, ae3a4d60c7b64c9abe8c889c0c252a52; no voters: 
I20260709 13:13:37.114118  5816 raft_consensus.cc:2468] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 4.
I20260709 13:13:37.114734  5888 consensus_queue.cc:260] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:37.115974  5888 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:37.116765  6067 raft_consensus.cc:697] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 LEADER]: Becoming Leader. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:37.117354  6080 raft_consensus.cc:2804] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:37.117836  6080 raft_consensus.cc:697] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 LEADER]: Becoming Leader. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:37.117856  6067 consensus_queue.cc:237] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:37.118788  6080 consensus_queue.cc:237] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:37.129650  5638 catalog_manager.cc:5697] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 reported cstate change: term changed from 2 to 3, leader changed from eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2) to ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1). New cstate: current_term: 3 leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.133641  5888 raft_consensus.cc:2468] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 4.
I20260709 13:13:37.142819  5638 catalog_manager.cc:5697] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 reported cstate change: term changed from 3 to 4, leader changed from 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3) to ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1). New cstate: current_term: 4 leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.144016  5638 catalog_manager.cc:5697] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 reported cstate change: term changed from 3 to 4, leader changed from 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3) to ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1). New cstate: current_term: 4 leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.149791  6078 raft_consensus.cc:993] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb: : Instructing follower ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:37.150246  6078 raft_consensus.cc:1081] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 LEADER]: Signalling peer ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:37.151973  5739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:60750
I20260709 13:13:37.152432  5739 raft_consensus.cc:493] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.152791  5739 raft_consensus.cc:3060] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:37.157451  5739 raft_consensus.cc:515] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:37.159653  5739 leader_election.cc:290] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 3 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:37.159993  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:37.160655  5814 raft_consensus.cc:3055] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:37.160918  5814 raft_consensus.cc:740] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Running, Role: LEADER
I20260709 13:13:37.161685  5814 consensus_queue.cc:260] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:37.161984  5888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff07cf8ab33d4ba4a6803c2416d7c5a0" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:37.162488  5888 raft_consensus.cc:3060] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:37.162592  5814 raft_consensus.cc:3060] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:37.166498  5814 raft_consensus.cc:2468] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 3.
I20260709 13:13:37.167243  5888 raft_consensus.cc:2468] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 3.
I20260709 13:13:37.167331  5704 leader_election.cc:304] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:37.168134  6080 raft_consensus.cc:2804] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:37.168540  6080 raft_consensus.cc:697] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 LEADER]: Becoming Leader. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:37.169366  6080 consensus_queue.cc:237] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:37.176446  5638 catalog_manager.cc:5697] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 reported cstate change: term changed from 2 to 3, leader changed from eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2) to ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1). New cstate: current_term: 3 leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.230340  6076 raft_consensus.cc:993] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823: : Instructing follower ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:37.230799  6034 raft_consensus.cc:1081] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Signalling peer ae3a4d60c7b64c9abe8c889c0c252a52 to start an election
I20260709 13:13:37.232244  5739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
 from {username='slave'} at 127.0.0.1:60756
I20260709 13:13:37.232736  5739 raft_consensus.cc:493] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.233039  5739 raft_consensus.cc:3060] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:37.237268  5741 raft_consensus.cc:1275] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Refusing update from remote peer 0efd05f9c0644d4499af913d22b6b823: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:37.237990  5739 raft_consensus.cc:515] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:37.238423  6034 consensus_queue.cc:1048] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:37.239854  5739 leader_election.cc:290] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 4 election: Requested vote from peers eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:37.240515  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:37.240859  5888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d39a3e326b748bcae7ed3655f7808f3" candidate_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:37.241082  5814 raft_consensus.cc:3060] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:37.242377  5888 raft_consensus.cc:3055] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:37.242743  5888 raft_consensus.cc:740] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:37.243638  5816 raft_consensus.cc:1275] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Refusing update from remote peer 0efd05f9c0644d4499af913d22b6b823: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:37.243999  5888 consensus_queue.cc:260] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:37.245523  5888 raft_consensus.cc:3060] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:37.245265  6070 consensus_queue.cc:1048] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:37.251487  5814 raft_consensus.cc:2468] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 4.
I20260709 13:13:37.252013  5888 raft_consensus.cc:2468] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3a4d60c7b64c9abe8c889c0c252a52 in term 4.
I20260709 13:13:37.252604  5704 leader_election.cc:304] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae3a4d60c7b64c9abe8c889c0c252a52, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:37.253497  6080 raft_consensus.cc:2804] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:37.254088  6080 raft_consensus.cc:697] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 LEADER]: Becoming Leader. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:37.254948  6080 consensus_queue.cc:237] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } }
I20260709 13:13:37.264009  5638 catalog_manager.cc:5697] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 reported cstate change: term changed from 3 to 4, leader changed from 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3) to ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1). New cstate: current_term: 4 leader_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.392376  5816 raft_consensus.cc:1275] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:37.393524  6080 consensus_queue.cc:1048] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:37.402015  5888 raft_consensus.cc:1275] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:37.403841  6082 consensus_queue.cc:1048] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:37.514886  5888 raft_consensus.cc:1275] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:37.516093  6082 consensus_queue.cc:1048] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:37.525193  5816 raft_consensus.cc:1275] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:37.526904  6067 consensus_queue.cc:1048] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:37.634225  5888 raft_consensus.cc:1275] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:37.635404  6067 consensus_queue.cc:1048] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:37.643576  5814 raft_consensus.cc:1275] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:37.645058  6080 consensus_queue.cc:1048] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:37.684672  5814 raft_consensus.cc:1275] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:37.685982  6080 consensus_queue.cc:1048] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:37.695125  5888 raft_consensus.cc:1275] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:37.696578  6081 consensus_queue.cc:1048] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:37.704178  5888 raft_consensus.cc:1275] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:37.705438  6081 consensus_queue.cc:1048] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:37.707773  5814 raft_consensus.cc:1275] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:37.708369  5889 raft_consensus.cc:1275] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:37.708946  6080 consensus_queue.cc:1048] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:37.710280  6080 consensus_queue.cc:1048] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:37.721339  5816 raft_consensus.cc:1275] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Refusing update from remote peer ae3a4d60c7b64c9abe8c889c0c252a52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:37.723438  6082 consensus_queue.cc:1048] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:39.779965  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:39.789438  5741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c557673688a4726ab294b8f53337fc2"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
mode: GRACEFUL
new_leader_uuid: "0efd05f9c0644d4499af913d22b6b823"
 from {username='slave'} at 127.0.0.1:60772
I20260709 13:13:39.789927  5741 raft_consensus.cc:606] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Received request to transfer leadership to TS 0efd05f9c0644d4499af913d22b6b823
I20260709 13:13:39.792397  5741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3d869fcf1b946be8e0b4cdc1700cbad"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
mode: GRACEFUL
new_leader_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
 from {username='slave'} at 127.0.0.1:60772
I20260709 13:13:39.792964  5741 raft_consensus.cc:606] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Received request to transfer leadership to TS eac2aed77b3d4cdb8afdc9395c47b4fb
I20260709 13:13:39.795291  5741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
mode: GRACEFUL
new_leader_uuid: "0efd05f9c0644d4499af913d22b6b823"
 from {username='slave'} at 127.0.0.1:60772
I20260709 13:13:39.795711  5741 raft_consensus.cc:606] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 LEADER]: Received request to transfer leadership to TS 0efd05f9c0644d4499af913d22b6b823
I20260709 13:13:39.797703  5741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8"
dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
mode: GRACEFUL
new_leader_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
 from {username='slave'} at 127.0.0.1:60772
I20260709 13:13:39.798135  5741 raft_consensus.cc:606] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 LEADER]: Received request to transfer leadership to TS eac2aed77b3d4cdb8afdc9395c47b4fb
I20260709 13:13:39.799016  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:13:39.799499  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:39.950738  6067 raft_consensus.cc:993] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52: : Instructing follower eac2aed77b3d4cdb8afdc9395c47b4fb to start an election
I20260709 13:13:39.951220  6102 raft_consensus.cc:1081] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Signalling peer eac2aed77b3d4cdb8afdc9395c47b4fb to start an election
I20260709 13:13:39.952617  5814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3d869fcf1b946be8e0b4cdc1700cbad"
dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
 from {username='slave'} at 127.0.0.1:34140
I20260709 13:13:39.953059  5814 raft_consensus.cc:493] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:39.953370  5814 raft_consensus.cc:3060] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:39.957333  5814 raft_consensus.cc:515] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:39.958694  5814 leader_election.cc:290] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 3 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:39.959539  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d869fcf1b946be8e0b4cdc1700cbad" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:39.959614  5889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d869fcf1b946be8e0b4cdc1700cbad" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:39.960209  5741 raft_consensus.cc:3055] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:39.960250  5889 raft_consensus.cc:3060] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:39.960681  5741 raft_consensus.cc:740] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:39.961506  5741 consensus_queue.cc:260] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:39.962637  5741 raft_consensus.cc:3060] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:39.967604  5889 raft_consensus.cc:2468] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 3.
I20260709 13:13:39.968973  5741 raft_consensus.cc:2468] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 3.
I20260709 13:13:39.968987  5780 leader_election.cc:304] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:39.969871  6074 raft_consensus.cc:2804] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:39.970902  6074 raft_consensus.cc:697] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 LEADER]: Becoming Leader. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Running, Role: LEADER
I20260709 13:13:39.971643  6074 consensus_queue.cc:237] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:39.978137  5636 catalog_manager.cc:5697] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb reported cstate change: term changed from 2 to 3, leader changed from ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1) to eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2). New cstate: current_term: 3 leader_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.048249  6067 raft_consensus.cc:993] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52: : Instructing follower 0efd05f9c0644d4499af913d22b6b823 to start an election
I20260709 13:13:40.048691  6067 raft_consensus.cc:1081] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 LEADER]: Signalling peer 0efd05f9c0644d4499af913d22b6b823 to start an election
I20260709 13:13:40.050108  5889 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
 from {username='slave'} at 127.0.0.1:39356
I20260709 13:13:40.050642  5889 raft_consensus.cc:493] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:40.050971  5889 raft_consensus.cc:3060] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:40.055966  5889 raft_consensus.cc:515] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:40.057763  5889 leader_election.cc:290] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 4 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:40.058413  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:40.058990  5741 raft_consensus.cc:3055] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:40.058866  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e18282a42a4a23826d5a5f90ce831e" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:40.059289  5741 raft_consensus.cc:740] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:40.059497  5814 raft_consensus.cc:3060] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:40.059969  5741 consensus_queue.cc:260] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:40.060777  5741 raft_consensus.cc:3060] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:40.063953  5814 raft_consensus.cc:2468] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 4.
I20260709 13:13:40.064580  5741 raft_consensus.cc:2468] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 4.
I20260709 13:13:40.065227  5853 leader_election.cc:304] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:40.066201  6076 raft_consensus.cc:2804] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:40.067359  6076 raft_consensus.cc:697] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 4 LEADER]: Becoming Leader. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:40.068135  6076 consensus_queue.cc:237] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:40.075181  5636 catalog_manager.cc:5697] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 reported cstate change: term changed from 3 to 4, leader changed from ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1) to 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3). New cstate: current_term: 4 leader_uuid: "0efd05f9c0644d4499af913d22b6b823" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:40.147455  6102 raft_consensus.cc:993] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52: : Instructing follower 0efd05f9c0644d4499af913d22b6b823 to start an election
I20260709 13:13:40.147877  6102 raft_consensus.cc:1081] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Signalling peer 0efd05f9c0644d4499af913d22b6b823 to start an election
I20260709 13:13:40.149169  5889 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c557673688a4726ab294b8f53337fc2"
dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
 from {username='slave'} at 127.0.0.1:39356
I20260709 13:13:40.149575  5889 raft_consensus.cc:493] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:40.149830  5889 raft_consensus.cc:3060] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.154488  5889 raft_consensus.cc:515] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:40.155948  5889 leader_election.cc:290] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 2 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979)
I20260709 13:13:40.156764  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c557673688a4726ab294b8f53337fc2" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:40.157089  5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c557673688a4726ab294b8f53337fc2" candidate_uuid: "0efd05f9c0644d4499af913d22b6b823" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
I20260709 13:13:40.157258  5741 raft_consensus.cc:3055] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:40.157613  5814 raft_consensus.cc:3060] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.157604  5741 raft_consensus.cc:740] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:40.158457  5741 consensus_queue.cc:260] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:40.159600  5741 raft_consensus.cc:3060] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.162616  5814 raft_consensus.cc:2468] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 2.
I20260709 13:13:40.163478  5853 leader_election.cc:304] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:40.164158  6076 raft_consensus.cc:2804] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.164273  5741 raft_consensus.cc:2468] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efd05f9c0644d4499af913d22b6b823 in term 2.
I20260709 13:13:40.164557  6076 raft_consensus.cc:697] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [term 2 LEADER]: Becoming Leader. State: Replica: 0efd05f9c0644d4499af913d22b6b823, State: Running, Role: LEADER
I20260709 13:13:40.165417  6076 consensus_queue.cc:237] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:40.172173  5636 catalog_manager.cc:5697] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 reported cstate change: term changed from 1 to 2, leader changed from ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1) to 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "0efd05f9c0644d4499af913d22b6b823" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:40.225922  6067 raft_consensus.cc:993] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52: : Instructing follower eac2aed77b3d4cdb8afdc9395c47b4fb to start an election
I20260709 13:13:40.226358  6102 raft_consensus.cc:1081] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 LEADER]: Signalling peer eac2aed77b3d4cdb8afdc9395c47b4fb to start an election
I20260709 13:13:40.227700  5814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8"
dest_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb"
 from {username='slave'} at 127.0.0.1:34140
I20260709 13:13:40.228072  5814 raft_consensus.cc:493] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:40.228286  5814 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:40.233455  5814 raft_consensus.cc:515] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:40.234694  5814 leader_election.cc:290] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 5 election: Requested vote from peers ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823), 0efd05f9c0644d4499af913d22b6b823 (127.4.254.3:38097)
I20260709 13:13:40.235466  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52"
I20260709 13:13:40.235653  5889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e6e8de5a484ee0a55578fb18216ab8" candidate_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0efd05f9c0644d4499af913d22b6b823"
I20260709 13:13:40.235970  5741 raft_consensus.cc:3055] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:40.236199  5889 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:40.236292  5741 raft_consensus.cc:740] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ae3a4d60c7b64c9abe8c889c0c252a52, State: Running, Role: LEADER
I20260709 13:13:40.237010  5741 consensus_queue.cc:260] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:40.237859  5741 raft_consensus.cc:3060] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:40.240860  5889 raft_consensus.cc:2468] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 5.
I20260709 13:13:40.241644  5741 raft_consensus.cc:2468] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eac2aed77b3d4cdb8afdc9395c47b4fb in term 5.
I20260709 13:13:40.242004  5780 leader_election.cc:304] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efd05f9c0644d4499af913d22b6b823, eac2aed77b3d4cdb8afdc9395c47b4fb; no voters: 
I20260709 13:13:40.242692  6074 raft_consensus.cc:2804] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:40.243119  6074 raft_consensus.cc:697] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 5 LEADER]: Becoming Leader. State: Replica: eac2aed77b3d4cdb8afdc9395c47b4fb, State: Running, Role: LEADER
I20260709 13:13:40.243701  6074 consensus_queue.cc:237] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } }
I20260709 13:13:40.250280  5636 catalog_manager.cc:5697] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb reported cstate change: term changed from 4 to 5, leader changed from ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1) to eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2). New cstate: current_term: 5 leader_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.448957  5889 raft_consensus.cc:1275] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Refusing update from remote peer eac2aed77b3d4cdb8afdc9395c47b4fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:40.450320  6074 consensus_queue.cc:1048] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:40.460731  5741 raft_consensus.cc:1275] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Refusing update from remote peer eac2aed77b3d4cdb8afdc9395c47b4fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:40.463074  6115 consensus_queue.cc:1048] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:40.575619  5814 raft_consensus.cc:1275] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Refusing update from remote peer 0efd05f9c0644d4499af913d22b6b823: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:40.576851  6076 consensus_queue.cc:1048] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:40.586643  5741 raft_consensus.cc:1275] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Refusing update from remote peer 0efd05f9c0644d4499af913d22b6b823: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:40.587983  6076 consensus_queue.cc:1048] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:40.706562  5741 raft_consensus.cc:1275] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 5 FOLLOWER]: Refusing update from remote peer eac2aed77b3d4cdb8afdc9395c47b4fb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:40.707757  6115 consensus_queue.cc:1048] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:40.715596  5889 raft_consensus.cc:1275] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 5 FOLLOWER]: Refusing update from remote peer eac2aed77b3d4cdb8afdc9395c47b4fb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:40.716969  6074 consensus_queue.cc:1048] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efd05f9c0644d4499af913d22b6b823" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 38097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:40.746428  5741 raft_consensus.cc:1275] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Refusing update from remote peer 0efd05f9c0644d4499af913d22b6b823: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.747586  6076 consensus_queue.cc:1048] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae3a4d60c7b64c9abe8c889c0c252a52" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 37823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:40.756304  5814 raft_consensus.cc:1275] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Refusing update from remote peer 0efd05f9c0644d4499af913d22b6b823: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.757786  6109 consensus_queue.cc:1048] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac2aed77b3d4cdb8afdc9395c47b4fb" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:40.800282  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:40.805968  5112 tablet_server.cc:179] TabletServer@127.4.254.1:0 shutting down...
I20260709 13:13:40.830794  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:40.831514  5112 tablet_replica.cc:333] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52: stopping tablet replica
I20260709 13:13:40.832254  5112 raft_consensus.cc:2243] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.832641  5112 raft_consensus.cc:2272] T c3d869fcf1b946be8e0b4cdc1700cbad P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.834712  5112 tablet_replica.cc:333] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52: stopping tablet replica
I20260709 13:13:40.835170  5112 raft_consensus.cc:2243] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.835510  5112 raft_consensus.cc:2272] T e7e6e8de5a484ee0a55578fb18216ab8 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.837603  5112 tablet_replica.cc:333] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52: stopping tablet replica
I20260709 13:13:40.838097  5112 raft_consensus.cc:2243] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.838725  5112 raft_consensus.cc:2272] T 20f34fa88da342b2a101928690d11819 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.840224  5112 tablet_replica.cc:333] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52: stopping tablet replica
I20260709 13:13:40.840639  5112 raft_consensus.cc:2243] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.840993  5112 raft_consensus.cc:2272] T 50dc05011a0345a59c00b22bdc1f0b4f P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.842514  5112 tablet_replica.cc:333] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52: stopping tablet replica
I20260709 13:13:40.842923  5112 raft_consensus.cc:2243] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.843256  5112 raft_consensus.cc:2272] T d2e18282a42a4a23826d5a5f90ce831e P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.845180  5112 tablet_replica.cc:333] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52: stopping tablet replica
I20260709 13:13:40.845626  5112 raft_consensus.cc:2243] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.846244  5112 raft_consensus.cc:2272] T e30c770d46a44d0fb5d96eb046c464d3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.847721  5112 tablet_replica.cc:333] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52: stopping tablet replica
I20260709 13:13:40.848136  5112 raft_consensus.cc:2243] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.848740  5112 raft_consensus.cc:2272] T 8d39a3e326b748bcae7ed3655f7808f3 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.850389  5112 tablet_replica.cc:333] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52: stopping tablet replica
I20260709 13:13:40.850796  5112 raft_consensus.cc:2243] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.851125  5112 raft_consensus.cc:2272] T 6111fdb849fd49db876e4cff832cdb99 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.852531  5112 tablet_replica.cc:333] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52: stopping tablet replica
I20260709 13:13:40.852932  5112 raft_consensus.cc:2243] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.853317  5112 raft_consensus.cc:2272] T 0c557673688a4726ab294b8f53337fc2 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.855232  5112 tablet_replica.cc:333] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52: stopping tablet replica
I20260709 13:13:40.855620  5112 raft_consensus.cc:2243] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.856209  5112 raft_consensus.cc:2272] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P ae3a4d60c7b64c9abe8c889c0c252a52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.884580  5112 tablet_server.cc:196] TabletServer@127.4.254.1:0 shutdown complete.
I20260709 13:13:40.904246  5112 tablet_server.cc:179] TabletServer@127.4.254.2:0 shutting down...
I20260709 13:13:40.924998  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:40.925868  5112 tablet_replica.cc:333] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb: stopping tablet replica
I20260709 13:13:40.926458  5112 raft_consensus.cc:2243] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.926895  5112 raft_consensus.cc:2272] T 20f34fa88da342b2a101928690d11819 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.928563  5112 tablet_replica.cc:333] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb: stopping tablet replica
I20260709 13:13:40.929085  5112 raft_consensus.cc:2243] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.929863  5112 raft_consensus.cc:2272] T c3d869fcf1b946be8e0b4cdc1700cbad P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.931685  5112 tablet_replica.cc:333] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb: stopping tablet replica
I20260709 13:13:40.932186  5112 raft_consensus.cc:2243] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.932569  5112 raft_consensus.cc:2272] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.934064  5112 tablet_replica.cc:333] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb: stopping tablet replica
I20260709 13:13:40.934545  5112 raft_consensus.cc:2243] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.934955  5112 raft_consensus.cc:2272] T e30c770d46a44d0fb5d96eb046c464d3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.936463  5112 tablet_replica.cc:333] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb: stopping tablet replica
I20260709 13:13:40.936921  5112 raft_consensus.cc:2243] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.937322  5112 raft_consensus.cc:2272] T d2e18282a42a4a23826d5a5f90ce831e P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.939853  5112 tablet_replica.cc:333] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb: stopping tablet replica
I20260709 13:13:40.940368  5112 raft_consensus.cc:2243] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.940759  5112 raft_consensus.cc:2272] T 8d39a3e326b748bcae7ed3655f7808f3 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.942360  5112 tablet_replica.cc:333] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb: stopping tablet replica
I20260709 13:13:40.942814  5112 raft_consensus.cc:2243] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.943182  5112 raft_consensus.cc:2272] T 6111fdb849fd49db876e4cff832cdb99 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.944634  5112 tablet_replica.cc:333] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb: stopping tablet replica
I20260709 13:13:40.945093  5112 raft_consensus.cc:2243] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.945520  5112 raft_consensus.cc:2272] T 0c557673688a4726ab294b8f53337fc2 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.947408  5112 tablet_replica.cc:333] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb: stopping tablet replica
I20260709 13:13:40.948011  5112 raft_consensus.cc:2243] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.948700  5112 raft_consensus.cc:2272] T e7e6e8de5a484ee0a55578fb18216ab8 P eac2aed77b3d4cdb8afdc9395c47b4fb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.950675  5112 tablet_replica.cc:333] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb: stopping tablet replica
I20260709 13:13:40.951205  5112 raft_consensus.cc:2243] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.951817  5112 raft_consensus.cc:2272] T 50dc05011a0345a59c00b22bdc1f0b4f P eac2aed77b3d4cdb8afdc9395c47b4fb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:40.972077  5853 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.254.2:36979: connect: Connection refused (error 111)
I20260709 13:13:40.972307  5112 tablet_server.cc:196] TabletServer@127.4.254.2:0 shutdown complete.
W20260709 13:13:40.975625  5853 consensus_peers.cc:597] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 -> Peer eac2aed77b3d4cdb8afdc9395c47b4fb (127.4.254.2:36979): Couldn't send request to peer eac2aed77b3d4cdb8afdc9395c47b4fb. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:36979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:40.981618  5853 consensus_peers.cc:597] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 -> Peer ae3a4d60c7b64c9abe8c889c0c252a52 (127.4.254.1:37823): Couldn't send request to peer ae3a4d60c7b64c9abe8c889c0c252a52. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:37823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.993496  5112 tablet_server.cc:179] TabletServer@127.4.254.3:0 shutting down...
I20260709 13:13:41.017200  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:41.017889  5112 tablet_replica.cc:333] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823: stopping tablet replica
I20260709 13:13:41.018433  5112 raft_consensus.cc:2243] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.018944  5112 raft_consensus.cc:2272] T 20f34fa88da342b2a101928690d11819 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.020638  5112 tablet_replica.cc:333] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823: stopping tablet replica
I20260709 13:13:41.021221  5112 raft_consensus.cc:2243] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.021932  5112 raft_consensus.cc:2272] T d2e18282a42a4a23826d5a5f90ce831e P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.024334  5112 tablet_replica.cc:333] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823: stopping tablet replica
I20260709 13:13:41.024814  5112 raft_consensus.cc:2243] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.025241  5112 raft_consensus.cc:2272] T e30c770d46a44d0fb5d96eb046c464d3 P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.026764  5112 tablet_replica.cc:333] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823: stopping tablet replica
I20260709 13:13:41.027217  5112 raft_consensus.cc:2243] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.027593  5112 raft_consensus.cc:2272] T 50dc05011a0345a59c00b22bdc1f0b4f P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.029101  5112 tablet_replica.cc:333] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823: stopping tablet replica
I20260709 13:13:41.029645  5112 raft_consensus.cc:2243] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.030028  5112 raft_consensus.cc:2272] T c3d869fcf1b946be8e0b4cdc1700cbad P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.032495  5112 tablet_replica.cc:333] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823: stopping tablet replica
I20260709 13:13:41.032963  5112 raft_consensus.cc:2243] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.033401  5112 raft_consensus.cc:2272] T ff07cf8ab33d4ba4a6803c2416d7c5a0 P 0efd05f9c0644d4499af913d22b6b823 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.034783  5112 tablet_replica.cc:333] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823: stopping tablet replica
I20260709 13:13:41.035173  5112 raft_consensus.cc:2243] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.035759  5112 raft_consensus.cc:2272] T 6111fdb849fd49db876e4cff832cdb99 P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.037222  5112 tablet_replica.cc:333] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823: stopping tablet replica
I20260709 13:13:41.037688  5112 raft_consensus.cc:2243] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.038053  5112 raft_consensus.cc:2272] T 8d39a3e326b748bcae7ed3655f7808f3 P 0efd05f9c0644d4499af913d22b6b823 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.039453  5112 tablet_replica.cc:333] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823: stopping tablet replica
I20260709 13:13:41.039893  5112 raft_consensus.cc:2243] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.040555  5112 raft_consensus.cc:2272] T 0c557673688a4726ab294b8f53337fc2 P 0efd05f9c0644d4499af913d22b6b823 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.042320  5112 tablet_replica.cc:333] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823: stopping tablet replica
I20260709 13:13:41.042773  5112 raft_consensus.cc:2243] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.043164  5112 raft_consensus.cc:2272] T e7e6e8de5a484ee0a55578fb18216ab8 P 0efd05f9c0644d4499af913d22b6b823 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.071374  5112 tablet_server.cc:196] TabletServer@127.4.254.3:0 shutdown complete.
I20260709 13:13:41.089350  5112 master.cc:562] Master@127.4.254.62:38309 shutting down...
I20260709 13:13:41.108937  5112 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.109493  5112 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.109817  5112 tablet_replica.cc:333] T 00000000000000000000000000000000 P 341ca2519bca466d994078d930588feb: stopping tablet replica
I20260709 13:13:41.146736  5112 master.cc:584] Master@127.4.254.62:38309 shutdown complete.
0efd05f9c0644d4499af913d22b6b823  1
ae3a4d60c7b64c9abe8c889c0c252a52  5
eac2aed77b3d4cdb8afdc9395c47b4fb  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (12433 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:13:41.187875  5112 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.254.62:46653
I20260709 13:13:41.188915  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:41.194535  6129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:41.195423  6132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:41.195653  6130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:41.196056  5112 server_base.cc:1061] running on GCE node
I20260709 13:13:41.196897  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:41.197101  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:41.197321  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783602821197303 us; error 0 us; skew 500 ppm
I20260709 13:13:41.197857  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:41.200166  5112 webserver.cc:533] Webserver started at http://127.4.254.62:44917/ using document root <none> and password file <none>
I20260709 13:13:41.200676  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:41.200879  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:41.201218  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:41.202302  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/master-0-root/instance:
uuid: "c499d062fa5b4229bfb05f1ac581a6c6"
format_stamp: "Formatted at 2026-07-09 13:13:41 on dist-test-slave-k73n"
I20260709 13:13:41.206533  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:13:41.209707  6137 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:41.210433  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:41.210754  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/master-0-root
uuid: "c499d062fa5b4229bfb05f1ac581a6c6"
format_stamp: "Formatted at 2026-07-09 13:13:41 on dist-test-slave-k73n"
I20260709 13:13:41.211072  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:41.233402  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:41.234710  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:41.273408  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.62:46653
I20260709 13:13:41.273509  6188 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.62:46653 every 8 connection(s)
I20260709 13:13:41.277801  6189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.287483  6189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6: Bootstrap starting.
I20260709 13:13:41.292317  6189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.296389  6189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6: No bootstrap required, opened a new log
I20260709 13:13:41.298400  6189 raft_consensus.cc:359] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c499d062fa5b4229bfb05f1ac581a6c6" member_type: VOTER }
I20260709 13:13:41.298754  6189 raft_consensus.cc:385] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.298936  6189 raft_consensus.cc:740] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c499d062fa5b4229bfb05f1ac581a6c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.299404  6189 consensus_queue.cc:260] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c499d062fa5b4229bfb05f1ac581a6c6" member_type: VOTER }
I20260709 13:13:41.299803  6189 raft_consensus.cc:399] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:41.299985  6189 raft_consensus.cc:493] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:41.300191  6189 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.304217  6189 raft_consensus.cc:515] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c499d062fa5b4229bfb05f1ac581a6c6" member_type: VOTER }
I20260709 13:13:41.304682  6189 leader_election.cc:304] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c499d062fa5b4229bfb05f1ac581a6c6; no voters: 
I20260709 13:13:41.306074  6189 leader_election.cc:290] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:41.306454  6192 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:41.307684  6192 raft_consensus.cc:697] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [term 1 LEADER]: Becoming Leader. State: Replica: c499d062fa5b4229bfb05f1ac581a6c6, State: Running, Role: LEADER
I20260709 13:13:41.308320  6192 consensus_queue.cc:237] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c499d062fa5b4229bfb05f1ac581a6c6" member_type: VOTER }
I20260709 13:13:41.308985  6189 sys_catalog.cc:565] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:41.313019  6193 sys_catalog.cc:455] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c499d062fa5b4229bfb05f1ac581a6c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c499d062fa5b4229bfb05f1ac581a6c6" member_type: VOTER } }
I20260709 13:13:41.313198  6194 sys_catalog.cc:455] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c499d062fa5b4229bfb05f1ac581a6c6. Latest consensus state: current_term: 1 leader_uuid: "c499d062fa5b4229bfb05f1ac581a6c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c499d062fa5b4229bfb05f1ac581a6c6" member_type: VOTER } }
I20260709 13:13:41.313869  6193 sys_catalog.cc:458] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:41.313907  6194 sys_catalog.cc:458] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:41.317934  6199 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:41.325690  6199 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:41.326632  5112 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:41.333789  6199 catalog_manager.cc:1383] Generated new cluster ID: d40325aeff36474392b40ab7ab8460cc
I20260709 13:13:41.334077  6199 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:41.358139  6199 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:41.359378  6199 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:41.370515  6199 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6: Generated new TSK 0
I20260709 13:13:41.371097  6199 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:41.393261  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:41.399068  6210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:41.400002  6211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:41.403095  6213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:41.403311  5112 server_base.cc:1061] running on GCE node
I20260709 13:13:41.404160  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:41.404337  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:41.404456  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783602821404445 us; error 0 us; skew 500 ppm
I20260709 13:13:41.404913  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:41.407136  5112 webserver.cc:533] Webserver started at http://127.4.254.1:33933/ using document root <none> and password file <none>
I20260709 13:13:41.407562  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:41.407713  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:41.407928  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:41.408927  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/instance:
uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
format_stamp: "Formatted at 2026-07-09 13:13:41 on dist-test-slave-k73n"
I20260709 13:13:41.413388  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:13:41.416560  6218 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:41.417352  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:41.417630  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root
uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
format_stamp: "Formatted at 2026-07-09 13:13:41 on dist-test-slave-k73n"
I20260709 13:13:41.417905  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:41.441596  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:41.442857  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:41.444864  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:41.447219  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:41.447461  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:41.447721  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:41.447953  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:41.488042  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.1:43495
I20260709 13:13:41.488117  6280 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.1:43495 every 8 connection(s)
I20260709 13:13:41.493201  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:41.500756  6285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:41.502051  6286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:41.503842  6288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:41.504832  5112 server_base.cc:1061] running on GCE node
I20260709 13:13:41.505954  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:41.506136  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:41.506259  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783602821506249 us; error 0 us; skew 500 ppm
I20260709 13:13:41.506763  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:41.509079  5112 webserver.cc:533] Webserver started at http://127.4.254.2:46547/ using document root <none> and password file <none>
I20260709 13:13:41.509687  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:41.509909  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:41.510190  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:41.511606  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/instance:
uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
format_stamp: "Formatted at 2026-07-09 13:13:41 on dist-test-slave-k73n"
I20260709 13:13:41.512527  6281 heartbeater.cc:344] Connected to a master server at 127.4.254.62:46653
I20260709 13:13:41.512951  6281 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:41.513680  6281 heartbeater.cc:507] Master 127.4.254.62:46653 requested a full tablet report, sending...
I20260709 13:13:41.515902  6154 ts_manager.cc:194] Registered new tserver with Master: 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:13:41.516816  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:13:41.518335  6154 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55326
I20260709 13:13:41.521395  6293 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:41.522358  5112 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:13:41.522755  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root
uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
format_stamp: "Formatted at 2026-07-09 13:13:41 on dist-test-slave-k73n"
I20260709 13:13:41.523164  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:41.550490  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:41.551622  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:41.553009  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:41.555225  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:41.555477  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:41.555729  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:41.555882  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:41.594609  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.2:39965
I20260709 13:13:41.594714  6355 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.2:39965 every 8 connection(s)
I20260709 13:13:41.599655  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:41.607213  6359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:41.608135  6360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:41.610482  6362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:41.611796  5112 server_base.cc:1061] running on GCE node
I20260709 13:13:41.612751  6356 heartbeater.cc:344] Connected to a master server at 127.4.254.62:46653
I20260709 13:13:41.612942  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:13:41.613165  6356 heartbeater.cc:461] Registering TS with master...
W20260709 13:13:41.613273  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:41.613633  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783602821613616 us; error 0 us; skew 500 ppm
I20260709 13:13:41.614168  6356 heartbeater.cc:507] Master 127.4.254.62:46653 requested a full tablet report, sending...
I20260709 13:13:41.614235  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:41.616549  6154 ts_manager.cc:194] Registered new tserver with Master: a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:41.617199  5112 webserver.cc:533] Webserver started at http://127.4.254.3:35849/ using document root <none> and password file <none>
I20260709 13:13:41.617693  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:41.617904  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:41.618165  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:41.618157  6154 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55342
I20260709 13:13:41.619830  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/instance:
uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
format_stamp: "Formatted at 2026-07-09 13:13:41 on dist-test-slave-k73n"
I20260709 13:13:41.624734  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:41.628575  6367 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:41.629550  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:41.629837  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root
uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
format_stamp: "Formatted at 2026-07-09 13:13:41 on dist-test-slave-k73n"
I20260709 13:13:41.630082  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:41.658306  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:41.659487  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:41.660907  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:41.663234  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:41.663432  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:41.663757  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:41.663923  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:41.704520  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.3:34111
I20260709 13:13:41.704622  6429 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.3:34111 every 8 connection(s)
I20260709 13:13:41.718062  6430 heartbeater.cc:344] Connected to a master server at 127.4.254.62:46653
I20260709 13:13:41.718441  6430 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:41.719144  6430 heartbeater.cc:507] Master 127.4.254.62:46653 requested a full tablet report, sending...
I20260709 13:13:41.721045  6154 ts_manager.cc:194] Registered new tserver with Master: b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:41.722048  5112 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014422577s
I20260709 13:13:41.722494  6154 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55346
I20260709 13:13:41.746099  6154 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55350:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:41.752101  6154 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:41.949967  6321 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca18f52abcd4cf291ae45a415535e88 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:41.951555  6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca18f52abcd4cf291ae45a415535e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.953684  6320 tablet_service.cc:1511] Processing CreateTablet for tablet 3d35ec80c8064f08b90ca13dd30691c7 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:41.955144  6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d35ec80c8064f08b90ca13dd30691c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.957054  6319 tablet_service.cc:1511] Processing CreateTablet for tablet 47b0eafc00f84cdab5bdb591a10c058d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:41.958462  6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b0eafc00f84cdab5bdb591a10c058d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.965523  6318 tablet_service.cc:1511] Processing CreateTablet for tablet 19435892007a4e0a9b2b4d0b26ccd0c0 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:41.966810  6246 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca18f52abcd4cf291ae45a415535e88 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:41.968215  6246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca18f52abcd4cf291ae45a415535e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.969545  6317 tablet_service.cc:1511] Processing CreateTablet for tablet 772aad0e3cb043d989afc6d1abdbf6f4 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:41.969870  6395 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca18f52abcd4cf291ae45a415535e88 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:41.971197  6395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca18f52abcd4cf291ae45a415535e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.966917  6243 tablet_service.cc:1511] Processing CreateTablet for tablet 19435892007a4e0a9b2b4d0b26ccd0c0 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:41.972743  6243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19435892007a4e0a9b2b4d0b26ccd0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.973042  6316 tablet_service.cc:1511] Processing CreateTablet for tablet 05f408a1388f424db8b65332c1dcd467 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:41.974325  6245 tablet_service.cc:1511] Processing CreateTablet for tablet 3d35ec80c8064f08b90ca13dd30691c7 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:41.975617  6245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d35ec80c8064f08b90ca13dd30691c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.977211  6242 tablet_service.cc:1511] Processing CreateTablet for tablet 772aad0e3cb043d989afc6d1abdbf6f4 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:41.978475  6242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772aad0e3cb043d989afc6d1abdbf6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.979882  6244 tablet_service.cc:1511] Processing CreateTablet for tablet 47b0eafc00f84cdab5bdb591a10c058d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:41.981240  6244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b0eafc00f84cdab5bdb591a10c058d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.982256  6240 tablet_service.cc:1511] Processing CreateTablet for tablet 3009228e555646f4870d29db171cddfb (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:41.982968  6394 tablet_service.cc:1511] Processing CreateTablet for tablet 3d35ec80c8064f08b90ca13dd30691c7 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:41.983547  6240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3009228e555646f4870d29db171cddfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.984287  6394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d35ec80c8064f08b90ca13dd30691c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.981022  6241 tablet_service.cc:1511] Processing CreateTablet for tablet 05f408a1388f424db8b65332c1dcd467 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:41.986479  6241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f408a1388f424db8b65332c1dcd467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.990588  6393 tablet_service.cc:1511] Processing CreateTablet for tablet 47b0eafc00f84cdab5bdb591a10c058d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:41.990746  6315 tablet_service.cc:1511] Processing CreateTablet for tablet 3009228e555646f4870d29db171cddfb (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:41.992043  6393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b0eafc00f84cdab5bdb591a10c058d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.996672  6314 tablet_service.cc:1511] Processing CreateTablet for tablet 69156f57197e4f1fbed9461749553d8d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:41.999085  6313 tablet_service.cc:1511] Processing CreateTablet for tablet 1230017e50f4469992de6002ca8cd7b6 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:41.966930  6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19435892007a4e0a9b2b4d0b26ccd0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.003921  6392 tablet_service.cc:1511] Processing CreateTablet for tablet 19435892007a4e0a9b2b4d0b26ccd0c0 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:42.005436  6392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19435892007a4e0a9b2b4d0b26ccd0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.005628  6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f408a1388f424db8b65332c1dcd467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.009514  6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3009228e555646f4870d29db171cddfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.012799  6390 tablet_service.cc:1511] Processing CreateTablet for tablet 05f408a1388f424db8b65332c1dcd467 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:42.013638  6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772aad0e3cb043d989afc6d1abdbf6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.014477  6390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f408a1388f424db8b65332c1dcd467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.015296  6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69156f57197e4f1fbed9461749553d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.016857  6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1230017e50f4469992de6002ca8cd7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.016512  6389 tablet_service.cc:1511] Processing CreateTablet for tablet 3009228e555646f4870d29db171cddfb (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:42.018406  6389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3009228e555646f4870d29db171cddfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.002002  6312 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4a17642c254c2e869ca48ecd16fce0 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:42.036672  6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4a17642c254c2e869ca48ecd16fce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.036559  6238 tablet_service.cc:1511] Processing CreateTablet for tablet 1230017e50f4469992de6002ca8cd7b6 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:42.038546  6238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1230017e50f4469992de6002ca8cd7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.020219  6239 tablet_service.cc:1511] Processing CreateTablet for tablet 69156f57197e4f1fbed9461749553d8d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:42.030237  6388 tablet_service.cc:1511] Processing CreateTablet for tablet 69156f57197e4f1fbed9461749553d8d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:42.032701  6387 tablet_service.cc:1511] Processing CreateTablet for tablet 1230017e50f4469992de6002ca8cd7b6 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:42.034852  6391 tablet_service.cc:1511] Processing CreateTablet for tablet 772aad0e3cb043d989afc6d1abdbf6f4 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:42.042500  6388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69156f57197e4f1fbed9461749553d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.045382  6391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772aad0e3cb043d989afc6d1abdbf6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.047308  6387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1230017e50f4469992de6002ca8cd7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.043815  6239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69156f57197e4f1fbed9461749553d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.067078  6386 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4a17642c254c2e869ca48ecd16fce0 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:42.068511  6386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4a17642c254c2e869ca48ecd16fce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.070868  6237 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4a17642c254c2e869ca48ecd16fce0 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:42.072350  6237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4a17642c254c2e869ca48ecd16fce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.088284  6244 tablet_service.cc:1511] Processing CreateTablet for tablet 1e2856a0d3994696bbc8de68c3679c2f (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:42.115540  6445 tablet_bootstrap.cc:492] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:42.116930  6242 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9d4db6a641496881a55d48d32c6f7e (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:42.152082  6238 tablet_service.cc:1511] Processing CreateTablet for tablet 1061e95aa2d446f2aeb9563f482f1cd9 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:42.154431  6394 tablet_service.cc:1511] Processing CreateTablet for tablet 1061e95aa2d446f2aeb9563f482f1cd9 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:42.155782  6394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1061e95aa2d446f2aeb9563f482f1cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.158231  6316 tablet_service.cc:1511] Processing CreateTablet for tablet 7508c25b6d9944dda6f30aac9f238ae6 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:42.160311  6320 tablet_service.cc:1511] Processing CreateTablet for tablet c5f7d4daab074bd6b452f58e1a57a7ea (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:42.161497  6244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e2856a0d3994696bbc8de68c3679c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.164718  6390 tablet_service.cc:1511] Processing CreateTablet for tablet f3c8c870200141efa8a5f7cc58ece4a6 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:42.124806  6321 tablet_service.cc:1511] Processing CreateTablet for tablet f3c8c870200141efa8a5f7cc58ece4a6 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:42.167083  6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7508c25b6d9944dda6f30aac9f238ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.167333  6238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1061e95aa2d446f2aeb9563f482f1cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.169026  6240 tablet_service.cc:1511] Processing CreateTablet for tablet f3c8c870200141efa8a5f7cc58ece4a6 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:42.170305  6240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c8c870200141efa8a5f7cc58ece4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.173496  6243 tablet_service.cc:1511] Processing CreateTablet for tablet 7508c25b6d9944dda6f30aac9f238ae6 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:42.174783  6243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7508c25b6d9944dda6f30aac9f238ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.176067  6445 tablet_bootstrap.cc:654] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.182928  6319 tablet_service.cc:1511] Processing CreateTablet for tablet c422c1ccba3c4f8c9a7811e10c0f5dd3 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:42.187433  6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5f7d4daab074bd6b452f58e1a57a7ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.199023  6246 tablet_service.cc:1511] Processing CreateTablet for tablet c422c1ccba3c4f8c9a7811e10c0f5dd3 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:42.200816  6246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c422c1ccba3c4f8c9a7811e10c0f5dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.201967  6240 tablet_service.cc:1511] Processing CreateTablet for tablet 26c3f5e2706b41929dff126f046ad839 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:42.204550  6237 tablet_service.cc:1511] Processing CreateTablet for tablet bec594ed8e8449619512ba6e0d3d04cf (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:42.207017  6315 tablet_service.cc:1511] Processing CreateTablet for tablet 26c3f5e2706b41929dff126f046ad839 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:42.209981  6314 tablet_service.cc:1511] Processing CreateTablet for tablet bec594ed8e8449619512ba6e0d3d04cf (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:42.227487  6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c8c870200141efa8a5f7cc58ece4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.228003  6239 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad52cf302674a048c4b3a989596b435 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:42.234016  6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c422c1ccba3c4f8c9a7811e10c0f5dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.234735  6318 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad52cf302674a048c4b3a989596b435 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:42.236064  6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad52cf302674a048c4b3a989596b435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.237810  6447 tablet_bootstrap.cc:492] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:42.237645  6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec594ed8e8449619512ba6e0d3d04cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.225993  6237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec594ed8e8449619512ba6e0d3d04cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.239413  6390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c8c870200141efa8a5f7cc58ece4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.247875  6241 tablet_service.cc:1511] Processing CreateTablet for tablet c5f7d4daab074bd6b452f58e1a57a7ea (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:42.249078  6317 tablet_service.cc:1511] Processing CreateTablet for tablet 1061e95aa2d446f2aeb9563f482f1cd9 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:42.252557  6387 tablet_service.cc:1511] Processing CreateTablet for tablet c5f7d4daab074bd6b452f58e1a57a7ea (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:42.283433  6387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5f7d4daab074bd6b452f58e1a57a7ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.284255  6316 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9d4db6a641496881a55d48d32c6f7e (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:42.254366  6313 tablet_service.cc:1511] Processing CreateTablet for tablet 1e2856a0d3994696bbc8de68c3679c2f (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:42.257699  6391 tablet_service.cc:1511] Processing CreateTablet for tablet c422c1ccba3c4f8c9a7811e10c0f5dd3 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:42.258872  6393 tablet_service.cc:1511] Processing CreateTablet for tablet 26c3f5e2706b41929dff126f046ad839 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:42.260784  6386 tablet_service.cc:1511] Processing CreateTablet for tablet bec594ed8e8449619512ba6e0d3d04cf (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:42.291042  6393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c3f5e2706b41929dff126f046ad839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.291908  6386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec594ed8e8449619512ba6e0d3d04cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.292575  6391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c422c1ccba3c4f8c9a7811e10c0f5dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.262663  6388 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad52cf302674a048c4b3a989596b435 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:42.266814  6392 tablet_service.cc:1511] Processing CreateTablet for tablet 1e2856a0d3994696bbc8de68c3679c2f (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:42.271833  6245 tablet_service.cc:1511] Processing CreateTablet for tablet c0c4567153664b518d2f6515e419da60 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:42.273084  6446 tablet_bootstrap.cc:492] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:42.274658  6312 tablet_service.cc:1511] Processing CreateTablet for tablet c0c4567153664b518d2f6515e419da60 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:42.275525  6239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad52cf302674a048c4b3a989596b435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.275840  6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1061e95aa2d446f2aeb9563f482f1cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.276648  6394 tablet_service.cc:1511] Processing CreateTablet for tablet c0c4567153664b518d2f6515e419da60 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:42.282094  6395 tablet_service.cc:1511] Processing CreateTablet for tablet 7508c25b6d9944dda6f30aac9f238ae6 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:42.299875  6242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9d4db6a641496881a55d48d32c6f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.300043  6394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c4567153664b518d2f6515e419da60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.305464  6245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c4567153664b518d2f6515e419da60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.306133  6243 tablet_service.cc:1511] Processing CreateTablet for tablet ae75079e4a9346d0a9b0c375570b7f9d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:42.307389  6243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae75079e4a9346d0a9b0c375570b7f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.312040  6241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5f7d4daab074bd6b452f58e1a57a7ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.311630  6321 tablet_service.cc:1511] Processing CreateTablet for tablet ae75079e4a9346d0a9b0c375570b7f9d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:42.313445  6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c4567153664b518d2f6515e419da60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.313970  6238 tablet_service.cc:1511] Processing CreateTablet for tablet c2c1e4f96c604cc898081f72ae4eacf2 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:42.315212  6238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c1e4f96c604cc898081f72ae4eacf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.317425  6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9d4db6a641496881a55d48d32c6f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.307137  6389 tablet_service.cc:1511] Processing CreateTablet for tablet c2c1e4f96c604cc898081f72ae4eacf2 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:42.319100  6320 tablet_service.cc:1511] Processing CreateTablet for tablet c2c1e4f96c604cc898081f72ae4eacf2 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:42.320912  6395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7508c25b6d9944dda6f30aac9f238ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.322378  6389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c1e4f96c604cc898081f72ae4eacf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.322489  6446 tablet_bootstrap.cc:654] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:42.323251  6202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:42.325711  6388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad52cf302674a048c4b3a989596b435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.332472  6240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c3f5e2706b41929dff126f046ad839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.335820  6390 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9d4db6a641496881a55d48d32c6f7e (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:42.336810  6445 tablet_bootstrap.cc:492] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:42.337101  6390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9d4db6a641496881a55d48d32c6f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.344936  6237 tablet_service.cc:1511] Processing CreateTablet for tablet 55cead5798bd4451a23aee760d202f18 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:42.357811  6392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e2856a0d3994696bbc8de68c3679c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.358502  6237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55cead5798bd4451a23aee760d202f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.346468  6244 tablet_service.cc:1511] Processing CreateTablet for tablet 884ae035eff04463b5ff7a054f75935d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:42.362452  6244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884ae035eff04463b5ff7a054f75935d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.346489  6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c1e4f96c604cc898081f72ae4eacf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.347685  6447 tablet_bootstrap.cc:654] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.369256  6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae75079e4a9346d0a9b0c375570b7f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.337378  6445 ts_tablet_manager.cc:1403] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.222s	user 0.025s	sys 0.020s
I20260709 13:13:42.356904  6319 tablet_service.cc:1511] Processing CreateTablet for tablet 55cead5798bd4451a23aee760d202f18 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:42.376566  6445 raft_consensus.cc:359] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:42.386183  6318 tablet_service.cc:1511] Processing CreateTablet for tablet 884ae035eff04463b5ff7a054f75935d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:42.391253  6314 tablet_service.cc:1511] Processing CreateTablet for tablet dd8e69d69ccd4bc99194b3d3e6633693 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:42.380172  6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e2856a0d3994696bbc8de68c3679c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.414825  6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c3f5e2706b41929dff126f046ad839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.378724  6445 raft_consensus.cc:385] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.417421  6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884ae035eff04463b5ff7a054f75935d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.424232  6239 tablet_service.cc:1511] Processing CreateTablet for tablet dd8e69d69ccd4bc99194b3d3e6633693 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:42.434501  6395 tablet_service.cc:1511] Processing CreateTablet for tablet 55cead5798bd4451a23aee760d202f18 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:42.435845  6395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55cead5798bd4451a23aee760d202f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.435935  6386 tablet_service.cc:1511] Processing CreateTablet for tablet dd8e69d69ccd4bc99194b3d3e6633693 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:42.436152  6387 tablet_service.cc:1511] Processing CreateTablet for tablet 50e7a35d701c4730b5efb6fefa7f5ec6 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:42.434501  6394 tablet_service.cc:1511] Processing CreateTablet for tablet ae75079e4a9346d0a9b0c375570b7f9d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:42.438717  6386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8e69d69ccd4bc99194b3d3e6633693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.432976  6321 tablet_service.cc:1511] Processing CreateTablet for tablet c17ed9277f5d4839b300200e6c909c0f (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:42.439798  6394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae75079e4a9346d0a9b0c375570b7f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.441422  6391 tablet_service.cc:1511] Processing CreateTablet for tablet 884ae035eff04463b5ff7a054f75935d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:42.442373  6387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e7a35d701c4730b5efb6fefa7f5ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.449368  6239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8e69d69ccd4bc99194b3d3e6633693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.438481  6393 tablet_service.cc:1511] Processing CreateTablet for tablet c17ed9277f5d4839b300200e6c909c0f (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:42.450886  6243 tablet_service.cc:1511] Processing CreateTablet for tablet 50e7a35d701c4730b5efb6fefa7f5ec6 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:42.451478  6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8e69d69ccd4bc99194b3d3e6633693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.452113  6243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e7a35d701c4730b5efb6fefa7f5ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.442960  6316 tablet_service.cc:1511] Processing CreateTablet for tablet 50e7a35d701c4730b5efb6fefa7f5ec6 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:42.453588  6393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c17ed9277f5d4839b300200e6c909c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.453472  6312 tablet_service.cc:1511] Processing CreateTablet for tablet efde1f99d92b4d97b29f2a2f0d1c1c62 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:42.417979  6445 raft_consensus.cc:740] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.454042  6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55cead5798bd4451a23aee760d202f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.471686  6391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884ae035eff04463b5ff7a054f75935d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.476817  6446 tablet_bootstrap.cc:492] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:42.472370  6447 tablet_bootstrap.cc:492] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:42.481154  6447 ts_tablet_manager.cc:1403] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.244s	user 0.015s	sys 0.000s
I20260709 13:13:42.483933  6447 raft_consensus.cc:359] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:13:42.484632  6447 raft_consensus.cc:385] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.485337  6446 ts_tablet_manager.cc:1403] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.213s	user 0.011s	sys 0.003s
I20260709 13:13:42.488096  6446 raft_consensus.cc:359] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:42.488760  6446 raft_consensus.cc:385] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.489367  6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c17ed9277f5d4839b300200e6c909c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.491218  6245 tablet_service.cc:1511] Processing CreateTablet for tablet 5af589183a05415d9cb49d32caedd78f (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:42.492511  6245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af589183a05415d9cb49d32caedd78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.494077  6240 tablet_service.cc:1511] Processing CreateTablet for tablet efde1f99d92b4d97b29f2a2f0d1c1c62 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:42.495374  6240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efde1f99d92b4d97b29f2a2f0d1c1c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.495093  6241 tablet_service.cc:1511] Processing CreateTablet for tablet e1c5cae95db44ec58187d3429c9bdf2e (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:42.496331  6241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c5cae95db44ec58187d3429c9bdf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.503425  6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efde1f99d92b4d97b29f2a2f0d1c1c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.484921  6447 raft_consensus.cc:740] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.509951  6447 consensus_queue.cc:260] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:13:42.510812  6320 tablet_service.cc:1511] Processing CreateTablet for tablet 5af589183a05415d9cb49d32caedd78f (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:42.512104  6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af589183a05415d9cb49d32caedd78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.519057  6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e7a35d701c4730b5efb6fefa7f5ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.520437  6392 tablet_service.cc:1511] Processing CreateTablet for tablet efde1f99d92b4d97b29f2a2f0d1c1c62 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:42.521541  6281 heartbeater.cc:499] Master 127.4.254.62:46653 was elected leader, sending a full tablet report...
I20260709 13:13:42.522446  6392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efde1f99d92b4d97b29f2a2f0d1c1c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.489035  6446 raft_consensus.cc:740] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.526122  6446 consensus_queue.cc:260] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:42.478629  6445 consensus_queue.cc:260] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:42.531314  6393 tablet_service.cc:1511] Processing CreateTablet for tablet 5af589183a05415d9cb49d32caedd78f (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:42.532189  6388 tablet_service.cc:1511] Processing CreateTablet for tablet e1c5cae95db44ec58187d3429c9bdf2e (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:42.532763  6393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af589183a05415d9cb49d32caedd78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.533556  6388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c5cae95db44ec58187d3429c9bdf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.545313  6246 tablet_service.cc:1511] Processing CreateTablet for tablet c17ed9277f5d4839b300200e6c909c0f (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:42.546669  6246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c17ed9277f5d4839b300200e6c909c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.551532  6316 tablet_service.cc:1511] Processing CreateTablet for tablet e1c5cae95db44ec58187d3429c9bdf2e (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:42.552915  6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c5cae95db44ec58187d3429c9bdf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.528566  6242 tablet_service.cc:1511] Processing CreateTablet for tablet ea04d9d509e04fbdafdf863603b94c70 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:42.554489  6242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea04d9d509e04fbdafdf863603b94c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.556475  6244 tablet_service.cc:1511] Processing CreateTablet for tablet e25e23b6cebd41369f84b2c74e182cbd (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:42.570914  6386 tablet_service.cc:1511] Processing CreateTablet for tablet 090a0dad86b546e6b091b67e69cc1bcc (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:42.571319  6316 tablet_service.cc:1511] Processing CreateTablet for tablet ea04d9d509e04fbdafdf863603b94c70 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:42.572364  6386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090a0dad86b546e6b091b67e69cc1bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.572464  6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea04d9d509e04fbdafdf863603b94c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.599850  6244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25e23b6cebd41369f84b2c74e182cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.565029  6390 tablet_service.cc:1511] Processing CreateTablet for tablet ea04d9d509e04fbdafdf863603b94c70 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:42.608507  6387 tablet_service.cc:1511] Processing CreateTablet for tablet e25e23b6cebd41369f84b2c74e182cbd (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:42.615157  6451 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.614694  6430 heartbeater.cc:499] Master 127.4.254.62:46653 was elected leader, sending a full tablet report...
I20260709 13:13:42.617468  6447 ts_tablet_manager.cc:1434] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.136s	user 0.009s	sys 0.007s
I20260709 13:13:42.614841  6390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea04d9d509e04fbdafdf863603b94c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.618481  6447 tablet_bootstrap.cc:492] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:42.609305  6245 tablet_service.cc:1511] Processing CreateTablet for tablet e31ff23bb63c4e33afd90afd6bf5f198 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:42.616148  6356 heartbeater.cc:499] Master 127.4.254.62:46653 was elected leader, sending a full tablet report...
I20260709 13:13:42.625195  6451 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:13:42.629776  6238 tablet_service.cc:1511] Processing CreateTablet for tablet 090a0dad86b546e6b091b67e69cc1bcc (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:42.638010  6387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25e23b6cebd41369f84b2c74e182cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.639921  6245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31ff23bb63c4e33afd90afd6bf5f198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.641932  6317 tablet_service.cc:1511] Processing CreateTablet for tablet 090a0dad86b546e6b091b67e69cc1bcc (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:42.643428  6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090a0dad86b546e6b091b67e69cc1bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.649869  6451 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:13:42.658542  6238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090a0dad86b546e6b091b67e69cc1bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.673485  6445 ts_tablet_manager.cc:1434] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.300s	user 0.010s	sys 0.002s
I20260709 13:13:42.674566  6445 tablet_bootstrap.cc:492] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:42.673640  6446 ts_tablet_manager.cc:1434] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.188s	user 0.021s	sys 0.023s
I20260709 13:13:42.679296  6393 tablet_service.cc:1511] Processing CreateTablet for tablet e31ff23bb63c4e33afd90afd6bf5f198 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:42.680549  6393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31ff23bb63c4e33afd90afd6bf5f198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.684809  6453 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.685321  6453 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:42.685019  6395 tablet_service.cc:1511] Processing CreateTablet for tablet cbc89cb8d0e64feba7a58705d738d699 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:42.690153  6453 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:42.704833  6446 tablet_bootstrap.cc:492] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:42.718613  6243 tablet_service.cc:1511] Processing CreateTablet for tablet 334e41443e364890b884c69082b3bb30 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:42.723982  6243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334e41443e364890b884c69082b3bb30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.721752  6237 tablet_service.cc:1511] Processing CreateTablet for tablet cbc89cb8d0e64feba7a58705d738d699 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:42.733784  6237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc89cb8d0e64feba7a58705d738d699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.733630  6321 tablet_service.cc:1511] Processing CreateTablet for tablet e25e23b6cebd41369f84b2c74e182cbd (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:42.734982  6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25e23b6cebd41369f84b2c74e182cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.740579  6388 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1866b70cb54443b0830659c633edcf (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:42.755336  6315 tablet_service.cc:1511] Processing CreateTablet for tablet e31ff23bb63c4e33afd90afd6bf5f198 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:42.755901  6394 tablet_service.cc:1511] Processing CreateTablet for tablet 334e41443e364890b884c69082b3bb30 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:42.756711  6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31ff23bb63c4e33afd90afd6bf5f198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.759012  6314 tablet_service.cc:1511] Processing CreateTablet for tablet cbc89cb8d0e64feba7a58705d738d699 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:42.760380  6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc89cb8d0e64feba7a58705d738d699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.740799  6245 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc84db94ed44cf9bab11e4626d2ba6e (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:42.766175  6245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc84db94ed44cf9bab11e4626d2ba6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.766170  6445 tablet_bootstrap.cc:654] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.751881  6395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc89cb8d0e64feba7a58705d738d699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.782285  6446 tablet_bootstrap.cc:654] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.764945  6246 tablet_service.cc:1511] Processing CreateTablet for tablet 0fbd02cf1f2d48d2ac594411f00f9678 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:42.787668  6246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbd02cf1f2d48d2ac594411f00f9678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.778216  6313 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1866b70cb54443b0830659c633edcf (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:42.790421  6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1866b70cb54443b0830659c633edcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.793862  6244 tablet_service.cc:1511] Processing CreateTablet for tablet ce99643832824368978841e0265f9d2d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:42.795616  6244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce99643832824368978841e0265f9d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.795831  6391 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc84db94ed44cf9bab11e4626d2ba6e (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:42.812148  6391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc84db94ed44cf9bab11e4626d2ba6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.816324  6389 tablet_service.cc:1511] Processing CreateTablet for tablet 9e60eb0eafd44b02ac71f72df7d3e65d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:42.785203  6239 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1866b70cb54443b0830659c633edcf (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:42.821919  6239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1866b70cb54443b0830659c633edcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.829620  6389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e60eb0eafd44b02ac71f72df7d3e65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.835963  6447 tablet_bootstrap.cc:654] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.854269  6452 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.854843  6452 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:42.801357  6241 tablet_service.cc:1511] Processing CreateTablet for tablet 9e60eb0eafd44b02ac71f72df7d3e65d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:42.849510  6388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1866b70cb54443b0830659c633edcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.862596  6320 tablet_service.cc:1511] Processing CreateTablet for tablet 334e41443e364890b884c69082b3bb30 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:42.866549  6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334e41443e364890b884c69082b3bb30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.870000  6318 tablet_service.cc:1511] Processing CreateTablet for tablet 9e60eb0eafd44b02ac71f72df7d3e65d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:42.871773  6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e60eb0eafd44b02ac71f72df7d3e65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.883329  6241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e60eb0eafd44b02ac71f72df7d3e65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.860945  6386 tablet_service.cc:1511] Processing CreateTablet for tablet ce99643832824368978841e0265f9d2d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:42.890182  6394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334e41443e364890b884c69082b3bb30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.891649  6386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce99643832824368978841e0265f9d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.855337  6390 tablet_service.cc:1511] Processing CreateTablet for tablet 0fbd02cf1f2d48d2ac594411f00f9678 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:42.893837  6452 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:42.907356  6240 tablet_service.cc:1511] Processing CreateTablet for tablet b8b0bb0f383c43abb44e0ab66a228225 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:42.908764  6240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b0bb0f383c43abb44e0ab66a228225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.914657  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:42.915385  6445 tablet_bootstrap.cc:492] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:42.915891  6445 ts_tablet_manager.cc:1403] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.242s	user 0.031s	sys 0.026s
I20260709 13:13:42.915589  6314 tablet_service.cc:1511] Processing CreateTablet for tablet 0fbd02cf1f2d48d2ac594411f00f9678 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 13:13:42.916348  6369 leader_election.cc:343] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:42.916913  6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbd02cf1f2d48d2ac594411f00f9678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.918110  6316 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc84db94ed44cf9bab11e4626d2ba6e (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:42.899958  6390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbd02cf1f2d48d2ac594411f00f9678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.883350  6392 tablet_service.cc:1511] Processing CreateTablet for tablet b8b0bb0f383c43abb44e0ab66a228225 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:42.921236  6445 raft_consensus.cc:359] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:42.952036  6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc84db94ed44cf9bab11e4626d2ba6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.943207  6445 raft_consensus.cc:385] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.956857  6445 raft_consensus.cc:740] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.967157  6392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b0bb0f383c43abb44e0ab66a228225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.960280  6319 tablet_service.cc:1511] Processing CreateTablet for tablet ce99643832824368978841e0265f9d2d (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:42.946072  6242 tablet_service.cc:1511] Processing CreateTablet for tablet ef76416cb5194a2cb26550333d72c307 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:42.979837  6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce99643832824368978841e0265f9d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.993376  6237 tablet_service.cc:1511] Processing CreateTablet for tablet fc9bf1ef8bde4a7db7ca1d39945d2ffe (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:42.993845  6447 tablet_bootstrap.cc:492] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:42.995636  6237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9bf1ef8bde4a7db7ca1d39945d2ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:42.997424  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:13:42.999094  6219 leader_election.cc:343] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.000571  6317 tablet_service.cc:1511] Processing CreateTablet for tablet ef76416cb5194a2cb26550333d72c307 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:43.001397  6447 ts_tablet_manager.cc:1403] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.383s	user 0.019s	sys 0.022s
I20260709 13:13:43.009964  6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef76416cb5194a2cb26550333d72c307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.014115  6391 tablet_service.cc:1511] Processing CreateTablet for tablet fc9bf1ef8bde4a7db7ca1d39945d2ffe (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:43.004779  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:43.002564  6242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef76416cb5194a2cb26550333d72c307. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:43.021800  6368 leader_election.cc:343] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.022315  6368 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:43.023285  6454 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:43.018091  6446 tablet_bootstrap.cc:492] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:43.025458  6446 ts_tablet_manager.cc:1403] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.330s	user 0.022s	sys 0.016s
I20260709 13:13:43.025640  6391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9bf1ef8bde4a7db7ca1d39945d2ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.028090  6312 tablet_service.cc:1511] Processing CreateTablet for tablet b8b0bb0f383c43abb44e0ab66a228225 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:43.029356  6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b0bb0f383c43abb44e0ab66a228225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.034255  6387 tablet_service.cc:1511] Processing CreateTablet for tablet aba53315de954573854008b23574a90f (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:43.035523  6387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba53315de954573854008b23574a90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.036240  6386 tablet_service.cc:1511] Processing CreateTablet for tablet 5176b2e1ff0145bdb28b559244b3cf5e (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:43.037474  6386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5176b2e1ff0145bdb28b559244b3cf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.037897  6393 tablet_service.cc:1511] Processing CreateTablet for tablet ef76416cb5194a2cb26550333d72c307 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:43.039067  6393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef76416cb5194a2cb26550333d72c307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.042088  6391 tablet_service.cc:1511] Processing CreateTablet for tablet 7143f4f3a1eb4f73ae609d74917b08bc (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:42.994628  6445 consensus_queue.cc:260] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.043260  6391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7143f4f3a1eb4f73ae609d74917b08bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.043726  6246 tablet_service.cc:1511] Processing CreateTablet for tablet aba53315de954573854008b23574a90f (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:43.044864  6246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba53315de954573854008b23574a90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.050101  6447 raft_consensus.cc:359] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.050894  6447 raft_consensus.cc:385] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.051185  6447 raft_consensus.cc:740] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.051926  6447 consensus_queue.cc:260] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.062552  6317 tablet_service.cc:1511] Processing CreateTablet for tablet fc9bf1ef8bde4a7db7ca1d39945d2ffe (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:43.074067  6446 raft_consensus.cc:359] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.074867  6446 raft_consensus.cc:385] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.075170  6446 raft_consensus.cc:740] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.075898  6446 consensus_queue.cc:260] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.082463  6244 tablet_service.cc:1511] Processing CreateTablet for tablet 5176b2e1ff0145bdb28b559244b3cf5e (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:43.083766  6244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5176b2e1ff0145bdb28b559244b3cf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.086208  6245 tablet_service.cc:1511] Processing CreateTablet for tablet 7143f4f3a1eb4f73ae609d74917b08bc (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:43.054617  6445 ts_tablet_manager.cc:1434] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.129s	user 0.007s	sys 0.003s
I20260709 13:13:43.090442  6245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7143f4f3a1eb4f73ae609d74917b08bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.090742  6445 tablet_bootstrap.cc:492] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:43.103619  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:43.105914  6221 leader_election.cc:343] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.106371  6221 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:43.107465  6453 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:43.107926  6395 tablet_service.cc:1511] Processing CreateTablet for tablet 41e18ec9396146c6acf964c759dd56fc (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:43.110394  6390 tablet_service.cc:1511] Processing CreateTablet for tablet 1c399f07ba644d25ba3579e60d6962bd (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:43.123042  6447 ts_tablet_manager.cc:1434] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.113s	user 0.005s	sys 0.002s
I20260709 13:13:43.132915  6389 tablet_service.cc:1511] Processing CreateTablet for tablet 7eeec6c3b81b4e22b65d23b164087705 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:43.133335  6239 tablet_service.cc:1511] Processing CreateTablet for tablet 1c399f07ba644d25ba3579e60d6962bd (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:43.140448  6239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c399f07ba644d25ba3579e60d6962bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.141774  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:43.142479  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:43.143116  6256 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
W20260709 13:13:43.143392  6296 leader_election.cc:343] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.144528  6446 ts_tablet_manager.cc:1434] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.001s
I20260709 13:13:43.144603  6295 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:43.145663  6452 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:43.146035  6452 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.146355  6452 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.096971  6445 tablet_bootstrap.cc:654] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.148689  6238 tablet_service.cc:1511] Processing CreateTablet for tablet 41e18ec9396146c6acf964c759dd56fc (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:43.157539  6238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e18ec9396146c6acf964c759dd56fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.153868  6318 tablet_service.cc:1511] Processing CreateTablet for tablet 5176b2e1ff0145bdb28b559244b3cf5e (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:43.154392  6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9bf1ef8bde4a7db7ca1d39945d2ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.158639  6319 tablet_service.cc:1511] Processing CreateTablet for tablet 7143f4f3a1eb4f73ae609d74917b08bc (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:43.159353  6321 tablet_service.cc:1511] Processing CreateTablet for tablet 1c399f07ba644d25ba3579e60d6962bd (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:43.159909  6320 tablet_service.cc:1511] Processing CreateTablet for tablet 41e18ec9396146c6acf964c759dd56fc (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:43.160804  6315 tablet_service.cc:1511] Processing CreateTablet for tablet bc0d5cf9e08445eea2f9773bf33622d4 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:43.161376  6243 tablet_service.cc:1511] Processing CreateTablet for tablet bc0d5cf9e08445eea2f9773bf33622d4 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:43.162914  6447 tablet_bootstrap.cc:492] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:43.166579  6395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e18ec9396146c6acf964c759dd56fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.166412  6446 tablet_bootstrap.cc:492] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:43.153651  6313 tablet_service.cc:1511] Processing CreateTablet for tablet aba53315de954573854008b23574a90f (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:43.179271  6243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc0d5cf9e08445eea2f9773bf33622d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.181977  6386 tablet_service.cc:1511] Processing CreateTablet for tablet bc0d5cf9e08445eea2f9773bf33622d4 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:43.183867  6386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc0d5cf9e08445eea2f9773bf33622d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.187144  6237 tablet_service.cc:1511] Processing CreateTablet for tablet 7eeec6c3b81b4e22b65d23b164087705 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:43.188428  6237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eeec6c3b81b4e22b65d23b164087705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.193908  6241 tablet_service.cc:1511] Processing CreateTablet for tablet b91f0c50e2de47c299569a0a5d7af6b8 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:43.194407  6390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c399f07ba644d25ba3579e60d6962bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.201558  6389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eeec6c3b81b4e22b65d23b164087705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.202860  6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5176b2e1ff0145bdb28b559244b3cf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.203544  6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba53315de954573854008b23574a90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.208005  6452 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.209894  6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc0d5cf9e08445eea2f9773bf33622d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.213917  6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c399f07ba644d25ba3579e60d6962bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.219350  6316 tablet_service.cc:1511] Processing CreateTablet for tablet b91f0c50e2de47c299569a0a5d7af6b8 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:43.221850  6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91f0c50e2de47c299569a0a5d7af6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.232764  6388 tablet_service.cc:1511] Processing CreateTablet for tablet b91f0c50e2de47c299569a0a5d7af6b8 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:43.234056  6388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91f0c50e2de47c299569a0a5d7af6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.235560  6445 tablet_bootstrap.cc:492] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:43.236110  6445 ts_tablet_manager.cc:1403] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.146s	user 0.043s	sys 0.028s
I20260709 13:13:43.239020  6445 raft_consensus.cc:359] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.212407  6314 tablet_service.cc:1511] Processing CreateTablet for tablet 7eeec6c3b81b4e22b65d23b164087705 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:43.267082  6312 tablet_service.cc:1511] Processing CreateTablet for tablet b2b0ed24d02e419bb6f1e4b24f0bcff5 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:43.267405  6391 tablet_service.cc:1511] Processing CreateTablet for tablet 47628993693e4f69a935e61e4071de94 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:43.268621  6391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47628993693e4f69a935e61e4071de94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.241071  6393 tablet_service.cc:1511] Processing CreateTablet for tablet b2b0ed24d02e419bb6f1e4b24f0bcff5 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:43.274646  6393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b0ed24d02e419bb6f1e4b24f0bcff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.245637  6394 tablet_service.cc:1511] Processing CreateTablet for tablet bade3854ad1b4b2492dd0ecd47e1398b (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:43.277428  6394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bade3854ad1b4b2492dd0ecd47e1398b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.255555  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:43.277963  6256 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.255832  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:43.278200  6392 tablet_service.cc:1511] Processing CreateTablet for tablet 72b743ddeba148d8a8fb0d816501812b (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:13:43.279714  6296 leader_election.cc:343] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.256238  6452 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.262876  6447 tablet_bootstrap.cc:654] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.263330  6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e18ec9396146c6acf964c759dd56fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.289701  6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7143f4f3a1eb4f73ae609d74917b08bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.263504  6446 tablet_bootstrap.cc:654] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.288904  6242 tablet_service.cc:1511] Processing CreateTablet for tablet 72b743ddeba148d8a8fb0d816501812b (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:43.265756  6445 raft_consensus.cc:385] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.296255  6392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b743ddeba148d8a8fb0d816501812b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.296537  6445 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.248013  6245 tablet_service.cc:1511] Processing CreateTablet for tablet 47628993693e4f69a935e61e4071de94 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:43.264882  6240 tablet_service.cc:1511] Processing CreateTablet for tablet b2b0ed24d02e419bb6f1e4b24f0bcff5 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:43.297211  6395 tablet_service.cc:1511] Processing CreateTablet for tablet ca1ca4c5e4934cf9b482701f5eb26d1a (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:43.265460  6241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91f0c50e2de47c299569a0a5d7af6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.297609  6445 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.298457  6395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca1ca4c5e4934cf9b482701f5eb26d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.253360  6246 tablet_service.cc:1511] Processing CreateTablet for tablet bade3854ad1b4b2492dd0ecd47e1398b (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:43.301874  6246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bade3854ad1b4b2492dd0ecd47e1398b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.305449  6240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b0ed24d02e419bb6f1e4b24f0bcff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.307001  6445 ts_tablet_manager.cc:1434] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
W20260709 13:13:43.325588  6202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:43.296279  6313 tablet_service.cc:1511] Processing CreateTablet for tablet bade3854ad1b4b2492dd0ecd47e1398b (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:43.325506  6387 tablet_service.cc:1511] Processing CreateTablet for tablet 4340bb97f0154dbb981570b2ee2f49c5 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:43.309551  6245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47628993693e4f69a935e61e4071de94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.327028  6387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4340bb97f0154dbb981570b2ee2f49c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.312827  6317 tablet_service.cc:1511] Processing CreateTablet for tablet 47628993693e4f69a935e61e4071de94 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:43.329403  6242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b743ddeba148d8a8fb0d816501812b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.315562  6256 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:43.330811  6295 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:43.339088  6445 tablet_bootstrap.cc:492] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:43.318149  6244 tablet_service.cc:1511] Processing CreateTablet for tablet 4340bb97f0154dbb981570b2ee2f49c5 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:43.339942  6452 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:43.293409  6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b0ed24d02e419bb6f1e4b24f0bcff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.348795  6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bade3854ad1b4b2492dd0ecd47e1398b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.352010  6315 tablet_service.cc:1511] Processing CreateTablet for tablet 72b743ddeba148d8a8fb0d816501812b (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:43.353309  6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b743ddeba148d8a8fb0d816501812b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.353082  6316 tablet_service.cc:1511] Processing CreateTablet for tablet 4340bb97f0154dbb981570b2ee2f49c5 (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:43.354283  6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4340bb97f0154dbb981570b2ee2f49c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.356860  6239 tablet_service.cc:1511] Processing CreateTablet for tablet ca1ca4c5e4934cf9b482701f5eb26d1a (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:43.365196  6244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4340bb97f0154dbb981570b2ee2f49c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.366789  6454 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.367412  6454 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.372376  6318 tablet_service.cc:1511] Processing CreateTablet for tablet ca1ca4c5e4934cf9b482701f5eb26d1a (DEFAULT_TABLE table=test-workload [id=1d0c277e2a764f84a5bd12505138eaac]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:43.374729  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:43.375381  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:43.376016  6239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca1ca4c5e4934cf9b482701f5eb26d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.375954  6454 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:43.383279  6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eeec6c3b81b4e22b65d23b164087705. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:43.390164  6369 leader_election.cc:343] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:43.399374  6368 leader_election.cc:343] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.401494  6368 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:43.402554  6454 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:43.404332  6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47628993693e4f69a935e61e4071de94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.412860  6452 raft_consensus.cc:697] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:43.425175  6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca1ca4c5e4934cf9b482701f5eb26d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.426376  6446 tablet_bootstrap.cc:492] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:43.428015  6446 ts_tablet_manager.cc:1403] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.262s	user 0.014s	sys 0.015s
I20260709 13:13:43.431026  6446 raft_consensus.cc:359] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:13:43.431761  6446 raft_consensus.cc:385] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.432053  6446 raft_consensus.cc:740] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.432912  6452 consensus_queue.cc:237] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.433738  6445 tablet_bootstrap.cc:654] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.438504  6473 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.438982  6473 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.442226  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:43.442656  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:43.442858  6256 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:43.440995  6473 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.444005  6295 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:13:43.445324  6296 leader_election.cc:343] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.446983  6473 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:43.447340  6473 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.447691  6473 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.456297  6154 catalog_manager.cc:5697] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:43.436285  6446 consensus_queue.cc:260] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:13:43.467132  6446 ts_tablet_manager.cc:1434] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.002s
I20260709 13:13:43.468109  6446 tablet_bootstrap.cc:492] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:43.475641  6447 tablet_bootstrap.cc:492] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:43.476295  6447 ts_tablet_manager.cc:1403] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.352s	user 0.026s	sys 0.013s
I20260709 13:13:43.485918  6446 tablet_bootstrap.cc:654] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.487470  6473 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.493709  6473 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.494531  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:43.494748  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:43.495154  6256 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:43.496194  6296 leader_election.cc:343] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.481103  6447 raft_consensus.cc:359] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.505528  6256 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:43.506819  6295 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:43.507954  6473 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:43.508443  6473 raft_consensus.cc:697] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:43.509269  6473 consensus_queue.cc:237] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.498945  6447 raft_consensus.cc:385] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.512107  6447 raft_consensus.cc:740] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.513614  6447 consensus_queue.cc:260] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.515157  6447 ts_tablet_manager.cc:1434] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:13:43.518347  6447 tablet_bootstrap.cc:492] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:43.527462  6445 tablet_bootstrap.cc:492] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:43.528787  6445 ts_tablet_manager.cc:1403] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.190s	user 0.042s	sys 0.021s
I20260709 13:13:43.531635  6445 raft_consensus.cc:359] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.532240  6445 raft_consensus.cc:385] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.532490  6445 raft_consensus.cc:740] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.535310  6447 tablet_bootstrap.cc:654] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.533257  6445 consensus_queue.cc:260] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.540473  6445 ts_tablet_manager.cc:1434] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:13:43.541682  6445 tablet_bootstrap.cc:492] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:43.542632  6446 tablet_bootstrap.cc:492] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:43.543092  6446 ts_tablet_manager.cc:1403] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.075s	user 0.006s	sys 0.005s
I20260709 13:13:43.548403  6445 tablet_bootstrap.cc:654] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.559842  6446 raft_consensus.cc:359] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.560635  6446 raft_consensus.cc:385] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.560933  6446 raft_consensus.cc:740] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.563827  6446 consensus_queue.cc:260] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.565716  6445 tablet_bootstrap.cc:492] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:43.566213  6445 ts_tablet_manager.cc:1403] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.001s
I20260709 13:13:43.566448  6446 ts_tablet_manager.cc:1434] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:13:43.567162  6447 tablet_bootstrap.cc:492] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:43.567438  6446 tablet_bootstrap.cc:492] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:43.567751  6447 ts_tablet_manager.cc:1403] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.003s
I20260709 13:13:43.569541  6445 raft_consensus.cc:359] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.570320  6445 raft_consensus.cc:385] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.570634  6445 raft_consensus.cc:740] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.570993  6447 raft_consensus.cc:359] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.571779  6447 raft_consensus.cc:385] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.571496  6445 consensus_queue.cc:260] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.572144  6447 raft_consensus.cc:740] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.573001  6447 consensus_queue.cc:260] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.574163  6446 tablet_bootstrap.cc:654] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.575213  6447 ts_tablet_manager.cc:1434] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:43.576184  6447 tablet_bootstrap.cc:492] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:43.581707  6453 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.582525  6447 tablet_bootstrap.cc:654] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.582206  6453 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.583907  6445 ts_tablet_manager.cc:1434] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:13:43.586601  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:43.588498  6445 tablet_bootstrap.cc:492] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:43.588145  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:43.598503  6445 tablet_bootstrap.cc:654] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:43.598927  6219 leader_election.cc:343] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.599650  6446 tablet_bootstrap.cc:492] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:43.600152  6446 ts_tablet_manager.cc:1403] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.019s
I20260709 13:13:43.604116  6446 raft_consensus.cc:359] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.605103  6446 raft_consensus.cc:385] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.605257  6453 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.605532  6446 raft_consensus.cc:740] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.605974  6453 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.606415  6453 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.606724  6446 consensus_queue.cc:260] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.609675  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:43.610010  6446 ts_tablet_manager.cc:1434] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.005s
I20260709 13:13:43.611567  6446 tablet_bootstrap.cc:492] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
W20260709 13:13:43.611575  6219 leader_election.cc:343] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.620424  6446 tablet_bootstrap.cc:654] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.624298  6453 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.628422  6152 catalog_manager.cc:5697] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:43.633435  6446 tablet_bootstrap.cc:492] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:43.634092  6446 ts_tablet_manager.cc:1403] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.007s
I20260709 13:13:43.638136  6446 raft_consensus.cc:359] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.638970  6446 raft_consensus.cc:385] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.639251  6446 raft_consensus.cc:740] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.640039  6446 consensus_queue.cc:260] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:43.641701  6221 leader_election.cc:343] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.642416  6446 ts_tablet_manager.cc:1434] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:43.642331  6221 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:43.643726  6446 tablet_bootstrap.cc:492] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:43.645239  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:43.647933  6221 leader_election.cc:343] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.648566  6221 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:43.652338  6446 tablet_bootstrap.cc:654] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.665201  6446 tablet_bootstrap.cc:492] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:43.665872  6446 ts_tablet_manager.cc:1403] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.005s
I20260709 13:13:43.665802  6453 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:43.667094  6453 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:43.670055  6446 raft_consensus.cc:359] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.670832  6446 raft_consensus.cc:385] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.671121  6446 raft_consensus.cc:740] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.671579  6447 tablet_bootstrap.cc:492] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:43.672045  6447 ts_tablet_manager.cc:1403] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.096s	user 0.029s	sys 0.061s
I20260709 13:13:43.671864  6446 consensus_queue.cc:260] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.672441  6445 tablet_bootstrap.cc:492] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:43.672886  6445 ts_tablet_manager.cc:1403] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.085s	user 0.041s	sys 0.033s
I20260709 13:13:43.674456  6446 ts_tablet_manager.cc:1434] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:13:43.674772  6447 raft_consensus.cc:359] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.675459  6447 raft_consensus.cc:385] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.675626  6446 tablet_bootstrap.cc:492] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:43.675765  6447 raft_consensus.cc:740] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.675710  6445 raft_consensus.cc:359] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.676574  6445 raft_consensus.cc:385] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.676898  6445 raft_consensus.cc:740] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.676780  6447 consensus_queue.cc:260] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.679215  6447 ts_tablet_manager.cc:1434] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 13:13:43.680555  6447 tablet_bootstrap.cc:492] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:43.682304  6446 tablet_bootstrap.cc:654] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.686715  6447 tablet_bootstrap.cc:654] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.692081  6486 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.693073  6446 tablet_bootstrap.cc:492] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:43.692761  6486 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.693531  6446 ts_tablet_manager.cc:1403] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:13:43.693859  6445 consensus_queue.cc:260] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.695261  6473 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.695935  6473 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.696190  6446 raft_consensus.cc:359] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.696859  6446 raft_consensus.cc:385] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.697156  6446 raft_consensus.cc:740] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.698626  6473 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.699149  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:43.699785  6256 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:43.700793  6295 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:43.700805  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:43.701601  6405 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:43.697888  6446 consensus_queue.cc:260] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.702373  6452 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:43.702719  6452 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.702853  6445 ts_tablet_manager.cc:1434] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:13:43.703091  6452 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.703599  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:43.703879  6445 tablet_bootstrap.cc:492] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
W20260709 13:13:43.704860  6219 leader_election.cc:343] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.706395  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:43.707917  6221 leader_election.cc:343] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.710359  6445 tablet_bootstrap.cc:654] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.711302  6221 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:43.712141  6453 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:43.704209  6486 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.712275  6446 ts_tablet_manager.cc:1434] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:13:43.713581  6446 tablet_bootstrap.cc:492] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:43.715124  6447 tablet_bootstrap.cc:492] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:43.715626  6447 ts_tablet_manager.cc:1403] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.003s
I20260709 13:13:43.717811  6446 tablet_bootstrap.cc:654] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.718076  6447 raft_consensus.cc:359] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.718633  6447 raft_consensus.cc:385] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.718911  6447 raft_consensus.cc:740] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.710321  6452 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.720239  6473 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.722325  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:43.719620  6447 consensus_queue.cc:260] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.722294  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:43.723044  6256 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.723138  6405 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.723511  6454 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.722842  6473 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:13:43.723922  6454 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.725534  6473 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:13:43.727270  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:43.728363  6454 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:13:43.728629  6295 leader_election.cc:343] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.729045  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:43.730377  6404 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:43.732295  6296 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:13:43.734256  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:43.735460  6405 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:43.735857  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:43.721340  6452 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.736788  6452 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:43.736805  6255 raft_consensus.cc:2393] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:13:43.737084  6452 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.737500  6452 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.738653  6446 tablet_bootstrap.cc:492] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:43.739099  6446 ts_tablet_manager.cc:1403] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:13:43.740490  6369 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:43.741912  6454 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.741683  6446 raft_consensus.cc:359] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.743340  6446 raft_consensus.cc:385] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.743604  6446 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.744038  6452 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:13:43.744251  6446 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.746158  6446 ts_tablet_manager.cc:1434] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:43.746995  6446 tablet_bootstrap.cc:492] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:43.746999  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:13:43.748282  6295 leader_election.cc:343] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.748886  6452 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:13:43.751748  6446 tablet_bootstrap.cc:654] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.738317  6296 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:43.753643  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:43.754364  6405 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.756845  6473 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:43.757350  6473 raft_consensus.cc:697] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:43.758157  6473 consensus_queue.cc:237] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.770619  6405 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:43.773346  6296 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:13:43.775738  6256 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:43.777787  6496 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.778272  6496 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.777189  6452 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:43.781272  6446 tablet_bootstrap.cc:492] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:43.781860  6446 ts_tablet_manager.cc:1403] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.012s
I20260709 13:13:43.782819  6494 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.783424  6445 tablet_bootstrap.cc:492] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:43.783269  6494 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.784061  6445 ts_tablet_manager.cc:1403] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.004s
I20260709 13:13:43.786357  6496 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.787653  6494 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:43.788661  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:43.783262  6452 raft_consensus.cc:697] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:43.789322  6255 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 0.
I20260709 13:13:43.791065  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:43.791700  6256 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:43.791355  6445 raft_consensus.cc:359] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.792223  6445 raft_consensus.cc:385] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.792299  6369 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:43.792917  6295 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:43.789059  6454 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:43.793500  6494 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:43.793687  6496 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:43.794054  6494 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.794309  6496 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.794595  6494 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.794901  6496 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.794368  6452 consensus_queue.cc:237] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:13:43.793555  6447 ts_tablet_manager.cc:1434] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.078s	user 0.027s	sys 0.029s
I20260709 13:13:43.797274  6447 tablet_bootstrap.cc:492] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:43.799458  6446 raft_consensus.cc:359] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.800123  6446 raft_consensus.cc:385] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.800413  6446 raft_consensus.cc:740] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.801051  6446 consensus_queue.cc:260] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.802990  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:43.803437  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:43.804054  6331 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 0.
I20260709 13:13:43.792616  6445 raft_consensus.cc:740] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
W20260709 13:13:43.805280  6296 leader_election.cc:343] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.805758  6445 consensus_queue.cc:260] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.806666  6496 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.808907  6445 ts_tablet_manager.cc:1434] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 13:13:43.811041  6496 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.811573  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:43.812462  6446 ts_tablet_manager.cc:1434] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:13:43.812575  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:13:43.812964  6296 leader_election.cc:343] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.813182  6256 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.813458  6446 tablet_bootstrap.cc:492] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:43.810462  6494 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.819203  6447 tablet_bootstrap.cc:654] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.819909  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:43.820462  6255 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.822657  6446 tablet_bootstrap.cc:654] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.823662  6445 tablet_bootstrap.cc:492] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:43.825529  6256 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:43.828591  6295 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:43.829526  6496 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:43.830150  6496 raft_consensus.cc:697] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:43.831189  6496 consensus_queue.cc:237] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.831583  6445 tablet_bootstrap.cc:654] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.834622  6255 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:13:43.835868  6369 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:43.836630  6454 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:43.837291  6494 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:43.839990  6445 tablet_bootstrap.cc:492] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:43.840070  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:43.840482  6445 ts_tablet_manager.cc:1403] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.003s
I20260709 13:13:43.840700  6331 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.841095  6446 tablet_bootstrap.cc:492] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:43.841523  6446 ts_tablet_manager.cc:1403] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.001s
I20260709 13:13:43.842976  6445 raft_consensus.cc:359] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.843607  6445 raft_consensus.cc:385] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.843873  6445 raft_consensus.cc:740] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.845299  6405 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.846570  6447 tablet_bootstrap.cc:492] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:43.847011  6447 ts_tablet_manager.cc:1403] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.004s
I20260709 13:13:43.847049  6152 catalog_manager.cc:5697] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:43.848465  6331 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:13:43.849421  6452 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.849848  6447 raft_consensus.cc:359] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.851009  6447 raft_consensus.cc:385] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.851305  6447 raft_consensus.cc:740] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.851230  6452 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.852488  6454 raft_consensus.cc:697] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:13:43.852139  6447 consensus_queue.cc:260] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.853731  6473 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:43.856665  6454 consensus_queue.cc:237] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.843842  6446 raft_consensus.cc:359] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.857811  6446 raft_consensus.cc:385] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.858075  6446 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.858655  6446 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.860392  6446 ts_tablet_manager.cc:1434] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.002s
I20260709 13:13:43.861265  6446 tablet_bootstrap.cc:492] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:43.867453  6446 tablet_bootstrap.cc:654] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.844554  6445 consensus_queue.cc:260] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.869412  6486 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.869553  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:43.869927  6486 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.870935  6255 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:43.871232  6447 ts_tablet_manager.cc:1434] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:13:43.872246  6447 tablet_bootstrap.cc:492] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:43.872260  6295 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:43.871891  6151 catalog_manager.cc:5697] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:43.872555  6486 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.874483  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:43.874509  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:43.875037  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:43.875274  6331 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:43.875319  6404 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:43.874059  6151 catalog_manager.cc:5697] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:43.876608  6219 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:43.877164  6452 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.877537  6453 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:43.878170  6452 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:43.878587  6452 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.878978  6452 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.879153  6445 ts_tablet_manager.cc:1434] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:13:43.880059  6445 tablet_bootstrap.cc:492] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:43.880103  6453 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.880539  6453 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.885892  6445 tablet_bootstrap.cc:654] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.886418  6452 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.889498  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:43.890229  6453 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.891265  6447 tablet_bootstrap.cc:654] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.891847  6255 raft_consensus.cc:2393] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 1: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:13:43.903301  6446 tablet_bootstrap.cc:492] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:43.903954  6446 ts_tablet_manager.cc:1403] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.000s
I20260709 13:13:43.907464  6446 raft_consensus.cc:359] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.908382  6446 raft_consensus.cc:385] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.908721  6446 raft_consensus.cc:740] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.909168  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:43.909986  6331 raft_consensus.cc:2393] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 1: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:13:43.910964  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:43.911499  6404 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.911288  6446 consensus_queue.cc:260] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.912248  6445 tablet_bootstrap.cc:492] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:43.912698  6445 ts_tablet_manager.cc:1403] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.004s
I20260709 13:13:43.913268  6446 ts_tablet_manager.cc:1434] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:43.914140  6446 tablet_bootstrap.cc:492] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:43.915150  6445 raft_consensus.cc:359] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:13:43.915541  6473 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.915786  6445 raft_consensus.cc:385] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.916095  6445 raft_consensus.cc:740] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.916033  6473 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.916803  6154 catalog_manager.cc:5697] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 0 to 1, leader changed from <none> to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:43.917629  6445 consensus_queue.cc:260] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:13:43.919754  6446 tablet_bootstrap.cc:654] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.919924  6445 ts_tablet_manager.cc:1434] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:13:43.920892  6445 tablet_bootstrap.cc:492] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:43.920825  6473 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.927917  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:43.929755  6296 leader_election.cc:343] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.930371  6445 tablet_bootstrap.cc:654] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.932647  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:43.937107  6404 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:43.937033  6296 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:43.938421  6473 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:43.938715  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:43.939016  6221 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:43.939509  6255 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:43.939757  6486 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:43.941370  6446 tablet_bootstrap.cc:492] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:43.941946  6446 ts_tablet_manager.cc:1403] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.020s
I20260709 13:13:43.943011  6295 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:43.944077  6473 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:43.944443  6473 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.944581  6496 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.944802  6473 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.944941  6446 raft_consensus.cc:359] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.945067  6496 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.945667  6446 raft_consensus.cc:385] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.945967  6446 raft_consensus.cc:740] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.945775  6452 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.946703  6446 consensus_queue.cc:260] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.947098  6496 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.948439  6453 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.948755  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:43.950158  6296 leader_election.cc:343] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.952440  6446 ts_tablet_manager.cc:1434] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:13:43.953454  6446 tablet_bootstrap.cc:492] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:43.953531  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:43.954272  6255 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:43.955935  6295 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:43.957634  6497 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:43.952462  6473 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.958107  6497 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.958490  6497 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.959745  6446 tablet_bootstrap.cc:654] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:43.961949  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:43.962513  6256 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:43.959674  6473 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:43.968755  6486 raft_consensus.cc:697] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:43.969641  6486 consensus_queue.cc:237] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.954475  6445 tablet_bootstrap.cc:492] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:43.971372  6445 ts_tablet_manager.cc:1403] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.006s
I20260709 13:13:43.970757  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:13:43.981827  6296 leader_election.cc:343] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.990047  6496 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:43.990547  6445 raft_consensus.cc:359] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.991410  6445 raft_consensus.cc:385] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:43.991760  6445 raft_consensus.cc:740] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.992481  6445 consensus_queue.cc:260] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:43.994583  6445 ts_tablet_manager.cc:1434] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:13:43.995522  6445 tablet_bootstrap.cc:492] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:43.997190  6447 tablet_bootstrap.cc:492] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:43.997779  6447 ts_tablet_manager.cc:1403] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.126s	user 0.025s	sys 0.011s
I20260709 13:13:44.001798  6445 tablet_bootstrap.cc:654] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.003952  6453 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.004484  6453 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.006671  6496 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:44.007056  6453 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.007776  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:44.008378  6331 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:44.010016  6219 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:44.010725  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.011260  6453 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.011751  6453 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.012180  6453 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:44.012846  6221 leader_election.cc:343] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:43.984900  6256 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:44.018666  6295 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:44.019687  6496 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.020277  6496 raft_consensus.cc:697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:44.021466  6496 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.022222  6453 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.025576  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:44.025879  6445 tablet_bootstrap.cc:492] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:44.026141  6331 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.026486  6445 ts_tablet_manager.cc:1403] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.012s
I20260709 13:13:44.029247  6445 raft_consensus.cc:359] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.031407  6445 raft_consensus.cc:385] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.032061  6445 raft_consensus.cc:740] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.033407  6445 consensus_queue.cc:260] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.033828  6331 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:44.036314  6219 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:44.037382  6513 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.038760  6445 ts_tablet_manager.cc:1434] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:44.040047  6445 tablet_bootstrap.cc:492] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:44.040541  6154 catalog_manager.cc:5697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.042685  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:13:44.044569  6221 leader_election.cc:343] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.049662  6445 tablet_bootstrap.cc:654] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.052107  6496 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.034878  6453 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.057929  6496 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.059544  6473 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.062202  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.062794  6513 raft_consensus.cc:697] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:13:44.063825  6296 leader_election.cc:343] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.063623  6513 consensus_queue.cc:237] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.071244  6497 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.071790  6447 raft_consensus.cc:359] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.072443  6447 raft_consensus.cc:385] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.073268  6497 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.074322  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:44.075557  6446 tablet_bootstrap.cc:492] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:44.076310  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:44.076471  6446 ts_tablet_manager.cc:1403] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.123s	user 0.029s	sys 0.066s
I20260709 13:13:44.076407  6496 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.079279  6446 raft_consensus.cc:359] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.079990  6446 raft_consensus.cc:385] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.080250  6446 raft_consensus.cc:740] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.082465  6446 consensus_queue.cc:260] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.084502  6446 ts_tablet_manager.cc:1434] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:13:44.085364  6446 tablet_bootstrap.cc:492] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:44.090855  6446 tablet_bootstrap.cc:654] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.099376  6496 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.100019  6496 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.102803  6496 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.104246  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:44.105042  6253 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.104143  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.107172  6445 tablet_bootstrap.cc:492] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:44.108027  6445 ts_tablet_manager.cc:1403] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.015s
I20260709 13:13:44.107307  6152 catalog_manager.cc:5697] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:44.108280  6296 leader_election.cc:343] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.109336  6496 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.109829  6496 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.112172  6445 raft_consensus.cc:359] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.113175  6445 raft_consensus.cc:385] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.113255  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.113543  6445 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.112141  6496 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.113901  6404 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:44.114457  6445 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.115701  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:44.116675  6445 ts_tablet_manager.cc:1434] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:13:44.117622  6445 tablet_bootstrap.cc:492] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
W20260709 13:13:44.117830  6295 leader_election.cc:343] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.118288  6295 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:44.119835  6523 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:44.120574  6296 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:44.121397  6452 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:44.119963  6295 leader_election.cc:343] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.121737  6452 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.121934  6295 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:44.122108  6452 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.124172  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:44.124778  6254 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:44.124788  6523 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:44.072682  6447 raft_consensus.cc:740] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.127450  6447 consensus_queue.cc:260] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.128281  6405 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.130820  6445 tablet_bootstrap.cc:654] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.131419  6452 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.135208  6405 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:44.137071  6296 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:44.137938  6523 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.138396  6523 raft_consensus.cc:697] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:44.139250  6523 consensus_queue.cc:237] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.122886  6253 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:44.143911  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:44.144511  6254 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.144747  6445 tablet_bootstrap.cc:492] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:44.145172  6452 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.145570  6445 ts_tablet_manager.cc:1403] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.005s
I20260709 13:13:44.146934  6152 catalog_manager.cc:5697] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.149343  6445 raft_consensus.cc:359] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.150159  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:44.150476  6445 raft_consensus.cc:385] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.150750  6404 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.151000  6445 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.154821  6445 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.158799  6445 ts_tablet_manager.cc:1434] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:13:44.159993  6445 tablet_bootstrap.cc:492] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:44.161235  6523 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.163664  6254 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:44.164760  6295 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:44.165953  6452 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.166545  6452 raft_consensus.cc:697] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:44.167112  6404 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:44.167405  6452 consensus_queue.cc:237] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.168184  6445 tablet_bootstrap.cc:654] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.178483  6523 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.179548  6447 ts_tablet_manager.cc:1434] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.181s	user 0.006s	sys 0.000s
I20260709 13:13:44.180503  6447 tablet_bootstrap.cc:492] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:44.193894  6445 tablet_bootstrap.cc:492] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:44.194591  6445 ts_tablet_manager.cc:1403] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.003s
I20260709 13:13:44.201920  6152 catalog_manager.cc:5697] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.202489  6445 raft_consensus.cc:359] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.203506  6447 tablet_bootstrap.cc:654] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.203568  6445 raft_consensus.cc:385] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.204134  6445 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.205176  6445 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.207149  6445 ts_tablet_manager.cc:1434] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:44.207595  6446 tablet_bootstrap.cc:492] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:44.208063  6446 ts_tablet_manager.cc:1403] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.123s	user 0.046s	sys 0.068s
I20260709 13:13:44.208707  6445 tablet_bootstrap.cc:492] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:44.212452  6446 raft_consensus.cc:359] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.213227  6446 raft_consensus.cc:385] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.213548  6446 raft_consensus.cc:740] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.214188  6446 consensus_queue.cc:260] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.215272  6445 tablet_bootstrap.cc:654] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.215436  6513 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.215852  6513 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.217834  6513 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.218542  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:44.219189  6331 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:44.220023  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.220400  6219 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:44.221627  6513 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:44.221662  6221 leader_election.cc:343] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.222106  6513 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.222493  6513 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.226145  6446 ts_tablet_manager.cc:1434] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:13:44.227327  6446 tablet_bootstrap.cc:492] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:44.235095  6513 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.235894  6447 tablet_bootstrap.cc:492] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:44.236220  6446 tablet_bootstrap.cc:654] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.236353  6447 ts_tablet_manager.cc:1403] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.006s
I20260709 13:13:44.237118  6513 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.238368  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:44.238500  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:44.238996  6331 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:44.239893  6221 leader_election.cc:343] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.242676  6445 tablet_bootstrap.cc:492] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:44.243216  6445 ts_tablet_manager.cc:1403] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.006s
I20260709 13:13:44.243655  6151 catalog_manager.cc:5697] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.245795  6331 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:44.246501  6447 raft_consensus.cc:359] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.246906  6219 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:44.247195  6447 raft_consensus.cc:385] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.247519  6447 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.248001  6513 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.248201  6447 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.248651  6513 raft_consensus.cc:697] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:44.249467  6446 tablet_bootstrap.cc:492] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:44.250027  6446 ts_tablet_manager.cc:1403] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:13:44.249845  6445 raft_consensus.cc:359] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.250483  6445 raft_consensus.cc:385] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.250784  6445 raft_consensus.cc:740] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.249503  6513 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.252667  6447 ts_tablet_manager.cc:1434] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:13:44.253978  6447 tablet_bootstrap.cc:492] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:44.252987  6445 consensus_queue.cc:260] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.256199  6445 ts_tablet_manager.cc:1434] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:13:44.257647  6445 tablet_bootstrap.cc:492] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:44.259749  6447 tablet_bootstrap.cc:654] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.252768  6446 raft_consensus.cc:359] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.260203  6446 raft_consensus.cc:385] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.260530  6452 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.260548  6446 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.266194  6446 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.268846  6446 ts_tablet_manager.cc:1434] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:13:44.269676  6446 tablet_bootstrap.cc:492] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:44.271612  6445 tablet_bootstrap.cc:654] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.275676  6447 tablet_bootstrap.cc:492] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:44.276249  6447 ts_tablet_manager.cc:1403] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.007s
I20260709 13:13:44.281662  6447 raft_consensus.cc:359] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.283501  6447 raft_consensus.cc:385] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.283845  6447 raft_consensus.cc:740] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.284945  6446 tablet_bootstrap.cc:654] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.284732  6447 consensus_queue.cc:260] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.290645  6447 ts_tablet_manager.cc:1434] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:13:44.291553  6447 tablet_bootstrap.cc:492] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
W20260709 13:13:44.297228  6296 consensus_peers.cc:597] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:44.297978  6151 catalog_manager.cc:5697] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.305292  6446 tablet_bootstrap.cc:492] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:44.305749  6454 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.307586  6445 tablet_bootstrap.cc:492] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:44.305778  6446 ts_tablet_manager.cc:1403] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.017s
I20260709 13:13:44.308034  6445 ts_tablet_manager.cc:1403] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.004s
I20260709 13:13:44.308512  6513 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.308952  6513 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.310971  6446 raft_consensus.cc:359] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.311607  6445 raft_consensus.cc:359] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.312294  6445 raft_consensus.cc:385] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.312551  6445 raft_consensus.cc:740] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.311640  6513 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.311653  6446 raft_consensus.cc:385] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.297946  6447 tablet_bootstrap.cc:654] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.313948  6446 raft_consensus.cc:740] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.312840  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.314826  6446 consensus_queue.cc:260] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.313426  6445 consensus_queue.cc:260] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.314285  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:44.318213  6330 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
W20260709 13:13:44.319244  6221 leader_election.cc:343] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.320060  6446 ts_tablet_manager.cc:1434] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:44.319794  6219 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:44.321113  6446 tablet_bootstrap.cc:492] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:44.322060  6445 ts_tablet_manager.cc:1434] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:13:44.322803  6445 tablet_bootstrap.cc:492] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:44.321640  6513 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.323841  6513 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.324175  6513 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.329301  6486 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.329835  6486 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.330905  6446 tablet_bootstrap.cc:654] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.331931  6521 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.332448  6521 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.334671  6521 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.337373  6445 tablet_bootstrap.cc:654] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.337909  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:44.338367  6486 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.340144  6486 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.337925  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.342566  6486 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:13:44.347261  6521 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.349740  6521 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.351868  6497 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.352329  6497 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.354911  6447 tablet_bootstrap.cc:492] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:44.355363  6447 ts_tablet_manager.cc:1403] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.003s
W20260709 13:13:44.342319  6219 leader_election.cc:343] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:44.360924  6221 leader_election.cc:343] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.361891  6221 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:44.362396  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:44.355790  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.363241  6329 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:44.363870  6453 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:44.357502  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.365048  6497 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.344698  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:44.363799  6404 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:44.371805  6219 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:44.372905  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:13:44.373167  6219 leader_election.cc:343] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.373785  6253 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:44.374444  6454 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:44.374831  6453 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.375459  6453 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.375898  6453 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.384574  6295 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:44.385460  6473 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.385937  6473 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.386523  6496 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.387106  6496 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.387573  6496 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.388041  6473 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.390424  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:44.391855  6221 leader_election.cc:343] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.392553  6221 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:44.392455  6447 raft_consensus.cc:359] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.393178  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:44.354545  6521 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.393571  6447 raft_consensus.cc:385] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.394029  6447 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.394228  6521 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.394744  6521 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.395156  6521 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.395215  6447 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.400197  6497 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.400468  6254 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.404469  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:44.399176  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.407099  6486 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.410640  6447 ts_tablet_manager.cc:1434] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.001s
W20260709 13:13:44.411554  6296 leader_election.cc:343] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:44.419379  6296 leader_election.cc:343] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.422420  6447 tablet_bootstrap.cc:492] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:44.418022  6453 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:44.424921  6202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:44.425582  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:44.425871  6453 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.429473  6446 tablet_bootstrap.cc:492] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:44.430037  6446 ts_tablet_manager.cc:1403] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.109s	user 0.025s	sys 0.033s
I20260709 13:13:44.432462  6513 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.432675  6446 raft_consensus.cc:359] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.433480  6446 raft_consensus.cc:385] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.433895  6446 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.434665  6446 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.435827  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:44.436405  6329 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.436931  6446 ts_tablet_manager.cc:1434] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:13:44.437908  6446 tablet_bootstrap.cc:492] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
W20260709 13:13:44.446111  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 53636.3us
W20260709 13:13:44.449707  6295 leader_election.cc:343] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.450187  6295 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:44.451310  6523 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:44.453033  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.456904  6521 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.459584  6446 tablet_bootstrap.cc:654] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.460532  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:44.464013  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:13:44.466153  6219 leader_election.cc:343] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.467804  6445 tablet_bootstrap.cc:492] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:44.468585  6445 ts_tablet_manager.cc:1403] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.146s	user 0.018s	sys 0.000s
I20260709 13:13:44.467811  6329 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:44.470484  6221 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:44.457480  6513 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.472869  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:44.473763  6521 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.473322  6219 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:44.473454  6486 consensus_queue.cc:1048] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:13:44.472756  6221 leader_election.cc:343] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.476755  6521 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.477666  6521 raft_consensus.cc:697] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:44.476438  6445 raft_consensus.cc:359] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.479140  6445 raft_consensus.cc:385] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.479421  6445 raft_consensus.cc:740] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.480365  6445 consensus_queue.cc:260] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.481001  6547 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:44.481716  6521 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.482815  6445 ts_tablet_manager.cc:1434] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:13:44.487447  6445 tablet_bootstrap.cc:492] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
W20260709 13:13:44.483731  6221 leader_election.cc:343] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.485829  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:44.490633  6404 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.478729  6496 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.492193  6547 consensus_queue.cc:1048] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.493314  6523 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.496389  6331 raft_consensus.cc:2393] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 1: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:13:44.497520  6447 tablet_bootstrap.cc:654] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.498759  6219 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:44.499858  6547 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:44.501870  6404 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:44.504863  6446 tablet_bootstrap.cc:492] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:44.505360  6446 ts_tablet_manager.cc:1403] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.014s
I20260709 13:13:44.509388  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:44.510277  6253 raft_consensus.cc:2393] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 1: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:13:44.513337  6221 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:44.514364  6453 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.514400  6446 raft_consensus.cc:359] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.514917  6453 raft_consensus.cc:697] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:44.515133  6446 raft_consensus.cc:385] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.515424  6446 raft_consensus.cc:740] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.515758  6453 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.516189  6496 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.516742  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:44.522516  6445 tablet_bootstrap.cc:654] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.519526  6446 consensus_queue.cc:260] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:44.525820  6296 leader_election.cc:343] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.530046  6446 ts_tablet_manager.cc:1434] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:13:44.530387  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:44.531356  6446 tablet_bootstrap.cc:492] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:44.538672  6523 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:44.539359  6523 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.546614  6446 tablet_bootstrap.cc:654] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.546487  6523 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.552985  6473 consensus_queue.cc:1048] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.557367  6547 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.557718  6405 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.568056  6473 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:44.615250  6523 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:44.628177  6445 tablet_bootstrap.cc:492] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:44.628652  6445 ts_tablet_manager.cc:1403] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.141s	user 0.022s	sys 0.006s
I20260709 13:13:44.631196  6445 raft_consensus.cc:359] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.631886  6445 raft_consensus.cc:385] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.632170  6445 raft_consensus.cc:740] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.633713  6446 tablet_bootstrap.cc:492] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
W20260709 13:13:44.634963  6221 consensus_peers.cc:597] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:44.636562  6446 ts_tablet_manager.cc:1403] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.105s	user 0.022s	sys 0.004s
I20260709 13:13:44.631489  6523 consensus_queue.cc:1048] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:44.632824  6445 consensus_queue.cc:260] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.640087  6445 ts_tablet_manager.cc:1434] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:44.641646  6445 tablet_bootstrap.cc:492] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:44.646987  6446 raft_consensus.cc:359] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.647504  6446 raft_consensus.cc:385] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.647744  6446 raft_consensus.cc:740] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.648327  6446 consensus_queue.cc:260] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.655068  6446 ts_tablet_manager.cc:1434] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 13:13:44.656069  6446 tablet_bootstrap.cc:492] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:44.664913  6453 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:44.688999  6445 tablet_bootstrap.cc:654] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.713651  6446 tablet_bootstrap.cc:654] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.670317  6153 catalog_manager.cc:5697] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.729082  6546 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.886916  6546 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.732088  6496 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.890075  6496 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.890467  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:44.750957  6523 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.892426  6496 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.892259  6523 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.785095  6521 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.884496  6447 tablet_bootstrap.cc:492] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:44.893549  6447 ts_tablet_manager.cc:1403] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.471s	user 0.025s	sys 0.038s
I20260709 13:13:44.893419  6521 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.894202  6523 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.894671  6546 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:44.895462  6521 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.895993  6447 raft_consensus.cc:359] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.896492  6447 raft_consensus.cc:385] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.896733  6447 raft_consensus.cc:740] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.897454  6447 consensus_queue.cc:260] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.898656  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:44.899227  6447 ts_tablet_manager.cc:1434] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:44.899984  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.899255  6329 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:44.900966  6447 tablet_bootstrap.cc:492] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:44.901557  6566 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.902211  6566 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.907116  6566 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.910127  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:44.913367  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:44.913944  6521 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.914479  6521 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.914911  6521 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.917352  6447 tablet_bootstrap.cc:654] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:44.917997  6219 consensus_peers.cc:597] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:44.924360  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:44.926909  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:13:44.928186  6295 leader_election.cc:343] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.929745  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:44.929505  6521 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.929939  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.930852  6253 raft_consensus.cc:2393] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 1: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:13:44.931453  6221 consensus_peers.cc:597] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:44.932108  6221 leader_election.cc:343] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:44.932399  6296 leader_election.cc:343] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.932500  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.932783  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:44.932880  6296 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:44.933451  6329 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:44.933597  6295 leader_election.cc:343] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.933917  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.934039  6566 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:44.935565  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:44.936303  6546 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:44.936965  6402 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:44.938129  6296 leader_election.cc:343] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.938902  6296 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:44.940845  6453 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.944113  6329 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:44.944595  6566 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:44.944660  6296 leader_election.cc:343] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.945452  6296 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:44.947544  6445 tablet_bootstrap.cc:492] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:44.947476  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:44.949710  6445 ts_tablet_manager.cc:1403] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.309s	user 0.020s	sys 0.032s
I20260709 13:13:44.951148  6453 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.952184  6453 raft_consensus.cc:697] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:44.953275  6453 consensus_queue.cc:237] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.956352  6521 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:44.956413  6566 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:44.958693  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:44.961910  6445 raft_consensus.cc:359] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.962396  6445 raft_consensus.cc:385] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.962618  6445 raft_consensus.cc:740] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.965878  6445 consensus_queue.cc:260] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:44.961347  6221 leader_election.cc:343] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.966522  6521 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.969753  6445 ts_tablet_manager.cc:1434] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:13:44.970763  6445 tablet_bootstrap.cc:492] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:44.971545  6521 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.988903  6496 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.989616  6496 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:44.994500  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:44.996227  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:13:44.996590  6296 leader_election.cc:343] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.997378  6496 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.004015  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:45.004915  6331 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:45.006376  6219 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:45.007469  6513 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.007849  6513 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.008273  6513 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:45.007682  6295 leader_election.cc:343] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.011895  6295 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:45.012477  6521 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.018702  6447 tablet_bootstrap.cc:492] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:45.019290  6447 ts_tablet_manager.cc:1403] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.119s	user 0.021s	sys 0.041s
I20260709 13:13:45.022177  6496 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.024896  6445 tablet_bootstrap.cc:654] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.026508  6513 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.028403  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.029003  6447 raft_consensus.cc:359] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.029580  6402 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.029693  6447 raft_consensus.cc:385] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.014577  6152 catalog_manager.cc:5697] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:13:45.030009  6447 raft_consensus.cc:740] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.030700  6447 consensus_queue.cc:260] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.033583  6447 ts_tablet_manager.cc:1434] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:13:45.034478  6447 tablet_bootstrap.cc:492] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:45.037772  6513 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:13:45.039331  6221 leader_election.cc:343] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.034623  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:45.039327  6446 tablet_bootstrap.cc:492] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:45.042793  6446 ts_tablet_manager.cc:1403] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.387s	user 0.006s	sys 0.013s
I20260709 13:13:45.041797  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:13:45.047580  6221 leader_election.cc:343] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.044737  6580 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:13:45.045300  6331 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.055431  6151 catalog_manager.cc:5697] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:45.060496  6221 consensus_peers.cc:597] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:45.056196  6446 raft_consensus.cc:359] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.061493  6446 raft_consensus.cc:385] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.061767  6331 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:45.061898  6446 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.063076  6219 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:45.062873  6446 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.063594  6447 tablet_bootstrap.cc:654] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.064160  6580 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.064677  6580 raft_consensus.cc:697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:45.065521  6580 consensus_queue.cc:237] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.080833  6447 tablet_bootstrap.cc:492] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:45.081375  6447 ts_tablet_manager.cc:1403] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.002s
I20260709 13:13:45.082015  6445 tablet_bootstrap.cc:492] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:45.082450  6445 ts_tablet_manager.cc:1403] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.112s	user 0.009s	sys 0.006s
I20260709 13:13:45.084503  6447 raft_consensus.cc:359] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.085230  6447 raft_consensus.cc:385] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.085187  6445 raft_consensus.cc:359] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.085639  6447 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.085929  6445 raft_consensus.cc:385] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.086213  6445 raft_consensus.cc:740] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.086628  6447 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.089169  6447 ts_tablet_manager.cc:1434] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:13:45.090394  6447 tablet_bootstrap.cc:492] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:45.093747  6446 ts_tablet_manager.cc:1434] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.004s
I20260709 13:13:45.094606  6446 tablet_bootstrap.cc:492] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:45.098671  6447 tablet_bootstrap.cc:654] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.099845  6446 tablet_bootstrap.cc:654] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.086989  6445 consensus_queue.cc:260] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.101989  6445 ts_tablet_manager.cc:1434] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:13:45.102847  6445 tablet_bootstrap.cc:492] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:45.108109  6445 tablet_bootstrap.cc:654] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.109673  6580 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.110134  6580 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.112684  6580 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.114497  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.115185  6402 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:45.114497  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:13:45.117949  6219 leader_election.cc:343] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.119716  6221 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:45.120803  6580 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.121210  6580 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.121647  6580 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.127741  6447 tablet_bootstrap.cc:492] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:45.128285  6447 ts_tablet_manager.cc:1403] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.007s
I20260709 13:13:45.129770  6580 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.131793  6580 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.133311  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:13:45.136088  6219 leader_election.cc:343] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.138401  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:45.139209  6402 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.151976  6497 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.152544  6497 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.154595  6153 catalog_manager.cc:5697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.156116  6497 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.156709  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:45.158749  6296 leader_election.cc:343] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.159205  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:45.159546  6402 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:45.160409  6447 raft_consensus.cc:359] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:45.160835  6295 leader_election.cc:343] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.161099  6447 raft_consensus.cc:385] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.161414  6447 raft_consensus.cc:740] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.161309  6295 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:45.162168  6447 consensus_queue.cc:260] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.162848  6566 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.164283  6447 ts_tablet_manager.cc:1434] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.036s	user 0.001s	sys 0.002s
I20260709 13:13:45.165315  6446 tablet_bootstrap.cc:492] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:45.165750  6446 ts_tablet_manager.cc:1403] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.038s
I20260709 13:13:45.165895  6221 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:45.167126  6580 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.167727  6580 raft_consensus.cc:697] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:45.168314  6446 raft_consensus.cc:359] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.168977  6446 raft_consensus.cc:385] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.169334  6446 raft_consensus.cc:740] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.168802  6580 consensus_queue.cc:237] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.169960  6446 consensus_queue.cc:260] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.171443  6446 ts_tablet_manager.cc:1434] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:45.172224  6446 tablet_bootstrap.cc:492] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:45.174288  6447 tablet_bootstrap.cc:492] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:45.175606  6445 tablet_bootstrap.cc:492] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:45.176071  6445 ts_tablet_manager.cc:1403] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.046s
I20260709 13:13:45.179205  6445 raft_consensus.cc:359] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.179924  6447 tablet_bootstrap.cc:654] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.180107  6445 raft_consensus.cc:385] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.180433  6445 raft_consensus.cc:740] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.181191  6445 consensus_queue.cc:260] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.183492  6445 ts_tablet_manager.cc:1434] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:45.184412  6445 tablet_bootstrap.cc:492] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:45.190840  6445 tablet_bootstrap.cc:654] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.192590  6446 tablet_bootstrap.cc:654] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.205302  6152 catalog_manager.cc:5697] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.226342  6445 tablet_bootstrap.cc:492] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:45.226902  6445 ts_tablet_manager.cc:1403] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 13:13:45.227069  6446 tablet_bootstrap.cc:492] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:45.227586  6446 ts_tablet_manager.cc:1403] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.000s
I20260709 13:13:45.228710  6447 tablet_bootstrap.cc:492] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:45.229197  6447 ts_tablet_manager.cc:1403] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.003s
I20260709 13:13:45.229075  6445 raft_consensus.cc:359] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.229737  6445 raft_consensus.cc:385] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.229982  6445 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.230798  6445 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.230679  6446 raft_consensus.cc:359] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.231441  6446 raft_consensus.cc:385] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.231709  6446 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.231997  6447 raft_consensus.cc:359] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.232622  6447 raft_consensus.cc:385] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.232764  6445 ts_tablet_manager.cc:1434] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:45.232479  6446 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.232908  6447 raft_consensus.cc:740] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.233707  6447 consensus_queue.cc:260] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.234395  6445 tablet_bootstrap.cc:492] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:45.235700  6447 ts_tablet_manager.cc:1434] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:45.239868  6447 tablet_bootstrap.cc:492] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:45.239954  6446 ts_tablet_manager.cc:1434] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:45.241840  6445 tablet_bootstrap.cc:654] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.243105  6446 tablet_bootstrap.cc:492] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:45.246421  6447 tablet_bootstrap.cc:654] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.253397  6445 tablet_bootstrap.cc:492] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:45.253895  6445 ts_tablet_manager.cc:1403] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:13:45.255544  6546 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.256019  6546 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.256759  6445 raft_consensus.cc:359] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.257489  6445 raft_consensus.cc:385] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.257808  6445 raft_consensus.cc:740] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.258090  6546 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:45.259472  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:45.259488  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:45.260133  6253 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 0.
I20260709 13:13:45.260442  6331 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 0.
I20260709 13:13:45.261508  6369 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:45.262343  6546 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.262739  6546 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.263111  6546 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.263844  6566 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.264444  6566 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.267068  6566 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.258662  6445 consensus_queue.cc:260] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.269227  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.269641  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:45.271334  6295 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:45.272576  6580 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.263509  6446 tablet_bootstrap.cc:654] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.273026  6580 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.275089  6580 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.276530  6445 ts_tablet_manager.cc:1434] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:13:45.276511  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:45.277251  6331 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:45.277915  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.278111  6566 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.278498  6219 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:13:45.279239  6221 leader_election.cc:343] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.279366  6580 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.280061  6580 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.280431  6445 tablet_bootstrap.cc:492] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:45.280616  6580 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.281672  6447 tablet_bootstrap.cc:492] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:45.282092  6447 ts_tablet_manager.cc:1403] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.020s
I20260709 13:13:45.284617  6447 raft_consensus.cc:359] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.285251  6447 raft_consensus.cc:385] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.285542  6447 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.286329  6447 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.287489  6446 tablet_bootstrap.cc:492] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:45.287902  6446 ts_tablet_manager.cc:1403] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.003s
I20260709 13:13:45.290329  6445 tablet_bootstrap.cc:654] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.291019  6447 ts_tablet_manager.cc:1434] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:13:45.291924  6447 tablet_bootstrap.cc:492] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:45.293771  6446 raft_consensus.cc:359] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.294407  6446 raft_consensus.cc:385] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.294675  6446 raft_consensus.cc:740] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.295413  6446 consensus_queue.cc:260] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.297364  6446 ts_tablet_manager.cc:1434] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:13:45.298169  6447 tablet_bootstrap.cc:654] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.298352  6446 tablet_bootstrap.cc:492] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:45.302881  6546 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.306877  6546 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:45.304914  6446 tablet_bootstrap.cc:654] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.305166  6445 tablet_bootstrap.cc:492] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:45.307595  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:45.308176  6253 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.308502  6447 tablet_bootstrap.cc:492] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:45.308924  6447 ts_tablet_manager.cc:1403] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.001s
I20260709 13:13:45.289681  6580 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.310819  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:45.311362  6331 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.311726  6580 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.311388  6447 raft_consensus.cc:359] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.312147  6447 raft_consensus.cc:385] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.312417  6447 raft_consensus.cc:740] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.312920  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:45.313163  6447 consensus_queue.cc:260] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.313957  6402 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.307603  6445 ts_tablet_manager.cc:1403] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.001s
I20260709 13:13:45.318100  6580 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.318465  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:45.318651  6580 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.319022  6329 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.320065  6402 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:45.320614  6580 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.321918  6221 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:45.322263  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.322656  6580 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.320858  6445 raft_consensus.cc:359] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:45.323436  6221 leader_election.cc:343] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.323804  6580 raft_consensus.cc:697] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:45.325615  6445 raft_consensus.cc:385] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.325971  6445 raft_consensus.cc:740] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.326503  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:45.326644  6445 consensus_queue.cc:260] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.327069  6330 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:45.327391  6447 ts_tablet_manager.cc:1434] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:13:45.328295  6219 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:45.329166  6513 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.329522  6513 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.329852  6513 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.330253  6329 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:45.331887  6253 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:13:45.330438  6445 ts_tablet_manager.cc:1434] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:45.333300  6369 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:45.333564  6445 tablet_bootstrap.cc:492] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:45.334182  6546 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.334837  6546 raft_consensus.cc:697] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:13:45.331116  6331 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:13:45.336314  6447 tablet_bootstrap.cc:492] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:45.335623  6546 consensus_queue.cc:237] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.338621  6580 consensus_queue.cc:237] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.338779  6513 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.342818  6453 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.343768  6453 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.344067  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:45.344605  6331 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.345073  6446 tablet_bootstrap.cc:492] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:45.345534  6446 ts_tablet_manager.cc:1403] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.011s
I20260709 13:13:45.346848  6402 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.347939  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:45.348230  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:45.348532  6329 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:45.348839  6453 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.349768  6219 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:13:45.349838  6221 leader_election.cc:343] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.350313  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.350793  6453 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.351161  6453 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.351972  6453 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.351810  6152 catalog_manager.cc:5697] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 0 to 1, leader changed from <none> to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:45.353360  6221 leader_election.cc:343] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.353155  6446 raft_consensus.cc:359] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.353811  6446 raft_consensus.cc:385] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.354080  6446 raft_consensus.cc:740] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.342795  6513 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.360913  6446 consensus_queue.cc:260] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.362517  6445 tablet_bootstrap.cc:654] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.362986  6446 ts_tablet_manager.cc:1434] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:13:45.366382  6446 tablet_bootstrap.cc:492] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:45.371840  6446 tablet_bootstrap.cc:654] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.372800  6447 tablet_bootstrap.cc:654] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.373533  6331 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:45.374701  6219 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:45.375770  6513 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.376317  6513 raft_consensus.cc:697] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:45.377308  6513 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.380879  6445 tablet_bootstrap.cc:492] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:45.381381  6445 ts_tablet_manager.cc:1403] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.006s
I20260709 13:13:45.381062  6453 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.384085  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:45.384032  6445 raft_consensus.cc:359] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.384799  6445 raft_consensus.cc:385] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.384847  6329 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.385217  6445 raft_consensus.cc:740] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.385978  6445 consensus_queue.cc:260] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.386915  6546 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.392354  6445 ts_tablet_manager.cc:1434] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:13:45.393431  6546 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.394043  6445 tablet_bootstrap.cc:492] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:45.395455  6447 tablet_bootstrap.cc:492] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:45.395908  6447 ts_tablet_manager.cc:1403] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.001s
I20260709 13:13:45.396687  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:45.398386  6447 raft_consensus.cc:359] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.399050  6447 raft_consensus.cc:385] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.399299  6447 raft_consensus.cc:740] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.399848  6546 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:45.399895  6447 consensus_queue.cc:260] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.402956  6447 ts_tablet_manager.cc:1434] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:45.404043  6447 tablet_bootstrap.cc:492] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:45.404003  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:13:45.405675  6221 leader_election.cc:343] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.402928  6453 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.407872  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:45.408648  6331 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:13:45.408828  6446 tablet_bootstrap.cc:492] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:45.409809  6446 ts_tablet_manager.cc:1403] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.044s	user 0.004s	sys 0.018s
I20260709 13:13:45.411473  6368 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:45.412643  6546 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.412009  6152 catalog_manager.cc:5697] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.413125  6446 raft_consensus.cc:359] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.413654  6446 raft_consensus.cc:385] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.413889  6446 raft_consensus.cc:740] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.414417  6446 consensus_queue.cc:260] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.416067  6446 ts_tablet_manager.cc:1434] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.002s
I20260709 13:13:45.416795  6446 tablet_bootstrap.cc:492] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:45.419867  6445 tablet_bootstrap.cc:654] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.436503  6566 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.437026  6566 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.438187  6329 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:45.439041  6566 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.439390  6219 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:45.440428  6446 tablet_bootstrap.cc:654] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.441344  6447 tablet_bootstrap.cc:654] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.446259  6446 tablet_bootstrap.cc:492] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:45.447363  6446 ts_tablet_manager.cc:1403] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.004s
I20260709 13:13:45.449052  6580 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.449510  6546 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.450279  6446 raft_consensus.cc:359] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.451269  6446 raft_consensus.cc:385] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.446664  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:45.451596  6446 raft_consensus.cc:740] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.452478  6446 consensus_queue.cc:260] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.453444  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.454212  6402 raft_consensus.cc:2393] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 1: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:13:45.454774  6446 ts_tablet_manager.cc:1434] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:13:45.449579  6580 raft_consensus.cc:697] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:45.456297  6446 tablet_bootstrap.cc:492] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:45.456301  6580 consensus_queue.cc:237] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.456703  6295 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:45.459847  6497 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.463371  6446 tablet_bootstrap.cc:654] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.465232  6152 catalog_manager.cc:5697] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.468169  6523 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.469446  6523 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.472150  6523 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.474231  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:45.475100  6253 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:45.476899  6295 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:45.479051  6523 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.479480  6523 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.479892  6523 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.479936  6496 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.479185  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.480691  6496 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.484642  6496 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:13:45.487397  6296 leader_election.cc:343] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.489804  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:45.491945  6331 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.495828  6523 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.489841  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.499253  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:45.500597  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:45.501364  6253 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:45.504307  6296 leader_election.cc:343] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:45.505033  6296 leader_election.cc:343] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:45.507658  6221 consensus_peers.cc:597] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:45.504325  6402 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:45.510058  6295 leader_election.cc:343] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.510713  6295 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:45.512480  6566 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.523634  6523 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.528455  6523 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.530791  6153 catalog_manager.cc:5697] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.532387  6453 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.535144  6580 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.535652  6580 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.538646  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.545255  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:13:45.546610  6219 leader_election.cc:343] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:45.548365  6221 leader_election.cc:343] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.549631  6221 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:45.550920  6513 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.551550  6513 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.563223  6580 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.532541  6523 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.565250  6447 tablet_bootstrap.cc:492] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:45.565719  6447 ts_tablet_manager.cc:1403] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.162s	user 0.012s	sys 0.002s
I20260709 13:13:45.567911  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:45.571624  6445 tablet_bootstrap.cc:492] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:45.572172  6445 ts_tablet_manager.cc:1403] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.178s	user 0.077s	sys 0.045s
I20260709 13:13:45.572290  6446 tablet_bootstrap.cc:492] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:45.572767  6446 ts_tablet_manager.cc:1403] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.017s
I20260709 13:13:45.574105  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.575101  6445 raft_consensus.cc:359] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:45.575438  6295 leader_election.cc:343] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.575759  6445 raft_consensus.cc:385] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.576051  6445 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.576457  6446 raft_consensus.cc:359] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.577186  6446 raft_consensus.cc:385] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.576812  6445 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.577473  6446 raft_consensus.cc:740] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.578343  6446 consensus_queue.cc:260] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.579006  6445 ts_tablet_manager.cc:1434] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:45.579929  6445 tablet_bootstrap.cc:492] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:45.580344  6446 ts_tablet_manager.cc:1434] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:13:45.581202  6446 tablet_bootstrap.cc:492] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:45.585562  6445 tablet_bootstrap.cc:654] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.588141  6446 tablet_bootstrap.cc:654] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:45.579509  6296 leader_election.cc:343] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.592741  6296 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:45.593170  6453 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.568275  6497 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.596673  6445 tablet_bootstrap.cc:492] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:45.597146  6445 ts_tablet_manager.cc:1403] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:13:45.599603  6445 raft_consensus.cc:359] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.600236  6445 raft_consensus.cc:385] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.600502  6445 raft_consensus.cc:740] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.568500  6253 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:45.601336  6445 consensus_queue.cc:260] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.603410  6445 ts_tablet_manager.cc:1434] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:45.603148  6447 raft_consensus.cc:359] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.603803  6447 raft_consensus.cc:385] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.604097  6447 raft_consensus.cc:740] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.604246  6295 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:45.604820  6447 consensus_queue.cc:260] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.606192  6446 tablet_bootstrap.cc:492] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:45.606271  6496 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.606734  6446 ts_tablet_manager.cc:1403] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.008s
I20260709 13:13:45.607411  6445 tablet_bootstrap.cc:492] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
W20260709 13:13:45.609112  6202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:45.609730  6446 raft_consensus.cc:359] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.610486  6446 raft_consensus.cc:385] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.610764  6446 raft_consensus.cc:740] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.611395  6446 consensus_queue.cc:260] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.613587  6445 tablet_bootstrap.cc:654] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.567185  6523 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.617264  6447 ts_tablet_manager.cc:1434] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:13:45.625816  6446 ts_tablet_manager.cc:1434] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:13:45.626756  6446 tablet_bootstrap.cc:492] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:45.634841  6566 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.635528  6566 raft_consensus.cc:697] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:45.636590  6566 consensus_queue.cc:237] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.643806  6447 tablet_bootstrap.cc:492] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:45.645569  6453 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.649919  6446 tablet_bootstrap.cc:654] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.660238  6447 tablet_bootstrap.cc:654] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.667011  6445 tablet_bootstrap.cc:492] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:45.667452  6445 ts_tablet_manager.cc:1403] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.060s	user 0.028s	sys 0.028s
I20260709 13:13:45.669775  6445 raft_consensus.cc:359] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.670428  6445 raft_consensus.cc:385] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.670692  6445 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.671823  6445 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.674852  6447 tablet_bootstrap.cc:492] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:45.675283  6447 ts_tablet_manager.cc:1403] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.004s
I20260709 13:13:45.675391  6153 catalog_manager.cc:5697] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.677675  6447 raft_consensus.cc:359] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.678320  6447 raft_consensus.cc:385] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.678567  6447 raft_consensus.cc:740] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.679170  6447 consensus_queue.cc:260] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.682093  6445 ts_tablet_manager.cc:1434] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:13:45.680987  6447 ts_tablet_manager.cc:1434] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:45.683655  6447 tablet_bootstrap.cc:492] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:45.689797  6445 tablet_bootstrap.cc:492] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:45.692859  6453 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.695760  6445 tablet_bootstrap.cc:654] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.700201  6447 tablet_bootstrap.cc:654] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.712334  6447 tablet_bootstrap.cc:492] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:45.712782  6447 ts_tablet_manager.cc:1403] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.012s
I20260709 13:13:45.716827  6447 raft_consensus.cc:359] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.717715  6447 raft_consensus.cc:385] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.718067  6447 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.719122  6447 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.722096  6447 ts_tablet_manager.cc:1434] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:45.723253  6447 tablet_bootstrap.cc:492] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:45.731788  6447 tablet_bootstrap.cc:654] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.733748  6446 tablet_bootstrap.cc:492] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:45.734249  6446 ts_tablet_manager.cc:1403] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.009s
I20260709 13:13:45.740018  6569 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.740255  6446 raft_consensus.cc:359] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.740932  6446 raft_consensus.cc:385] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.741286  6446 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.745455  6446 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.750973  6445 tablet_bootstrap.cc:492] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:45.752403  6546 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.753844  6445 ts_tablet_manager.cc:1403] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.025s
I20260709 13:13:45.753675  6546 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.752842  6446 ts_tablet_manager.cc:1434] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:13:45.755692  6546 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:45.756384  6445 raft_consensus.cc:359] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.757709  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:45.757863  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:45.758378  6331 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 0.
W20260709 13:13:45.759093  6369 leader_election.cc:343] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.759725  6368 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:13:45.760703  6546 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.761050  6546 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.761412  6546 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.766331  6446 tablet_bootstrap.cc:492] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:45.767493  6546 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.769779  6546 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:45.770650  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:45.770650  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:45.771595  6331 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:45.772678  6369 leader_election.cc:343] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.757076  6445 raft_consensus.cc:385] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.773728  6445 raft_consensus.cc:740] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.774632  6445 consensus_queue.cc:260] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.778967  6331 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:13:45.780431  6368 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:13:45.785346  6453 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.789988  6446 tablet_bootstrap.cc:654] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.790787  6628 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.791302  6628 raft_consensus.cc:697] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:13:45.792124  6628 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.801522  6447 tablet_bootstrap.cc:492] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:45.801908  6453 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.802138  6447 ts_tablet_manager.cc:1403] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.079s	user 0.028s	sys 0.014s
I20260709 13:13:45.801414  6523 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.803874  6523 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.802378  6453 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.805935  6445 ts_tablet_manager.cc:1434] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 13:13:45.807436  6445 tablet_bootstrap.cc:492] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:45.809885  6523 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.810688  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:45.811336  6253 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:45.811623  6453 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.813423  6295 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:45.813489  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:45.814311  6523 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.814250  6331 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:45.821709  6447 raft_consensus.cc:359] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.822479  6447 raft_consensus.cc:385] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.815124  6523 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.822746  6447 raft_consensus.cc:740] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.829182  6523 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.829478  6447 consensus_queue.cc:260] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.830232  6521 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.830677  6521 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.831598  6447 ts_tablet_manager.cc:1434] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:13:45.823315  6219 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:45.833184  6447 tablet_bootstrap.cc:492] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:45.834620  6513 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.834825  6580 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.834990  6513 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.835397  6513 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.835316  6580 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.836503  6445 tablet_bootstrap.cc:654] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:45.822893  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 45193.1us
I20260709 13:13:45.838299  6580 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.840344  6446 tablet_bootstrap.cc:492] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:45.840783  6446 ts_tablet_manager.cc:1403] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.006s
I20260709 13:13:45.841452  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:45.842990  6546 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.843451  6546 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.832598  6521 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.845803  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:45.846390  6331 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:45.846987  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.847347  6219 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:45.847702  6446 raft_consensus.cc:359] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.848438  6446 raft_consensus.cc:385] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.848821  6446 raft_consensus.cc:740] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.849045  6521 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.854915  6521 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.849821  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.855405  6521 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.851814  6523 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.852133  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.856043  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:45.856492  6403 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:45.856786  6329 raft_consensus.cc:2393] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:13:45.852958  6221 leader_election.cc:343] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.857892  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:45.858897  6513 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.860214  6486 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.854102  6629 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:45.862810  6219 leader_election.cc:343] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:45.862982  6221 leader_election.cc:343] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.863787  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:45.865888  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:45.854334  6546 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:45.866456  6331 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:45.865005  6221 leader_election.cc:343] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.867830  6523 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.850805  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:45.868458  6447 tablet_bootstrap.cc:654] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.855155  6446 consensus_queue.cc:260] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.870764  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:45.870914  6580 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.871336  6253 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.872664  6629 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:45.873222  6221 leader_election.cc:343] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.869236  6513 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.874289  6221 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:45.875509  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:45.879370  6405 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.879985  6446 ts_tablet_manager.cc:1434] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.002s
I20260709 13:13:45.873227  6629 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.881683  6446 tablet_bootstrap.cc:492] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:45.886878  6369 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:45.889990  6629 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:45.894563  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:45.895043  6331 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:45.895221  6330 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 0.
I20260709 13:13:45.896283  6629 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.893005  6405 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:45.886417  6513 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.896306  6152 catalog_manager.cc:5697] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 0 to 1, leader changed from <none> to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:45.898808  6521 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.906016  6521 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.906332  6296 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:45.907167  6446 tablet_bootstrap.cc:654] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.910007  6629 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.911741  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:45.911989  6368 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:45.912962  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:13:45.913240  6221 consensus_peers.cc:597] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:45.913677  6255 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 0.
W20260709 13:13:45.914132  6221 leader_election.cc:343] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.890605  6253 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:45.914913  6546 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.915297  6546 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.915608  6546 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.917532  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:45.918247  6330 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.922123  6546 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.912984  6523 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.926126  6523 raft_consensus.cc:697] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:45.927244  6523 consensus_queue.cc:237] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.929723  6546 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:45.932801  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:45.935508  6219 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:45.935714  6331 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.936718  6445 tablet_bootstrap.cc:492] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:45.937150  6445 ts_tablet_manager.cc:1403] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.130s	user 0.033s	sys 0.016s
I20260709 13:13:45.937574  6453 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.938059  6453 raft_consensus.cc:697] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:45.938844  6453 consensus_queue.cc:237] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.939631  6445 raft_consensus.cc:359] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.940239  6445 raft_consensus.cc:385] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.940485  6445 raft_consensus.cc:740] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.942099  6566 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.942687  6566 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.933499  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:45.949189  6445 consensus_queue.cc:260] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.947808  6255 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.954728  6445 ts_tablet_manager.cc:1434] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:13:45.959198  6446 tablet_bootstrap.cc:492] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:45.959649  6446 ts_tablet_manager.cc:1403] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.009s
I20260709 13:13:45.959728  6447 tablet_bootstrap.cc:492] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:45.960184  6447 ts_tablet_manager.cc:1403] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.127s	user 0.011s	sys 0.007s
I20260709 13:13:45.971624  6445 tablet_bootstrap.cc:492] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:45.981812  6446 raft_consensus.cc:359] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.982966  6446 raft_consensus.cc:385] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.984263  6446 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.985478  6566 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:45.986855  6446 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.988544  6446 ts_tablet_manager.cc:1434] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 13:13:46.028065  6447 raft_consensus.cc:359] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.087392  6446 tablet_bootstrap.cc:492] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:46.087360  6447 raft_consensus.cc:385] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:46.088954  6447 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:46.090442  6447 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:45.984228  6473 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.982952  6330 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:45.996158  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:46.018566  6546 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.997306  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:46.099226  6447 ts_tablet_manager.cc:1434] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.139s	user 0.008s	sys 0.008s
I20260709 13:13:46.100834  6447 tablet_bootstrap.cc:492] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:46.076507  6331 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:13:46.054854  6486 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260709 13:13:46.108723  6445 tablet_bootstrap.cc:654] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:46.102962  6253 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:46.098043  6473 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.106542  6580 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.100286  6546 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.118109  6546 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:46.121415  6219 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:46.122411  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:46.123483  6521 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:46.124011  6521 raft_consensus.cc:697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:46.124255  6255 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:13:46.125540  6369 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:46.127101  6453 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.126751  6153 catalog_manager.cc:5697] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.124862  6521 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.132591  6546 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:46.116564  6580 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.146162  6546 raft_consensus.cc:697] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:13:46.157195  6486 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.157373  6546 consensus_queue.cc:237] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.158298  6486 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.163362  6447 tablet_bootstrap.cc:654] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:46.172971  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:13:46.177613  6219 leader_election.cc:343] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.176692  6152 catalog_manager.cc:5697] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.180402  6446 tablet_bootstrap.cc:654] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:46.183931  6254 raft_consensus.cc:2393] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:13:46.182771  6296 leader_election.cc:343] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.197600  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:46.198400  6329 raft_consensus.cc:2393] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:13:46.200567  6153 catalog_manager.cc:5697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.218716  6497 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.219370  6486 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:46.232980  6445 tablet_bootstrap.cc:492] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:46.234066  6445 ts_tablet_manager.cc:1403] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.263s	user 0.025s	sys 0.019s
I20260709 13:13:46.240624  6445 raft_consensus.cc:359] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.241297  6445 raft_consensus.cc:385] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:46.241555  6445 raft_consensus.cc:740] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:46.241603  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:46.242261  6445 consensus_queue.cc:260] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.229626  6497 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.245404  6329 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:46.246798  6580 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:46.247153  6219 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:46.248543  6497 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:46.251921  6295 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:46.253815  6628 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.254570  6628 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.256632  6628 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:46.257380  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:13:46.257558  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 75846.7us
I20260709 13:13:46.253366  6151 catalog_manager.cc:5697] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 0 to 1, leader changed from <none> to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:46.259904  6497 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:46.267335  6497 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.267715  6497 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:46.265467  6580 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:46.268266  6580 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.268640  6580 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.270803  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:46.265798  6445 ts_tablet_manager.cc:1434] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:13:46.273648  6445 tablet_bootstrap.cc:492] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:46.278069  6644 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.278590  6644 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.281558  6644 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:46.284440  6473 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:46.282229  6580 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.300765  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:46.301465  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:46.302000  6445 tablet_bootstrap.cc:654] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:46.305567  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:46.306164  6253 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
W20260709 13:13:46.307452  6296 consensus_peers.cc:597] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:46.307770  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:13:46.308071  6296 leader_election.cc:343] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.308270  6329 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.308523  6644 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.308845  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:46.310164  6368 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:46.310632  6327 raft_consensus.cc:2393] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:13:46.311281  6580 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:46.311861  6628 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:46.311981  6446 tablet_bootstrap.cc:492] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:46.312704  6446 ts_tablet_manager.cc:1403] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.226s	user 0.011s	sys 0.003s
I20260709 13:13:46.313952  6447 tablet_bootstrap.cc:492] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
W20260709 13:13:46.314185  6295 leader_election.cc:343] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.314396  6447 ts_tablet_manager.cc:1403] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.214s	user 0.011s	sys 0.018s
I20260709 13:13:46.315404  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:46.314647  6295 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:46.319159  6628 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:46.324882  6253 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:46.319136  6329 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:13:46.340256  6219 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:46.342058  6649 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:13:46.342578  6295 leader_election.cc:343] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.342618  6644 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:46.343330  6295 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:46.330250  6447 raft_consensus.cc:359] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.344092  6447 raft_consensus.cc:385] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:46.344410  6447 raft_consensus.cc:740] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:46.344190  6644 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:46.345108  6644 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.345479  6644 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:46.336748  6497 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.350263  6649 raft_consensus.cc:697] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:46.350545  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:46.351114  6256 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:46.351226  6649 consensus_queue.cc:237] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.349684  6628 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:46.359042  6256 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:46.359066  6644 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.360554  6295 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:46.361507  6473 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:46.362025  6473 raft_consensus.cc:697] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:46.362893  6473 consensus_queue.cc:237] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.345505  6447 consensus_queue.cc:260] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.365253  6644 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:46.370405  6447 ts_tablet_manager.cc:1434] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.003s
I20260709 13:13:46.378274  6447 tablet_bootstrap.cc:492] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:46.382503  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:46.335284  6446 raft_consensus.cc:359] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.383876  6446 raft_consensus.cc:385] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:46.384063  6446 raft_consensus.cc:740] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:46.385105  6446 consensus_queue.cc:260] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.388240  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:46.388839  6405 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:46.391274  6497 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:46.393333  6473 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.384689  6256 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:46.405489  6446 ts_tablet_manager.cc:1434] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.092s	user 0.005s	sys 0.002s
I20260709 13:13:46.406404  6446 tablet_bootstrap.cc:492] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:46.410547  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:46.408289  6153 catalog_manager.cc:5697] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.411126  6402 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.454959  6649 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:13:46.470890  6402 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:13:46.525985  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:46.526798  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:46.527124  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:46.528149  6368 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:46.528553  6405 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:46.529235  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:46.529503  6447 tablet_bootstrap.cc:654] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:46.530180  6629 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:46.536111  6445 tablet_bootstrap.cc:492] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:46.535961  6630 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:46.536609  6445 ts_tablet_manager.cc:1403] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.263s	user 0.011s	sys 0.000s
I20260709 13:13:46.537210  6629 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:46.539996  6445 raft_consensus.cc:359] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.540869  6445 raft_consensus.cc:385] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:46.541162  6445 raft_consensus.cc:740] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:46.541821  6445 consensus_queue.cc:260] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.542451  6447 tablet_bootstrap.cc:492] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:46.543005  6447 ts_tablet_manager.cc:1403] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.165s	user 0.007s	sys 0.006s
I20260709 13:13:46.543494  6446 tablet_bootstrap.cc:654] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:46.544240  6445 ts_tablet_manager.cc:1434] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:13:46.545290  6445 tablet_bootstrap.cc:492] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:46.545838  6447 raft_consensus.cc:359] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.546443  6447 raft_consensus.cc:385] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:46.546727  6447 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:46.547338  6447 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.549703  6447 ts_tablet_manager.cc:1434] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:46.550644  6447 tablet_bootstrap.cc:492] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:46.553983  6446 tablet_bootstrap.cc:492] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
W20260709 13:13:46.611718  6221 leader_election.cc:343] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.612910  6221 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:46.554064  6445 tablet_bootstrap.cc:654] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:46.628255  6580 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:46.642390  6296 leader_election.cc:343] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.643023  6296 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:46.616207  6151 catalog_manager.cc:5697] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 2, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.645468  6643 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:46.647456  6296 leader_election.cc:343] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:46.648379  6296 leader_election.cc:343] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.649224  6446 ts_tablet_manager.cc:1403] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.243s	user 0.014s	sys 0.007s
W20260709 13:13:46.655925  6221 consensus_peers.cc:597] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:46.666496  6447 tablet_bootstrap.cc:654] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:46.679888  6566 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:46.677079  6256 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:46.691406  6486 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.691085  6446 raft_consensus.cc:359] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.691938  6446 raft_consensus.cc:385] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:46.692013  6630 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.692335  6446 raft_consensus.cc:740] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:46.692093  6486 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.692715  6630 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.694540  6486 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:46.695209  6630 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:46.696332  6295 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:46.697243  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:46.697640  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:46.698163  6566 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:46.698503  6253 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:13:46.698686  6566 raft_consensus.cc:697] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:46.699819  6566 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.693060  6446 consensus_queue.cc:260] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:46.705526  6221 leader_election.cc:343] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.708282  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:13:46.710743  6296 leader_election.cc:343] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.712334  6446 ts_tablet_manager.cc:1434] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.004s
W20260709 13:13:46.716385  6219 leader_election.cc:343] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.716866  6219 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:46.718777  6649 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:46.721998  6446 tablet_bootstrap.cc:492] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:46.732304  6566 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.732965  6566 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.741302  6473 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.741838  6473 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.743970  6473 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:13:46.744247  6202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:46.745844  6566 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:46.747020  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:46.750159  6629 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:46.777814  6486 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:46.790135  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:46.791815  6445 tablet_bootstrap.cc:492] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:46.792430  6445 ts_tablet_manager.cc:1403] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.247s	user 0.011s	sys 0.009s
W20260709 13:13:46.792205  6295 leader_election.cc:343] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.795506  6445 raft_consensus.cc:359] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.796278  6445 raft_consensus.cc:385] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:46.803962  6295 leader_election.cc:343] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.806304  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:46.810882  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:46.816459  6447 tablet_bootstrap.cc:492] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:46.817013  6447 ts_tablet_manager.cc:1403] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.267s	user 0.066s	sys 0.047s
I20260709 13:13:46.819857  6649 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:46.819916  6447 raft_consensus.cc:359] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.820832  6447 raft_consensus.cc:385] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:46.821163  6447 raft_consensus.cc:740] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:46.823637  6447 consensus_queue.cc:260] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.825188  6447 ts_tablet_manager.cc:1434] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:46.828975  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:46.831940  6629 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.833956  6368 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:46.796571  6445 raft_consensus.cc:740] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:46.835994  6629 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:46.835812  6445 consensus_queue.cc:260] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.839169  6445 ts_tablet_manager.cc:1434] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.002s
I20260709 13:13:46.842214  6473 consensus_queue.cc:1048] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:46.848708  6296 leader_election.cc:343] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.849253  6296 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:46.850121  6473 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:46.850806  6296 leader_election.cc:343] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:46.851264  6296 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:46.852253  6566 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:46.860028  6447 tablet_bootstrap.cc:492] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:46.858521  6151 catalog_manager.cc:5697] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.871222  6447 tablet_bootstrap.cc:654] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:46.882303  6296 consensus_peers.cc:597] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:46.882827  6445 tablet_bootstrap.cc:492] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:46.883982  6446 tablet_bootstrap.cc:654] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:46.903369  6629 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:46.905457  6445 tablet_bootstrap.cc:654] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:46.916565  6403 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:46.916802  6328 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:46.905386  6447 tablet_bootstrap.cc:492] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:46.922367  6447 ts_tablet_manager.cc:1403] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.003s
I20260709 13:13:46.926033  6521 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:46.928369  6405 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:46.929703  6649 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.953295  6447 raft_consensus.cc:359] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.953991  6447 raft_consensus.cc:385] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:46.954259  6447 raft_consensus.cc:740] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:46.962392  6447 consensus_queue.cc:260] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.965363  6447 ts_tablet_manager.cc:1434] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:13:46.966485  6447 tablet_bootstrap.cc:492] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:46.968729  6446 tablet_bootstrap.cc:492] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:46.971814  6446 ts_tablet_manager.cc:1403] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.250s	user 0.030s	sys 0.036s
I20260709 13:13:46.974484  6446 raft_consensus.cc:359] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.975101  6446 raft_consensus.cc:385] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:46.975373  6446 raft_consensus.cc:740] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:46.976001  6446 consensus_queue.cc:260] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:46.997583  6445 tablet_bootstrap.cc:492] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:46.998096  6445 ts_tablet_manager.cc:1403] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.129s	user 0.023s	sys 0.037s
I20260709 13:13:46.998306  6446 ts_tablet_manager.cc:1434] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:13:46.999397  6446 tablet_bootstrap.cc:492] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:47.001118  6445 raft_consensus.cc:359] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.001995  6445 raft_consensus.cc:385] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.002336  6445 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.007328  6580 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.007778  6580 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.009842  6580 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.011126  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:47.012008  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:47.012617  6327 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
W20260709 13:13:47.012871  6221 leader_election.cc:343] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.013688  6219 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.014700  6486 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:47.015107  6486 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.015488  6486 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.018409  6446 tablet_bootstrap.cc:654] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.019040  6445 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.021256  6445 ts_tablet_manager.cc:1434] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:13:47.022238  6445 tablet_bootstrap.cc:492] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:47.028455  6445 tablet_bootstrap.cc:654] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.029968  6486 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.033154  6403 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.021621  6447 tablet_bootstrap.cc:654] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.037475  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:47.038058  6327 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.043061  6486 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.044281  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:13:47.045810  6221 leader_election.cc:343] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.049981  6327 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:47.051311  6219 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.052423  6486 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:47.053539  6486 raft_consensus.cc:697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:47.056692  6486 consensus_queue.cc:237] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.058565  6445 tablet_bootstrap.cc:492] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:47.059011  6445 ts_tablet_manager.cc:1403] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.005s
I20260709 13:13:47.063967  6445 raft_consensus.cc:359] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.064837  6445 raft_consensus.cc:385] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.065186  6445 raft_consensus.cc:740] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.065879  6445 consensus_queue.cc:260] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.068424  6445 ts_tablet_manager.cc:1434] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:13:47.069813  6445 tablet_bootstrap.cc:492] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:47.077621  6445 tablet_bootstrap.cc:654] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.090481  6445 tablet_bootstrap.cc:492] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:47.091010  6445 ts_tablet_manager.cc:1403] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.006s
I20260709 13:13:47.097770  6447 tablet_bootstrap.cc:492] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:47.098235  6447 ts_tablet_manager.cc:1403] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.132s	user 0.010s	sys 0.002s
I20260709 13:13:47.100801  6447 raft_consensus.cc:359] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.104923  6447 raft_consensus.cc:385] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.105388  6447 raft_consensus.cc:740] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.105772  6580 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.106282  6447 consensus_queue.cc:260] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.106467  6580 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.108987  6447 ts_tablet_manager.cc:1434] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:47.110196  6447 tablet_bootstrap.cc:492] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:47.110142  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:47.110889  6327 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:47.103991  6445 raft_consensus.cc:359] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.112823  6445 raft_consensus.cc:385] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.113025  6580 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.113230  6445 raft_consensus.cc:740] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.113657  6219 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:47.114040  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:47.114012  6445 consensus_queue.cc:260] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.115304  6453 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:47.115631  6453 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.115942  6453 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.116164  6445 ts_tablet_manager.cc:1434] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:13:47.117179  6445 tablet_bootstrap.cc:492] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
W20260709 13:13:47.120187  6221 leader_election.cc:343] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.127084  6453 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.128445  6445 tablet_bootstrap.cc:654] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.127585  6447 tablet_bootstrap.cc:654] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.132332  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:13:47.133759  6221 leader_election.cc:343] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.134848  6453 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.137548  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:47.138252  6327 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.141690  6447 tablet_bootstrap.cc:492] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:47.142254  6447 ts_tablet_manager.cc:1403] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.005s
I20260709 13:13:47.151087  6445 tablet_bootstrap.cc:492] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:47.151536  6445 ts_tablet_manager.cc:1403] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.035s	user 0.004s	sys 0.008s
I20260709 13:13:47.155761  6445 raft_consensus.cc:359] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.156416  6445 raft_consensus.cc:385] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.156662  6445 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.157279  6445 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.159278  6445 ts_tablet_manager.cc:1434] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:13:47.160182  6445 tablet_bootstrap.cc:492] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:47.164626  6447 raft_consensus.cc:359] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.165288  6447 raft_consensus.cc:385] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.165553  6447 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.166653  6447 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.168110  6447 ts_tablet_manager.cc:1434] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:13:47.169070  6447 tablet_bootstrap.cc:492] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:47.171111  6580 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.171541  6580 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.173183  6580 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.176800  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:47.177114  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:47.177570  6331 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
W20260709 13:13:47.178866  6221 leader_election.cc:343] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.179405  6219 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.183223  6580 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:47.185348  6580 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.186230  6580 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.186988  6666 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:47.195891  6327 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:47.196463  6446 tablet_bootstrap.cc:492] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:47.196957  6446 ts_tablet_manager.cc:1403] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.198s	user 0.047s	sys 0.085s
I20260709 13:13:47.200577  6446 raft_consensus.cc:359] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.201030  6446 raft_consensus.cc:385] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.201341  6446 raft_consensus.cc:740] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.202840  6446 consensus_queue.cc:260] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.205665  6219 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.207146  6521 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:47.207620  6521 raft_consensus.cc:697] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:47.209730  6666 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.209417  6521 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.210173  6666 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.212872  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:47.213792  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:47.214309  6295 leader_election.cc:343] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.214984  6446 ts_tablet_manager.cc:1434] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:13:47.212302  6666 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:13:47.215142  6296 leader_election.cc:343] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.215910  6446 tablet_bootstrap.cc:492] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:47.215946  6296 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.217907  6445 tablet_bootstrap.cc:654] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.218469  6496 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:47.227789  6497 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:47.233522  6447 tablet_bootstrap.cc:654] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.244204  6445 tablet_bootstrap.cc:492] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:47.244692  6445 ts_tablet_manager.cc:1403] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.012s
I20260709 13:13:47.254622  6445 raft_consensus.cc:359] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.255287  6445 raft_consensus.cc:385] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.255553  6445 raft_consensus.cc:740] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.256186  6445 consensus_queue.cc:260] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.257308  6580 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.258876  6446 tablet_bootstrap.cc:654] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.263074  6580 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.263294  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:47.263628  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:47.264849  6327 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:47.265087  6221 leader_election.cc:343] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.264936  6445 ts_tablet_manager.cc:1434] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.002s
I20260709 13:13:47.267516  6445 tablet_bootstrap.cc:492] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:47.273406  6154 catalog_manager.cc:5697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:47.282546  6327 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:47.284947  6219 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.285167  6580 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.287240  6580 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.287622  6521 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:47.288115  6521 raft_consensus.cc:697] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:47.289242  6580 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.288923  6521 consensus_queue.cc:237] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.291805  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:47.292348  6445 tablet_bootstrap.cc:654] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:47.293429  6221 leader_election.cc:343] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.293612  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:13:47.294926  6219 leader_election.cc:343] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.295825  6219 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.296356  6447 tablet_bootstrap.cc:492] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:47.296768  6447 ts_tablet_manager.cc:1403] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.128s	user 0.016s	sys 0.004s
I20260709 13:13:47.296810  6453 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:47.300004  6446 tablet_bootstrap.cc:492] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:47.299834  6447 raft_consensus.cc:359] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.300580  6447 raft_consensus.cc:385] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.300729  6446 ts_tablet_manager.cc:1403] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.005s
I20260709 13:13:47.305151  6497 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.304673  6446 raft_consensus.cc:359] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.305617  6497 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.306146  6446 raft_consensus.cc:385] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.306921  6446 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.307662  6497 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.309161  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:47.310050  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:47.307928  6446 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:47.312172  6295 leader_election.cc:343] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:47.313648  6296 leader_election.cc:343] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.314168  6296 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.315714  6473 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:47.317333  6447 raft_consensus.cc:740] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.319319  6629 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.319780  6629 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.321898  6629 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:47.323616  6446 ts_tablet_manager.cc:1434] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:13:47.327108  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:47.327534  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:47.328552  6327 raft_consensus.cc:2393] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:13:47.329252  6447 consensus_queue.cc:260] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.330125  6368 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:47.332424  6446 tablet_bootstrap.cc:492] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:47.335899  6630 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.345485  6630 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:47.354506  6403 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.357318  6447 ts_tablet_manager.cc:1434] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.001s
I20260709 13:13:47.362011  6447 tablet_bootstrap.cc:492] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:47.368211  6447 tablet_bootstrap.cc:654] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.367550  6152 catalog_manager.cc:5697] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:47.370460  6446 tablet_bootstrap.cc:654] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.369918  6152 catalog_manager.cc:5697] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:47.379289  6405 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.381878  6447 tablet_bootstrap.cc:492] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:47.382357  6447 ts_tablet_manager.cc:1403] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:13:47.383448  6473 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.383935  6473 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.384974  6447 raft_consensus.cc:359] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.385665  6447 raft_consensus.cc:385] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.385922  6447 raft_consensus.cc:740] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.386137  6473 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.386566  6447 consensus_queue.cc:260] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.389052  6447 ts_tablet_manager.cc:1434] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:47.389501  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:47.390106  6447 tablet_bootstrap.cc:492] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
W20260709 13:13:47.391598  6295 leader_election.cc:343] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.393335  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:47.395851  6296 leader_election.cc:343] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.396239  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.399065  6445 tablet_bootstrap.cc:492] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:47.399514  6445 ts_tablet_manager.cc:1403] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.132s	user 0.030s	sys 0.034s
I20260709 13:13:47.399941  6497 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:47.402784  6447 tablet_bootstrap.cc:654] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.402314  6445 raft_consensus.cc:359] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.403234  6445 raft_consensus.cc:385] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.421451  6445 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.422169  6445 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.418555  6447 tablet_bootstrap.cc:492] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:47.426090  6447 ts_tablet_manager.cc:1403] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.004s
I20260709 13:13:47.428433  6447 raft_consensus.cc:359] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.429039  6447 raft_consensus.cc:385] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.429330  6447 raft_consensus.cc:740] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.429944  6447 consensus_queue.cc:260] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.431421  6447 ts_tablet_manager.cc:1434] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:13:47.432296  6447 tablet_bootstrap.cc:492] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:47.434721  6445 ts_tablet_manager.cc:1434] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 13:13:47.436565  6445 tablet_bootstrap.cc:492] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:47.443559  6447 tablet_bootstrap.cc:654] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.444712  6445 tablet_bootstrap.cc:654] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.448091  6446 tablet_bootstrap.cc:492] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:47.448535  6446 ts_tablet_manager.cc:1403] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.015s
I20260709 13:13:47.451973  6446 raft_consensus.cc:359] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.452497  6446 raft_consensus.cc:385] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.452827  6446 raft_consensus.cc:740] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.454162  6446 consensus_queue.cc:260] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.455950  6446 ts_tablet_manager.cc:1434] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:47.457285  6446 tablet_bootstrap.cc:492] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:47.463840  6446 tablet_bootstrap.cc:654] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.474013  6445 tablet_bootstrap.cc:492] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:47.474089  6447 tablet_bootstrap.cc:492] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:47.474511  6447 ts_tablet_manager.cc:1403] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.005s
I20260709 13:13:47.474511  6445 ts_tablet_manager.cc:1403] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.016s
I20260709 13:13:47.477110  6445 raft_consensus.cc:359] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.477325  6447 raft_consensus.cc:359] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.477820  6445 raft_consensus.cc:385] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.477903  6447 raft_consensus.cc:385] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.478137  6445 raft_consensus.cc:740] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.478183  6447 raft_consensus.cc:740] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.479310  6446 tablet_bootstrap.cc:492] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:47.478998  6447 consensus_queue.cc:260] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.479413  6445 consensus_queue.cc:260] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.479763  6446 ts_tablet_manager.cc:1403] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.007s
I20260709 13:13:47.481783  6521 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:47.482816  6446 raft_consensus.cc:359] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.483481  6446 raft_consensus.cc:385] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.483752  6446 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.484661  6445 ts_tablet_manager.cc:1434] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:47.484766  6446 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.485904  6445 tablet_bootstrap.cc:492] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:47.487093  6446 ts_tablet_manager.cc:1434] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:47.489612  6446 tablet_bootstrap.cc:492] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:47.492707  6445 tablet_bootstrap.cc:654] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.494469  6447 ts_tablet_manager.cc:1434] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:13:47.495815  6446 tablet_bootstrap.cc:654] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.506578  6649 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.507108  6649 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.510191  6649 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.512496  6447 tablet_bootstrap.cc:492] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:47.511765  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:47.511817  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:47.513765  6221 leader_election.cc:343] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:47.514235  6219 leader_election.cc:343] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.514664  6219 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.515368  6649 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:47.520404  6405 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.521844  6447 tablet_bootstrap.cc:654] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.531286  6445 tablet_bootstrap.cc:492] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:47.531780  6445 ts_tablet_manager.cc:1403] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.006s
I20260709 13:13:47.532855  6446 tablet_bootstrap.cc:492] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:47.533317  6446 ts_tablet_manager.cc:1403] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.008s
I20260709 13:13:47.534492  6445 raft_consensus.cc:359] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.535988  6446 raft_consensus.cc:359] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.536768  6447 tablet_bootstrap.cc:492] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:47.537101  6446 raft_consensus.cc:385] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.537412  6446 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.537478  6445 raft_consensus.cc:385] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.537432  6447 ts_tablet_manager.cc:1403] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 13:13:47.537945  6453 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:47.539949  6446 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.537958  6445 raft_consensus.cc:740] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.541340  6447 raft_consensus.cc:359] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.541402  6445 consensus_queue.cc:260] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.542089  6447 raft_consensus.cc:385] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.542107  6446 ts_tablet_manager.cc:1434] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:13:47.542436  6447 raft_consensus.cc:740] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.543375  6446 tablet_bootstrap.cc:492] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:47.543437  6445 ts_tablet_manager.cc:1434] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:13:47.544528  6445 tablet_bootstrap.cc:492] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:47.550045  6446 tablet_bootstrap.cc:654] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.550045  6445 tablet_bootstrap.cc:654] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.558746  6445 tablet_bootstrap.cc:492] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:47.559129  6445 ts_tablet_manager.cc:1403] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 13:13:47.561453  6447 consensus_queue.cc:260] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.562315  6445 raft_consensus.cc:359] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.562995  6445 raft_consensus.cc:385] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.563243  6445 raft_consensus.cc:740] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.563606  6447 ts_tablet_manager.cc:1434] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.000s
I20260709 13:13:47.563807  6445 consensus_queue.cc:260] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.564533  6447 tablet_bootstrap.cc:492] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:47.565683  6445 ts_tablet_manager.cc:1434] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 13:13:47.566651  6445 tablet_bootstrap.cc:492] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:47.567346  6446 tablet_bootstrap.cc:492] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:47.567837  6446 ts_tablet_manager.cc:1403] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 13:13:47.570339  6446 raft_consensus.cc:359] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.571210  6446 raft_consensus.cc:385] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.571528  6446 raft_consensus.cc:740] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.572162  6446 consensus_queue.cc:260] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.572811  6445 tablet_bootstrap.cc:654] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.574721  6446 ts_tablet_manager.cc:1434] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:47.575090  6447 tablet_bootstrap.cc:654] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.577517  6453 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.578172  6453 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.580902  6453 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.582243  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:47.582756  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:47.583339  6327 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
W20260709 13:13:47.583726  6221 leader_election.cc:343] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.584753  6219 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.586410  6649 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:47.586905  6649 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.587347  6649 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.599296  6649 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.603260  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:47.604019  6327 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.605202  6649 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.612830  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:13:47.620393  6221 leader_election.cc:343] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.623584  6445 tablet_bootstrap.cc:492] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:47.624034  6445 ts_tablet_manager.cc:1403] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.036s
I20260709 13:13:47.625078  6649 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:47.626957  6445 raft_consensus.cc:359] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.627411  6447 tablet_bootstrap.cc:492] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:47.627627  6445 raft_consensus.cc:385] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.627915  6447 ts_tablet_manager.cc:1403] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.064s	user 0.021s	sys 0.022s
I20260709 13:13:47.627941  6445 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.628711  6445 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.630805  6445 ts_tablet_manager.cc:1434] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:13:47.633457  6445 tablet_bootstrap.cc:492] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:47.629403  6327 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:47.636914  6219 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.637965  6649 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:47.639415  6473 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.639892  6473 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.642059  6473 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.641898  6447 raft_consensus.cc:359] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.642560  6447 raft_consensus.cc:385] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.642867  6447 raft_consensus.cc:740] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.638594  6649 raft_consensus.cc:697] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:47.643378  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:47.643620  6447 consensus_queue.cc:260] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.643970  6254 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:47.643926  6649 consensus_queue.cc:237] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.645195  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:47.642612  6445 tablet_bootstrap.cc:654] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.645987  6447 ts_tablet_manager.cc:1434] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:13:47.646735  6496 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:47.646929  6447 tablet_bootstrap.cc:492] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:47.647130  6496 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.647449  6496 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.653185  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:47.654541  6296 leader_election.cc:343] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.653514  6447 tablet_bootstrap.cc:654] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.657582  6445 tablet_bootstrap.cc:492] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:47.658021  6445 ts_tablet_manager.cc:1403] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.008s
I20260709 13:13:47.658634  6446 tablet_bootstrap.cc:492] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:47.660523  6445 raft_consensus.cc:359] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.661176  6445 raft_consensus.cc:385] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.661478  6445 raft_consensus.cc:740] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.662158  6445 consensus_queue.cc:260] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.664345  6445 ts_tablet_manager.cc:1434] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:47.665307  6445 tablet_bootstrap.cc:492] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:47.668983  6446 tablet_bootstrap.cc:654] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.678824  6453 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:47.682052  6486 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.684082  6486 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.689750  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:47.690639  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:47.690404  6402 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
W20260709 13:13:47.693094  6219 leader_election.cc:343] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.686981  6486 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.699929  6445 tablet_bootstrap.cc:654] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.683267  6496 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.703822  6221 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:47.703840  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:47.704545  6254 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.704984  6486 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:47.705459  6486 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.705842  6486 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.700256  6153 catalog_manager.cc:5697] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:47.710158  6496 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.711174  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:13:47.715332  6296 leader_election.cc:343] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.725569  6629 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.726094  6629 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.728229  6629 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:47.729682  6486 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.729957  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:47.730589  6256 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 0.
I20260709 13:13:47.733551  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:47.734163  6327 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 0.
I20260709 13:13:47.735008  6369 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:47.723070  6254 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:47.736781  6629 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:47.738150  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.738490  6629 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.738999  6629 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.739029  6453 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:47.765033  6566 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:47.767463  6566 raft_consensus.cc:697] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:47.776453  6447 tablet_bootstrap.cc:492] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:47.776914  6447 ts_tablet_manager.cc:1403] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.130s	user 0.021s	sys 0.010s
I20260709 13:13:47.775168  6649 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.782403  6649 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.784400  6649 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.784546  6447 raft_consensus.cc:359] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.785158  6447 raft_consensus.cc:385] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.768553  6566 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.790359  6446 tablet_bootstrap.cc:492] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:47.790679  6445 tablet_bootstrap.cc:492] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:47.790800  6446 ts_tablet_manager.cc:1403] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.132s	user 0.011s	sys 0.007s
I20260709 13:13:47.790874  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:47.791318  6445 ts_tablet_manager.cc:1403] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.016s
I20260709 13:13:47.786015  6447 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.788676  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:13:47.793454  6221 leader_election.cc:343] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.793301  6402 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.796478  6629 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.796792  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:47.793596  6447 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.785624  6486 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.798988  6649 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.801065  6649 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.802346  6402 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:47.803278  6649 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.803939  6446 raft_consensus.cc:359] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.805570  6446 raft_consensus.cc:385] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.805857  6446 raft_consensus.cc:740] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.806468  6446 consensus_queue.cc:260] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.807928  6446 ts_tablet_manager.cc:1434] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.001s
I20260709 13:13:47.808697  6630 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.808904  6445 raft_consensus.cc:359] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.809239  6630 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.808806  6446 tablet_bootstrap.cc:492] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:47.811354  6630 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:47.809602  6445 raft_consensus.cc:385] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.812777  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:47.813436  6254 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 0.
I20260709 13:13:47.813743  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:47.814322  6329 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:47.814675  6369 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:47.812857  6445 raft_consensus.cc:740] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.815230  6629 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:47.815778  6629 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:47.816150  6629 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.816478  6629 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.816675  6447 ts_tablet_manager.cc:1434] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.039s	user 0.001s	sys 0.003s
I20260709 13:13:47.816529  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:47.803925  6221 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:47.817793  6447 tablet_bootstrap.cc:492] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:47.817799  6254 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.821744  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:47.823926  6649 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:47.824438  6649 raft_consensus.cc:697] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:47.825295  6649 consensus_queue.cc:237] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.815701  6445 consensus_queue.cc:260] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.804543  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:47.834054  6221 leader_election.cc:343] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.836196  6445 ts_tablet_manager.cc:1434] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.003s
I20260709 13:13:47.838581  6445 tablet_bootstrap.cc:492] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:47.829242  6254 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:13:47.840188  6369 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:47.841013  6630 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:47.841506  6630 raft_consensus.cc:697] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:13:47.847893  6630 consensus_queue.cc:237] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:47.841523  6219 leader_election.cc:343] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.851686  6219 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.852442  6486 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:47.852809  6486 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.853385  6486 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.854692  6453 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.855134  6453 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:47.852783  6219 leader_election.cc:343] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.858362  6453 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.858944  6219 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.860462  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:47.865840  6447 tablet_bootstrap.cc:654] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.867818  6453 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:47.868062  6221 leader_election.cc:343] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:47.855501  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 61314.9us
I20260709 13:13:47.866427  6486 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.890889  6153 catalog_manager.cc:5697] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:47.896530  6445 tablet_bootstrap.cc:654] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.886487  6496 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.892099  6497 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.906476  6446 tablet_bootstrap.cc:654] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.909175  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:47.911065  6331 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:47.911387  6152 catalog_manager.cc:5697] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 0 to 1, leader changed from <none> to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.917035  6723 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:47.918489  6221 consensus_peers.cc:597] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.907495  6497 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.922861  6219 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:47.923117  6497 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.901239  6496 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.923879  6580 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:47.924278  6580 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.924638  6580 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.917284  6154 catalog_manager.cc:5697] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:47.934531  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:47.938381  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:47.939164  6254 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:47.940001  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:47.940598  6256 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:47.941069  6295 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:47.942047  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:47.942080  6497 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:47.942701  6497 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.943053  6497 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.944392  6295 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:47.917781  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:13:47.950340  6296 leader_election.cc:343] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:47.925372  6496 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:47.935576  6723 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:47.946718  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:47.968456  6329 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.965288  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:47.970139  6331 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.960276  6496 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:47.985960  6202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:47.971949  6496 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.996132  6628 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.994801  6486 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:13:48.004331  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 59998.7us
I20260709 13:13:48.004724  6447 tablet_bootstrap.cc:492] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:48.005352  6447 ts_tablet_manager.cc:1403] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.188s	user 0.017s	sys 0.006s
I20260709 13:13:47.999645  6496 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:48.008991  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 58091.6us
I20260709 13:13:48.010344  6446 tablet_bootstrap.cc:492] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:48.010880  6446 ts_tablet_manager.cc:1403] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.202s	user 0.016s	sys 0.012s
I20260709 13:13:48.004063  6628 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.027401  6446 raft_consensus.cc:359] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.028064  6446 raft_consensus.cc:385] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.028313  6446 raft_consensus.cc:740] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.028898  6446 consensus_queue.cc:260] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.029876  6447 raft_consensus.cc:359] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.030416  6447 raft_consensus.cc:385] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.030642  6447 raft_consensus.cc:740] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.033510  6445 tablet_bootstrap.cc:492] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:48.031255  6447 consensus_queue.cc:260] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.034660  6445 ts_tablet_manager.cc:1403] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.196s	user 0.027s	sys 0.053s
I20260709 13:13:48.021881  6629 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.047674  6405 raft_consensus.cc:2393] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 1: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:13:48.047523  6580 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.048578  6629 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:48.050236  6580 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.052563  6446 ts_tablet_manager.cc:1434] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 13:13:48.040223  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:48.052089  6329 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:13:48.053274  6256 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:48.053565  6446 tablet_bootstrap.cc:492] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:48.055796  6445 raft_consensus.cc:359] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.056864  6445 raft_consensus.cc:385] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.044447  6628 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:48.044951  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:48.044960  6723 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.060175  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:48.064883  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:48.065447  6405 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:48.066419  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:48.066965  6326 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.047698  6497 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:48.068130  6221 leader_election.cc:343] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:48.068785  6221 leader_election.cc:343] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.064672  6496 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.057181  6445 raft_consensus.cc:740] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.069782  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:48.070442  6256 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 0.
I20260709 13:13:48.070185  6445 consensus_queue.cc:260] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.070788  6496 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.058207  6331 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:48.059444  6447 ts_tablet_manager.cc:1434] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 13:13:48.073891  6219 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:48.075464  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:48.060267  6580 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.078361  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:48.086153  6445 ts_tablet_manager.cc:1434] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.000s
I20260709 13:13:48.087064  6445 tablet_bootstrap.cc:492] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:48.088120  6369 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:48.078660  6447 tablet_bootstrap.cc:492] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:48.072983  6295 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:48.076334  6649 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:48.090528  6649 raft_consensus.cc:697] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:48.091351  6649 consensus_queue.cc:237] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.081439  6327 raft_consensus.cc:2393] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:13:48.082159  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:13:48.092998  6296 leader_election.cc:343] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.083321  6497 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.083694  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:48.089869  6628 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:48.094182  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:48.094355  6628 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.094794  6628 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.089932  6723 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:48.084472  6580 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.096578  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:48.097393  6402 raft_consensus.cc:2393] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 1: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:13:48.099647  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:48.100836  6253 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.101719  6296 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:48.098487  6723 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.105598  6723 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.094220  6256 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.126566  6496 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:48.137115  6628 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.144273  6405 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.152889  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:48.153393  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:48.159785  6453 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:48.160692  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:48.143059  6628 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:48.145390  6580 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:13:48.167096  6221 leader_election.cc:343] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:48.173240  6219 leader_election.cc:343] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.175412  6219 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:48.166113  6256 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:13:48.183056  6737 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:48.174516  6326 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:48.190120  6446 tablet_bootstrap.cc:654] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.194526  6447 tablet_bootstrap.cc:654] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.196314  6253 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:48.195169  6723 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.197448  6295 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:48.197899  6369 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:48.191744  6153 catalog_manager.cc:5697] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:48.199344  6580 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.200218  6734 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:48.200467  6580 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.200771  6734 raft_consensus.cc:697] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:48.202837  6734 consensus_queue.cc:237] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.199525  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:48.204825  6254 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.204111  6628 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:48.210381  6330 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:13:48.212308  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:48.213300  6628 raft_consensus.cc:697] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:13:48.214387  6723 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.214624  6445 tablet_bootstrap.cc:654] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.214277  6628 consensus_queue.cc:237] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.216605  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:48.217429  6403 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 1: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:13:48.219166  6296 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:48.220419  6497 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:48.223757  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:48.223913  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:48.224701  6580 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:13:48.225741  6221 leader_election.cc:343] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.225767  6219 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:48.226598  6580 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:48.227315  6580 raft_consensus.cc:697] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:13:48.227866  6219 leader_election.cc:343] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.228256  6219 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:48.228221  6580 consensus_queue.cc:237] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.231858  6728 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:48.233796  6649 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:48.239778  6733 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.240263  6733 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.243264  6445 tablet_bootstrap.cc:492] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:48.243535  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:48.244822  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:48.245327  6733 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:48.253403  6256 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 0.
I20260709 13:13:48.254851  6369 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:48.255698  6733 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:48.256093  6733 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.256526  6733 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.257252  6254 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:13:48.256855  6154 catalog_manager.cc:5697] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:48.258381  6369 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:48.259116  6629 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:48.256590  6445 ts_tablet_manager.cc:1403] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.170s	user 0.009s	sys 0.007s
I20260709 13:13:48.259577  6629 raft_consensus.cc:697] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:13:48.260412  6629 consensus_queue.cc:237] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.245800  6446 tablet_bootstrap.cc:492] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:48.262079  6446 ts_tablet_manager.cc:1403] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.209s	user 0.014s	sys 0.001s
I20260709 13:13:48.261999  6445 raft_consensus.cc:359] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:48.262828  6368 leader_election.cc:343] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.273219  6736 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:48.264673  6446 raft_consensus.cc:359] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.275767  6446 raft_consensus.cc:385] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.276120  6446 raft_consensus.cc:740] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.262720  6445 raft_consensus.cc:385] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.286832  6445 raft_consensus.cc:740] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.287452  6446 consensus_queue.cc:260] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.287566  6445 consensus_queue.cc:260] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.294623  6445 ts_tablet_manager.cc:1434] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:13:48.288170  6153 catalog_manager.cc:5697] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:48.290380  6446 ts_tablet_manager.cc:1434] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:13:48.286312  6733 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.305294  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:48.305493  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:48.305912  6254 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:48.306792  6368 leader_election.cc:343] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.309209  6446 tablet_bootstrap.cc:492] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:48.313704  6445 tablet_bootstrap.cc:492] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:48.314534  6497 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:48.323316  6254 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:13:48.325969  6369 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:48.327581  6628 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:48.329663  6628 raft_consensus.cc:697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:13:48.330543  6628 consensus_queue.cc:237] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.333228  6446 tablet_bootstrap.cc:654] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.332413  6154 catalog_manager.cc:5697] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 0 to 1, leader changed from <none> to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:48.340902  6296 consensus_peers.cc:597] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:48.308610  6733 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:48.354002  6445 tablet_bootstrap.cc:654] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.358361  6447 tablet_bootstrap.cc:492] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:48.358968  6447 ts_tablet_manager.cc:1403] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.281s	user 0.005s	sys 0.013s
I20260709 13:13:48.363929  6736 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:48.365355  6447 raft_consensus.cc:359] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.366019  6447 raft_consensus.cc:385] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.366297  6447 raft_consensus.cc:740] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.367851  6447 consensus_queue.cc:260] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.370239  6447 ts_tablet_manager.cc:1434] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:13:48.376390  6154 catalog_manager.cc:5697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 0 to 1, leader changed from <none> to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.377660  6447 tablet_bootstrap.cc:492] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:48.378018  6154 catalog_manager.cc:5697] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 0 to 1, leader changed from <none> to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.392410  6445 tablet_bootstrap.cc:492] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:48.392946  6446 tablet_bootstrap.cc:492] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:48.393611  6446 ts_tablet_manager.cc:1403] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.009s
I20260709 13:13:48.395255  6497 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.395714  6497 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.396561  6445 ts_tablet_manager.cc:1403] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.088s	user 0.008s	sys 0.010s
I20260709 13:13:48.397733  6497 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.398590  6330 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.400707  6447 tablet_bootstrap.cc:654] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.400566  6446 raft_consensus.cc:359] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.401508  6446 raft_consensus.cc:385] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.402305  6446 raft_consensus.cc:740] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.400107  6445 raft_consensus.cc:359] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.403059  6445 raft_consensus.cc:385] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.404186  6445 raft_consensus.cc:740] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.404889  6445 consensus_queue.cc:260] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.407001  6445 ts_tablet_manager.cc:1434] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 13:13:48.407743  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:48.403527  6446 consensus_queue.cc:260] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.408514  6405 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 1: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:13:48.408897  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:48.410652  6446 ts_tablet_manager.cc:1434] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:13:48.412240  6446 tablet_bootstrap.cc:492] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:48.412586  6296 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:48.408030  6445 tablet_bootstrap.cc:492] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:48.414597  6649 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:48.426915  6446 tablet_bootstrap.cc:654] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.429682  6445 tablet_bootstrap.cc:654] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.432978  6497 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:48.433758  6649 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:48.443181  6649 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.443971  6649 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.447554  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:48.448212  6330 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:48.449536  6219 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:48.449693  6649 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.450346  6580 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:48.450767  6580 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.451133  6580 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.452384  6447 tablet_bootstrap.cc:492] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:48.452857  6447 ts_tablet_manager.cc:1403] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.004s
I20260709 13:13:48.454941  6447 raft_consensus.cc:359] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.455667  6447 raft_consensus.cc:385] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.455894  6447 raft_consensus.cc:740] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.456444  6447 consensus_queue.cc:260] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.458186  6447 ts_tablet_manager.cc:1434] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:13:48.458928  6447 tablet_bootstrap.cc:492] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:48.462116  6580 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.463303  6445 tablet_bootstrap.cc:492] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:48.463866  6445 ts_tablet_manager.cc:1403] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.008s
I20260709 13:13:48.466725  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:48.467295  6327 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.467767  6445 raft_consensus.cc:359] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.468487  6445 raft_consensus.cc:385] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.468755  6445 raft_consensus.cc:740] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.469338  6445 consensus_queue.cc:260] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.471673  6445 ts_tablet_manager.cc:1434] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:13:48.472666  6445 tablet_bootstrap.cc:492] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:48.475489  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:48.463866  6580 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.478111  6327 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:48.479202  6219 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:48.479686  6445 tablet_bootstrap.cc:654] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.479952  6580 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:48.480556  6580 raft_consensus.cc:697] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:48.481335  6580 consensus_queue.cc:237] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.481798  6447 tablet_bootstrap.cc:654] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.494637  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:48.495096  6405 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:48.494797  6221 leader_election.cc:343] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:48.502239  6221 leader_election.cc:343] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.507123  6447 tablet_bootstrap.cc:492] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:48.507596  6447 ts_tablet_manager.cc:1403] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.019s
I20260709 13:13:48.508996  6446 tablet_bootstrap.cc:492] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:48.509492  6446 ts_tablet_manager.cc:1403] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.001s
I20260709 13:13:48.511243  6447 raft_consensus.cc:359] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.511911  6447 raft_consensus.cc:385] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.512239  6447 raft_consensus.cc:740] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.511904  6446 raft_consensus.cc:359] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.512977  6446 raft_consensus.cc:385] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.512987  6447 consensus_queue.cc:260] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.513476  6446 raft_consensus.cc:740] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.514318  6446 consensus_queue.cc:260] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.516232  6446 ts_tablet_manager.cc:1434] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:13:48.517253  6446 tablet_bootstrap.cc:492] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:48.514662  6447 ts_tablet_manager.cc:1434] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:48.530227  6447 tablet_bootstrap.cc:492] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:48.542018  6445 tablet_bootstrap.cc:492] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:48.542578  6445 ts_tablet_manager.cc:1403] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.070s	user 0.024s	sys 0.008s
I20260709 13:13:48.545480  6445 raft_consensus.cc:359] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.546238  6445 raft_consensus.cc:385] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.546555  6445 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.547436  6445 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.560189  6446 tablet_bootstrap.cc:654] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.550007  6153 catalog_manager.cc:5697] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:48.601616  6628 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.612735  6628 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.594502  6447 tablet_bootstrap.cc:654] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.595602  6728 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.624238  6728 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.632227  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:48.636761  6330 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:48.637844  6445 ts_tablet_manager.cc:1434] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.002s
I20260709 13:13:48.638041  6731 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.638897  6445 tablet_bootstrap.cc:492] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:48.638542  6731 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.640645  6731 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.641511  6219 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:48.636958  6580 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:13:48.642349  6453 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:48.642712  6453 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.643062  6453 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.645541  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:48.646206  6256 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:48.647392  6295 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:48.648398  6731 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:48.648895  6731 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.649327  6731 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.652621  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:48.653141  6628 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:48.654668  6728 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.659504  6731 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.662299  6649 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.662807  6649 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.664495  6446 tablet_bootstrap.cc:492] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:48.665035  6446 ts_tablet_manager.cc:1403] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.148s	user 0.009s	sys 0.008s
I20260709 13:13:48.665427  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:48.665946  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:48.666669  6326 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:13:48.666805  6219 leader_election.cc:343] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.670544  6405 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.671896  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:48.675448  6453 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.667716  6446 raft_consensus.cc:359] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.683609  6446 raft_consensus.cc:385] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.683888  6446 raft_consensus.cc:740] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.688140  6453 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.689935  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:48.686527  6446 consensus_queue.cc:260] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.694576  6368 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:48.688844  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:48.695299  6256 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.696653  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:48.697237  6326 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:48.697471  6296 leader_election.cc:343] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.701056  6496 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:48.695291  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:48.702405  6731 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.711370  6446 ts_tablet_manager.cc:1434] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.002s
I20260709 13:13:48.710682  6649 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.709726  6628 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.714915  6447 tablet_bootstrap.cc:492] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:48.715507  6447 ts_tablet_manager.cc:1403] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.192s	user 0.018s	sys 0.006s
I20260709 13:13:48.720147  6326 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:48.726150  6446 tablet_bootstrap.cc:492] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:48.732208  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:48.733400  6736 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:48.736469  6447 raft_consensus.cc:359] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.738126  6447 raft_consensus.cc:385] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.738410  6447 raft_consensus.cc:740] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
W20260709 13:13:48.738432  6221 consensus_peers.cc:597] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:48.740283  6219 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:48.739138  6447 consensus_queue.cc:260] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.741647  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:48.741776  6649 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:48.739360  6221 leader_election.cc:343] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:48.745999  6296 leader_election.cc:343] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.742425  6649 raft_consensus.cc:697] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:48.755039  6256 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:48.756592  6628 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:48.752851  6649 consensus_queue.cc:237] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.767889  6445 tablet_bootstrap.cc:654] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:48.778111  6221 leader_election.cc:343] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:48.779006  6221 leader_election.cc:343] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.779374  6221 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:48.780249  6521 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.787072  6521 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.788645  6521 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.783192  6737 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:48.797766  6447 ts_tablet_manager.cc:1434] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.082s	user 0.010s	sys 0.003s
I20260709 13:13:48.802227  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:48.805361  6295 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:13:48.806550  6219 leader_election.cc:343] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.807855  6731 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:48.808516  6731 raft_consensus.cc:697] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:48.810060  6731 consensus_queue.cc:237] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.811404  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:48.799091  6447 tablet_bootstrap.cc:492] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:48.813771  6770 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:48.817732  6736 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:48.820233  6221 leader_election.cc:343] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.820665  6221 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:48.821494  6453 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:48.821358  6521 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:48.827951  6496 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:48.839879  6445 tablet_bootstrap.cc:492] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:48.840365  6445 ts_tablet_manager.cc:1403] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.202s	user 0.004s	sys 0.011s
I20260709 13:13:48.842880  6733 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.850744  6733 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.855041  6736 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:48.858413  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:13:48.859818  6368 leader_election.cc:343] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:48.862838  6446 tablet_bootstrap.cc:654] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.864938  6628 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:48.863332  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:48.865087  6154 catalog_manager.cc:5697] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:48.865993  6255 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 0.
I20260709 13:13:48.857510  6733 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:48.873790  6445 raft_consensus.cc:359] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.874984  6445 raft_consensus.cc:385] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.875377  6445 raft_consensus.cc:740] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.877883  6445 consensus_queue.cc:260] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.884202  6447 tablet_bootstrap.cc:654] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.874805  6369 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:48.898418  6628 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:48.898801  6628 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.905382  6628 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.903950  6154 catalog_manager.cc:5697] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:48.916501  6445 ts_tablet_manager.cc:1434] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.003s
I20260709 13:13:48.925714  6445 tablet_bootstrap.cc:492] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:48.925885  6733 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:48.931412  6769 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.931914  6769 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.946563  6769 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:48.948256  6329 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:48.960222  6446 tablet_bootstrap.cc:492] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:48.961033  6446 ts_tablet_manager.cc:1403] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.235s	user 0.017s	sys 0.005s
I20260709 13:13:48.931914  6628 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.966533  6628 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:48.966639  6521 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.967147  6521 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:48.968947  6445 tablet_bootstrap.cc:654] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.970149  6453 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:48.969504  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:13:48.981665  6774 log.cc:927] Time spent T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:13:48.969369  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:48.987962  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:13:48.991189  6368 leader_election.cc:343] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.031634  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:49.032575  6252 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:49.039723  6282 tablet.cc:2406] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:49.042423  6770 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.043056  6770 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:49.114578  6745 log.cc:927] Time spent T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.073s	user 0.005s	sys 0.013s
I20260709 13:13:49.145360  6496 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.145880  6496 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.150316  6295 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:49.219141  6521 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:49.220270  6446 raft_consensus.cc:359] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.220980  6446 raft_consensus.cc:385] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.221266  6446 raft_consensus.cc:740] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.221868  6446 consensus_queue.cc:260] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.227430  6446 ts_tablet_manager.cc:1434] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.266s	user 0.009s	sys 0.002s
I20260709 13:13:49.232257  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:49.232924  6770 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:49.233006  6324 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
W20260709 13:13:49.238993  6221 consensus_peers.cc:597] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:49.252595  6202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:49.258860  6446 tablet_bootstrap.cc:492] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:49.263706  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:13:49.265632  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 55924.3us
I20260709 13:13:49.272287  6445 tablet_bootstrap.cc:492] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:49.272830  6445 ts_tablet_manager.cc:1403] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.347s	user 0.003s	sys 0.015s
I20260709 13:13:49.269268  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:49.284804  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:49.287464  6254 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:49.285511  6731 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.279373  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:49.295984  6445 raft_consensus.cc:359] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.296449  6445 raft_consensus.cc:385] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.296692  6445 raft_consensus.cc:740] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.294974  6219 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:49.294992  6252 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:13:49.303287  6445 consensus_queue.cc:260] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.304698  6445 ts_tablet_manager.cc:1434] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.000s
I20260709 13:13:49.309755  6786 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.310328  6786 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.310736  6786 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.312981  6447 tablet_bootstrap.cc:492] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:49.314152  6447 ts_tablet_manager.cc:1403] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.515s	user 0.023s	sys 0.037s
I20260709 13:13:49.317493  6447 raft_consensus.cc:359] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.318111  6447 raft_consensus.cc:385] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.318239  6496 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:49.318393  6447 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.319128  6445 tablet_bootstrap.cc:492] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
W20260709 13:13:49.319859  6219 leader_election.cc:343] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.323061  6446 tablet_bootstrap.cc:654] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.318984  6447 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.329722  6447 ts_tablet_manager.cc:1434] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:13:49.332612  6447 tablet_bootstrap.cc:492] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
W20260709 13:13:49.345181  6296 leader_election.cc:343] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.353921  6295 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:49.356694  6445 tablet_bootstrap.cc:654] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.356801  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:49.353765  6221 leader_election.cc:343] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.357539  6734 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.371441  6496 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:49.372103  6734 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.384697  6734 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:49.385996  6221 leader_election.cc:343] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.386566  6221 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:49.357647  6736 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:13:49.392170  6580 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.399704  6786 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.400594  6785 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20260709 13:13:49.403733  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 46426us
I20260709 13:13:49.414039  6369 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:49.417218  6734 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.431023  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:49.433357  6734 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:13:49.438199  6296 leader_election.cc:343] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:49.438737  6296 consensus_peers.cc:597] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:49.447670  6447 tablet_bootstrap.cc:654] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.449908  6445 tablet_bootstrap.cc:492] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:49.450541  6445 ts_tablet_manager.cc:1403] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.136s	user 0.011s	sys 0.002s
I20260709 13:13:49.456138  6786 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:13:49.458616  6221 consensus_peers.cc:597] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:49.460619  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:49.441766  6736 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.464954  6446 tablet_bootstrap.cc:492] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:49.464819  6736 raft_consensus.cc:697] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:13:49.463510  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:49.466713  6446 ts_tablet_manager.cc:1403] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.208s	user 0.010s	sys 0.007s
W20260709 13:13:49.467222  6221 leader_election.cc:343] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:49.460175  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 46222.8us
I20260709 13:13:49.473788  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:49.478952  6328 raft_consensus.cc:2393] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 1: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:13:49.491918  6446 raft_consensus.cc:359] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.492903  6446 raft_consensus.cc:385] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.493268  6446 raft_consensus.cc:740] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.494194  6446 consensus_queue.cc:260] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.495709  6445 raft_consensus.cc:359] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.496587  6445 raft_consensus.cc:385] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.496925  6445 raft_consensus.cc:740] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.491925  6219 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:49.493176  6736 consensus_queue.cc:237] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.502082  6445 consensus_queue.cc:260] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.493948  6254 raft_consensus.cc:2393] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 1: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:13:49.509692  6446 ts_tablet_manager.cc:1434] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.005s
I20260709 13:13:49.510998  6446 tablet_bootstrap.cc:492] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:49.512894  6728 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.513733  6295 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:49.516041  6790 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.517189  6445 ts_tablet_manager.cc:1434] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.000s
I20260709 13:13:49.518131  6445 tablet_bootstrap.cc:492] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:49.542143  6152 catalog_manager.cc:5697] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 0 to 1, leader changed from <none> to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.561460  6446 tablet_bootstrap.cc:654] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.568390  6446 tablet_bootstrap.cc:492] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:49.568866  6446 ts_tablet_manager.cc:1403] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.000s
I20260709 13:13:49.569204  6445 tablet_bootstrap.cc:654] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.571264  6446 raft_consensus.cc:359] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.571887  6446 raft_consensus.cc:385] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.572183  6446 raft_consensus.cc:740] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.573215  6447 tablet_bootstrap.cc:492] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:49.573679  6447 ts_tablet_manager.cc:1403] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.242s	user 0.014s	sys 0.001s
I20260709 13:13:49.572912  6446 consensus_queue.cc:260] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.575620  6446 ts_tablet_manager.cc:1434] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:49.575994  6447 raft_consensus.cc:359] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.576545  6447 raft_consensus.cc:385] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.576884  6447 raft_consensus.cc:740] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.576514  6446 tablet_bootstrap.cc:492] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:49.577622  6447 consensus_queue.cc:260] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.578914  6445 tablet_bootstrap.cc:492] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:49.579348  6445 ts_tablet_manager.cc:1403] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 13:13:49.581831  6445 raft_consensus.cc:359] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.582546  6445 raft_consensus.cc:385] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.582803  6445 raft_consensus.cc:740] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.583494  6445 consensus_queue.cc:260] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.584618  6447 ts_tablet_manager.cc:1434] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:49.585528  6447 tablet_bootstrap.cc:492] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:49.585937  6446 tablet_bootstrap.cc:654] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.591490  6447 tablet_bootstrap.cc:654] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.596195  6446 tablet_bootstrap.cc:492] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:49.596627  6446 ts_tablet_manager.cc:1403] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 13:13:49.598887  6445 ts_tablet_manager.cc:1434] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:13:49.599133  6446 raft_consensus.cc:359] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.599776  6446 raft_consensus.cc:385] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.600009  6446 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.600586  6446 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.602525  6446 ts_tablet_manager.cc:1434] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:13:49.603376  6446 tablet_bootstrap.cc:492] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:49.606673  6445 tablet_bootstrap.cc:492] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:49.608779  6446 tablet_bootstrap.cc:654] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.613382  6445 tablet_bootstrap.cc:654] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.620517  6446 tablet_bootstrap.cc:492] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:49.620927  6446 ts_tablet_manager.cc:1403] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:13:49.623800  6446 raft_consensus.cc:359] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.624447  6446 raft_consensus.cc:385] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.624729  6446 raft_consensus.cc:740] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.625352  6446 consensus_queue.cc:260] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.627384  6446 ts_tablet_manager.cc:1434] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.002s
I20260709 13:13:49.628289  6446 tablet_bootstrap.cc:492] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:49.633824  6446 tablet_bootstrap.cc:654] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.651839  6446 tablet_bootstrap.cc:492] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:49.652325  6446 ts_tablet_manager.cc:1403] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.009s
I20260709 13:13:49.652592  6447 tablet_bootstrap.cc:492] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:49.653309  6447 ts_tablet_manager.cc:1403] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.007s
I20260709 13:13:49.654783  6446 raft_consensus.cc:359] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.655514  6446 raft_consensus.cc:385] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.655787  6446 raft_consensus.cc:740] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.656678  6566 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.656432  6446 consensus_queue.cc:260] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.657187  6566 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.657794  6447 raft_consensus.cc:359] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.658653  6446 ts_tablet_manager.cc:1434] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:49.658739  6447 raft_consensus.cc:385] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.659201  6447 raft_consensus.cc:740] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.659632  6446 tablet_bootstrap.cc:492] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:49.660409  6566 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:49.660313  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:49.661388  6252 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:49.664093  6295 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:49.664960  6566 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.665390  6566 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.665566  6446 tablet_bootstrap.cc:654] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.666116  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:49.666363  6784 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.665849  6566 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.666950  6405 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:49.666985  6784 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.672392  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:49.672947  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:49.673401  6324 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
W20260709 13:13:49.674247  6221 leader_election.cc:343] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.675439  6219 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:49.677726  6786 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.678179  6786 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.678587  6786 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.685655  6405 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.672394  6784 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:49.695394  6566 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.697305  6785 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.703064  6785 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.699283  6447 consensus_queue.cc:260] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.706991  6734 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.707444  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:49.707662  6734 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.709581  6785 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:49.711484  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:49.711699  6219 leader_election.cc:343] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:49.713249  6221 leader_election.cc:343] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.698333  6786 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.700090  6790 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.714303  6790 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.713647  6221 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:49.717068  6790 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:49.718274  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:49.719944  6296 leader_election.cc:343] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.719952  6785 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.765887  6445 tablet_bootstrap.cc:492] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:49.766358  6445 ts_tablet_manager.cc:1403] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.160s	user 0.029s	sys 0.040s
I20260709 13:13:49.769076  6445 raft_consensus.cc:359] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.769979  6445 raft_consensus.cc:385] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.770308  6445 raft_consensus.cc:740] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.770946  6445 consensus_queue.cc:260] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.768993  6446 tablet_bootstrap.cc:492] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:49.772019  6446 ts_tablet_manager.cc:1403] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.113s	user 0.027s	sys 0.048s
I20260709 13:13:49.776950  6445 ts_tablet_manager.cc:1434] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:13:49.777938  6445 tablet_bootstrap.cc:492] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:49.778101  6734 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:49.769935  6447 ts_tablet_manager.cc:1434] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.000s
I20260709 13:13:49.782536  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:49.783810  6447 tablet_bootstrap.cc:492] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:49.783571  6254 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:49.788343  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:49.789285  6446 raft_consensus.cc:359] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.790226  6446 raft_consensus.cc:385] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.790529  6446 raft_consensus.cc:740] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.799654  6402 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.798568  6446 consensus_queue.cc:260] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.803753  6649 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.803766  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:49.804291  6649 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.805227  6447 tablet_bootstrap.cc:654] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.801316  6254 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 1: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:13:49.797896  6786 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:13:49.813642  6221 leader_election.cc:343] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.821007  6446 ts_tablet_manager.cc:1434] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.049s	user 0.012s	sys 0.007s
I20260709 13:13:49.801716  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:49.825909  6324 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.814497  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:49.832974  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:49.835090  6446 tablet_bootstrap.cc:492] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:49.837232  6566 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:13:49.837272  6219 leader_election.cc:343] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.841044  6445 tablet_bootstrap.cc:654] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:49.844506  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 45604.6us
I20260709 13:13:49.852397  6649 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:49.853230  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:49.853847  6399 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.856061  6295 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:49.856700  6496 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.857023  6496 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.857338  6496 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.865562  6446 tablet_bootstrap.cc:654] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.865725  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:49.866984  6295 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:49.871150  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:49.871776  6250 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:49.877497  6221 leader_election.cc:343] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.878050  6221 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:49.878978  6649 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.881433  6629 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:49.876992  6447 tablet_bootstrap.cc:492] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:49.885618  6447 ts_tablet_manager.cc:1403] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.102s	user 0.008s	sys 0.005s
I20260709 13:13:49.899585  6819 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.925459  6447 raft_consensus.cc:359] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.926083  6447 raft_consensus.cc:385] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.926344  6447 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
W20260709 13:13:49.932773  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 64486.4us
I20260709 13:13:49.936292  6496 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.936491  6447 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.941615  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:49.941831  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:49.942335  6252 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.943507  6445 tablet_bootstrap.cc:492] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:49.943981  6445 ts_tablet_manager.cc:1403] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.166s	user 0.021s	sys 0.011s
I20260709 13:13:49.943876  6250 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
W20260709 13:13:49.945317  6296 leader_election.cc:343] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.950100  6447 ts_tablet_manager.cc:1434] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.002s
I20260709 13:13:49.951148  6447 tablet_bootstrap.cc:492] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:49.951870  6252 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:49.940347  6496 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:49.954231  6736 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.962942  6736 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.964335  6295 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:49.965360  6496 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.965999  6496 raft_consensus.cc:697] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:49.966125  6295 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:49.954325  6734 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.967023  6734 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.954598  6399 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:49.969933  6566 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.974227  6566 raft_consensus.cc:697] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:49.975802  6566 consensus_queue.cc:237] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.976322  6734 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:49.978374  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:49.981227  6445 raft_consensus.cc:359] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.982936  6445 raft_consensus.cc:385] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:49.983165  6296 leader_election.cc:343] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.983563  6445 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.984282  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:49.989249  6446 tablet_bootstrap.cc:492] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:49.989692  6446 ts_tablet_manager.cc:1403] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.156s	user 0.016s	sys 0.005s
I20260709 13:13:49.990979  6324 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:49.992224  6445 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.992826  6219 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:49.967730  6496 consensus_queue.cc:237] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.994071  6728 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.994558  6728 raft_consensus.cc:697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:49.995347  6728 consensus_queue.cc:237] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:49.998332  6819 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.999364  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:50.000133  6252 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:50.000404  6736 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:49.995854  6445 ts_tablet_manager.cc:1434] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 13:13:50.002110  6736 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.002562  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:50.004966  6446 raft_consensus.cc:359] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.005625  6446 raft_consensus.cc:385] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.005878  6446 raft_consensus.cc:740] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.006531  6446 consensus_queue.cc:260] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.007273  6368 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:50.008055  6790 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.008622  6446 ts_tablet_manager.cc:1434] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.000s
I20260709 13:13:50.008533  6790 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.010056  6446 tablet_bootstrap.cc:492] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:50.011632  6736 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.014084  6790 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.013628  6154 catalog_manager.cc:5697] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.015240  6445 tablet_bootstrap.cc:492] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:50.016603  6295 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:50.017584  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:50.018859  6296 leader_election.cc:343] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.020130  6790 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:50.020498  6790 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.020830  6790 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.019181  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:13:50.025957  6295 leader_election.cc:343] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.026297  6295 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:50.026798  6496 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.030977  6447 tablet_bootstrap.cc:654] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.037232  6496 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.037690  6496 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.039788  6496 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.045569  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:50.047236  6296 leader_election.cc:343] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.049947  6790 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.052824  6790 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.053977  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:50.054698  6253 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.058118  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:13:50.059479  6295 leader_election.cc:343] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.059866  6295 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:50.060956  6790 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.062333  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:13:50.063628  6296 leader_election.cc:343] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.064702  6728 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.065438  6728 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.065635  6154 catalog_manager.cc:5697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.081454  6728 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.084455  6253 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:50.084795  6153 catalog_manager.cc:5697] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.086613  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:50.086823  6295 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:13:50.087653  6221 leader_election.cc:343] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.091379  6496 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.091904  6496 raft_consensus.cc:697] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:50.092818  6445 tablet_bootstrap.cc:654] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.092682  6496 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.095005  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:50.095918  6446 tablet_bootstrap.cc:654] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:50.100625  6219 leader_election.cc:343] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.101189  6219 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:50.102771  6446 tablet_bootstrap.cc:492] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:50.102718  6784 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.103386  6446 ts_tablet_manager.cc:1403] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.094s	user 0.001s	sys 0.010s
I20260709 13:13:50.110402  6446 raft_consensus.cc:359] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.111009  6446 raft_consensus.cc:385] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.111259  6446 raft_consensus.cc:740] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.111981  6446 consensus_queue.cc:260] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.112560  6447 tablet_bootstrap.cc:492] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:50.113106  6447 ts_tablet_manager.cc:1403] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.162s	user 0.015s	sys 0.000s
I20260709 13:13:50.114329  6446 ts_tablet_manager.cc:1434] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:13:50.115813  6446 tablet_bootstrap.cc:492] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:50.116555  6447 raft_consensus.cc:359] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.117259  6447 raft_consensus.cc:385] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.117527  6447 raft_consensus.cc:740] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.118134  6447 consensus_queue.cc:260] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.121694  6445 tablet_bootstrap.cc:492] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:50.122139  6445 ts_tablet_manager.cc:1403] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.107s	user 0.015s	sys 0.001s
I20260709 13:13:50.122700  6446 tablet_bootstrap.cc:654] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.124689  6445 raft_consensus.cc:359] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.125432  6445 raft_consensus.cc:385] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.125777  6445 raft_consensus.cc:740] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.126497  6445 consensus_queue.cc:260] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.128077  6446 tablet_bootstrap.cc:492] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:50.128403  6445 ts_tablet_manager.cc:1434] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:13:50.128504  6446 ts_tablet_manager.cc:1403] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:13:50.122148  6447 ts_tablet_manager.cc:1434] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:13:50.129644  6447 tablet_bootstrap.cc:492] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:50.130781  6153 catalog_manager.cc:5697] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.131481  6446 raft_consensus.cc:359] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.132236  6446 raft_consensus.cc:385] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.132524  6446 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.133237  6446 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.135178  6447 tablet_bootstrap.cc:654] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.135254  6446 ts_tablet_manager.cc:1434] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:50.136168  6446 tablet_bootstrap.cc:492] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:50.138370  6445 tablet_bootstrap.cc:492] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:50.144053  6445 tablet_bootstrap.cc:654] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.147374  6447 tablet_bootstrap.cc:492] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:50.147823  6447 ts_tablet_manager.cc:1403] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:13:50.150516  6446 tablet_bootstrap.cc:654] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.155881  6447 raft_consensus.cc:359] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.156810  6447 raft_consensus.cc:385] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.157164  6447 raft_consensus.cc:740] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.158021  6447 consensus_queue.cc:260] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.160310  6447 ts_tablet_manager.cc:1434] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:50.162488  6447 tablet_bootstrap.cc:492] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:50.163017  6445 tablet_bootstrap.cc:492] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:50.163447  6445 ts_tablet_manager.cc:1403] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:13:50.165984  6446 tablet_bootstrap.cc:492] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:50.165984  6445 raft_consensus.cc:359] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.166533  6446 ts_tablet_manager.cc:1403] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.006s
I20260709 13:13:50.166754  6445 raft_consensus.cc:385] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.167042  6445 raft_consensus.cc:740] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.168047  6447 tablet_bootstrap.cc:654] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.167780  6445 consensus_queue.cc:260] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.169018  6446 raft_consensus.cc:359] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.169714  6446 raft_consensus.cc:385] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.169956  6446 raft_consensus.cc:740] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.170606  6446 consensus_queue.cc:260] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.175272  6445 ts_tablet_manager.cc:1434] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:50.176230  6445 tablet_bootstrap.cc:492] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: Bootstrap starting.
I20260709 13:13:50.182142  6446 ts_tablet_manager.cc:1434] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:13:50.183313  6496 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.183725  6496 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.184234  6445 tablet_bootstrap.cc:654] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.185570  6496 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.188100  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:13:50.191149  6296 leader_election.cc:343] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.192827  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:50.193835  6253 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:50.196405  6295 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:50.198328  6496 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:50.198767  6496 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.199167  6496 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.183132  6446 tablet_bootstrap.cc:492] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Bootstrap starting.
I20260709 13:13:50.216194  6446 tablet_bootstrap.cc:654] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.218240  6496 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.236063  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:50.236900  6252 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.238390  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:13:50.240173  6296 leader_election.cc:343] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.240895  6496 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.244066  6447 tablet_bootstrap.cc:492] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:50.245352  6447 ts_tablet_manager.cc:1403] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.084s	user 0.021s	sys 0.028s
I20260709 13:13:50.246807  6784 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.247273  6784 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.249286  6784 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.248898  6447 raft_consensus.cc:359] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.249789  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:50.250468  6329 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:50.250654  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:50.251730  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:13:50.252245  6221 leader_election.cc:343] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.252604  6252 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:50.253044  6784 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:50.254402  6784 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.254803  6784 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.253556  6445 tablet_bootstrap.cc:492] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: No bootstrap required, opened a new log
I20260709 13:13:50.253793  6295 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:50.249819  6447 raft_consensus.cc:385] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.255998  6822 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.256253  6447 raft_consensus.cc:740] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.256556  6822 raft_consensus.cc:697] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:50.257062  6445 ts_tablet_manager.cc:1403] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.036s
I20260709 13:13:50.257177  6447 consensus_queue.cc:260] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.257401  6822 consensus_queue.cc:237] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.259919  6445 raft_consensus.cc:359] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.260731  6445 raft_consensus.cc:385] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.260977  6445 raft_consensus.cc:740] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.261677  6445 consensus_queue.cc:260] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.264003  6649 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.264452  6649 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.265638  6447 ts_tablet_manager.cc:1434] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:13:50.266294  6566 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.266741  6447 tablet_bootstrap.cc:492] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:50.266767  6566 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.268911  6566 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.270452  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:50.270773  6649 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.272094  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:50.272672  6329 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:50.273742  6219 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:50.274329  6447 tablet_bootstrap.cc:654] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.274509  6649 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:50.274933  6649 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.275321  6649 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:50.272014  6296 leader_election.cc:343] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.278920  6446 tablet_bootstrap.cc:492] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: No bootstrap required, opened a new log
I20260709 13:13:50.279999  6446 ts_tablet_manager.cc:1403] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent bootstrapping tablet: real 0.097s	user 0.019s	sys 0.016s
I20260709 13:13:50.282877  6649 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.283622  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:50.285465  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:50.285974  6329 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.289538  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:50.290345  6252 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:50.292019  6295 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:50.292263  6329 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:50.292552  6447 tablet_bootstrap.cc:492] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:50.293018  6447 ts_tablet_manager.cc:1403] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.005s
I20260709 13:13:50.293507  6219 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:50.294180  6445 ts_tablet_manager.cc:1434] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:50.294946  6770 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.282895  6446 raft_consensus.cc:359] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.295421  6770 raft_consensus.cc:697] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:50.295619  6446 raft_consensus.cc:385] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.295565  6447 raft_consensus.cc:359] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.296202  6496 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:50.296380  6447 raft_consensus.cc:385] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.296576  6496 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.296736  6447 raft_consensus.cc:740] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.296983  6496 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.297514  6447 consensus_queue.cc:260] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:50.298110  6221 leader_election.cc:343] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.296036  6446 raft_consensus.cc:740] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.298491  6566 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.299216  6649 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.302263  6770 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.305091  6566 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.305289  6446 consensus_queue.cc:260] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.307135  6566 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.310590  6447 ts_tablet_manager.cc:1434] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:13:50.311036  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:50.311637  6252 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:50.313865  6447 tablet_bootstrap.cc:492] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:50.315524  6295 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:50.316264  6566 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:50.316648  6566 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.317022  6566 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.319666  6447 tablet_bootstrap.cc:654] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.321295  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:13:50.325911  6221 leader_election.cc:343] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.329041  6446 ts_tablet_manager.cc:1434] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 13:13:50.329952  6399 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.332649  6566 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.333842  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:50.312755  6784 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:50.334936  6296 leader_election.cc:343] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.336022  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:50.336588  6252 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.336676  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:50.337001  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:50.337568  6327 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:50.337831  6296 leader_election.cc:343] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.334964  6566 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.345854  6252 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:50.311741  6151 catalog_manager.cc:5697] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.356964  6295 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:50.357986  6566 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.358443  6566 raft_consensus.cc:697] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:50.359206  6566 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.361409  6736 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.362035  6736 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.364554  6736 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:50.376248  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:50.378073  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:50.385231  6784 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.386709  6400 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.389029  6496 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.400007  6496 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.402804  6368 leader_election.cc:304] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:50.370074  6327 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:50.419420  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:50.419571  6151 catalog_manager.cc:5697] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.420804  6770 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.421523  6770 raft_consensus.cc:697] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:50.422675  6770 consensus_queue.cc:237] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.426198  6736 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.428169  6153 catalog_manager.cc:5697] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.429572  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:50.430320  6253 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.445273  6253 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:50.446977  6447 tablet_bootstrap.cc:492] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:50.447603  6295 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:50.448863  6447 ts_tablet_manager.cc:1403] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.135s	user 0.037s	sys 0.050s
W20260709 13:13:50.449491  6202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:50.450665  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:50.451653  6822 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.462286  6496 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.463294  6447 raft_consensus.cc:359] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.463977  6447 raft_consensus.cc:385] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.464242  6447 raft_consensus.cc:740] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.464882  6447 consensus_queue.cc:260] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.465619  6496 raft_consensus.cc:697] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:50.466662  6496 consensus_queue.cc:237] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.467342  6447 ts_tablet_manager.cc:1434] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:13:50.468904  6399 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.468921  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:50.471174  6447 tablet_bootstrap.cc:492] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:50.477727  6447 tablet_bootstrap.cc:654] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:50.478469  6221 leader_election.cc:343] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:50.481748  6296 leader_election.cc:343] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.489640  6728 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:50.497349  6221 consensus_peers.cc:597] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:50.502441  6649 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.502940  6649 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.485314  6151 catalog_manager.cc:5697] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.504827  6649 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.508613  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:50.521199  6328 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:50.525343  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:50.525784  6822 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.525563  6219 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:50.526265  6822 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:50.528513  6221 leader_election.cc:343] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.528821  6822 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.529264  6785 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:50.529621  6785 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.529935  6785 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.531672  6152 catalog_manager.cc:5697] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.534729  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:50.535557  6252 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 0.
I20260709 13:13:50.536681  6295 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:50.537442  6822 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:50.537798  6822 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.538123  6822 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.557490  6566 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.561412  6402 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.557607  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:50.575695  6819 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.584244  6822 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:50.585706  6296 leader_election.cc:343] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.587626  6785 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.592494  6785 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.593230  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:50.593861  6328 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.601414  6328 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:50.602666  6219 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:50.604221  6447 tablet_bootstrap.cc:492] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:50.604735  6447 ts_tablet_manager.cc:1403] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.134s	user 0.031s	sys 0.038s
I20260709 13:13:50.605402  6649 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.605839  6649 raft_consensus.cc:697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:50.606496  6649 consensus_queue.cc:237] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.610496  6447 raft_consensus.cc:359] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.611270  6736 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.611732  6736 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.613897  6736 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:50.615186  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:50.611264  6447 raft_consensus.cc:385] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.615955  6252 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:13:50.616158  6447 raft_consensus.cc:740] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.618103  6447 consensus_queue.cc:260] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.624990  6447 ts_tablet_manager.cc:1434] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:13:50.626806  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:50.617244  6822 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:50.627842  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:50.641839  6252 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.646726  6819 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.649927  6252 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:50.631369  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:50.655055  6447 tablet_bootstrap.cc:492] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:50.632651  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:50.661089  6295 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:50.662961  6736 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.666424  6736 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.664878  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:50.667802  6629 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.668530  6736 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:50.669199  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:50.670425  6860 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.671578  6860 raft_consensus.cc:697] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:50.672525  6860 consensus_queue.cc:237] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.674777  6629 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:50.675388  6296 leader_election.cc:343] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:50.681622  6221 leader_election.cc:343] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.681792  6822 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.683243  6822 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.684415  6447 tablet_bootstrap.cc:654] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.689318  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:50.690798  6328 raft_consensus.cc:2393] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:13:50.694492  6368 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:13:50.696642  6296 consensus_peers.cc:597] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:50.698314  6629 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.705888  6629 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.717542  6151 catalog_manager.cc:5697] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.724378  6447 tablet_bootstrap.cc:492] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:50.724949  6447 ts_tablet_manager.cc:1403] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.000s
I20260709 13:13:50.728108  6447 raft_consensus.cc:359] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.728816  6447 raft_consensus.cc:385] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.729144  6447 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.729656  6861 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.729925  6447 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.731196  6152 catalog_manager.cc:5697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.737026  6447 ts_tablet_manager.cc:1434] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:50.737993  6447 tablet_bootstrap.cc:492] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:50.748466  6629 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.749583  6447 tablet_bootstrap.cc:654] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.749037  6629 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.753014  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:50.753777  6252 raft_consensus.cc:2393] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:13:50.753669  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:50.755162  6368 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:50.755779  6629 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:50.755779  6736 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.762951  6736 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.771595  6447 tablet_bootstrap.cc:492] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:50.772027  6447 ts_tablet_manager.cc:1403] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 13:13:50.778216  6447 raft_consensus.cc:359] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.778692  6447 raft_consensus.cc:385] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.778916  6447 raft_consensus.cc:740] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.779417  6447 consensus_queue.cc:260] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.781446  6447 ts_tablet_manager.cc:1434] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:50.782728  6447 tablet_bootstrap.cc:492] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:50.787288  6447 tablet_bootstrap.cc:654] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.791088  6447 tablet_bootstrap.cc:492] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:50.791436  6447 ts_tablet_manager.cc:1403] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.009s	user 0.001s	sys 0.007s
I20260709 13:13:50.793179  6447 raft_consensus.cc:359] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.793653  6447 raft_consensus.cc:385] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.793875  6447 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.794409  6447 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.796166  6447 ts_tablet_manager.cc:1434] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:13:50.797089  6447 tablet_bootstrap.cc:492] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:50.801972  6447 tablet_bootstrap.cc:654] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.805979  6447 tablet_bootstrap.cc:492] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:50.806411  6447 ts_tablet_manager.cc:1403] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:50.808223  6861 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.809918  6447 raft_consensus.cc:359] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.810576  6447 raft_consensus.cc:385] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.810837  6447 raft_consensus.cc:740] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.811434  6447 consensus_queue.cc:260] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.813407  6447 ts_tablet_manager.cc:1434] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:50.814679  6447 tablet_bootstrap.cc:492] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:50.819100  6649 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.820040  6447 tablet_bootstrap.cc:654] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.827191  6860 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.848489  6770 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.853807  6447 tablet_bootstrap.cc:492] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:50.854238  6447 ts_tablet_manager.cc:1403] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.018s
I20260709 13:13:50.856727  6447 raft_consensus.cc:359] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.858361  6447 raft_consensus.cc:385] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.858628  6447 raft_consensus.cc:740] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.859212  6447 consensus_queue.cc:260] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.861337  6399 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.868790  6447 ts_tablet_manager.cc:1434] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:13:50.869793  6447 tablet_bootstrap.cc:492] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:50.876521  6447 tablet_bootstrap.cc:654] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.877518  6649 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.887458  6447 tablet_bootstrap.cc:492] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:50.887905  6447 ts_tablet_manager.cc:1403] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:13:50.890057  6447 raft_consensus.cc:359] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.890673  6447 raft_consensus.cc:385] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.890946  6447 raft_consensus.cc:740] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.891533  6447 consensus_queue.cc:260] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.893545  6447 ts_tablet_manager.cc:1434] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:13:50.894388  6447 tablet_bootstrap.cc:492] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92: Bootstrap starting.
I20260709 13:13:50.899693  6447 tablet_bootstrap.cc:654] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.900161  6785 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.911347  6447 tablet_bootstrap.cc:492] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92: No bootstrap required, opened a new log
I20260709 13:13:50.911794  6447 ts_tablet_manager.cc:1403] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent bootstrapping tablet: real 0.018s	user 0.002s	sys 0.009s
I20260709 13:13:50.914373  6447 raft_consensus.cc:359] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.915314  6447 raft_consensus.cc:385] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.915585  6447 raft_consensus.cc:740] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.916181  6447 consensus_queue.cc:260] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.918184  6447 ts_tablet_manager.cc:1434] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:50.928807  6861 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.939651  6401 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.945772  6629 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.946225  6629 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:50.947976  6629 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:50.948956  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:50.949549  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:50.951157  6369 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:50.952292  6629 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.959220  6861 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.979800  6401 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.090471  6401 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.100433  6736 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.100845  6736 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:51.102500  6736 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:51.103106  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:51.103358  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:51.103919  6252 raft_consensus.cc:2393] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 1: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:13:51.104908  6369 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:51.105527  6736 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.111534  6736 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:51.174526  6400 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.179944  6770 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:51.194169  6770 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:51.214983  6566 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:51.226428  6496 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:51.273986  6770 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.274506  6770 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:51.276402  6770 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:51.276871  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:51.277504  6327 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:13:51.277616  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:51.278206  6401 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 0.
I20260709 13:13:51.278731  6219 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:51.279683  6649 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:51.280047  6649 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.280336  6649 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:51.286481  6649 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:51.288177  6649 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:51.289520  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:51.290040  6327 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:51.294377  6327 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:13:51.293154  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:51.295575  6401 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 0 FOLLOWER]: Advancing to term 2
I20260709 13:13:51.295946  6219 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:51.296777  6728 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:51.297254  6728 raft_consensus.cc:697] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:51.298023  6728 consensus_queue.cc:237] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:51.302711  6401 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:13:51.313614  6153 catalog_manager.cc:5697] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 0 to 2, leader changed from <none> to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.723939  6401 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:51.735306  6770 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:51.762555  6327 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:51.763761  6728 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:52.235332  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:52.271384  6896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:52.271420  6899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:52.272578  6897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:52.274682  5112 server_base.cc:1061] running on GCE node
I20260709 13:13:52.276196  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:52.276513  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:52.276772  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783602832276752 us; error 0 us; skew 500 ppm
I20260709 13:13:52.277567  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:52.282426  5112 webserver.cc:533] Webserver started at http://127.4.254.4:34571/ using document root <none> and password file <none>
I20260709 13:13:52.282874  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:52.283099  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:52.283429  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:52.284891  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-3-root/instance:
uuid: "8600a3fead0e48a7aa813822ec44d0fe"
format_stamp: "Formatted at 2026-07-09 13:13:52 on dist-test-slave-k73n"
I20260709 13:13:52.290557  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:13:52.293680  6904 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:52.294365  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260709 13:13:52.294620  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-3-root
uuid: "8600a3fead0e48a7aa813822ec44d0fe"
format_stamp: "Formatted at 2026-07-09 13:13:52 on dist-test-slave-k73n"
I20260709 13:13:52.294854  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:52.313232  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:52.315110  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:52.322544  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:52.328940  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:52.329320  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:13:52.329710  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:52.330004  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:52.383766  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.4:33105
I20260709 13:13:52.383852  6966 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.4:33105 every 8 connection(s)
I20260709 13:13:52.388460  5112 auto_leader_rebalancer-test.cc:384] add a tserver: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:13:52.400712  6967 heartbeater.cc:344] Connected to a master server at 127.4.254.62:46653
I20260709 13:13:52.401340  6967 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:52.402256  6967 heartbeater.cc:507] Master 127.4.254.62:46653 requested a full tablet report, sending...
I20260709 13:13:52.404136  6152 ts_manager.cc:194] Registered new tserver with Master: 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:13:52.405812  6152 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49212
I20260709 13:13:52.569574  6324 consensus_queue.cc:237] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:52.585800  6400 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:52.587172  6496 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:52.591743  6252 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:52.594197  6496 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:52.611644  6297 consensus_peers.cc:597] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd8e69d69ccd4bc99194b3d3e6633693. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.616751  6858 raft_consensus.cc:2955] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:52.618526  6252 raft_consensus.cc:2955] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:52.625658  6400 raft_consensus.cc:2955] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:52.637024  6327 consensus_queue.cc:237] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:52.641669  6152 catalog_manager.cc:5697] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
W20260709 13:13:52.644891  6297 consensus_peers.cc:597] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7eeec6c3b81b4e22b65d23b164087705. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.651588  6400 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:52.652884  6253 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:52.654395  6496 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.660251  6860 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:52.676363  6860 raft_consensus.cc:2955] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:52.678658  6252 raft_consensus.cc:2955] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:52.681372  6401 raft_consensus.cc:2955] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:52.708349  6153 catalog_manager.cc:5697] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:52.730067  6253 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:52.737442  6401 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:52.737746  6327 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:52.740264  6649 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.742354  6728 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:52.759079  6728 raft_consensus.cc:2955] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:52.761945  6327 raft_consensus.cc:2955] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
W20260709 13:13:52.770169  6222 consensus_peers.cc:597] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e9d4db6a641496881a55d48d32c6f7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.773707  6253 consensus_queue.cc:237] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:52.773478  6401 raft_consensus.cc:2955] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:52.782397  6152 catalog_manager.cc:5697] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:52.793179  6222 consensus_peers.cc:597] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1c5cae95db44ec58187d3429c9bdf2e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.794672  6400 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:52.796001  6728 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.796725  6327 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:52.798545  6784 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.815371  6649 raft_consensus.cc:2955] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:52.816938  6401 raft_consensus.cc:2955] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:52.820502  6327 raft_consensus.cc:2955] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:52.834034  6153 catalog_manager.cc:5697] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.041440  6994 ts_tablet_manager.cc:933] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:53.043351  6994 tablet_copy_client.cc:323] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.2:39965
I20260709 13:13:53.056699  6341 tablet_copy_service.cc:140] P a13ffe92eb374309a5c8476d9fbbb2b8: Received BeginTabletCopySession request for tablet dd8e69d69ccd4bc99194b3d3e6633693 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41502)
I20260709 13:13:53.057222  6341 tablet_copy_service.cc:161] P a13ffe92eb374309a5c8476d9fbbb2b8: Beginning new tablet copy session on tablet dd8e69d69ccd4bc99194b3d3e6633693 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41502: session id = 8600a3fead0e48a7aa813822ec44d0fe-dd8e69d69ccd4bc99194b3d3e6633693
I20260709 13:13:53.066151  6341 tablet_copy_source_session.cc:215] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:53.069548  6994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8e69d69ccd4bc99194b3d3e6633693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.082232  6994 tablet_copy_client.cc:806] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:53.082820  6994 tablet_copy_client.cc:670] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:53.090553  6994 tablet_copy_client.cc:538] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:53.096571  6994 tablet_bootstrap.cc:492] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:13:53.117978  6994 tablet_bootstrap.cc:492] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:53.135957  6998 ts_tablet_manager.cc:933] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:53.134958  6994 tablet_bootstrap.cc:492] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:13:53.136860  6994 ts_tablet_manager.cc:1403] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.003s
I20260709 13:13:53.141733  6994 raft_consensus.cc:359] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:53.142695  6994 raft_consensus.cc:740] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:13:53.142724  6998 tablet_copy_client.cc:323] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.2:39965
I20260709 13:13:53.143342  6994 consensus_queue.cc:260] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:53.145002  6341 tablet_copy_service.cc:140] P a13ffe92eb374309a5c8476d9fbbb2b8: Received BeginTabletCopySession request for tablet 7eeec6c3b81b4e22b65d23b164087705 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41502)
I20260709 13:13:53.145622  6341 tablet_copy_service.cc:161] P a13ffe92eb374309a5c8476d9fbbb2b8: Beginning new tablet copy session on tablet 7eeec6c3b81b4e22b65d23b164087705 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41502: session id = 8600a3fead0e48a7aa813822ec44d0fe-7eeec6c3b81b4e22b65d23b164087705
I20260709 13:13:53.153450  6341 tablet_copy_source_session.cc:215] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:53.158327  6998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eeec6c3b81b4e22b65d23b164087705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.165005  7001 ts_tablet_manager.cc:933] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:13:53.178206  7001 tablet_copy_client.cc:323] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:13:53.183581  6998 tablet_copy_client.cc:806] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:53.184190  6998 tablet_copy_client.cc:670] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:53.197224  6998 tablet_copy_client.cc:538] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:53.218401  6967 heartbeater.cc:499] Master 127.4.254.62:46653 was elected leader, sending a full tablet report...
I20260709 13:13:53.218596  6998 tablet_bootstrap.cc:492] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:13:53.226902  6994 ts_tablet_manager.cc:1434] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.090s	user 0.032s	sys 0.040s
I20260709 13:13:53.230504  6266 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet 0e9d4db6a641496881a55d48d32c6f7e from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:13:53.231204  6266 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet 0e9d4db6a641496881a55d48d32c6f7e from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-0e9d4db6a641496881a55d48d32c6f7e
I20260709 13:13:53.233412  6341 tablet_copy_service.cc:342] P a13ffe92eb374309a5c8476d9fbbb2b8: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-dd8e69d69ccd4bc99194b3d3e6633693 received from {username='slave'} at 127.0.0.1:41502
I20260709 13:13:53.233960  6341 tablet_copy_service.cc:434] P a13ffe92eb374309a5c8476d9fbbb2b8: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-dd8e69d69ccd4bc99194b3d3e6633693 on tablet dd8e69d69ccd4bc99194b3d3e6633693 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:13:53.247926  6266 tablet_copy_source_session.cc:215] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:53.253445  7001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9d4db6a641496881a55d48d32c6f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.257764  6998 tablet_bootstrap.cc:492] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:53.258754  6998 tablet_bootstrap.cc:492] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:13:53.259488  6998 ts_tablet_manager.cc:1403] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.041s	user 0.026s	sys 0.008s
I20260709 13:13:53.262813  6998 raft_consensus.cc:359] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:53.263785  6998 raft_consensus.cc:740] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:13:53.264561  6998 consensus_queue.cc:260] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:53.267722  6998 ts_tablet_manager.cc:1434] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:53.269685  6341 tablet_copy_service.cc:342] P a13ffe92eb374309a5c8476d9fbbb2b8: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-7eeec6c3b81b4e22b65d23b164087705 received from {username='slave'} at 127.0.0.1:41502
I20260709 13:13:53.270079  6341 tablet_copy_service.cc:434] P a13ffe92eb374309a5c8476d9fbbb2b8: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-7eeec6c3b81b4e22b65d23b164087705 on tablet 7eeec6c3b81b4e22b65d23b164087705 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:13:53.287252  7001 tablet_copy_client.cc:806] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:53.288118  7001 tablet_copy_client.cc:670] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:53.299669  7001 tablet_copy_client.cc:538] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:53.309257  7001 tablet_bootstrap.cc:492] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:13:53.332135  7001 tablet_bootstrap.cc:492] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:53.332942  7001 tablet_bootstrap.cc:492] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:13:53.333582  7001 ts_tablet_manager.cc:1403] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:13:53.336416  7001 raft_consensus.cc:359] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:53.337293  7001 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:13:53.338122  7001 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:53.340330  7001 ts_tablet_manager.cc:1434] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:13:53.343604  6266 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-0e9d4db6a641496881a55d48d32c6f7e received from {username='slave'} at 127.0.0.1:38692
I20260709 13:13:53.344049  6266 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-0e9d4db6a641496881a55d48d32c6f7e on tablet 0e9d4db6a641496881a55d48d32c6f7e with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:13:53.357103  7001 ts_tablet_manager.cc:933] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:13:53.358624  7001 tablet_copy_client.cc:323] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:13:53.360014  6266 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet e1c5cae95db44ec58187d3429c9bdf2e from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:13:53.360519  6266 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet e1c5cae95db44ec58187d3429c9bdf2e from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-e1c5cae95db44ec58187d3429c9bdf2e
I20260709 13:13:53.365792  6266 tablet_copy_source_session.cc:215] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:53.370136  7001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c5cae95db44ec58187d3429c9bdf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.386193  7001 tablet_copy_client.cc:806] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:53.386914  7001 tablet_copy_client.cc:670] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:53.390062  7001 tablet_copy_client.cc:538] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:53.399458  7001 tablet_bootstrap.cc:492] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:13:53.415015  7001 tablet_bootstrap.cc:492] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:53.415706  7001 tablet_bootstrap.cc:492] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:13:53.416199  7001 ts_tablet_manager.cc:1403] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:13:53.418510  7001 raft_consensus.cc:359] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:53.419359  7001 raft_consensus.cc:740] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:13:53.420032  7001 consensus_queue.cc:260] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:53.422232  7001 ts_tablet_manager.cc:1434] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:53.428153  6266 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-e1c5cae95db44ec58187d3429c9bdf2e received from {username='slave'} at 127.0.0.1:38692
I20260709 13:13:53.428568  6266 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-e1c5cae95db44ec58187d3429c9bdf2e on tablet e1c5cae95db44ec58187d3429c9bdf2e with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:13:53.451344  6942 raft_consensus.cc:1217] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:53.527201  6942 raft_consensus.cc:1217] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:13:54.406520  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 94307.3us
I20260709 13:13:54.563143  7026 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:54.563861  7026 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.566468  7026 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:54.624698  7026 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:54.625438  7026 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.628451  7026 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:54.646857  7025 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:13:54.647619  7025 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.650261  7025 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:13:54.668004  6426 debug-util.cc:398] Leaking SignalData structure 0x7b0800173940 after lost signal to thread 5115
I20260709 13:13:54.706816  7013 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:13:54.707173  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08001ad6e0 after lost signal to thread 6188
I20260709 13:13:54.707428  7013 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.708578  6942 raft_consensus.cc:1217] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:54.709710  7013 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:54.710089  7007 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:13:54.710635  7007 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:13:54.711575  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 48124.7us
I20260709 13:13:54.713533  7008 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:13:54.714272  7008 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.717199  7008 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:54.712815  7007 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:54.726588  7012 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:13:54.729696  7012 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:13:54.731812  7012 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:54.732072  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.732681  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.733482  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:13:54.726531  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 324192us
W20260709 13:13:54.736594  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 328971us
W20260709 13:13:54.740206  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002e30c0 after lost signal to thread 6280
I20260709 13:13:54.745040  7030 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:54.745743  6940 raft_consensus.cc:1217] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:54.746105  6629 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:54.746583  6629 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.749706  6629 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:54.757462  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:54.745625  7030 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.777433  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:54.808315  6629 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:54.808831  6629 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.774961  7028 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:54.813320  6629 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:54.812907  7028 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.820717  7028 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:13:54.821923  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3b80 after lost signal to thread 6355
W20260709 13:13:54.822449  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 410738us
W20260709 13:13:54.823349  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4140 after lost signal to thread 6429
I20260709 13:13:54.831423  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.833861  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.836531  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.840241  6629 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:54.840672  6629 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.836935  6736 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:13:54.846396  6736 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:54.851858  6629 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:54.860397  6629 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:13:54.861783  6736 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:54.836531  7008 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:54.861161  6629 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.869156  6629 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:54.870347  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.871668  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:54.857720  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.879557  6736 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:54.880164  6736 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.881788  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:54.881943  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:13:54.885408  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4b00 after lost signal to thread 6966
I20260709 13:13:54.867453  7008 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.887154  7008 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:54.888265  7030 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:54.889290  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:54.889628  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:54.890182  6401 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:54.891242  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.884411  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:54.895887  6404 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:13:54.883966  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.898947  6736 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:54.904723  7015 raft_consensus.cc:1064] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:13:54.907280  7015 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:54.916509  7007 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:54.917073  7007 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.919039  7007 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:54.919468  7007 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:54.919893  7007 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.920823  6296 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:54.921689  6858 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:54.922953  7007 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:54.924438  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:54.925247  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:54.927266  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:54.930138  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:54.931160  6736 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:54.931704  6736 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:54.932504  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:54.933115  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:54.934175  6736 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:54.936635  7014 raft_consensus.cc:1064] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:13:54.939247  7014 consensus_queue.cc:237] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:54.955904  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.961866  6941 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:54.963559  6858 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:54.964947  6941 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:54.967065  6330 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:54.966950  7017 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:54.969902  7031 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:54.973155  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.976111  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.985424  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.988482  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.992231  6249 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:54.994441  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:54.995337  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:55.003578  7017 raft_consensus.cc:2955] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.006875  6330 raft_consensus.cc:2955] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.009759  7022 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:55.016103  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:13:55.026959  6151 catalog_manager.cc:5697] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.043205  6400 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:55.045853  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:55.048298  7036 raft_consensus.cc:2955] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.055573  6941 raft_consensus.cc:2955] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.064219  6940 raft_consensus.cc:2955] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.074981  6248 raft_consensus.cc:2955] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.100842  6296 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:13:55.102025  7022 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:55.102468  7022 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:55.102888  7022 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.110565  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:55.129295  7022 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:55.135159  6330 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:55.136164  6296 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:13:55.137198  6858 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:55.137528  6858 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:55.137878  6858 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.138231  7029 consensus_queue.cc:1059] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:13:55.140312  7029 raft_consensus.cc:3055] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:55.140616  7029 raft_consensus.cc:740] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:55.141436  7029 consensus_queue.cc:260] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:55.144675  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:55.145215  7022 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:55.145596  7029 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.148203  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:55.146525  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:55.150991  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:55.151739  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:55.155045  6858 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:55.156881  6858 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:55.168205  6249 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:13:55.173656  6295 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:13:55.158042  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:55.174451  6858 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:55.175952  6858 raft_consensus.cc:697] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:13:55.176760  6858 consensus_queue.cc:237] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:55.189647  6400 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:55.197387  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:55.197580  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:13:55.197288  6221 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:55.198200  6368 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:55.204305  6368 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:55.204901  6736 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.205382  6368 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:55.207795  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:55.208765  6368 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:55.206511  6221 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:55.209830  7019 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.210022  6368 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:55.210532  7019 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.211191  7037 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.206410  7015 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.211647  7031 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.212591  6368 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:55.206007  7030 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.209149  7008 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.216714  7008 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.217758  6368 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:55.218497  7007 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.221773  6368 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:55.227233  6368 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:55.228142  7008 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.228648  7007 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.244225  7015 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:13:55.250048  6368 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:55.258201  7007 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.266466  6153 catalog_manager.cc:5697] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.271070  7027 raft_consensus.cc:1064] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:13:55.259436  6368 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:55.272444  7007 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:55.276526  6368 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:55.274003  7027 consensus_queue.cc:237] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:55.278666  6152 catalog_manager.cc:5697] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 2 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.281400  7022 raft_consensus.cc:1064] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:13:55.288259  7007 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.288060  7022 consensus_queue.cc:237] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:55.283263  6330 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:55.289526  6368 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:55.290369  7007 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.291011  7017 consensus_queue.cc:1059] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.291996  7017 raft_consensus.cc:3055] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:55.292409  7017 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:13:55.293346  7017 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:55.294617  7017 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.298705  6330 consensus_queue.cc:237] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:55.313711  6940 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:55.316107  6858 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:55.322633  6248 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:55.326884  7020 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:55.326742  6940 raft_consensus.cc:2955] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.325330  6858 raft_consensus.cc:2955] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.340979  6248 raft_consensus.cc:2955] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.359853  6296 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:13:55.360975  7014 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.365329  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dd8e69d69ccd4bc99194b3d3e6633693 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:55.380013  6152 catalog_manager.cc:5697] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.483381  6399 raft_consensus.cc:2955] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.550637  6940 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:13:55.561609  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 129694us
W20260709 13:13:55.594233  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 114674us
I20260709 13:13:55.609257  6940 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:55.611964  6391 tablet_service.cc:1558] Processing DeleteTablet for tablet dd8e69d69ccd4bc99194b3d3e6633693 with delete_type TABLET_DATA_TOMBSTONED (TS b940f12ed61a49c4b3c11f13ef50fa92 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36156
I20260709 13:13:55.614892  7036 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:55.598697  7015 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 13:13:55.668342  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 102169us
W20260709 13:13:55.671429  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 71930.6us
W20260709 13:13:55.672430  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 74868.5us
I20260709 13:13:55.687016  6400 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:55.704488  6322 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:55.706462  6248 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:55.706727  6256 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.715710  7066 tablet_replica.cc:333] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:13:55.720052  7034 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:55.721048  7052 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.722620  7017 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:55.725453  6399 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:55.746037  7066 raft_consensus.cc:2243] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.746824  7066 raft_consensus.cc:2272] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.774732  7052 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:55.775349  6249 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:55.783931  7063 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:55.796160  6402 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.804960  6402 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.808881  7034 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.815704  6941 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:55.815416  7017 raft_consensus.cc:2955] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.818608  7066 ts_tablet_manager.cc:1916] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:55.819767  7060 raft_consensus.cc:2955] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.822861  6399 raft_consensus.cc:2955] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.829344  6397 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:55.836364  7065 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:13:55.834206  6249 raft_consensus.cc:2955] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.837703  7064 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:13:55.870167  6941 raft_consensus.cc:2955] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.875495  6940 raft_consensus.cc:2955] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.898940  6153 catalog_manager.cc:5697] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:55.935878  6784 raft_consensus.cc:2955] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.939419  6153 catalog_manager.cc:5697] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:55.970268  6400 raft_consensus.cc:2955] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:55.984673  6399 raft_consensus.cc:2955] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:56.046792  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0e9d4db6a641496881a55d48d32c6f7e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:56.036062  6939 raft_consensus.cc:2955] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:56.204541  6330 raft_consensus.cc:2955] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:13:56.225028  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 68060.8us
I20260709 13:13:56.253494  7066 ts_tablet_manager.cc:1929] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 13:13:56.254037  7066 log.cc:1199] T dd8e69d69ccd4bc99194b3d3e6633693 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/wals/dd8e69d69ccd4bc99194b3d3e6633693
I20260709 13:13:56.255987  6249 consensus_queue.cc:237] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:56.260694  6151 catalog_manager.cc:5697] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:56.278455  6140 catalog_manager.cc:5028] TS b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): tablet dd8e69d69ccd4bc99194b3d3e6633693 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:13:56.289990  6940 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:56.295253  6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e9d4db6a641496881a55d48d32c6f7e with delete_type TABLET_DATA_TOMBSTONED (TS a13ffe92eb374309a5c8476d9fbbb2b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57216
I20260709 13:13:56.297250  6784 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:56.299789  6326 consensus_queue.cc:237] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:56.306813  6940 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:56.308583  7052 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:56.315685  7082 tablet_replica.cc:333] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:13:56.317762  6939 raft_consensus.cc:2955] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:56.317885  7067 raft_consensus.cc:2955] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:56.323311  7082 raft_consensus.cc:2243] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.323935  7062 raft_consensus.cc:2955] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:56.326649  6940 raft_consensus.cc:2955] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:56.326517  6399 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:56.332437  6399 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:56.332355  6151 catalog_manager.cc:5697] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:56.351135  7065 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:56.357321  7082 raft_consensus.cc:2272] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.358220  6317 tablet_service.cc:1558] Processing DeleteTablet for tablet e1c5cae95db44ec58187d3429c9bdf2e with delete_type TABLET_DATA_TOMBSTONED (TS a13ffe92eb374309a5c8476d9fbbb2b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57216
I20260709 13:13:56.360155  7082 ts_tablet_manager.cc:1916] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:56.361791  7052 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:56.369434  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7eeec6c3b81b4e22b65d23b164087705 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:56.371326  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e1c5cae95db44ec58187d3429c9bdf2e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:56.420058  7082 ts_tablet_manager.cc:1929] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:56.420626  7082 log.cc:1199] T 0e9d4db6a641496881a55d48d32c6f7e P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/wals/0e9d4db6a641496881a55d48d32c6f7e
I20260709 13:13:56.422940  6138 catalog_manager.cc:5028] TS a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): tablet 0e9d4db6a641496881a55d48d32c6f7e (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:13:56.422590  6153 catalog_manager.cc:5697] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:56.428978  6400 raft_consensus.cc:2955] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:56.424063  7082 tablet_replica.cc:333] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:13:56.432422  7082 raft_consensus.cc:2243] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.433187  7082 raft_consensus.cc:2272] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.446416  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet 7eeec6c3b81b4e22b65d23b164087705 with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
I20260709 13:13:56.447546  7082 ts_tablet_manager.cc:1916] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:56.468207  7083 tablet_replica.cc:333] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:13:56.469578  7083 raft_consensus.cc:2243] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.472086  7083 raft_consensus.cc:2272] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.475348  6397 raft_consensus.cc:2955] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:56.476348  7083 ts_tablet_manager.cc:1916] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:13:56.483265  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 43546.9us
I20260709 13:13:56.494544  7083 ts_tablet_manager.cc:1929] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:56.495016  7083 log.cc:1199] T 7eeec6c3b81b4e22b65d23b164087705 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/7eeec6c3b81b4e22b65d23b164087705
I20260709 13:13:56.496639  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet 7eeec6c3b81b4e22b65d23b164087705 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:13:56.523537  7059 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:56.524060  7059 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:56.519688  7082 ts_tablet_manager.cc:1929] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:56.528842  7082 log.cc:1199] T e1c5cae95db44ec58187d3429c9bdf2e P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/wals/e1c5cae95db44ec58187d3429c9bdf2e
I20260709 13:13:56.528748  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:13:56.530702  6138 catalog_manager.cc:5028] TS a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): tablet e1c5cae95db44ec58187d3429c9bdf2e (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:13:56.531129  6249 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:13:56.532222  6369 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:13:56.532316  7059 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:56.533214  7080 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:56.533630  7080 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:13:56.533965  7080 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:56.537806  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:13:56.538765  6326 raft_consensus.cc:2393] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 2: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:13:56.543339  7080 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:56.545584  7080 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:56.546566  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:13:56.546861  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:13:56.547452  6326 raft_consensus.cc:2393] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 2: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:13:56.558473  6248 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:13:56.560279  6369 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:13:56.561645  7080 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:56.562849  7080 raft_consensus.cc:697] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:13:56.563786  7080 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:13:56.583112  6151 catalog_manager.cc:5697] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:56.950541  6329 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:56.952497  7059 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:56.985677  6248 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:56.988008  7059 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:13:57.574681  6326 consensus_queue.cc:237] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
W20260709 13:13:57.591168  6297 consensus_peers.cc:597] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7143f4f3a1eb4f73ae609d74917b08bc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:57.594372  6402 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:57.596442  7062 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:57.597774  6249 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:57.599056  7062 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:57.615126  7022 raft_consensus.cc:2955] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:57.616676  6248 raft_consensus.cc:2955] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:57.634110  6400 raft_consensus.cc:2955] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:57.643254  6248 consensus_queue.cc:237] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:57.641817  6151 catalog_manager.cc:5697] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
W20260709 13:13:57.655073  6222 consensus_peers.cc:597] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae75079e4a9346d0a9b0c375570b7f9d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:57.675911  6397 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:57.676589  6326 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:57.677554  7012 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:57.682082  7055 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:57.715024  7055 raft_consensus.cc:2955] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:57.723359  6326 raft_consensus.cc:2955] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:57.729966  6400 raft_consensus.cc:2955] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:57.749854  6249 consensus_queue.cc:237] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:57.755468  6153 catalog_manager.cc:5697] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:57.769688  6222 consensus_peers.cc:597] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 26c3f5e2706b41929dff126f046ad839. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:57.770809  6400 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:57.771647  6326 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:57.772234  7103 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:57.773064  7055 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:57.802347  6326 raft_consensus.cc:2955] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:57.806775  6402 raft_consensus.cc:2955] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:57.813560  7103 raft_consensus.cc:2955] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:57.825775  6152 catalog_manager.cc:5697] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:57.891989  6402 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:57.899712  6248 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:57.902428  6330 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:57.903807  7089 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:57.907527  7111 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:13:57.913875  7080 raft_consensus.cc:2955] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:57.920979  6248 raft_consensus.cc:2955] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:57.925868  6330 raft_consensus.cc:2955] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:13:57.947633  6152 catalog_manager.cc:5697] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
W20260709 13:13:57.954025  6371 consensus_peers.cc:597] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bec594ed8e8449619512ba6e0d3d04cf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:58.103250  7116 ts_tablet_manager.cc:933] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:13:58.105655  7116 tablet_copy_client.cc:323] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.2:39965
I20260709 13:13:58.107903  6341 tablet_copy_service.cc:140] P a13ffe92eb374309a5c8476d9fbbb2b8: Received BeginTabletCopySession request for tablet 7143f4f3a1eb4f73ae609d74917b08bc from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41502)
I20260709 13:13:58.108533  6341 tablet_copy_service.cc:161] P a13ffe92eb374309a5c8476d9fbbb2b8: Beginning new tablet copy session on tablet 7143f4f3a1eb4f73ae609d74917b08bc from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41502: session id = 8600a3fead0e48a7aa813822ec44d0fe-7143f4f3a1eb4f73ae609d74917b08bc
I20260709 13:13:58.117316  6341 tablet_copy_source_session.cc:215] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:58.121538  7116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7143f4f3a1eb4f73ae609d74917b08bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:58.142046  7116 tablet_copy_client.cc:806] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:58.142740  7116 tablet_copy_client.cc:670] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:58.147260  7116 tablet_copy_client.cc:538] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:58.157945  7116 tablet_bootstrap.cc:492] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:13:58.261097  7122 ts_tablet_manager.cc:933] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:13:58.262632  7121 ts_tablet_manager.cc:933] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:13:58.276180  7122 tablet_copy_client.cc:323] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:13:58.278308  6266 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet 26c3f5e2706b41929dff126f046ad839 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:13:58.278715  7121 tablet_copy_client.cc:323] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:13:58.278846  6266 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet 26c3f5e2706b41929dff126f046ad839 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-26c3f5e2706b41929dff126f046ad839
I20260709 13:13:58.279254  7116 tablet_bootstrap.cc:492] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:58.280210  7116 tablet_bootstrap.cc:492] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:13:58.280920  7116 ts_tablet_manager.cc:1403] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.043s
I20260709 13:13:58.281854  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet ae75079e4a9346d0a9b0c375570b7f9d from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:13:58.282438  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet ae75079e4a9346d0a9b0c375570b7f9d from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-ae75079e4a9346d0a9b0c375570b7f9d
I20260709 13:13:58.284257  7116 raft_consensus.cc:359] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:58.285185  7116 raft_consensus.cc:740] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:13:58.285920  7116 consensus_queue.cc:260] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:58.286851  6266 tablet_copy_source_session.cc:215] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:58.290014  6265 tablet_copy_source_session.cc:215] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:58.295267  7122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c3f5e2706b41929dff126f046ad839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:58.295953  7121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae75079e4a9346d0a9b0c375570b7f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:58.296006  7116 ts_tablet_manager.cc:1434] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:13:58.303413  6341 tablet_copy_service.cc:342] P a13ffe92eb374309a5c8476d9fbbb2b8: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-7143f4f3a1eb4f73ae609d74917b08bc received from {username='slave'} at 127.0.0.1:41502
I20260709 13:13:58.303905  6341 tablet_copy_service.cc:434] P a13ffe92eb374309a5c8476d9fbbb2b8: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-7143f4f3a1eb4f73ae609d74917b08bc on tablet 7143f4f3a1eb4f73ae609d74917b08bc with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:13:58.326664  7122 tablet_copy_client.cc:806] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:58.327243  7122 tablet_copy_client.cc:670] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:58.328436  7121 tablet_copy_client.cc:806] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:58.329089  7121 tablet_copy_client.cc:670] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:58.336728  7122 tablet_copy_client.cc:538] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:58.337215  7121 tablet_copy_client.cc:538] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:58.349180  7122 tablet_bootstrap.cc:492] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:13:58.357973  7121 tablet_bootstrap.cc:492] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:13:58.375873  7122 tablet_bootstrap.cc:492] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:58.376865  7122 tablet_bootstrap.cc:492] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:13:58.378525  7122 ts_tablet_manager.cc:1403] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.009s
I20260709 13:13:58.382431  7122 raft_consensus.cc:359] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:58.383322  7122 raft_consensus.cc:740] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:13:58.386111  7116 ts_tablet_manager.cc:933] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:13:58.385288  7122 consensus_queue.cc:260] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:58.415284  7122 ts_tablet_manager.cc:1434] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:13:58.418864  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-26c3f5e2706b41929dff126f046ad839 received from {username='slave'} at 127.0.0.1:38692
I20260709 13:13:58.419292  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-26c3f5e2706b41929dff126f046ad839 on tablet 26c3f5e2706b41929dff126f046ad839 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:13:58.419776  7121 tablet_bootstrap.cc:492] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:58.420632  7116 tablet_copy_client.cc:323] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.3:34111
I20260709 13:13:58.420678  7121 tablet_bootstrap.cc:492] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:13:58.423229  7121 ts_tablet_manager.cc:1403] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.009s
I20260709 13:13:58.429708  7121 raft_consensus.cc:359] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:58.430599  7121 raft_consensus.cc:740] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:13:58.431406  7121 consensus_queue.cc:260] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:58.434340  7121 ts_tablet_manager.cc:1434] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:58.436609  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-ae75079e4a9346d0a9b0c375570b7f9d received from {username='slave'} at 127.0.0.1:38692
I20260709 13:13:58.436995  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-ae75079e4a9346d0a9b0c375570b7f9d on tablet ae75079e4a9346d0a9b0c375570b7f9d with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:13:58.469054  6415 tablet_copy_service.cc:140] P b940f12ed61a49c4b3c11f13ef50fa92: Received BeginTabletCopySession request for tablet bec594ed8e8449619512ba6e0d3d04cf from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41486)
I20260709 13:13:58.469666  6415 tablet_copy_service.cc:161] P b940f12ed61a49c4b3c11f13ef50fa92: Beginning new tablet copy session on tablet bec594ed8e8449619512ba6e0d3d04cf from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41486: session id = 8600a3fead0e48a7aa813822ec44d0fe-bec594ed8e8449619512ba6e0d3d04cf
I20260709 13:13:58.479031  6415 tablet_copy_source_session.cc:215] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:58.482529  7116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec594ed8e8449619512ba6e0d3d04cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:58.498833  7116 tablet_copy_client.cc:806] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:58.499385  7116 tablet_copy_client.cc:670] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:58.504119  7116 tablet_copy_client.cc:538] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:58.524286  7116 tablet_bootstrap.cc:492] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:13:58.548563  7116 tablet_bootstrap.cc:492] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:58.549465  7116 tablet_bootstrap.cc:492] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:13:58.550173  7116 ts_tablet_manager.cc:1403] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.008s
I20260709 13:13:58.553323  7116 raft_consensus.cc:359] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:58.554289  7116 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:13:58.554994  7116 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:13:58.557687  7116 ts_tablet_manager.cc:1434] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:58.559456  6415 tablet_copy_service.cc:342] P b940f12ed61a49c4b3c11f13ef50fa92: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-bec594ed8e8449619512ba6e0d3d04cf received from {username='slave'} at 127.0.0.1:41486
I20260709 13:13:58.559885  6415 tablet_copy_service.cc:434] P b940f12ed61a49c4b3c11f13ef50fa92: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-bec594ed8e8449619512ba6e0d3d04cf on tablet bec594ed8e8449619512ba6e0d3d04cf with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:13:58.606179  6940 raft_consensus.cc:1217] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:58.613734  6940 raft_consensus.cc:1217] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:58.790203  6940 raft_consensus.cc:1217] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:58.960707  6940 raft_consensus.cc:1217] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:13:58.988941  7103 raft_consensus.cc:1064] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:13:58.996002  7103 consensus_queue.cc:237] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:59.010109  6939 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:59.011849  7108 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:59.013252  6397 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:59.014914  6330 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:59.014986  7103 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:59.017282  7108 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:59.043107  6330 raft_consensus.cc:2955] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.049381  6402 raft_consensus.cc:2955] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.041859  7103 raft_consensus.cc:2955] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.067209  6151 catalog_manager.cc:5697] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.105885  6939 raft_consensus.cc:2955] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.166708  6249 consensus_queue.cc:237] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:59.173363  6402 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:59.174810  7103 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:59.182052  6939 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:59.183671  7103 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:59.185667  7022 raft_consensus.cc:1064] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:13:59.185747  7055 raft_consensus.cc:2955] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.188340  7022 consensus_queue.cc:237] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:59.190898  6402 raft_consensus.cc:2955] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.195360  6939 raft_consensus.cc:2955] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.203420  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 26c3f5e2706b41929dff126f046ad839 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:59.212798  6152 catalog_manager.cc:5697] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.217186  6939 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:59.219005  6397 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:59.219559  7062 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:59.221045  7022 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:59.224751  6249 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:59.230890  7062 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:59.246317  6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 26c3f5e2706b41929dff126f046ad839 with delete_type TABLET_DATA_TOMBSTONED (TS a13ffe92eb374309a5c8476d9fbbb2b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57216
I20260709 13:13:59.279408  7144 tablet_replica.cc:333] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:13:59.285053  7144 raft_consensus.cc:2243] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:59.285880  7144 raft_consensus.cc:2272] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.290349  7144 ts_tablet_manager.cc:1916] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:59.300522  7108 raft_consensus.cc:1064] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:13:59.305260  7108 consensus_queue.cc:237] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:59.316324  7144 ts_tablet_manager.cc:1929] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:59.316821  7144 log.cc:1199] T 26c3f5e2706b41929dff126f046ad839 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/wals/26c3f5e2706b41929dff126f046ad839
I20260709 13:13:59.318699  6138 catalog_manager.cc:5028] TS a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): tablet 26c3f5e2706b41929dff126f046ad839 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:13:59.327414  7062 raft_consensus.cc:2955] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.337318  6249 raft_consensus.cc:2955] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.339439  6402 raft_consensus.cc:2955] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.357671  6940 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:59.359633  7103 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:59.362707  6330 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:59.365688  7118 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:59.369027  6397 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:59.371738  7118 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:59.375237  6939 raft_consensus.cc:2955] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.385013  6153 catalog_manager.cc:5697] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.454056  7103 raft_consensus.cc:2955] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.464802  6399 raft_consensus.cc:2955] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.482187  6153 catalog_manager.cc:5697] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.492368  6330 consensus_queue.cc:237] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:59.513409  6326 raft_consensus.cc:2955] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.522382  6249 consensus_queue.cc:237] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:59.521412  6939 raft_consensus.cc:2955] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.540356  6941 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:59.554086  6940 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:59.557986  7103 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:59.560469  7152 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:59.567468  6942 raft_consensus.cc:2955] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.569794  7114 raft_consensus.cc:2955] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.574764  6941 raft_consensus.cc:2955] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.583047  6153 catalog_manager.cc:5697] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.587285  7080 raft_consensus.cc:1064] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:13:59.589746  7080 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:59.601369  6391 tablet_service.cc:1558] Processing DeleteTablet for tablet ae75079e4a9346d0a9b0c375570b7f9d with delete_type TABLET_DATA_TOMBSTONED (TS b940f12ed61a49c4b3c11f13ef50fa92 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36156
I20260709 13:13:59.614195  6399 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:59.617049  7158 tablet_replica.cc:333] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:13:59.618883  7158 raft_consensus.cc:2243] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:59.633826  7158 raft_consensus.cc:2272] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.642175  6324 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:59.645666  7158 ts_tablet_manager.cc:1916] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:59.632862  7154 raft_consensus.cc:2955] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.656029  7118 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:59.664754  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7143f4f3a1eb4f73ae609d74917b08bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:59.671343  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ae75079e4a9346d0a9b0c375570b7f9d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:59.677296  6153 catalog_manager.cc:5697] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:59.685806  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 69914.8us
I20260709 13:13:59.687251  7146 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:59.695252  7158 ts_tablet_manager.cc:1929] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:59.695812  7158 log.cc:1199] T ae75079e4a9346d0a9b0c375570b7f9d P b940f12ed61a49c4b3c11f13ef50fa92: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/wals/ae75079e4a9346d0a9b0c375570b7f9d
I20260709 13:13:59.698642  6140 catalog_manager.cc:5028] TS b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): tablet ae75079e4a9346d0a9b0c375570b7f9d (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:13:59.698521  6326 raft_consensus.cc:2955] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.709085  6402 raft_consensus.cc:2955] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.727615  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet 7143f4f3a1eb4f73ae609d74917b08bc with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
W20260709 13:13:59.735646  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 116650us
I20260709 13:13:59.738219  6941 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:13:59.742107  7111 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:59.745484  6324 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:13:59.750612  7159 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:59.767635  6249 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:13:59.769544  7156 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:59.777307  7164 tablet_replica.cc:333] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:13:59.778533  7164 raft_consensus.cc:2243] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:59.779297  7164 raft_consensus.cc:2272] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.791882  7111 raft_consensus.cc:2955] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.795758  7164 ts_tablet_manager.cc:1916] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:59.797521  6324 raft_consensus.cc:2955] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.822999  6248 raft_consensus.cc:2955] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.826757  6941 raft_consensus.cc:2955] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.837491  6153 catalog_manager.cc:5697] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.863304  7164 ts_tablet_manager.cc:1929] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:59.863862  7164 log.cc:1199] T 7143f4f3a1eb4f73ae609d74917b08bc P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/7143f4f3a1eb4f73ae609d74917b08bc
I20260709 13:13:59.865507  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet 7143f4f3a1eb4f73ae609d74917b08bc (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:13:59.881223  6402 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:13:59.895412  6941 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:59.895576  6324 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:59.897284  7080 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:59.900753  7111 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:59.911700  7157 raft_consensus.cc:2955] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.914486  6324 raft_consensus.cc:2955] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.917306  6941 raft_consensus.cc:2955] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.941408  6153 catalog_manager.cc:5697] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 4 to 5, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:13:59.945695  6140 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bec594ed8e8449619512ba6e0d3d04cf with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:59.959344  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet bec594ed8e8449619512ba6e0d3d04cf with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49990
I20260709 13:13:59.960284  7164 tablet_replica.cc:333] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:13:59.961314  7164 raft_consensus.cc:2243] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:59.962095  7164 raft_consensus.cc:2272] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.965322  7164 ts_tablet_manager.cc:1916] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:59.979635  7164 ts_tablet_manager.cc:1929] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:13:59.980048  7164 log.cc:1199] T bec594ed8e8449619512ba6e0d3d04cf P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/bec594ed8e8449619512ba6e0d3d04cf
I20260709 13:13:59.981603  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet bec594ed8e8449619512ba6e0d3d04cf (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:02.097934  7169 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:02.098623  7169 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:02.101910  7169 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.408282  7169 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.408860  7169 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:02.411434  7169 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.411971  7169 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.412407  7169 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:02.419749  7169 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:02.416254  6906 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.003s	sys 0.007s
W20260709 13:14:02.424839  6906 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.003s	sys 0.008s
I20260709 13:14:02.417102  7170 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.425992  7170 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:02.416642  7168 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.428393  7170 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.428121  7168 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:02.432435  7170 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.432788  7169 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.433190  7170 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:02.434140  7172 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.435043  7172 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:02.433492  7169 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:02.442111  7169 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.444481  7168 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:02.500191  7170 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:02.507970  7172 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.540381  7178 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.544107  7173 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.545003  7177 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.557504  7177 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:14:02.558956  7181 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.559638  7181 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.562932  7181 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.560243  7177 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:02.664860  7177 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.658145  7173 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.691777  7180 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.695324  7180 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.698611  7180 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:02.700116  7173 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:02.700378  7180 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.702335  7180 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.711047  7180 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:02.692428  7177 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.657461  7179 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.731354  7175 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:02.731886  7175 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.735491  7179 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.765781  7175 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.766335  7177 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:02.658778  7178 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.769603  7178 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.770836  7173 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.779218  7173 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.782369  7173 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:02.773298  7184 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.785885  7184 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.773339  7180 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.789249  7180 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.791736  7180 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:02.792266  7180 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.793325  7184 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:02.794148  7184 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.795667  7184 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:02.799253  7184 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:02.775393  7183 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.802989  7183 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:02.805871  7183 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:02.773463  7177 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.806743  7177 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:02.809628  7177 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:02.812053  7177 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.792801  7180 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.814970  7180 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:02.771392  7179 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:02.812634  7173 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.816303  7181 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.816038  7173 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.816902  7181 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.819314  7181 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.818589  7173 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:02.822497  7175 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.823238  7175 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.826239  7175 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.826978  7175 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:02.827657  7175 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.829362  7185 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.830179  7185 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.833525  7186 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.834338  7186 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.837592  7174 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.838424  7174 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.846901  7174 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.847890  7174 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:02.848755  7174 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.854888  7174 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.851300  7178 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.859061  7178 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.862295  7178 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.850385  7186 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.863324  7186 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:02.864166  7186 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.867307  7186 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.868157  7186 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:02.868898  7186 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.852152  7185 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.855870  7190 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.821120  7182 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.819882  7181 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:02.821190  7177 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.879645  7173 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.937532  7173 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.939419  7177 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:02.940091  7173 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:02.881234  7183 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.881989  7179 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.882579  7180 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.883600  7192 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.884572  7195 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.885412  7188 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.895584  7194 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.901441  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:02.902505  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:02.945518  6402 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 1.
I20260709 13:14:02.902799  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:02.903447  7176 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.904137  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:02.904268  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:02.904702  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:02.905049  7189 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.909821  7193 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.858067  7175 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.918187  7184 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.928411  7202 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.917538  7174 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.932919  7182 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.936223  7181 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.822430  7187 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.981155  7193 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.925887  7178 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.919785  7201 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.947013  6401 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 1.
I20260709 13:14:02.966322  7197 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.968386  7194 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.940269  7190 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.947810  7173 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.988370  7174 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.998430  7203 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:02.943382  7179 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.942538  7183 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.943311  7180 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.984895  7204 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:02.946869  7195 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.986703  7208 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:03.023916  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:03.024466  7207 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:03.024572  6326 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:03.025287  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:03.027676  7179 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.028255  7179 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.028367  7193 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.014338  7173 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.024349  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:03.030411  7183 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.030639  7173 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.030927  7183 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.031072  7173 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.031426  7183 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.034391  7180 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.035939  7174 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.986296  6398 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 1.
I20260709 13:14:03.044790  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:02.982651  7176 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:03.028723  7179 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.999907  7178 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.997526  7184 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.999432  7202 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.046839  7174 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:03.085005  7213 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.086127  7177 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.037231  7203 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.050408  7212 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:02.986500  7189 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.031548  7173 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.085881  7174 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:02.946738  7188 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.025264  7207 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.078761  7205 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.047703  7191 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:02.952726  7192 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.117384  7196 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:03.085804  7213 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.077669  7214 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.087203  7183 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.042923  7197 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.045938  7204 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.097836  7177 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.100020  7212 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.130834  7194 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.131433  7205 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.095793  7182 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.047696  6905 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:03.098198  6400 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 1.
I20260709 13:14:03.012717  7201 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:03.095631  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:03.094492  7181 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:02.999341  7187 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:03.133908  7175 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:03.133210  7180 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.054970  7208 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.146646  7209 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.147927  7183 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.151624  7178 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.151086  7182 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.152274  7185 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.152653  7194 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.159245  6397 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 1.
I20260709 13:14:03.155678  7175 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:03.156774  7180 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.142702  7191 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.178378  7173 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.162216  7193 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.156189  7210 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.162597  6325 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 1.
I20260709 13:14:03.164191  7194 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.142218  7214 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.188563  7202 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.145514  7196 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.159780  7211 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.258704  7174 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.169432  7195 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.160101  7183 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.159408  7209 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.162441  7182 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.188422  7210 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.258126  7201 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:03.258479  7192 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.164961  7185 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.188277  7222 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:03.228615  7189 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.170039  7190 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.188687  7208 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.167836  7206 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:03.276675  7176 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:03.178972  7207 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.219610  7199 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.220875  7177 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.240317  7179 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.267134  7173 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.268401  7195 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.230916  7204 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.230006  7191 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.277480  6907 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:03.178917  7218 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.259498  7193 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.290133  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.290484  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.229707  7220 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.289459  7221 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.280526  7189 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.291767  7208 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:14:03.293036  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 248062us
I20260709 13:14:03.307864  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.259069  7211 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.293892  7173 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.295418  7203 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.307966  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.312366  7181 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.321568  6255 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 1.
I20260709 13:14:03.295643  7195 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.321866  7181 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.322289  7173 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.317518  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:03.323215  6942 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:03.313853  7197 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.314354  7182 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.300726  7225 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.308054  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.299384  7183 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.305470  7200 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:03.306911  7212 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.305847  7188 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.324229  7213 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.308544  7187 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:03.329612  6297 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:03.316923  7231 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:03.299911  7226 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.334548  7185 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.277063  7206 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.315811  7189 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.280970  7222 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.329556  7181 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.289898  7199 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.328738  7215 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.334307  7200 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.346728  7231 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:03.338683  7180 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.347925  7210 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.307751  7220 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.320118  7208 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.339982  7205 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.329732  7221 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.328814  7225 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.356467  7215 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.354347  7187 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:03.361600  7231 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:03.458889  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 470173us
I20260709 13:14:03.453579  7187 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.304253  7218 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.455653  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:03.453033  7194 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.452958  7193 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.451870  7195 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.454669  7214 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:03.525769  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4dc0 after lost signal to thread 5115
I20260709 13:14:03.485260  7213 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:14:03.690639  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002e46a0 after lost signal to thread 6188
I20260709 13:14:03.480103  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:03.565045  7210 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.691922  7225 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.692255  6324 consensus_queue.cc:237] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:03.644606  7186 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.681419  6941 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:14:03.634718  7216 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.579480  7196 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.490103  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:03.680663  7211 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.469166  7222 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.355856  7226 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.451267  7229 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.675616  7187 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.464445  7206 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.466091  7200 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.709673  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:03.630587  7209 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:03.701895  6426 debug-util.cc:398] Leaking SignalData structure 0x7b0800173a40 after lost signal to thread 6280
I20260709 13:14:03.407632  7230 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:03.720316  7236 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.705199  7193 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.464839  6907 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:03.489923  7233 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.715564  7220 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:03.734792  6426 debug-util.cc:398] Leaking SignalData structure 0x7b0800116e00 after lost signal to thread 6355
I20260709 13:14:03.734094  7230 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:03.739008  6426 debug-util.cc:398] Leaking SignalData structure 0x7b0800268760 after lost signal to thread 6429
W20260709 13:14:03.739846  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002b85e0 after lost signal to thread 6966
I20260709 13:14:03.729910  7222 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.714697  7210 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.718479  7195 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.718931  6940 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:14:03.730721  7211 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.715461  7213 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.745035  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.736912  7194 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.718765  7216 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.762112  7222 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.761430  7237 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.743934  7205 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.779755  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.748752  7180 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.734367  7236 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:14:03.781908  7205 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.738081  7193 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.736455  7229 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.794122  7201 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.751106  7195 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.783869  7221 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.747524  7233 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.751670  7211 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.805145  7201 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.805532  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:03.790756  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 322243us
I20260709 13:14:03.790459  7184 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.786906  7199 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.806131  6256 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:14:03.794730  7175 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:03.789757  7189 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.764070  7194 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.810845  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.787034  7235 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:03.790047  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:03.815301  6253 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:14:03.793354  7180 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.810966  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.810796  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.785802  7232 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:03.807961  7183 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.811280  6371 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:03.814679  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:03.826678  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.803520  7215 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.828969  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.824658  7216 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.796034  7237 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.840368  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.821117  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.824373  7184 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:03.845459  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:03.822618  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.841869  6254 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:14:03.825292  7235 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:03.825654  7205 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.848446  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.820869  6907 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:03.822959  7193 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.823589  7201 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.822175  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.853545  7235 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.854074  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:03.857544  6401 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
W20260709 13:14:03.858341  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.858354  7210 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.824221  6371 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:03.859108  7218 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.822638  7183 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.860334  7194 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.860869  7194 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:03.861233  7194 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.861469  7213 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.861608  7194 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.861743  7183 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.821899  7226 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.854995  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.845726  7240 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:03.845818  7184 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.822436  7232 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:03.860374  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.874995  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.877406  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.878268  6250 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:03.879415  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.880112  6250 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:03.881973  6248 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:03.863101  7236 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.866271  7208 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.866124  7237 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.866482  7240 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.892987  7240 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.863059  7231 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:03.888475  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.868738  7184 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.867218  7229 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.888644  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:03.903793  6326 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:14:03.876776  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:03.891319  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.891754  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.915810  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:03.921454  6329 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:14:03.916141  6942 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:03.915874  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:03.934954  6327 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:14:03.886152  7222 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.942024  7230 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:03.942974  7239 log.cc:927] Time spent T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:14:03.944716  7233 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:03.946130  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:03.947132  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.948261  7218 consensus_queue.cc:1059] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:03.949530  7226 raft_consensus.cc:3055] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:03.949990  7226 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:03.951032  7226 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:03.952510  7226 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:03.887444  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.937191  7180 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.937772  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.890569  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:03.940474  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.970986  6325 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:14:03.971208  7241 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:14:03.971536  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 152488us
I20260709 13:14:03.971676  7241 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:03.970293  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.973973  6251 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:03.974191  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:03.977419  6297 consensus_peers.cc:597] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05f408a1388f424db8b65332c1dcd467. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.977181  7195 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:03.987869  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.961315  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.024264  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:03.973237  7241 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.026436  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.010820  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.048225  6907 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.059267  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.060789  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.064262  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.071579  6402 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:14:04.074654  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.070149  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.066794  7235 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.077356  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.056763  6255 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
W20260709 13:14:04.089594  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.094861  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.098587  7194 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.099246  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.100281  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.104053  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.119810  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.104570  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.121889  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.047808  7231 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.135943  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:04.141789  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 94641.9us
I20260709 13:14:04.143186  6907 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:04.135929  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.122185  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.135849  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.143828  7240 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.147893  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.150164  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.135768  6935 raft_consensus.cc:1240] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.133787  7232 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:04.151763  6906 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.705s (SENT) [suppressed 1 similar messages]
I20260709 13:14:04.152455  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.152750  7242 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.151517  7231 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.153950  7242 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:04.154347  7231 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:04.153448  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.154982  7231 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.154452  7242 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.122867  7211 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:04.138427  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.158627  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.159502  7235 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.161089  7194 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:04.121884  7241 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.162505  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.165290  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:04.165426  6251 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:04.168032  7184 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.169900  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.169107  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.169755  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.168897  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.172191  6399 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.169690  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.174038  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.176532  6401 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:04.181751  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.182586  6402 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:04.185810  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.186910  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.188757  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.190307  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:04.197515  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.181624  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.201891  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.202334  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.202723  6322 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:14:04.203398  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.203506  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.203716  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.185154  7184 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:04.204659  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.204856  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.205086  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.207522  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.208230  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.208990  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.209302  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.209990  6405 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:04.210274  7187 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.209373  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.212222  6330 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.213449  7186 consensus_queue.cc:1059] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:04.214058  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.214459  7186 raft_consensus.cc:3055] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.214803  7186 raft_consensus.cc:740] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:04.215505  7186 consensus_queue.cc:260] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.216533  7186 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.227416  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.229995  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.230221  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.230829  6327 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:04.231719  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.233543  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.234187  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.234727  6330 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:14:04.235615  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.238133  7241 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.239096  7231 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.240374  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.241654  7231 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.242677  6219 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:04.241588  6905 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:04.226909  7187 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:04.245507  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.246734  7200 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.246851  6219 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:04.247571  6327 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:14:04.248359  6219 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:04.248631  7189 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.250506  7222 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.250630  7189 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:04.250922  7222 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:04.251075  7189 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.251125  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:04.200742  7242 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.247692  7200 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:04.253633  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.253908  7200 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.254215  6401 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:04.254333  7242 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.252619  7231 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.254899  7231 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:04.251327  7222 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.255113  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.255309  7231 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.258289  6219 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:04.260480  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.261405  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.263386  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:04.265000  7208 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.265321  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:04.265913  6326 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:04.265424  7208 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:04.266615  7208 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.267889  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.267973  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.268757  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.273976  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.274704  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.274991  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:04.277040  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:04.282188  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 47991.4us
I20260709 13:14:04.282311  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.282274  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.284865  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.280552  6326 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:04.246150  6907 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:04.285501  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.286175  6327 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:04.287446  6906 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.287371  7222 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.299137  7241 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.299237  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.300397  7200 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.288559  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.301348  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.289028  7208 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.291102  7231 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.291510  6219 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:04.292012  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.303488  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:04.295488  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.295922  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.296044  7240 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.296375  6905 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:04.306434  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.305358  7191 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.306694  7241 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:04.307092  7191 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:04.307296  7241 raft_consensus.cc:697] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:04.307507  7191 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.296815  6326 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:04.296916  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:04.297307  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 66583.4us
I20260709 13:14:04.297806  7242 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:04.297941  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.298241  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.300745  7222 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.269878  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.292692  7189 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.292620  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.311513  6295 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:04.312873  6295 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:04.314563  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.310701  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.315973  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.316308  6295 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:04.315444  6219 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:04.317194  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.317665  6399 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:04.318418  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.319008  6401 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:04.319118  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.320230  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.320425  6219 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:04.314740  7214 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.321542  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.308172  7241 consensus_queue.cc:237] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.322052  7245 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.322445  7245 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:04.322801  7245 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.314550  7236 consensus_queue.cc:1059] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:14:04.321581  7214 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:04.324170  6251 raft_consensus.cc:1240] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.324350  7214 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.325424  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.326462  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.327083  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.328702  7210 raft_consensus.cc:3055] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.331818  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:04.332185  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.328933  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.329466  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:04.328784  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.328732  7207 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.331887  7210 raft_consensus.cc:740] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:04.335357  6405 raft_consensus.cc:2393] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 3: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:04.335564  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.332782  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.320677  7222 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.316555  7187 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.334911  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.314996  7242 raft_consensus.cc:697] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:04.333992  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.336934  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.337276  6399 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 2: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:04.337539  6295 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:04.338603  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.352151  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.338454  7242 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.336912  7187 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:04.353268  7196 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.353745  6401 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:04.353359  7187 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.354754  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.356674  6295 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:04.330827  7189 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.357744  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.357776  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.358285  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.359290  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.359643  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.359318  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.335353  7207 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:04.339986  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.359174  7225 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.364049  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.338289  7210 consensus_queue.cc:260] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.355234  7196 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:04.365681  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.366743  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:04.337181  7222 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:04.367419  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.367942  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.368624  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.339771  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.367955  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.361670  7207 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.370064  6405 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.370591  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.371163  6399 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:04.372392  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.374042  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.364569  7225 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:04.376446  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:04.376646  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.371728  7186 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:14:04.379127  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.379554  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.380110  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.368243  7196 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.382712  6369 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:04.382515  7210 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.383558  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:04.383823  6369 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:04.387166  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.384142  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.384480  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.385162  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.387732  6399 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:04.391470  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.392076  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.374589  7231 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:04.393805  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.370003  7222 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.394423  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:04.376236  7225 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.392637  7184 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.412206  6324 raft_consensus.cc:2393] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 2: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:04.413095  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.413631  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.419543  6936 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.420393  6935 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.427553  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.393563  6369 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:04.426179  7184 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:04.397315  7194 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.426594  6939 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.429489  7184 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.429642  7194 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:04.430099  7194 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.431281  7203 consensus_queue.cc:1059] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:04.432245  7203 raft_consensus.cc:3055] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.432546  7203 raft_consensus.cc:740] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:04.433372  7203 consensus_queue.cc:260] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.436692  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.437508  6399 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:04.439348  7184 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.440903  7184 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:04.444621  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.444837  7226 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.447476  7226 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:04.447850  7226 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.449643  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.453823  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.454370  6399 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:04.432860  7207 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.456805  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.449060  7200 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.464203  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.445319  7214 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.466730  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.456422  7203 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.436452  7245 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.434201  6907 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.472959  7214 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.474382  6405 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:04.476660  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.477468  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:04.478739  7226 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.479679  7222 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.479863  7187 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.498968  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.500312  7187 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.480523  7193 consensus_queue.cc:1059] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:04.480711  7236 consensus_queue.cc:1059] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:04.481511  7207 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.482517  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.483189  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.483587  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.502005  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.484203  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.503069  7250 consensus_queue.cc:1059] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:04.503188  6369 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:04.485329  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.504102  7211 raft_consensus.cc:3055] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.485479  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.485886  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.504792  7211 raft_consensus.cc:740] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:04.484912  7196 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.504142  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.505587  7211 consensus_queue.cc:260] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.506701  7211 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.507105  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.507912  7196 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.503228  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.508716  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.486104  7208 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.511055  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.498086  7242 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.512491  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:04.513417  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.515441  7245 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.517462  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.486829  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.504184  7250 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.503284  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.476610  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:04.519737  7189 raft_consensus.cc:3055] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.519999  7236 raft_consensus.cc:3055] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.520287  7189 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:04.520584  7236 raft_consensus.cc:740] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:04.521608  7236 consensus_queue.cc:260] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.522579  7236 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.525373  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:04.523666  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.529549  6221 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.533526  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.530704  7194 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.535696  7194 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:04.538337  6369 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:04.541291  7211 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.542207  6369 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:04.542876  7211 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.546871  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.547706  7226 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:04.546871  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.533191  7251 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.545289  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.549049  7251 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:04.549589  7251 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:04.533365  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 112002us
I20260709 13:14:04.497429  7225 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.552611  6221 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.553692  7228 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.553864  7222 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.555467  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.555781  6907 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.557044  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.551801  7189 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.559119  7189 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.564993  6250 raft_consensus.cc:1240] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.559974  7242 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.561268  7228 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:04.570752  7228 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.561077  6907 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:04.562310  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.564217  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:04.510502  7191 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.565001  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.576169  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.578903  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:04.580590  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 133523us
I20260709 13:14:04.582847  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.582757  7211 consensus_queue.cc:1059] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:04.583107  6249 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:04.583877  7211 raft_consensus.cc:3055] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.584231  7211 raft_consensus.cc:740] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:04.585187  7211 consensus_queue.cc:260] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.585832  6906 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.586210  7211 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.587044  7242 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:04.588658  7242 raft_consensus.cc:697] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:04.589427  6251 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.589536  7242 consensus_queue.cc:237] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.592067  7191 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.592485  7231 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:04.592715  7225 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.593019  7231 raft_consensus.cc:697] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:04.593926  7231 consensus_queue.cc:237] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:04.595256  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.596099  6399 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.597055  6295 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:04.597810  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:04.599144  7226 consensus_queue.cc:1059] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.600207  7194 raft_consensus.cc:3055] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.600543  7194 raft_consensus.cc:740] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:04.601246  6255 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.601368  7194 consensus_queue.cc:260] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.603480  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.604947  6152 catalog_manager.cc:5697] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 2 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:04.606652  6152 catalog_manager.cc:5697] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 2 to 3, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 3 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:04.605821  7194 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.608480  6251 raft_consensus.cc:1240] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.609014  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.602349  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.610647  6296 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:04.611299  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.610695  6249 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.615949  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.616601  6296 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.613974  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.612213  7180 consensus_queue.cc:1059] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:14:04.616096  7196 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.618749  7180 raft_consensus.cc:3055] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.619030  7196 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:04.619140  7180 raft_consensus.cc:740] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:04.619493  7196 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.620018  7180 consensus_queue.cc:260] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.621197  7180 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.613560  7245 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.617204  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.613300  7250 consensus_queue.cc:1059] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:14:04.623844  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.624711  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:04.625658  7226 raft_consensus.cc:3055] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.626008  7226 raft_consensus.cc:740] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:04.626163  7214 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.626952  7226 consensus_queue.cc:260] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.629665  7226 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.631067  7250 consensus_queue.cc:1059] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.632032  7250 raft_consensus.cc:3055] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.632377  7250 raft_consensus.cc:740] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:04.637367  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.637733  7250 consensus_queue.cc:260] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.638972  7250 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.639780  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.639810  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.640625  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.641716  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.642953  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.643237  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.642942  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.644697  6249 raft_consensus.cc:2393] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 2: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:04.648223  6296 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.657733  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.658268  6400 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:04.658979  6401 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:04.661311  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:04.663596  6405 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:04.666052  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.667734  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.668350  6403 raft_consensus.cc:2393] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 2: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:04.668248  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.668965  6368 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.669474  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.670608  6368 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.616117  6907 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.669705  7211 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.674291  6368 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.675449  6402 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:04.670287  7249 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.678203  6368 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.679817  6368 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.671813  7214 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.671777  7195 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:04.674335  7231 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.677673  7194 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.688742  6221 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.681939  7184 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:04.679298  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 66743.4us
I20260709 13:14:04.685640  7211 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.682039  7214 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:04.697412  7213 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.700127  6399 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:04.682229  7251 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.706167  6221 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.700167  7214 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:04.730890  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.708739  7203 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.743031  7196 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.745488  6253 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.745819  6221 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.747511  6221 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.749243  6221 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.750358  7189 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.750419  7233 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.752043  7203 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.758280  7251 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.758416  6253 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.760675  7184 consensus_queue.cc:1059] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:04.761634  7252 log.cc:927] Time spent T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:14:04.761813  7184 raft_consensus.cc:3055] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.762212  7184 raft_consensus.cc:740] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:04.745412  7196 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.763028  7184 consensus_queue.cc:260] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.764015  7184 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:04.765537  7253 log.cc:927] Time spent T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:14:04.766446  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:04.769163  6936 raft_consensus.cc:1240] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.769528  6221 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.773571  6398 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:04.774019  7214 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.777025  6221 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.778863  6221 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.780229  6221 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.780360  7210 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.780928  7203 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.781401  7210 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.781669  7203 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.785897  7257 ts_tablet_manager.cc:933] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:04.785545  7228 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.789016  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:04.788441  6221 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.794957  6399 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.795524  7256 consensus_queue.cc:1059] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:14:04.796821  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 116744us
I20260709 13:14:04.802060  6296 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.806073  6296 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.806456  6221 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.807824  7191 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.808365  7214 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.809293  7249 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.810954  6221 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.816352  6221 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.817834  6221 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.818739  7210 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.819396  6296 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:04.832001  6399 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:04.832326  6296 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.821427  7203 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.834259  6296 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.813673  7191 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:04.825525  7248 raft_consensus.cc:3055] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.815073  7196 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:04.833415  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 153692us
I20260709 13:14:04.833938  7231 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:04.835716  6221 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.835772  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.837405  6221 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.837879  6368 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:04.836776  6404 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:04.838672  7203 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.839351  7191 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.836853  7249 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.840567  7256 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.841377  7191 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.834908  7248 raft_consensus.cc:740] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:04.842466  6221 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.843130  7191 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.842886  7248 consensus_queue.cc:260] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:04.843997  7248 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.844769  6221 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.845022  6296 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.845556  6368 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.845885  6221 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.846470  6296 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.848039  6296 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.849555  7191 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.849663  7225 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:04.850423  7203 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.850494  7256 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.851596  7206 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.852345  7261 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.857214  7228 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.854267  6296 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:04.858443  7206 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.859102  7206 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:04.856827  6221 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.859943  6296 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:04.860332  7191 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.859465  7206 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.861167  6399 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:04.861104  6221 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.853932  7258 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.862804  7191 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:04.862838  6368 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.862679  7258 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:04.863435  7191 raft_consensus.cc:697] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:04.863600  7256 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.863026  7184 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.864055  7256 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:04.863992  6296 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.869275  7225 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.864379  7191 consensus_queue.cc:237] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.871007  7214 consensus_queue.cc:1059] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.872119  7229 raft_consensus.cc:3055] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.872596  7229 raft_consensus.cc:740] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:04.873620  6296 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.869715  7258 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.877342  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.878973  6368 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.879277  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.878432  6250 raft_consensus.cc:1240] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.869922  7261 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.872076  7214 raft_consensus.cc:2955] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:04.880735  6252 raft_consensus.cc:2955] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:04.877713  7225 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.876714  6296 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.868017  7256 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.882468  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.863624  7231 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:14:04.890364  6368 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.875658  7257 tablet_copy_client.cc:323] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.2:39965
I20260709 13:14:04.891809  6368 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.892638  7226 raft_consensus.cc:2764] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:14:04.895097  6368 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.896093  6368 leader_election.cc:304] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.896209  6296 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.882241  7184 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.900415  6368 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.902243  6368 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.893599  7261 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.901441  7195 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.907157  7261 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.907405  6341 tablet_copy_service.cc:140] P a13ffe92eb374309a5c8476d9fbbb2b8: Received BeginTabletCopySession request for tablet 05f408a1388f424db8b65332c1dcd467 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41502)
I20260709 13:14:04.908005  6341 tablet_copy_service.cc:161] P a13ffe92eb374309a5c8476d9fbbb2b8: Beginning new tablet copy session on tablet 05f408a1388f424db8b65332c1dcd467 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41502: session id = 8600a3fead0e48a7aa813822ec44d0fe-05f408a1388f424db8b65332c1dcd467
I20260709 13:14:04.894327  7229 consensus_queue.cc:260] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.909950  7229 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.901394  7194 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.896864  7211 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.894451  7250 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.904902  7245 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:04.896807  7225 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.896864  7180 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.905524  7175 consensus_queue.cc:1059] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:14:04.922634  6368 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.924659  7248 raft_consensus.cc:3055] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.925027  7248 raft_consensus.cc:740] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:04.927980  6368 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.929939  6326 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.929934  6368 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.932011  6368 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.933607  6296 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.935732  7266 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.936836  6296 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:04.938632  7266 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.938995  7266 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:04.939111  6323 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:04.939357  7266 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.930054  7184 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.940733  6296 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.940866  7195 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.942297  7233 consensus_queue.cc:1059] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:14:04.942955  7225 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.942862  7258 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.945626  6330 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:04.948498  7258 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.938423  7206 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.951943  7206 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:04.942133  7231 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:14:04.932812  7211 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.957259  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:04.958995  7225 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.959100  7233 raft_consensus.cc:3055] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.959368  7225 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:04.959604  7233 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:04.959802  7225 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.963971  6296 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:04.965205  7258 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:04.965318  6296 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.965648  7258 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:04.966485  6296 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.964082  6368 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.966102  7186 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:04.969017  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 71788.2us
I20260709 13:14:04.972194  6368 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.967262  7261 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.973009  6368 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.974470  6326 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:04.960470  7233 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.975106  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:04.975198  6368 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.977463  7249 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.977989  7261 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.977893  7236 consensus_queue.cc:1059] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.978925  7248 consensus_queue.cc:260] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:04.981722  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.981877  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:04.984002  6154 catalog_manager.cc:5697] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 2, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:04.969025  7258 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.984839  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.972008  7180 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.986364  6296 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:04.996129  6368 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.997099  6221 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:04.974850  7250 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:05.002902  7211 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:04.992062  7245 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:05.003789  7245 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:05.004168  7245 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:05.004464  7225 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.006628  7225 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:05.007010  7233 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.001159  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:04.991277  7226 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.008989  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.013525  6326 raft_consensus.cc:1240] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:05.015075  7231 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:05.016031  7223 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:04.998378  7180 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.016826  7223 raft_consensus.cc:697] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:05.017728  7223 consensus_queue.cc:237] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.022503  6253 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:05.023447  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:05.025226  6327 raft_consensus.cc:1240] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:05.027410  6221 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:05.028692  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:05.028997  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:05.028721  6221 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.030068  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:05.030725  6324 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:05.034818  6221 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.035346  6296 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:05.036792  6221 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.040930  6368 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.040524  6221 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:05.027005  7203 consensus_queue.cc:1059] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:14:05.041015  7248 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.038836  7189 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.042593  7180 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.038544  7187 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.043529  6368 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.050981  6368 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.041550  7236 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.027284  7237 consensus_queue.cc:1059] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:14:05.052461  6221 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:04.971882  7256 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.036466  7225 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:05.036304  7213 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.039841  7210 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.049646  7191 raft_consensus.cc:3055] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.058490  6368 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.050357  7208 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.043368  7196 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:14:05.061704  7191 raft_consensus.cc:740] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:05.072563  7180 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.081612  7240 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:14:05.061015  7225 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:05.085700  7225 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.086499  6368 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.087924  6368 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.088598  7211 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.069927  7230 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.058867  7261 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.089423  7211 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.071898  7210 raft_consensus.cc:697] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:05.090708  6368 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.091586  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:05.091578  7256 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:05.090559  7210 consensus_queue.cc:237] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.070421  7193 raft_consensus.cc:3055] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.095659  7193 raft_consensus.cc:740] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:05.052692  7226 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:05.070168  6330 raft_consensus.cc:1240] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:05.097543  6368 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.098779  6368 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.051047  7189 raft_consensus.cc:697] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:05.101536  6368 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.101294  7261 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.103259  7250 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.084565  7191 consensus_queue.cc:260] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.104128  7222 consensus_queue.cc:1059] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.104523  7191 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.105142  7222 raft_consensus.cc:3055] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.106204  6368 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.116117  6368 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.072657  7232 raft_consensus.cc:3055] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.120224  6368 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.096514  7236 raft_consensus.cc:697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:05.101029  7180 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.099948  7211 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.133351  6368 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.137892  6368 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.143766  6368 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.105520  7222 raft_consensus.cc:740] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:05.134232  7195 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.132279  7226 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.136454  7184 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.132858  7232 raft_consensus.cc:740] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:05.166103  7236 consensus_queue.cc:237] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.166664  7232 consensus_queue.cc:260] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.168262  7232 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.100754  7193 consensus_queue.cc:260] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.151999  7250 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.152096  7194 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.150355  7264 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.150298  7214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:41486 (request call id 3) took 1633 ms. Trace:
I20260709 13:14:05.156415  7180 consensus_queue.cc:1059] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:14:05.192605  7222 consensus_queue.cc:260] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.195955  7222 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.194319  6252 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:05.185904  7189 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.207089  7193 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.220325  7264 raft_consensus.cc:3055] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.220650  6402 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:05.220758  7264 raft_consensus.cc:740] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:05.211790  7231 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:14:05.231071  7225 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.238425  7264 consensus_queue.cc:260] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.213770  7245 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.243103  7240 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:14:05.223776  7258 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:05.275013  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 124937us
I20260709 13:14:05.275854  6368 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:05.189458  7214 rpcz_store.cc:276] 0709 13:14:03.509304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.509468 (+   164us) service_pool.cc:224] Handling call
0709 13:14:03.718978 (+209510us) log.cc:844] Serialized 492 byte log entry
0709 13:14:03.917750 (+198772us) spinlock_profiling.cc:243] Waited 6.63 ms on lock 0x7b5400153220. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575b65b26 00007f4575b5f49a 00007f4575b5e714 00007f4575b3eeaa 00007f4575b45d53 00007f4575b45cd9 00007f4575b45c69 00007f4575b45c31 00007f4575b44dfd 000000000038f354
0709 13:14:03.949722 (+ 31972us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b5400153220. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575b65b26 00007f4575b5f49a 00007f4575b5e714 00007f4575b3eeaa 00007f4575b45d53 00007f4575b45cd9 00007f4575b45c69 00007f4575b45c31 00007f4575b44dfd 000000000038f354
0709 13:14:04.027072 (+ 77350us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b5400153220. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575b5e142 00007f4575b3eeaa 00007f4575b45d53 00007f4575b45cd9 00007f4575b45c69 00007f4575b45c31 00007f4575b44dfd 000000000038f354 000000000038f199 00007f4572af8475
0709 13:14:05.142484 (+1115412us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64528,"raft.queue_time_us":11905,"raft.run_cpu_time_us":8732,"raft.run_wall_time_us":519159,"spinlock_wait_cycles":24058880,"thread_start_us":49049,"threads_started":1,"wal-append.queue_time_us":96469,"wal-append.run_cpu_time_us":2618,"wal-append.run_wall_time_us":1111800}
I20260709 13:14:05.279309  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.280354  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.281374  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.280071  6400 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:05.284035  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.285481  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:14:05.255227  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 92129us
I20260709 13:14:05.286103  7225 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:05.286252  6398 raft_consensus.cc:2393] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 2: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:05.288838  6326 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:05.289113  6330 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:05.292311  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:05.293195  6296 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:05.294564  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:05.294984  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.296739  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.296856  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:05.297977  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.277280  6322 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:05.300029  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.287020  7245 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:05.300717  7187 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:14:05.300484  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.298316  7225 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.307981  6341 tablet_copy_source_session.cc:215] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:05.308262  7264 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.301380  6402 raft_consensus.cc:2393] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 2: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:05.301736  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.302603  7258 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:05.290083  7266 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.311434  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:05.280079  7226 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.302310  7210 consensus_queue.cc:1059] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:14:05.319394  6323 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:05.320070  7222 raft_consensus.cc:3055] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.320122  7266 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:05.320546  7222 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:05.321349  7222 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.322214  7222 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.326216  6402 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:05.329279  7256 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.335903  7257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f408a1388f424db8b65332c1dcd467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:05.314895  7191 consensus_queue.cc:1059] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:14:05.332125  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.339509  6323 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.341337  7196 raft_consensus.cc:3055] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.341733  7196 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:05.338595  6295 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:05.327952  6296 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:05.344188  6323 raft_consensus.cc:1240] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:05.344787  6296 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:05.345350  7258 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.331547  7233 consensus_queue.cc:1059] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:14:05.349589  6296 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:05.350869  7210 raft_consensus.cc:3055] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.352291  7196 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.353569  7265 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.353744  7196 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.354431  7228 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:05.356034  7228 consensus_queue.cc:1059] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.350482  7258 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.357993  7213 raft_consensus.cc:3055] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.358337  7213 raft_consensus.cc:740] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:05.359228  7213 consensus_queue.cc:260] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.352315  7210 raft_consensus.cc:740] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:05.360417  7213 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.361364  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:05.382465  6296 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:05.384388  6296 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:05.358451  6404 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:05.386435  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:05.363020  7228 raft_consensus.cc:3055] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:05.350127  7281 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:14:05.377468  7248 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:05.381389  7265 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.394152  7228 raft_consensus.cc:740] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:05.377380  7210 consensus_queue.cc:260] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.455755  7210 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.397099  7225 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:14:05.453425  7280 log.cc:927] Time spent T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.009s
W20260709 13:14:05.458881  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 64420.9us
I20260709 13:14:05.462182  6397 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.476204  7203 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.479833  6399 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:05.503599  7228 consensus_queue.cc:260] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.505039  7228 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:05.506584  6296 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:05.509106  6296 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:05.510769  6330 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.510130  6253 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:05.513826  6296 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:05.520830  6330 raft_consensus.cc:1275] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.516089  6400 raft_consensus.cc:2955] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:05.517549  7187 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.512219  7225 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.514963  7245 consensus_queue.cc:1059] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:14:05.542315  6398 raft_consensus.cc:1275] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.549227  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.517335  7249 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:14:05.560154  6202 auto_rebalancer.cc:629] Failed to schedule move for tablet 5176b2e1ff0145bdb28b559244b3cf5e: Illegal state: Replica b940f12ed61a49c4b3c11f13ef50fa92 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:14:05.548646  7187 raft_consensus.cc:697] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:05.565557  6404 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:05.574754  7265 raft_consensus.cc:3055] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.575199  7265 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:05.576048  7265 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:05.577258  6202 auto_rebalancer.cc:629] Failed to schedule move for tablet c0c4567153664b518d2f6515e419da60: Illegal state: Replica b940f12ed61a49c4b3c11f13ef50fa92 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:14:05.561409  7249 raft_consensus.cc:697] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:05.578390  7249 consensus_queue.cc:237] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.547173  7236 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:14:05.581921  7191 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:05.582592  7187 consensus_queue.cc:237] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.591454  6330 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:05.593664  6295 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:05.597061  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.607775  7222 consensus_queue.cc:1059] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:14:05.610922  6405 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.611615  7258 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:14:05.619102  7288 log.cc:927] Time spent T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:14:05.608295  7225 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.626503  7225 raft_consensus.cc:697] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:05.627401  7225 consensus_queue.cc:237] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.632929  7266 consensus_queue.cc:1059] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.633977  7214 raft_consensus.cc:3055] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.634343  7214 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:05.644886  6330 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.645834  6296 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:05.645756  6154 catalog_manager.cc:5697] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 2 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:05.653281  6327 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.653416  6154 catalog_manager.cc:5697] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 2 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:05.606684  7265 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.659489  6330 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.669626  7189 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.662029  7196 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.675609  6326 consensus_queue.cc:237] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:05.677147  7193 raft_consensus.cc:3055] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.677699  7193 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:05.678730  7193 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:05.680267  7193 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.663975  7191 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:14:05.705408  6327 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.635258  7214 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:05.731578  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 65654.5us
I20260709 13:14:05.734447  7236 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 13:14:05.747855  7290 log.cc:927] Time spent T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:14:05.710728  7203 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:14:05.736821  7222 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.754102  7222 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:05.756366  7222 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:05.759935  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:05.760653  6936 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:05.763850  6222 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:05.765059  7210 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:05.765444  7210 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.765771  7210 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:05.749687  7214 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.773535  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:05.775828  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 107297us
I20260709 13:14:05.759271  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41288 (request call id 62) took 1038 ms. Trace:
I20260709 13:14:05.800746  6402 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.774199  6396 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:05.810770  7236 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:14:05.803385  7257 rpcz_store.cc:276] 0709 13:14:04.703194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.703344 (+   150us) service_pool.cc:224] Handling call
0709 13:14:04.786387 (+ 83043us) ts_tablet_manager.cc:934] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
0709 13:14:05.334750 (+548363us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:05.470658 (+135908us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:05.470773 (+   115us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:05.681096 (+210323us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:05.701479 (+ 20383us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:05.735832 (+ 34353us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:05.741768 (+  5936us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":37332,"tablet-copy.queue_time_us":81947,"thread_start_us":121790,"threads_started":2}
I20260709 13:14:05.828012  7257 tablet_copy_client.cc:806] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:05.828595  7257 tablet_copy_client.cc:670] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:05.842605  6153 catalog_manager.cc:5697] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:05.844280  6153 catalog_manager.cc:5697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 2, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.854240  6153 catalog_manager.cc:5697] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 2, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.836712  7257 tablet_copy_client.cc:538] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:14:05.861466  6297 consensus_peers.cc:597] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 772aad0e3cb043d989afc6d1abdbf6f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.867079  6402 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:05.878036  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 58164.3us
I20260709 13:14:05.865670  6153 catalog_manager.cc:5697] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 2, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.881651  6153 catalog_manager.cc:5697] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 2, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.887249  6254 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:05.838527  7210 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:05.892334  7203 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.892364  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:05.893221  6936 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:05.906625  6399 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:05.908223  7248 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.897276  7210 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:05.919217  7266 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:05.915500  7213 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.915863  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:05.913998  6936 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:05.961050  6222 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:05.958562  7213 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:05.979872  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:05.980549  6403 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:05.971540  7232 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:05.994378  6221 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:05.997653  7210 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:05.976392  7213 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:05.961117  6404 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.017194  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:05.998045  7210 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.000610  7232 raft_consensus.cc:697] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:06.024839  7210 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.041486  6396 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.027746  6936 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:06.074239  6254 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:06.089957  6400 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.089946  7214 raft_consensus.cc:2955] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:06.093849  6247 raft_consensus.cc:2955] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:06.100044  7210 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:06.079865  7232 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:06.115136  6404 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:06.077354  7257 tablet_bootstrap.cc:492] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:06.110337  7196 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.113034  6254 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.103408  7266 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.122251  7248 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.131579  6154 catalog_manager.cc:5697] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 2 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.133414  6154 catalog_manager.cc:5697] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 1 to 2, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 2 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.141841  6247 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.148054  7214 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.137375  6154 catalog_manager.cc:5697] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 1 to 2, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 2 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.176244  6400 raft_consensus.cc:2955] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:06.175338  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:06.180068  6398 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.184330  7210 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:06.185393  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:06.185961  6936 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.232038  6936 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:06.233430  6222 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:06.233651  6247 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.234253  7210 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:06.234751  7210 raft_consensus.cc:697] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:06.235150  7187 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.235559  7210 consensus_queue.cc:237] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:06.230459  6152 catalog_manager.cc:5697] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.241964  6152 catalog_manager.cc:5697] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:06.246768  6404 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:06.254076  6398 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:06.294215  6404 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.299755  7214 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.319211  7257 tablet_bootstrap.cc:492] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:06.320313  7257 tablet_bootstrap.cc:492] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:06.321034  7257 ts_tablet_manager.cc:1403] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.261s	user 0.011s	sys 0.027s
I20260709 13:14:06.328305  6151 catalog_manager.cc:5697] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.333559  7257 raft_consensus.cc:359] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:06.341655  7257 raft_consensus.cc:740] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:06.342386  7257 consensus_queue.cc:260] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:06.345361  7257 ts_tablet_manager.cc:1434] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:14:06.347110  6341 tablet_copy_service.cc:342] P a13ffe92eb374309a5c8476d9fbbb2b8: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-05f408a1388f424db8b65332c1dcd467 received from {username='slave'} at 127.0.0.1:41502
I20260709 13:14:06.347457  6341 tablet_copy_service.cc:434] P a13ffe92eb374309a5c8476d9fbbb2b8: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-05f408a1388f424db8b65332c1dcd467 on tablet 05f408a1388f424db8b65332c1dcd467 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:06.371114  7257 ts_tablet_manager.cc:933] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:06.400693  7257 tablet_copy_client.cc:323] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.2:39965
I20260709 13:14:06.402546  6341 tablet_copy_service.cc:140] P a13ffe92eb374309a5c8476d9fbbb2b8: Received BeginTabletCopySession request for tablet 772aad0e3cb043d989afc6d1abdbf6f4 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41502)
I20260709 13:14:06.403141  6341 tablet_copy_service.cc:161] P a13ffe92eb374309a5c8476d9fbbb2b8: Beginning new tablet copy session on tablet 772aad0e3cb043d989afc6d1abdbf6f4 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41502: session id = 8600a3fead0e48a7aa813822ec44d0fe-772aad0e3cb043d989afc6d1abdbf6f4
I20260709 13:14:06.414077  6341 tablet_copy_source_session.cc:215] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:06.417966  7257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772aad0e3cb043d989afc6d1abdbf6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:06.424198  7233 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.424795  7233 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.427099  7233 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.428675  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:06.429370  7233 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.429944  7233 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.430744  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:06.431318  6399 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:14:06.432071  7233 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.429374  6329 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:06.435761  6221 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:06.436576  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:06.437279  6323 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:06.439852  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:06.440975  7298 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.441107  7257 tablet_copy_client.cc:806] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:06.441802  7257 tablet_copy_client.cc:670] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:06.441545  7298 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.442741  7231 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.443279  7231 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:06.443734  7298 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.445382  6219 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:06.446873  7210 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:06.447342  7210 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.447723  7210 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.448562  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:06.449371  6404 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:06.445422  7231 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.442764  7233 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:06.450484  6296 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:06.450953  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:06.451988  6399 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 1.
I20260709 13:14:06.452142  7298 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:06.452610  7298 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.452992  7298 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.453039  6907 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:06.454008  7231 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:06.454370  7231 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.454720  7231 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.455946  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:06.456568  6247 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:06.454562  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:06.460415  6329 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:06.460345  7298 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.451705  7233 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.462262  7233 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.451340  7257 tablet_copy_client.cc:538] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:06.464877  7298 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.465054  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:06.465106  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:06.465796  6399 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.465842  6247 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.470809  7298 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.471287  7298 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.473937  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:06.474575  7210 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.474591  6254 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:06.476145  6295 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:06.477872  7266 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:06.478932  7298 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.479105  7266 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.479465  6247 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:06.478413  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:06.488034  7233 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.488684  6404 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:06.479688  7266 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.492933  7257 tablet_bootstrap.cc:492] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:06.494123  7233 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.494959  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:06.495589  6323 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.480326  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:06.501425  6329 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.481858  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:06.483412  6399 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:06.476305  7231 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:06.507679  6296 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:06.508271  7231 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.508680  7298 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:06.509254  7298 raft_consensus.cc:697] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:06.510103  7298 consensus_queue.cc:237] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.510625  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:06.511417  6398 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.505239  6936 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:06.514482  7233 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.514966  7233 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.515405  7228 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:06.516844  7233 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.517226  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:06.517769  6327 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.522682  6398 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:06.523943  6907 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:06.524108  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:06.524670  6324 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:06.524729  7231 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:06.525449  7231 raft_consensus.cc:697] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:06.526324  7231 consensus_queue.cc:237] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:06.527649  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:06.528225  6396 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.524389  6327 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:06.529290  7264 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:06.523948  7230 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.529871  7264 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.530133  7230 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.532166  7230 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.532428  7264 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:06.534108  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:06.534199  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:06.534992  6247 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:06.535275  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:06.535921  6327 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:06.536134  6369 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:06.538125  6396 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:06.538369  6323 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:06.538211  7264 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:06.540046  7264 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:06.540416  7264 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:06.540670  7233 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:06.541066  7233 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.541410  7233 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.544100  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:06.544160  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:06.545462  6396 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:14:06.546337  6219 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:06.547037  7203 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:06.547153  6219 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:06.547421  7203 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.547809  7203 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.548975  6153 catalog_manager.cc:5697] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.550822  7208 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:06.551301  7208 raft_consensus.cc:697] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:06.552084  7208 consensus_queue.cc:237] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.554283  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:06.478376  7210 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.566462  6400 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:06.562690  7283 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:06.577665  7283 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.545058  6327 raft_consensus.cc:2393] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 2: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:06.570957  6329 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:06.581308  6219 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:06.564524  7233 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.583478  7230 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:06.560454  7203 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.599460  7233 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.600075  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:06.600634  6329 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.596724  7232 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:14:06.590791  7266 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.603386  7266 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.604401  7283 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:06.607972  7203 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.608276  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:06.609014  6327 raft_consensus.cc:2368] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
I20260709 13:14:06.609584  6153 catalog_manager.cc:5697] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.610723  6329 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:06.611150  6368 leader_election.cc:400] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
I20260709 13:14:06.611518  6368 leader_election.cc:403] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:06.611326  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:06.611742  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:06.612082  6327 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.612517  7203 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:06.612562  7283 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.616475  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:06.617094  6247 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.619807  7283 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
I20260709 13:14:06.620530  6327 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:06.622087  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:06.622272  7203 raft_consensus.cc:697] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:06.622615  6399 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.623200  7203 consensus_queue.cc:237] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.625578  6219 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:06.621415  7264 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.636595  6399 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:06.655488  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:06.656335  6400 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.665427  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:06.668121  6404 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:06.668344  7230 raft_consensus.cc:697] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:06.669935  6400 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:06.630568  7228 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:06.626668  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:06.671727  6296 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:06.674243  7327 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.674757  7327 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.676779  7327 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:06.673619  7265 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:06.678440  7265 raft_consensus.cc:697] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:06.679302  7265 consensus_queue.cc:237] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.673549  6397 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.681347  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:06.681967  6253 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:06.682940  6247 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:06.684006  6369 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:06.690475  7228 raft_consensus.cc:697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:06.693784  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:06.694470  6329 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:14:06.685333  7283 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:06.697266  7283 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.697640  7283 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.697901  7264 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:06.700062  7228 consensus_queue.cc:237] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.698822  7230 consensus_queue.cc:237] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.711745  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:06.712708  6329 raft_consensus.cc:2368] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
I20260709 13:14:06.714185  6368 leader_election.cc:400] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
I20260709 13:14:06.714579  6368 leader_election.cc:403] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:14:06.719301  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:06.717029  7329 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:06.728824  6397 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:06.773474  7264 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
I20260709 13:14:06.775645  7327 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.776142  7327 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.776576  6935 raft_consensus.cc:1217] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:06.778151  7327 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:06.832221  7328 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:06.834630  7328 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.830067  7327 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:06.837666  7327 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.839931  7327 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:06.840513  7327 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:06.845173  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:06.845852  6247 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:06.826071  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:06.846660  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:06.847321  6253 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
W20260709 13:14:06.850353  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 70152.3us
I20260709 13:14:06.848390  6369 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:06.852384  6369 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:06.790524  7329 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.849736  7328 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:06.854889  7264 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:06.841023  7327 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.858749  7336 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.869410  7328 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:06.857313  7283 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.867049  7264 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:06.878459  7328 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:06.885784  7343 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:06.886318  7343 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.886853  7329 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.877729  7336 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.888451  7343 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:06.888993  7336 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:06.922602  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:06.932828  7257 log.cc:927] Time spent T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:14:06.936236  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:06.937382  6329 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:06.938144  7257 tablet_bootstrap.cc:492] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:06.940336  7257 tablet_bootstrap.cc:492] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:06.944125  6219 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:06.946524  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:06.949981  6255 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:06.961568  7230 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:06.964391  7230 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.965056  7230 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.977308  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:06.978386  6329 raft_consensus.cc:2393] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 2: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:06.962265  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:06.981954  6327 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:06.975345  6369 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:06.988837  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:06.990011  6322 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 2: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:06.924715  6323 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:06.994383  7256 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.995519  7257 ts_tablet_manager.cc:1403] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.449s	user 0.034s	sys 0.028s
I20260709 13:14:06.882202  7264 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.995009  7256 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:06.885257  7328 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.011994  7283 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:07.012161  7327 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:07.019979  7343 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:07.020478  7343 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:07.020934  7343 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.026649  6323 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:07.026531  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:07.031891  7257 raft_consensus.cc:359] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:07.033311  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:07.042761  6254 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.027964  7283 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.044730  6152 catalog_manager.cc:5697] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 1 to 3, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 3 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.049743  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:07.051648  7328 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.055032  7242 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:07.055853  7327 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:07.057376  6936 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:07.059419  6219 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:07.061430  7256 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.062480  6397 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:14:07.064787  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 58775.6us
I20260709 13:14:07.079602  6322 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:07.074231  6255 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:07.080073  7283 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.081264  6151 catalog_manager.cc:5697] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.088372  6329 raft_consensus.cc:2393] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:07.071776  7257 raft_consensus.cc:740] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:07.094542  7348 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:07.095034  7348 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:07.097905  7348 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.099148  6368 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:07.106830  7242 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:07.103986  6369 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:07.118355  7346 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:07.118580  7329 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:07.112282  7257 consensus_queue.cc:260] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:07.118904  7346 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:07.102003  7230 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.101653  7327 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.129292  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:07.119453  7346 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.119410  7328 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:07.119280  7329 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.127044  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:07.141897  7233 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:07.147663  7257 ts_tablet_manager.cc:1434] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.003s
I20260709 13:14:07.148798  7230 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.149650  7283 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:07.151038  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:07.155063  6251 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:14:07.156085  7329 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.156595  7339 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.157115  7339 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.157891  6369 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:07.159268  7339 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.161777  7343 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.169248  7210 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:14:07.171245  6254 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:07.152089  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:07.153115  7328 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:07.171952  6329 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 2: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:07.172389  6322 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.150897  7264 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.175493  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:07.186018  7264 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:07.186127  6327 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:07.181972  6369 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:07.182850  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:07.189730  6323 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.177227  7328 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.160593  7348 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.177590  7283 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:07.197067  7328 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.206902  7283 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.211365  7283 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.210319  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:07.213835  6251 raft_consensus.cc:2368] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
I20260709 13:14:07.216307  7327 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:14:07.211063  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 112144us
I20260709 13:14:07.200903  7343 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:07.220793  6341 tablet_copy_service.cc:342] P a13ffe92eb374309a5c8476d9fbbb2b8: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-772aad0e3cb043d989afc6d1abdbf6f4 received from {username='slave'} at 127.0.0.1:41502
I20260709 13:14:07.221509  6341 tablet_copy_service.cc:434] P a13ffe92eb374309a5c8476d9fbbb2b8: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-772aad0e3cb043d989afc6d1abdbf6f4 on tablet 772aad0e3cb043d989afc6d1abdbf6f4 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:07.231968  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:07.218204  7230 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:07.240248  6369 leader_election.cc:400] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
I20260709 13:14:07.240589  6369 leader_election.cc:403] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:14:07.240837  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:07.241250  6254 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:07.242484  6369 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:07.243304  7343 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.243345  7230 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.248044  7230 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.224773  7264 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:07.256628  6326 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:07.262490  7348 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.262732  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:07.263319  6324 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:07.265827  6327 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:07.267098  7299 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.260666  7264 raft_consensus.cc:697] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:07.267688  7299 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.270394  7196 raft_consensus.cc:1064] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:07.271459  7299 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.273006  7264 consensus_queue.cc:237] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.272797  7196 consensus_queue.cc:237] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:07.274504  6219 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:14:07.279145  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 54040.5us
I20260709 13:14:07.280416  7228 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:07.280802  7228 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:07.281180  7228 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.290130  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:07.290925  6331 raft_consensus.cc:2393] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 2: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:07.293217  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:07.249117  6322 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:07.294243  6331 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:07.299012  6323 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:07.300362  7353 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:07.301524  7353 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:07.301985  7353 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.302645  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:07.303776  6331 raft_consensus.cc:2393] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:07.304711  7299 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.305276  7299 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.307163  6255 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:07.307778  7299 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.308389  6369 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:07.309262  7327 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:07.309726  7327 raft_consensus.cc:697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:07.310719  7327 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.313390  7193 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:07.315205  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:07.315338  6219 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:07.316036  6331 raft_consensus.cc:2368] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
I20260709 13:14:07.316491  7193 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:07.316594  6219 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:07.317025  7193 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:07.317584  7193 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.319559  7283 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.321770  7283 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:07.322432  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:07.322594  7346 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.323462  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:07.324728  7346 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:07.325470  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:07.325886  7228 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.326825  6253 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.324232  6331 raft_consensus.cc:2393] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 2: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:07.327816  7228 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.328570  7342 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:07.328881  7329 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:07.330399  7329 raft_consensus.cc:697] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:07.331295  7329 consensus_queue.cc:237] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.331904  6402 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:07.335929  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:07.336910  7248 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.337462  7248 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.338012  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:07.340148  7248 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.344515  6327 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:07.346545  6253 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:07.349344  6325 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:07.349469  6369 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:07.292922  7328 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.350245  7346 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:07.350833  7346 raft_consensus.cc:697] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:07.351722  7346 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.352541  6254 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:07.352903  7328 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:07.353538  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:07.354300  6402 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 2: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:07.355466  7343 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
I20260709 13:14:07.357803  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:07.358564  6402 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:07.359434  7193 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.374306  6369 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:14:07.421860  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 45727.4us
I20260709 13:14:07.383074  7343 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:07.437105  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:07.446895  6253 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.449664  6402 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:07.460409  6219 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:07.437765  6251 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:07.446990  6322 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:07.459880  7343 raft_consensus.cc:697] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:07.489804  6369 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:07.496415  6253 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:07.456458  7210 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:14:07.506172  6153 catalog_manager.cc:5697] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.507711  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:07.508425  6247 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:07.508055  6153 catalog_manager.cc:5697] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.509333  7208 raft_consensus.cc:2764] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:14:07.510362  6936 raft_consensus.cc:1217] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:07.513511  6255 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:07.518366  7264 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:07.540861  7343 consensus_queue.cc:237] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.544512  7264 raft_consensus.cc:697] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:07.546218  7264 consensus_queue.cc:237] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.561566  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:07.562227  6402 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:07.562438  6253 raft_consensus.cc:1275] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:07.563540  6369 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:07.564929  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:07.565598  6256 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:07.566299  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:07.566707  6936 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:07.566893  6251 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:07.568526  7193 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.569667  7353 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.571769  7353 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:07.572327  7353 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:07.572786  7353 raft_consensus.cc:697] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:07.568346  7298 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:07.578704  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:07.579553  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:07.575544  6219 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:07.584116  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:14:07.586716  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.597595  6247 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:07.599197  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:07.600034  6249 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:07.612720  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:07.588063  7210 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:07.615131  7210 raft_consensus.cc:697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:07.616091  7210 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.618036  6397 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:07.618758  6403 raft_consensus.cc:1275] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:07.623605  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:07.623374  6151 catalog_manager.cc:5697] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:07.627228  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.631552  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:07.632299  6396 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:07.634759  6295 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:07.635389  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:07.624964  6151 catalog_manager.cc:5697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.637540  7345 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:07.640146  7345 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.642129  7298 consensus_queue.cc:1048] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:07.641791  7256 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:07.644969  7353 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.642409  7345 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.652380  6325 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:07.648280  6151 catalog_manager.cc:5697] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 3, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.655264  6248 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:07.655768  6219 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:07.649782  6295 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:07.657186  6295 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:07.656312  6369 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:07.660331  6153 catalog_manager.cc:5697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:14:07.664567  6403 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:07.658155  7342 raft_consensus.cc:2764] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:14:07.662794  7339 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:07.682654  7339 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.661480  7298 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:07.683204  7339 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.687245  7348 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:07.688372  7228 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:07.665225  7264 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:07.694924  7264 raft_consensus.cc:697] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:07.695019  7345 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.683337  7298 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.696250  7264 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.707652  6368 leader_election.cc:400] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
I20260709 13:14:07.734944  7187 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:07.737517  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:07.737885  7256 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:07.739331  6404 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:07.705343  7298 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:07.741477  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:07.742219  6402 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:07.743659  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:07.745914  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:07.746549  6405 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 2: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:07.746701  7345 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.748389  6403 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:07.757323  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:07.771205  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:14:07.773898  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 62505.8us
I20260709 13:14:07.774150  6403 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:14:07.783226  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 74463.6us
I20260709 13:14:07.784162  6295 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:07.803617  6248 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:07.777499  7196 consensus_queue.cc:1048] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:14:07.804406  7339 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.812453  6296 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:07.814217  7256 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:07.814586  7256 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.814906  7256 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.817205  7266 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:07.821358  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:07.821949  6327 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.796903  7345 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:07.823712  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:07.825865  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:07.826556  6323 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.827430  6248 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:07.818104  7346 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:14:07.829252  7298 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:07.831252  7298 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.825227  7345 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.834312  7345 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.862241  6327 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:07.865312  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:07.828836  7353 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:14:07.876645  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:07.892566  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:07.894119  6397 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.895005  7339 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.894683  7345 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:07.895597  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 90232.2us
I20260709 13:14:07.895989  6324 raft_consensus.cc:2368] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
I20260709 13:14:07.891995  6329 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:07.898252  7376 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:07.900475  7348 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:07.904292  7210 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:07.905889  7345 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:07.834286  6323 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:07.923143  6152 catalog_manager.cc:5697] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 2 to 3, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.925057  6152 catalog_manager.cc:5697] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.928771  6329 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:07.932767  6152 catalog_manager.cc:5697] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 3, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.939707  6329 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:07.940910  6368 leader_election.cc:400] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
I20260709 13:14:07.925429  7210 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:14:07.952275  6152 catalog_manager.cc:5697] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.962476  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:07.963210  6250 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:07.966208  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:07.967412  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:07.967983  6253 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:07.976835  6397 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:07.928929  7256 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:07.970016  7381 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:14:07.975672  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:07.989707  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:07.971946  7343 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:14:08.004830  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:07.972086  7264 consensus_queue.cc:1059] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:14:08.024950  6325 raft_consensus.cc:2368] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
W20260709 13:14:08.034602  7386 log.cc:927] Time spent T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:14:08.082185  7390 log.cc:927] Time spent T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:14:08.095417  6253 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
W20260709 13:14:08.099354  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 97791.1us
W20260709 13:14:08.091346  7383 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
W20260709 13:14:08.098793  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 78708.9us
I20260709 13:14:08.116276  6250 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
W20260709 13:14:08.112659  7259 log.cc:927] Time spent T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:14:08.131364  7256 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:08.134475  6296 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:08.138504  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:08.149211  7395 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:08.203751  7395 raft_consensus.cc:697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:08.219236  6295 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:08.223325  6295 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:08.302189  7394 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:08.366864  7256 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:14:08.413116  7397 log.cc:927] Time spent T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:14:08.414578  7391 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:14:08.398908  7345 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:08.299237  7395 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:08.420712  7345 raft_consensus.cc:697] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:08.420137  7256 raft_consensus.cc:697] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:08.468686  6405 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:14:08.472751  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 249506us
I20260709 13:14:08.486661  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:08.525437  7345 consensus_queue.cc:237] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:08.519372  7256 consensus_queue.cc:237] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:08.511965  7410 raft_consensus.cc:2955] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:14:08.546721  7392 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:14:08.530855  7327 raft_consensus.cc:3055] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:08.550479  7327 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:08.565948  7327 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:08.577008  6369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.010s	sys 0.011s
W20260709 13:14:08.584831  6369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.012s	sys 0.011s
W20260709 13:14:08.589388  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 563464us
I20260709 13:14:08.595986  6254 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:08.598946  6252 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:08.600834  6254 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:08.625506  6935 raft_consensus.cc:2955] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:08.642541  6323 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:08.656309  7327 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:08.664181  6153 catalog_manager.cc:5697] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:08.686875  7248 raft_consensus.cc:1064] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:08.737973  6153 catalog_manager.cc:5697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:08.856102  6256 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:08.865278  6324 raft_consensus.cc:1240] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:08.869022  6404 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:08.876526  7409 consensus_queue.cc:1059] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:14:08.897991  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 273963us
I20260709 13:14:08.893400  7248 consensus_queue.cc:237] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:08.902076  7398 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:14:08.921223  7348 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:08.921864  7348 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:08.922295  7409 raft_consensus.cc:3055] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:08.922672  7409 raft_consensus.cc:740] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:08.923439  7409 consensus_queue.cc:260] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:08.926558  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 47219us
I20260709 13:14:08.868785  7264 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:14:08.923885  7348 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:08.955580  7393 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:14:08.959460  6252 raft_consensus.cc:1240] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:08.895284  7342 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:08.986517  7342 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
W20260709 13:14:09.108779  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.110500  6323 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:09.112280  6329 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:14:09.114552  7345 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.115337  7345 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.120615  6329 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:09.152514  7345 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:09.138754  7409 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:09.164341  6368 leader_election.cc:400] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3.
I20260709 13:14:09.161801  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:09.153074  7264 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:09.162458  7327 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:09.164902  7329 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:09.215504  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.165151  7398 consensus_queue.cc:1059] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:14:09.231160  7232 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:14:09.231796  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.204803  7342 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:09.208292  7393 consensus_queue.cc:1059] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 13:14:09.240891  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 74688us
I20260709 13:14:09.208671  7264 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.233743  6322 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:14:09.270210  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.237900  7248 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.223591  7327 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:09.290663  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 54348.4us
I20260709 13:14:09.241861  7230 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:14:09.243057  7329 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:09.305662  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 206688us
I20260709 13:14:09.317938  7430 raft_consensus.cc:3055] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:09.318375  7430 raft_consensus.cc:740] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:09.281073  7248 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.354717  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:09.343075  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 100192us
I20260709 13:14:09.323258  7329 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:09.320691  7398 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:09.382001  6255 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:14:09.323320  7230 raft_consensus.cc:3055] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:09.319823  7430 consensus_queue.cc:260] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.341094  7264 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:14:09.405395  7427 log.cc:927] Time spent T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:14:09.405526  7435 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:09.390043  7439 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.406162  7327 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.406353  7439 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.406767  7248 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:09.406711  7327 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:09.406065  7435 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.398756  7343 consensus_queue.cc:1059] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:14:09.408174  7343 consensus_queue.cc:1243] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Peer a13ffe92eb374309a5c8476d9fbbb2b8 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:14:09.408500  7439 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.389110  7398 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.394229  7230 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:09.409437  7435 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:14:09.402426  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 62793.6us
I20260709 13:14:09.421007  7398 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.409032  7439 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:09.421808  7439 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.424034  7439 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.409152  7343 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:09.425269  7343 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:09.426815  7343 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.403647  7264 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:14:09.433203  7343 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.433720  7343 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.435750  7343 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:14:09.436427  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 54472.9us
I20260709 13:14:09.440637  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.441422  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.442682  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.442842  7399 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.442945  7437 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:09.443051  7393 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:09.443341  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.443430  7399 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.444484  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.445659  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.444559  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.443609  7393 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.447165  7430 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:09.448359  7393 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.450101  7228 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:09.450646  7228 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.443557  7437 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.453550  7409 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:09.453828  7437 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.454098  7409 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.455205  7441 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.455817  7441 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.454316  7437 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.459812  7437 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.432585  7230 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.464906  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.467728  7441 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.468097  7409 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.470798  7399 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.471441  7437 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.472240  7329 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:09.472805  7329 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:09.475474  7230 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:09.475833  7406 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.476325  7406 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.477187  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:09.478204  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.479112  7329 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:09.481403  6329 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:09.483383  7406 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:09.488871  7228 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:09.489789  7438 raft_consensus.cc:3055] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:09.490183  7438 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:09.490958  7438 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.491978  7438 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:09.494242  6936 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.495949  6247 raft_consensus.cc:2955] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:09.496794  7214 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:09.506947  6151 catalog_manager.cc:5697] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:09.511987  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.513075  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.513947  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:09.516000  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 131070us
I20260709 13:14:09.531867  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.535136  7438 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:09.535727  7438 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.538434  7437 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.538875  7441 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.538925  7437 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.539498  7441 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.531841  7399 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:14:09.551230  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 159990us
I20260709 13:14:09.541388  7441 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.534057  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.541013  7437 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.544211  7233 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:09.562939  6295 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:09.567453  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:09.575650  7214 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:09.567075  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.549611  7445 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:09.577327  7445 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.580790  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.584656  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.585546  6324 raft_consensus.cc:2393] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:09.590055  6249 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:14:09.595638  6249 pending_rounds.cc:85] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 1
I20260709 13:14:09.595966  6249 pending_rounds.cc:107] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:14:09.596242  6249 raft_consensus.cc:2889] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:09.603013  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.602417  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.592474  6405 raft_consensus.cc:2955] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:09.610816  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:09.611881  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.616995  6256 raft_consensus.cc:1275] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:09.620080  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.601754  6153 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55326 (request call id 171) took 1656 ms. Trace:
I20260709 13:14:09.623530  6255 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.624652  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.623075  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:09.551007  7399 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.627913  6400 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.628698  6402 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:09.605918  7441 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.631021  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.652427  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.654412  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.602793  7233 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.627069  7214 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:14:09.639604  7409 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.647773  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.649374  7441 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.666953  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.668445  7441 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:14:09.667196  7424 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.353s	user 0.002s	sys 0.002s
I20260709 13:14:09.668215  7378 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:14:09.670589  7409 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.643188  7414 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:14:09.676342  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.677181  7438 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.677426  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.656237  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.675033  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.622587  6153 rpcz_store.cc:276] 0709 13:14:07.931603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.931737 (+   134us) service_pool.cc:224] Handling call
0709 13:14:09.588103 (+1656366us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:08.877332 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:08.893543 (+ 16211us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:08.893582 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:14:08.893612 (+    30us) tablet.cc:662] Decoding operations
0709 13:14:08.893995 (+   383us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:08.894079 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:08.894108 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:08.896846 (+  2738us) tablet.cc:701] Row locks acquired
0709 13:14:08.896866 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:14:08.897004 (+   138us) write_op.cc:270] Start()
0709 13:14:08.938011 (+ 41007us) write_op.cc:276] Timestamp: P: 1783602848896962 usec, L: 0
0709 13:14:08.954941 (+ 16930us) op_driver.cc:348] REPLICATION: starting
0709 13:14:09.062727 (+107786us) log.cc:844] Serialized 916 byte log entry
0709 13:14:09.314538 (+251811us) op_driver.cc:464] REPLICATION: finished
0709 13:14:09.352559 (+ 38021us) write_op.cc:301] APPLY: starting
0709 13:14:09.352638 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:09.352749 (+   111us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:09.352859 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:09.353253 (+   394us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:09.353425 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:14:09.353480 (+    55us) write_op.cc:312] APPLY: finished
0709 13:14:09.353655 (+   175us) log.cc:844] Serialized 28 byte log entry
0709 13:14:09.354345 (+   690us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:09.357970 (+  3625us) write_op.cc:454] Released schema lock
0709 13:14:09.358012 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:09.396405 (+ 38393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:09.397603 (+  1198us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":103937,"reported_tablets":8,"spinlock_wait_cycles":14720,"child_traces":[["op",{"apply.queue_time_us":33857,"apply.run_cpu_time_us":1835,"apply.run_wall_time_us":31436,"num_ops":2,"prepare.queue_time_us":91824,"prepare.run_cpu_time_us":11234,"prepare.run_wall_time_us":257762,"replication_time_us":325825,"spinlock_wait_cycles":1422080,"thread_start_us":133321,"threads_started":2}]]}
I20260709 13:14:09.654151  7446 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:14:09.695088  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 63337.9us
I20260709 13:14:09.674588  7445 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.702127  6328 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:14:09.702273  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.698488  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.710078  7233 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:09.711607  6401 raft_consensus.cc:1275] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:14:09.712054  6401 pending_rounds.cc:85] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 1
I20260709 13:14:09.712338  6401 pending_rounds.cc:107] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:14:09.712606  6401 raft_consensus.cc:2889] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:09.717226  7441 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.717772  7441 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.718183  7409 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.718312  7264 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.719962  7441 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.721086  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:09.724176  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:09.725992  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:09.727303  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.727880  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:09.732537  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:09.733363  6404 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:09.737591  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.735931  6219 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.765091  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.773499  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.768656  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.777640  7233 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.779811  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.780938  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.718858  7264 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.784173  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.784751  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.785235  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.788460  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.793041  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.786072  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:09.794438  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.779376  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:09.779852  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.803887  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.807159  6221 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:09.822695  6368 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.823670  6399 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:14:09.825730  6399 pending_rounds.cc:85] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 1
I20260709 13:14:09.826025  6399 pending_rounds.cc:107] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:14:09.826327  6399 raft_consensus.cc:2889] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:09.826457  7434 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.826655  7264 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:09.828045  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.829226  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.833663  6296 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:09.839577  7187 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:09.840296  6368 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.845309  7438 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:09.845950  7438 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.847174  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.849852  6221 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:09.850396  6368 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.851533  6368 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.862541  6296 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:09.876432  6368 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.878120  6368 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.878981  6296 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:09.896344  6368 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.901305  6368 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:09.896499  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 46724.6us
I20260709 13:14:09.903569  6368 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.852280  7264 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.907725  6368 leader_election.cc:304] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.908558  6221 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.875763  7438 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.910060  7416 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:09.912180  6368 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.852100  7445 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.895694  7378 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:09.899691  7228 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.926924  7447 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.914456  7398 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.895788  7299 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:09.899966  7441 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:09.936175  6221 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:09.937011  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.946933  7233 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.950706  7438 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.951507  6221 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:09.906635  7439 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.938666  6368 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.942505  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:09.955073  6368 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.910773  7437 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:09.910892  7346 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:09.962435  6368 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.940615  7342 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:09.964821  6368 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.956845  7329 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.907756  7394 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:14:09.974229  7437 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:09.974769  7437 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:09.967695  7342 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:09.977078  7342 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:09.968163  7445 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:09.977626  7439 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.965384  7447 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:09.958379  7441 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.974913  6368 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.913259  7196 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:14:09.981980  6368 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.989233  6368 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:09.991642  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 142291us
I20260709 13:14:09.991933  6368 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.985348  7445 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:09.988691  7346 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:09.996688  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:09.992349  7441 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:09.996412  7327 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:10.011303  7447 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:10.016810  7446 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:14:10.054258  7399 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:10.066821  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:10.079008  6369 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:10.092352  6369 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:10.096755  7467 log.cc:927] Time spent T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 13:14:10.122465  7464 log.cc:927] Time spent T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:14:10.115584  7398 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:10.143074  7342 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:10.146443  7446 raft_consensus.cc:2955] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:10.113819  7327 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:10.148828  7437 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:10.159016  7298 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.159566  7298 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:10.163057  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:10.164201  6397 raft_consensus.cc:2410] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:10.188053  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:10.188877  6249 raft_consensus.cc:2410] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:10.161638  7298 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:10.186137  6252 raft_consensus.cc:2955] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:10.229817  7342 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:10.235687  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:10.237933  7414 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:10.238060  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:10.239419  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:10.240146  6326 raft_consensus.cc:2393] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:10.250789  6939 raft_consensus.cc:2955] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:10.263511  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:10.270390  6400 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:10.275179  6368 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:10.272723  6401 raft_consensus.cc:2955] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:10.289474  7447 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:10.301496  6221 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:10.302268  7348 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:10.304076  7348 raft_consensus.cc:697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:10.305327  7348 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:10.307374  6151 catalog_manager.cc:5697] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:10.360864  6329 consensus_queue.cc:237] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:10.399000  6939 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:10.399251  6252 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:10.400686  7414 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:10.402693  7414 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:10.415580  7446 raft_consensus.cc:2955] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:10.417987  6252 raft_consensus.cc:2955] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:10.448181  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05f408a1388f424db8b65332c1dcd467 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:10.454813  6939 raft_consensus.cc:2955] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:10.512315  6150 catalog_manager.cc:5697] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 2 to 3, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 3 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:14:10.514222  6150 catalog_manager.cc:5697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 2 to 3, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 3 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:14:10.515750  6150 catalog_manager.cc:5697] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 4, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 4 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:14:10.562410  6151 catalog_manager.cc:5697] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:10.575646  6152 catalog_manager.cc:5697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 2 to 3, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:10.583344  6391 tablet_service.cc:1558] Processing DeleteTablet for tablet 05f408a1388f424db8b65332c1dcd467 with delete_type TABLET_DATA_TOMBSTONED (TS b940f12ed61a49c4b3c11f13ef50fa92 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36156
I20260709 13:14:10.602557  6329 consensus_queue.cc:237] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:10.611246  6939 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:10.612161  7484 tablet_replica.cc:333] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:14:10.612692  7417 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:10.614235  6252 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:10.614837  7484 raft_consensus.cc:2243] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:10.615734  7484 raft_consensus.cc:2272] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:10.617208  7417 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:10.623111  7484 ts_tablet_manager.cc:1916] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:10.623977  7256 raft_consensus.cc:2955] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:10.632225  6252 raft_consensus.cc:2955] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:10.637331  6939 raft_consensus.cc:2955] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:10.639569  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 772aad0e3cb043d989afc6d1abdbf6f4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:10.649475  6154 catalog_manager.cc:5697] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:10.671505  6391 tablet_service.cc:1558] Processing DeleteTablet for tablet 772aad0e3cb043d989afc6d1abdbf6f4 with delete_type TABLET_DATA_TOMBSTONED (TS b940f12ed61a49c4b3c11f13ef50fa92 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36156
I20260709 13:14:10.685668  7484 ts_tablet_manager.cc:1929] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:10.686131  7484 log.cc:1199] T 05f408a1388f424db8b65332c1dcd467 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/wals/05f408a1388f424db8b65332c1dcd467
I20260709 13:14:10.687997  7484 tablet_replica.cc:333] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:14:10.687965  6140 catalog_manager.cc:5028] TS b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): tablet 05f408a1388f424db8b65332c1dcd467 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:10.689050  7484 raft_consensus.cc:2243] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:10.689735  7484 raft_consensus.cc:2272] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:10.692214  7484 ts_tablet_manager.cc:1916] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:10.702055  7484 ts_tablet_manager.cc:1929] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:10.702404  7484 log.cc:1199] T 772aad0e3cb043d989afc6d1abdbf6f4 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/wals/772aad0e3cb043d989afc6d1abdbf6f4
I20260709 13:14:10.703732  6140 catalog_manager.cc:5028] TS b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): tablet 772aad0e3cb043d989afc6d1abdbf6f4 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:10.711494  6329 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:10.713227  7230 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:10.725804  6401 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:10.728055  7228 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:10.957893  7348 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:10.958961  7348 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:10.961915  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:10.962180  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:10.962530  6400 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:10.962949  6329 raft_consensus.cc:2393] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:10.963712  6221 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:10.963976  7348 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:10.964531  7228 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:10.964919  7228 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:10.965225  7228 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:10.970238  7228 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:10.972136  7228 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:10.972733  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:10.973268  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:10.973459  6329 raft_consensus.cc:2393] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:10.980243  6396 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:10.981259  6221 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:10.982023  7228 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:10.982520  7228 raft_consensus.cc:697] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:10.983371  7228 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:10.994807  6151 catalog_manager.cc:5697] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 2 to 3, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.512391  6329 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:11.513685  7348 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.530042  6401 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:11.531908  7228 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:11.735908  6331 consensus_queue.cc:237] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:11.741442  6400 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:11.741988  6297 consensus_peers.cc:597] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41e18ec9396146c6acf964c759dd56fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.742038  6253 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:11.742681  7256 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.743386  7492 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.750805  7256 raft_consensus.cc:2955] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:11.752570  6400 raft_consensus.cc:2955] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:11.753729  6253 raft_consensus.cc:2955] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:11.768940  6151 catalog_manager.cc:5697] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:11.774924  6252 consensus_queue.cc:237] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:11.781971  6400 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:11.782974  6222 consensus_peers.cc:597] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc0d5cf9e08445eea2f9773bf33622d4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.786504  7499 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:11.790390  6331 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.791879  7230 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.800812  7228 raft_consensus.cc:2955] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:11.802593  6331 raft_consensus.cc:2955] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:11.819598  6253 consensus_queue.cc:237] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:11.820190  6400 raft_consensus.cc:2955] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:11.820895  6152 catalog_manager.cc:5697] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
W20260709 13:14:11.848681  6222 consensus_peers.cc:597] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca1ca4c5e4934cf9b482701f5eb26d1a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.855247  6400 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:11.856067  6331 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:11.858448  7228 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.859160  7230 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.874842  7500 raft_consensus.cc:2955] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:11.881665  6331 raft_consensus.cc:2955] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:11.894172  6253 consensus_queue.cc:237] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:11.896667  6154 catalog_manager.cc:5697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.903419  6400 raft_consensus.cc:2955] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:11.918655  6400 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:11.919724  6325 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:11.920114  7499 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:11.918916  6222 consensus_peers.cc:597] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1e2856a0d3994696bbc8de68c3679c2f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.929289  7500 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:11.936447  7499 raft_consensus.cc:2955] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:11.939180  6400 raft_consensus.cc:2955] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:11.955844  6152 catalog_manager.cc:5697] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.958700  6325 raft_consensus.cc:2955] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:12.238813  7516 ts_tablet_manager.cc:933] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:12.241194  7516 tablet_copy_client.cc:323] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.2:39965
I20260709 13:14:12.244107  6341 tablet_copy_service.cc:140] P a13ffe92eb374309a5c8476d9fbbb2b8: Received BeginTabletCopySession request for tablet 41e18ec9396146c6acf964c759dd56fc from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41502)
I20260709 13:14:12.244654  6341 tablet_copy_service.cc:161] P a13ffe92eb374309a5c8476d9fbbb2b8: Beginning new tablet copy session on tablet 41e18ec9396146c6acf964c759dd56fc from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41502: session id = 8600a3fead0e48a7aa813822ec44d0fe-41e18ec9396146c6acf964c759dd56fc
I20260709 13:14:12.251662  6341 tablet_copy_source_session.cc:215] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:12.254238  7516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e18ec9396146c6acf964c759dd56fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.268601  7516 tablet_copy_client.cc:806] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:12.269205  7516 tablet_copy_client.cc:670] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:12.269237  7518 ts_tablet_manager.cc:933] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:12.271633  7518 tablet_copy_client.cc:323] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:14:12.273707  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet bc0d5cf9e08445eea2f9773bf33622d4 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:14:12.274246  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet bc0d5cf9e08445eea2f9773bf33622d4 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-bc0d5cf9e08445eea2f9773bf33622d4
I20260709 13:14:12.273115  7516 tablet_copy_client.cc:538] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:12.279342  6265 tablet_copy_source_session.cc:215] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:12.282231  7518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc0d5cf9e08445eea2f9773bf33622d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.285375  7516 tablet_bootstrap.cc:492] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:12.293785  7518 tablet_copy_client.cc:806] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:12.294327  7518 tablet_copy_client.cc:670] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:12.300738  7518 tablet_copy_client.cc:538] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:12.306420  7516 tablet_bootstrap.cc:492] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:12.307366  7516 tablet_bootstrap.cc:492] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:12.308024  7516 ts_tablet_manager.cc:1403] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.007s
I20260709 13:14:12.311118  7516 raft_consensus.cc:359] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:12.311944  7516 raft_consensus.cc:740] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:12.312604  7516 consensus_queue.cc:260] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:12.313763  7518 tablet_bootstrap.cc:492] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:12.321064  7516 ts_tablet_manager.cc:1434] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.008s
I20260709 13:14:12.323330  6341 tablet_copy_service.cc:342] P a13ffe92eb374309a5c8476d9fbbb2b8: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-41e18ec9396146c6acf964c759dd56fc received from {username='slave'} at 127.0.0.1:41502
I20260709 13:14:12.323768  6341 tablet_copy_service.cc:434] P a13ffe92eb374309a5c8476d9fbbb2b8: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-41e18ec9396146c6acf964c759dd56fc on tablet 41e18ec9396146c6acf964c759dd56fc with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:12.335116  7516 ts_tablet_manager.cc:933] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:12.348215  7518 tablet_bootstrap.cc:492] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:12.349145  7518 tablet_bootstrap.cc:492] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:12.349805  7518 ts_tablet_manager.cc:1403] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.004s
I20260709 13:14:12.352839  7518 raft_consensus.cc:359] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:12.353693  7518 raft_consensus.cc:740] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:12.354317  7518 consensus_queue.cc:260] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:12.356667  7518 ts_tablet_manager.cc:1434] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:12.358908  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-bc0d5cf9e08445eea2f9773bf33622d4 received from {username='slave'} at 127.0.0.1:38692
I20260709 13:14:12.359333  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-bc0d5cf9e08445eea2f9773bf33622d4 on tablet bc0d5cf9e08445eea2f9773bf33622d4 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:12.364573  7516 tablet_copy_client.cc:323] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:14:12.367161  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet ca1ca4c5e4934cf9b482701f5eb26d1a from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:14:12.367671  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet ca1ca4c5e4934cf9b482701f5eb26d1a from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-ca1ca4c5e4934cf9b482701f5eb26d1a
I20260709 13:14:12.376011  6265 tablet_copy_source_session.cc:215] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:12.379556  7516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca1ca4c5e4934cf9b482701f5eb26d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.395784  7516 tablet_copy_client.cc:806] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:12.396327  7516 tablet_copy_client.cc:670] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:12.399724  7516 tablet_copy_client.cc:538] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:12.404511  7518 ts_tablet_manager.cc:933] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:12.410313  7516 tablet_bootstrap.cc:492] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:12.422260  7518 tablet_copy_client.cc:323] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:14:12.424090  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet 1e2856a0d3994696bbc8de68c3679c2f from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:14:12.424633  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet 1e2856a0d3994696bbc8de68c3679c2f from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-1e2856a0d3994696bbc8de68c3679c2f
I20260709 13:14:12.432229  6265 tablet_copy_source_session.cc:215] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:12.436596  7518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e2856a0d3994696bbc8de68c3679c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.442523  7516 tablet_bootstrap.cc:492] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:12.443464  7516 tablet_bootstrap.cc:492] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:12.444149  7516 ts_tablet_manager.cc:1403] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.005s
I20260709 13:14:12.447319  7516 raft_consensus.cc:359] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:12.448132  7516 raft_consensus.cc:740] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:12.448771  7516 consensus_queue.cc:260] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:12.452225  7518 tablet_copy_client.cc:806] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:12.452744  7518 tablet_copy_client.cc:670] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:12.456735  7516 ts_tablet_manager.cc:1434] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.008s
I20260709 13:14:12.457780  7518 tablet_copy_client.cc:538] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:12.459064  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-ca1ca4c5e4934cf9b482701f5eb26d1a received from {username='slave'} at 127.0.0.1:38692
I20260709 13:14:12.464768  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-ca1ca4c5e4934cf9b482701f5eb26d1a on tablet ca1ca4c5e4934cf9b482701f5eb26d1a with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:12.476492  7518 tablet_bootstrap.cc:492] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:12.498880  7518 tablet_bootstrap.cc:492] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:12.499590  7518 tablet_bootstrap.cc:492] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:12.500241  7518 ts_tablet_manager.cc:1403] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:14:12.502997  7518 raft_consensus.cc:359] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:12.503763  7518 raft_consensus.cc:740] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:12.504274  7518 consensus_queue.cc:260] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:12.506484  7518 ts_tablet_manager.cc:1434] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:14:12.508332  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-1e2856a0d3994696bbc8de68c3679c2f received from {username='slave'} at 127.0.0.1:38692
I20260709 13:14:12.508781  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-1e2856a0d3994696bbc8de68c3679c2f on tablet 1e2856a0d3994696bbc8de68c3679c2f with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:12.771914  6939 raft_consensus.cc:1217] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:14:12.819886  6939 raft_consensus.cc:1217] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:12.860460  6939 raft_consensus.cc:1217] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:12.997493  6939 raft_consensus.cc:1217] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:13.170550  7230 raft_consensus.cc:1064] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:13.172652  7230 consensus_queue.cc:237] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:13.185333  6939 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:13.185418  6400 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:13.186702  7230 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:13.187318  6329 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:13.187672  7500 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:13.188657  7228 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:13.207291  7499 raft_consensus.cc:1064] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:13.209892  7499 consensus_queue.cc:237] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:13.211669  7230 raft_consensus.cc:2955] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.228659  6939 raft_consensus.cc:2955] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.229457  6400 raft_consensus.cc:2955] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.252914  6154 catalog_manager.cc:5697] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.266534  7529 raft_consensus.cc:1064] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:13.269498  7529 consensus_queue.cc:237] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:13.283028  6400 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:13.283071  6939 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:13.285719  7528 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:13.286543  7529 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:13.295135  6325 raft_consensus.cc:2955] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.298702  6252 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:13.306473  7529 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:13.317230  7417 raft_consensus.cc:2955] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.323467  6400 raft_consensus.cc:2955] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.349455  6939 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:13.350198  6325 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:13.351018  7228 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:13.353585  6396 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:13.353935  7533 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:13.360502  7500 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:14:13.374267  6939 raft_consensus.cc:2955] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:14:13.392436  7534 log.cc:927] Time spent T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:14:13.407194  6249 raft_consensus.cc:2955] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.406849  7499 raft_consensus.cc:2955] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.425328  6154 catalog_manager.cc:5697] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.427205  6935 raft_consensus.cc:2955] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.431020  6253 consensus_queue.cc:237] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:13.440964  6939 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:13.440253  6396 raft_consensus.cc:2955] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.441107  6401 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:13.442803  7546 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:13.443634  7228 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:13.454622  7500 raft_consensus.cc:2955] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.459232  6329 consensus_queue.cc:237] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:13.459694  6327 raft_consensus.cc:2955] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.461323  6401 raft_consensus.cc:2955] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.476729  6936 raft_consensus.cc:2955] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.479748  6939 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:13.481402  7550 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:13.491320  6939 raft_consensus.cc:2955] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.488895  7545 raft_consensus.cc:2955] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.509873  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bc0d5cf9e08445eea2f9773bf33622d4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:13.518697  6153 catalog_manager.cc:5697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.530025  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 41e18ec9396146c6acf964c759dd56fc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:13.542694  7533 raft_consensus.cc:1064] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:13.543476  6396 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:13.545327  7533 consensus_queue.cc:237] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:13.552767  7529 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:13.558902  6396 raft_consensus.cc:2955] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.569511  6249 consensus_queue.cc:237] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:13.575781  6936 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:13.577304  7230 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:13.578472  6329 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:13.584017  7230 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:13.586234  6935 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:13.588865  6401 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:13.590644  7228 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:13.591668  7230 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:13.593643  6154 catalog_manager.cc:5697] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.605072  7546 raft_consensus.cc:2955] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.606328  6936 raft_consensus.cc:2955] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.610526  6152 catalog_manager.cc:5697] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.614120  6317 tablet_service.cc:1558] Processing DeleteTablet for tablet bc0d5cf9e08445eea2f9773bf33622d4 with delete_type TABLET_DATA_TOMBSTONED (TS a13ffe92eb374309a5c8476d9fbbb2b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57216
I20260709 13:14:13.638933  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet 41e18ec9396146c6acf964c759dd56fc with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
I20260709 13:14:13.650916  6327 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:13.661525  6152 catalog_manager.cc:5697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.663178  7230 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:13.675554  6329 raft_consensus.cc:2955] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.677769  6391 tablet_service.cc:1558] Processing DeleteTablet for tablet ca1ca4c5e4934cf9b482701f5eb26d1a with delete_type TABLET_DATA_TOMBSTONED (TS b940f12ed61a49c4b3c11f13ef50fa92 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36156
I20260709 13:14:13.680168  7562 tablet_replica.cc:333] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:14:13.703977  7561 tablet_replica.cc:333] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:14:13.705514  7561 raft_consensus.cc:2243] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:13.712980  7559 tablet_replica.cc:333] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:14:13.714808  7562 raft_consensus.cc:2243] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:13.715569  7562 raft_consensus.cc:2272] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:13.715521  7533 raft_consensus.cc:2955] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.719352  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ca1ca4c5e4934cf9b482701f5eb26d1a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:13.721405  6935 raft_consensus.cc:2955] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.728778  7562 ts_tablet_manager.cc:1916] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:13.739288  7561 raft_consensus.cc:2272] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:13.749792  7559 raft_consensus.cc:2243] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:13.751075  7559 raft_consensus.cc:2272] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:13.751603  7561 ts_tablet_manager.cc:1916] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:13.771333  7559 ts_tablet_manager.cc:1916] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:13.804668  6329 raft_consensus.cc:2955] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.805850  6400 raft_consensus.cc:2955] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.811872  7562 ts_tablet_manager.cc:1929] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:13.831715  7559 ts_tablet_manager.cc:1929] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:14:13.849007  7559 log.cc:1199] T bc0d5cf9e08445eea2f9773bf33622d4 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/wals/bc0d5cf9e08445eea2f9773bf33622d4
I20260709 13:14:13.851053  7562 log.cc:1199] T ca1ca4c5e4934cf9b482701f5eb26d1a P b940f12ed61a49c4b3c11f13ef50fa92: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/wals/ca1ca4c5e4934cf9b482701f5eb26d1a
I20260709 13:14:13.851245  6138 catalog_manager.cc:5028] TS a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): tablet bc0d5cf9e08445eea2f9773bf33622d4 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:13.853178  6140 catalog_manager.cc:5028] TS b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): tablet ca1ca4c5e4934cf9b482701f5eb26d1a (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:13.830395  7561 ts_tablet_manager.cc:1929] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:13.854243  7561 log.cc:1199] T 41e18ec9396146c6acf964c759dd56fc P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/41e18ec9396146c6acf964c759dd56fc
I20260709 13:14:13.856843  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet 41e18ec9396146c6acf964c759dd56fc (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:13.862330  6150 catalog_manager.cc:5697] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.883054  6253 consensus_queue.cc:237] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:13.890740  6935 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:13.892506  6400 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:13.893736  7533 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:13.894734  7499 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:13.901824  7500 raft_consensus.cc:2955] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.903548  6935 raft_consensus.cc:2955] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.906373  6401 raft_consensus.cc:2955] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:13.912806  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1e2856a0d3994696bbc8de68c3679c2f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:13.920919  6151 catalog_manager.cc:5697] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.939685  6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e2856a0d3994696bbc8de68c3679c2f with delete_type TABLET_DATA_TOMBSTONED (TS a13ffe92eb374309a5c8476d9fbbb2b8 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:57216
I20260709 13:14:13.940554  7559 tablet_replica.cc:333] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:14:13.941583  7559 raft_consensus.cc:2243] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:13.942337  7559 raft_consensus.cc:2272] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:13.945556  7559 ts_tablet_manager.cc:1916] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:13.959559  7559 ts_tablet_manager.cc:1929] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:14:13.959873  7559 log.cc:1199] T 1e2856a0d3994696bbc8de68c3679c2f P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/wals/1e2856a0d3994696bbc8de68c3679c2f
I20260709 13:14:13.961115  6138 catalog_manager.cc:5028] TS a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): tablet 1e2856a0d3994696bbc8de68c3679c2f (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:14.050107  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:14.097218  6253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:14.097848  6253 raft_consensus.cc:606] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:14.100188  6253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:14.100616  6253 raft_consensus.cc:606] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:14.111410  6329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aba53315de954573854008b23574a90f"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:14.111886  6329 raft_consensus.cc:606] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:14.114280  6253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:14.115000  6253 raft_consensus.cc:606] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:14.117286  6253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce99643832824368978841e0265f9d2d"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:14.117723  6253 raft_consensus.cc:606] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:14.119767  6253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:14.120165  6253 raft_consensus.cc:606] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:14.121263  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:14.122393  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:14.157533  7533 raft_consensus.cc:993] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:14.158067  7499 raft_consensus.cc:1081] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:14.159308  6401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:14.159732  6401 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:14.159970  6401 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.165009  6401 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.166811  6401 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:14.167440  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:14.167654  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:14.167958  6253 raft_consensus.cc:3055] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:14.168246  6324 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.168303  6253 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:14.169112  6253 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.170154  6253 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.173264  6324 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:14.174268  6368 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:14.174962  7527 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:14.176045  6253 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:14.177316  7527 raft_consensus.cc:697] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:14.178432  7527 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.189968  6154 catalog_manager.cc:5697] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.290825  7499 raft_consensus.cc:993] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:14.291306  7533 raft_consensus.cc:1081] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:14.292573  6401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:14.292994  6401 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:14.293318  6401 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:14.297685  6401 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.299144  6401 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:14.299670  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:14.300235  6249 raft_consensus.cc:3055] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:14.300539  6249 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:14.301460  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:14.301224  6249 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.302022  6324 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:14.302485  6249 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:14.306267  6324 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:14.306770  6249 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:14.307169  6368 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:14.307893  7527 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:14.308234  7527 raft_consensus.cc:697] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:14.308887  7527 consensus_queue.cc:237] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.314656  7533 raft_consensus.cc:993] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:14.315115  7499 raft_consensus.cc:1081] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:14.316538  6401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:14.316991  6401 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:14.317348  6401 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:14.319810  6154 catalog_manager.cc:5697] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 4, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 4 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.323983  6401 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:14.327313  6401 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:14.328888  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:14.329274  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:14.329481  6935 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:14.333338  6249 raft_consensus.cc:3055] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:14.333519  7499 raft_consensus.cc:993] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:14.333645  6249 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:14.334071  7500 raft_consensus.cc:1081] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:14.334473  6249 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:14.335809  6249 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:14.335824  6401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:14.336508  6401 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:14.336875  6401 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.336980  6935 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:14.338217  6371 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:14.338951  7527 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:14.339438  7527 raft_consensus.cc:697] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:14.340266  7527 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:14.342006  6249 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:14.345213  6401 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.346839  6401 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:14.347776  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:14.348081  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:14.348315  6324 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.348642  6249 raft_consensus.cc:3055] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:14.349288  6249 raft_consensus.cc:740] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:14.350617  6249 consensus_queue.cc:260] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.351824  6249 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.352241  6154 catalog_manager.cc:5697] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 4, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 4 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.354619  6324 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:14.355769  6368 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:14.356611  7527 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:14.357062  7527 raft_consensus.cc:697] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:14.357913  7527 consensus_queue.cc:237] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.359053  6249 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:14.370018  6154 catalog_manager.cc:5697] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.538378  7554 raft_consensus.cc:993] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:14.538830  7554 raft_consensus.cc:1081] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:14.540083  6400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aba53315de954573854008b23574a90f"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36172
I20260709 13:14:14.540531  6400 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:14.540757  6400 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.545357  6400 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.546726  6400 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:14.547369  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:14.547874  6253 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.548259  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:14.548852  6324 raft_consensus.cc:3055] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:14.549250  6324 raft_consensus.cc:740] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:14.550037  6324 consensus_queue.cc:260] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.551116  6324 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.554349  6253 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:14.555305  6369 leader_election.cc:304] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:14.555914  7569 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:14.556393  7569 raft_consensus.cc:697] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:14.557083  6324 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:14.557219  7569 consensus_queue.cc:237] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.566256  6154 catalog_manager.cc:5697] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.628002  7500 raft_consensus.cc:993] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:14.628463  7533 raft_consensus.cc:1081] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:14.629917  6400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce99643832824368978841e0265f9d2d"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:14.630430  6400 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:14.630757  6400 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.635572  6400 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.637180  6400 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:14.637751  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:14.638063  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:14.638360  6253 raft_consensus.cc:3055] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:14.638645  6324 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.638736  6253 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:14.639767  6253 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.640733  6253 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.644115  6324 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:14.644935  6253 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:14.645016  6368 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:14.645915  7569 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:14.646423  7569 raft_consensus.cc:697] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:14.647265  7569 consensus_queue.cc:237] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:14.667820  6154 catalog_manager.cc:5697] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.677580  6324 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.679194  7569 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.688315  6253 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.690322  7568 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.730428  6253 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:14.731510  7568 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:14.735905  6935 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:14.737062  7568 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:14.740654  6329 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:14.744632  7527 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:14.766077  6253 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:14.768453  7569 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:14.773562  6249 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.775211  7569 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.784077  6329 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.785629  7568 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.999023  6329 consensus_queue.cc:237] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:15.005259  6401 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:15.005316  6253 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:14:15.005595  6297 consensus_peers.cc:597] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 090a0dad86b546e6b091b67e69cc1bcc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:15.006636  7555 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:15.007395  7575 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:15.017827  7575 raft_consensus.cc:2955] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.019405  6253 raft_consensus.cc:2955] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.020989  6401 raft_consensus.cc:2955] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.038975  6324 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:15.041155  7569 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:15.041091  6151 catalog_manager.cc:5697] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 2 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.043497  6329 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:15.047386  7569 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:15.063354  6329 consensus_queue.cc:237] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:15.064657  6249 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:15.065956  7568 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:15.070343  6396 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:15.070713  6297 consensus_peers.cc:597] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3009228e555646f4870d29db171cddfb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:15.072652  7575 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:15.087848  6249 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:15.097867  7555 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:15.105242  6253 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:15.101909  7590 raft_consensus.cc:2955] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.107085  7569 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:15.124024  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:15.133105  6400 raft_consensus.cc:2955] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.142730  6249 raft_consensus.cc:2955] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.154376  6253 consensus_queue.cc:237] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:15.160341  6150 catalog_manager.cc:5697] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.169801  6400 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:15.170149  6325 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:14:15.170912  6222 consensus_peers.cc:597] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4340bb97f0154dbb981570b2ee2f49c5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:15.171247  7499 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:15.172080  7533 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:15.201145  7533 raft_consensus.cc:2955] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.210060  6329 raft_consensus.cc:2955] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.213555  6396 raft_consensus.cc:2955] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.225081  6151 catalog_manager.cc:5697] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.233573  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:15.249456  6396 consensus_queue.cc:237] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
W20260709 13:14:15.258337  6371 consensus_peers.cc:597] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8b0bb0f383c43abb44e0ab66a228225. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:15.260811  6329 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:15.262344  7527 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:15.272486  7569 raft_consensus.cc:2955] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.274863  6253 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:15.274439  6325 raft_consensus.cc:2955] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.278498  7594 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:15.291779  6253 raft_consensus.cc:2955] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.295231  6151 catalog_manager.cc:5697] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:15.300644  6249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:15.301239  6249 raft_consensus.cc:606] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:15.311086  6329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:15.311640  6329 raft_consensus.cc:606] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:15.315215  6249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:15.315768  6249 raft_consensus.cc:606] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:15.317710  7533 raft_consensus.cc:993] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:15.318145  7533 raft_consensus.cc:1081] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:15.319207  6255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:15.319836  6255 raft_consensus.cc:606] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:15.321947  6396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:15.322467  6396 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.322801  6396 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:15.324259  6255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:15.324810  6255 raft_consensus.cc:606] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Received request to transfer leadership to TS 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:15.327971  6255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:15.328512  6255 raft_consensus.cc:606] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:15.329700  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:15.330049  6396 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:15.331434  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:15.333444  6396 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:15.335567  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:15.335894  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:15.336138  6253 raft_consensus.cc:3055] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:15.336469  6253 raft_consensus.cc:740] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:15.336508  6935 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:15.337821  6253 consensus_queue.cc:260] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:15.339895  6253 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:15.344139  6935 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:15.345517  6371 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:15.346310  7569 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:15.346781  7569 raft_consensus.cc:697] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:15.347636  7569 consensus_queue.cc:237] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:15.350162  6253 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:15.360841  6151 catalog_manager.cc:5697] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 2 to 3, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.474035  7533 raft_consensus.cc:993] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:15.474530  7533 raft_consensus.cc:1081] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:15.477562  6396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:15.478104  6396 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.478437  6396 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:15.488444  6396 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:15.490993  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:15.491578  6253 raft_consensus.cc:3055] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:15.491652  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:15.492132  6253 raft_consensus.cc:740] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:15.492479  6325 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:15.492926  6253 consensus_queue.cc:260] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:15.494046  6253 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:15.490976  6396 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:15.501176  6253 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:15.502240  6369 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:15.503018  7569 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:15.503494  7569 raft_consensus.cc:697] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:15.504454  7569 consensus_queue.cc:237] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:15.505591  6325 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:15.516328  6151 catalog_manager.cc:5697] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 2 to 3, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.530489  7604 raft_consensus.cc:993] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:15.531047  7499 raft_consensus.cc:1081] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:15.532825  6396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:15.533366  6396 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.533720  6396 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.538698  6396 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:15.540422  6396 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:15.541236  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:15.541805  6253 raft_consensus.cc:3055] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:15.542094  6253 raft_consensus.cc:740] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:15.542725  6253 consensus_queue.cc:260] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:15.543779  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:15.543887  6253 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.544407  6325 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.550896  6253 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:15.551403  6325 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:15.551944  6369 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:15.552814  7569 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:15.553332  7569 raft_consensus.cc:697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:15.554152  7569 consensus_queue.cc:237] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:15.566083  6151 catalog_manager.cc:5697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.589442  7609 ts_tablet_manager.cc:933] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:15.597837  7609 tablet_copy_client.cc:323] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.2:39965
I20260709 13:14:15.599604  6341 tablet_copy_service.cc:140] P a13ffe92eb374309a5c8476d9fbbb2b8: Received BeginTabletCopySession request for tablet 090a0dad86b546e6b091b67e69cc1bcc from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41502)
I20260709 13:14:15.600144  6341 tablet_copy_service.cc:161] P a13ffe92eb374309a5c8476d9fbbb2b8: Beginning new tablet copy session on tablet 090a0dad86b546e6b091b67e69cc1bcc from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41502: session id = 8600a3fead0e48a7aa813822ec44d0fe-090a0dad86b546e6b091b67e69cc1bcc
I20260709 13:14:15.604756  7499 raft_consensus.cc:993] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:14:15.605381  7604 raft_consensus.cc:1081] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Signalling peer 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:14:15.613385  6936 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:41298
I20260709 13:14:15.613988  6936 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.614339  6936 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.618696  6341 tablet_copy_source_session.cc:215] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:15.621852  7609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090a0dad86b546e6b091b67e69cc1bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:15.624758  6936 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:15.629019  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:15.629601  6325 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.631991  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:15.632558  6253 raft_consensus.cc:3055] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:15.633222  6253 raft_consensus.cc:740] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:15.634016  6253 consensus_queue.cc:260] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:15.635007  6253 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.643254  6325 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:15.646881  6905 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:15.647356  7609 tablet_copy_client.cc:806] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:15.648135  7609 tablet_copy_client.cc:670] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:15.648365  7605 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:15.648918  7605 raft_consensus.cc:697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:15.649791  7605 consensus_queue.cc:237] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:15.657644  7611 ts_tablet_manager.cc:933] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:15.661386  6253 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:15.661981  6936 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:15.666199  7611 tablet_copy_client.cc:323] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.2:39965
I20260709 13:14:15.667405  7609 tablet_copy_client.cc:538] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:15.667158  6151 catalog_manager.cc:5697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 2 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.670034  6341 tablet_copy_service.cc:140] P a13ffe92eb374309a5c8476d9fbbb2b8: Received BeginTabletCopySession request for tablet 3009228e555646f4870d29db171cddfb from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41502)
I20260709 13:14:15.670610  6341 tablet_copy_service.cc:161] P a13ffe92eb374309a5c8476d9fbbb2b8: Beginning new tablet copy session on tablet 3009228e555646f4870d29db171cddfb from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41502: session id = 8600a3fead0e48a7aa813822ec44d0fe-3009228e555646f4870d29db171cddfb
I20260709 13:14:15.676630  7609 tablet_bootstrap.cc:492] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:15.685303  7590 raft_consensus.cc:993] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:15.685791  7590 raft_consensus.cc:1081] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:15.695014  6400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36172
I20260709 13:14:15.695788  6400 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.696235  6400 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.705957  7614 ts_tablet_manager.cc:933] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:15.716463  6341 tablet_copy_source_session.cc:215] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:15.721170  7614 tablet_copy_client.cc:323] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.3:34111
I20260709 13:14:15.726631  7611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3009228e555646f4870d29db171cddfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:15.726862  6415 tablet_copy_service.cc:140] P b940f12ed61a49c4b3c11f13ef50fa92: Received BeginTabletCopySession request for tablet b8b0bb0f383c43abb44e0ab66a228225 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41486)
I20260709 13:14:15.727705  6415 tablet_copy_service.cc:161] P b940f12ed61a49c4b3c11f13ef50fa92: Beginning new tablet copy session on tablet b8b0bb0f383c43abb44e0ab66a228225 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41486: session id = 8600a3fead0e48a7aa813822ec44d0fe-b8b0bb0f383c43abb44e0ab66a228225
I20260709 13:14:15.726634  7604 raft_consensus.cc:993] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:15.730396  7604 raft_consensus.cc:1081] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:15.732410  6396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:15.733100  6396 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.733596  6396 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:15.740444  6400 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:15.744779  7617 ts_tablet_manager.cc:933] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:15.746513  6396 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:15.751430  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:15.755368  6400 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:15.755764  6253 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.758481  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:15.759048  6249 raft_consensus.cc:3055] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:15.759307  6249 raft_consensus.cc:740] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:15.759654  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:15.760167  6325 raft_consensus.cc:3055] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:15.759963  6249 consensus_queue.cc:260] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:15.760447  6325 raft_consensus.cc:740] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:15.760986  6249 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:15.761384  6325 consensus_queue.cc:260] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:15.762455  7611 tablet_copy_client.cc:806] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:15.762565  6325 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.763072  7611 tablet_copy_client.cc:670] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:15.768101  6249 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:15.754269  6255 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:15.771860  6325 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:15.754328  7617 tablet_copy_client.cc:323] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:14:15.755267  6415 tablet_copy_source_session.cc:215] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:15.778976  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet 4340bb97f0154dbb981570b2ee2f49c5 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:14:15.769925  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:15.779542  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet 4340bb97f0154dbb981570b2ee2f49c5 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-4340bb97f0154dbb981570b2ee2f49c5
I20260709 13:14:15.779949  6329 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:15.771220  6253 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:15.786779  6265 tablet_copy_source_session.cc:215] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:15.773015  6368 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:15.772912  7569 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:15.773742  6369 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:15.798828  6329 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:15.768965  6396 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:15.799562  7568 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:15.800061  7568 raft_consensus.cc:697] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:15.751600  7609 tablet_bootstrap.cc:492] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:15.801574  7609 tablet_bootstrap.cc:492] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:15.802276  7609 ts_tablet_manager.cc:1403] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.126s	user 0.028s	sys 0.020s
I20260709 13:14:15.776021  7611 tablet_copy_client.cc:538] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:15.816639  7527 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:15.817221  7527 raft_consensus.cc:697] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:15.800892  7568 consensus_queue.cc:237] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:15.818073  7527 consensus_queue.cc:237] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:15.828631  7609 raft_consensus.cc:359] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:15.829561  7609 raft_consensus.cc:740] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:15.830215  7609 consensus_queue.cc:260] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:15.832604  7609 ts_tablet_manager.cc:1434] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:14:15.840276  7617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4340bb97f0154dbb981570b2ee2f49c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:15.842700  7614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b0bb0f383c43abb44e0ab66a228225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:15.846158  7611 tablet_bootstrap.cc:492] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:15.860337  7617 tablet_copy_client.cc:806] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:15.860898  7617 tablet_copy_client.cc:670] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:15.876024  7617 tablet_copy_client.cc:538] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:15.893015  6151 catalog_manager.cc:5697] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 4, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 4 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:15.925573  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 89480.1us
I20260709 13:14:15.927253  6341 tablet_copy_service.cc:342] P a13ffe92eb374309a5c8476d9fbbb2b8: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-090a0dad86b546e6b091b67e69cc1bcc received from {username='slave'} at 127.0.0.1:41502
I20260709 13:14:15.927704  6341 tablet_copy_service.cc:434] P a13ffe92eb374309a5c8476d9fbbb2b8: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-090a0dad86b546e6b091b67e69cc1bcc on tablet 090a0dad86b546e6b091b67e69cc1bcc with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:15.928023  6936 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:15.931854  7569 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:15.933792  6253 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:15.935177  7619 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:15.942478  7611 tablet_bootstrap.cc:492] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:15.943423  7611 tablet_bootstrap.cc:492] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:15.944108  7611 ts_tablet_manager.cc:1403] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.100s	user 0.036s	sys 0.033s
I20260709 13:14:15.950371  7611 raft_consensus.cc:359] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:15.951134  7611 raft_consensus.cc:740] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:15.951762  7611 consensus_queue.cc:260] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:15.954203  6329 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:15.955017  7611 ts_tablet_manager.cc:1434] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:14:15.955894  7568 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:15.956681  6341 tablet_copy_service.cc:342] P a13ffe92eb374309a5c8476d9fbbb2b8: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-3009228e555646f4870d29db171cddfb received from {username='slave'} at 127.0.0.1:41502
I20260709 13:14:15.957098  6341 tablet_copy_service.cc:434] P a13ffe92eb374309a5c8476d9fbbb2b8: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-3009228e555646f4870d29db171cddfb on tablet 3009228e555646f4870d29db171cddfb with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:15.979638  7617 tablet_bootstrap.cc:492] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:16.000566  7614 tablet_copy_client.cc:806] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:16.001212  7614 tablet_copy_client.cc:670] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:16.013355  6325 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:16.014626  7614 tablet_copy_client.cc:538] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:16.020648  6936 raft_consensus.cc:1217] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:16.021286  6150 catalog_manager.cc:5697] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:16.033609  7527 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:16.049115  6936 raft_consensus.cc:1217] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:16.060148  7614 tablet_bootstrap.cc:492] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:16.082171  6253 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:16.085315  7594 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:16.115697  7617 tablet_bootstrap.cc:492] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:16.116722  7617 tablet_bootstrap.cc:492] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:16.118110  7617 ts_tablet_manager.cc:1403] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.139s	user 0.032s	sys 0.027s
I20260709 13:14:16.121198  7617 raft_consensus.cc:359] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:16.122054  7617 raft_consensus.cc:740] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:16.122758  7617 consensus_queue.cc:260] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:16.127625  7617 ts_tablet_manager.cc:1434] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:14:16.141888  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-4340bb97f0154dbb981570b2ee2f49c5 received from {username='slave'} at 127.0.0.1:38692
I20260709 13:14:16.142374  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-4340bb97f0154dbb981570b2ee2f49c5 on tablet 4340bb97f0154dbb981570b2ee2f49c5 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:16.154417  7614 tablet_bootstrap.cc:492] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:16.155532  7614 tablet_bootstrap.cc:492] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:16.156265  7614 ts_tablet_manager.cc:1403] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.108s	user 0.025s	sys 0.010s
I20260709 13:14:16.159273  7614 raft_consensus.cc:359] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:16.160156  7614 raft_consensus.cc:740] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:16.160828  7614 consensus_queue.cc:260] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:16.163455  7614 ts_tablet_manager.cc:1434] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:16.166761  6415 tablet_copy_service.cc:342] P b940f12ed61a49c4b3c11f13ef50fa92: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-b8b0bb0f383c43abb44e0ab66a228225 received from {username='slave'} at 127.0.0.1:41486
I20260709 13:14:16.167176  6415 tablet_copy_service.cc:434] P b940f12ed61a49c4b3c11f13ef50fa92: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-b8b0bb0f383c43abb44e0ab66a228225 on tablet b8b0bb0f383c43abb44e0ab66a228225 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:16.175454  6936 raft_consensus.cc:1217] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:16.220206  6325 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:16.221423  7521 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:16.232281  6249 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:16.235496  7623 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:16.257402  6253 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:16.258934  7594 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:16.269750  6325 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:16.271623  7619 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:16.282616  6249 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:16.284533  7619 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:16.287993  6324 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:16.290984  7619 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:16.332726  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:16.385854  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:16.436213  6325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:16.436789  6325 raft_consensus.cc:606] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:16.439734  6324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:16.440270  6324 raft_consensus.cc:606] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:16.442831  6324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:16.443343  6324 raft_consensus.cc:606] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:16.446967  6255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:16.447515  6255 raft_consensus.cc:606] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:16.447636  7635 raft_consensus.cc:1064] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:16.450142  7635 consensus_queue.cc:237] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:16.454980  6324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:16.455556  6324 raft_consensus.cc:606] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:16.456972  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:16.458643  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:16.458981  6939 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:16.460228  6396 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:16.460206  7634 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:16.464264  7554 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:16.466882  6255 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:16.468321  7554 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:16.479808  7634 raft_consensus.cc:2955] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.485823  6936 raft_consensus.cc:2955] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.486182  6396 raft_consensus.cc:2955] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.497310  6255 raft_consensus.cc:2955] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.498905  7635 raft_consensus.cc:993] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:16.499356  7635 raft_consensus.cc:1081] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:16.500946  6253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:16.501461  6253 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:16.501765  6253 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:16.506476  6153 catalog_manager.cc:5697] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.516016  6253 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:16.518673  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:16.519203  6325 raft_consensus.cc:3055] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:16.519531  6325 raft_consensus.cc:740] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:16.520217  6325 consensus_queue.cc:260] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:16.521191  6325 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:16.528705  6253 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:16.528925  6324 consensus_queue.cc:237] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:16.531425  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:16.531946  6396 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:16.534194  6936 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:16.535655  7554 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:16.542757  7555 raft_consensus.cc:2955] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.548089  6939 raft_consensus.cc:1217] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:14:16.547446  6936 raft_consensus.cc:2955] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.557258  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3009228e555646f4870d29db171cddfb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:16.565423  6154 catalog_manager.cc:5697] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.570045  7604 raft_consensus.cc:993] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:16.570566  7604 raft_consensus.cc:1081] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:16.573009  6401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:16.573066  6325 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:16.573601  6401 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:16.573966  6401 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:16.574780  6396 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:16.576653  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet 3009228e555646f4870d29db171cddfb with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
I20260709 13:14:16.579074  6219 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:16.580396  7604 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:16.580991  7604 raft_consensus.cc:697] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:16.585704  7604 consensus_queue.cc:237] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:16.593380  7635 raft_consensus.cc:1064] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
W20260709 13:14:16.593880  7635 raft_consensus.cc:1068] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8: Unable to promote non-voter 8600a3fead0e48a7aa813822ec44d0fe: Service unavailable: leader transfer in progress
I20260709 13:14:16.595777  6400 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:16.598639  6401 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:16.600502  6401 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:16.601281  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:16.601891  6255 raft_consensus.cc:3055] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:16.602181  6255 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:16.602890  6255 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:16.603983  6255 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:16.615134  7652 tablet_replica.cc:333] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:14:16.616183  7652 raft_consensus.cc:2243] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.616748  7554 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:16.616989  7652 raft_consensus.cc:2272] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.622576  6255 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:16.618966  6153 catalog_manager.cc:5697] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.622772  6401 raft_consensus.cc:2955] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.628147  6369 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:16.628995  7569 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:16.629542  7569 raft_consensus.cc:697] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:16.630434  7569 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:16.624523  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:16.631630  6325 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:16.626222  7652 ts_tablet_manager.cc:1916] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:16.637982  6325 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:16.663700  7652 ts_tablet_manager.cc:1929] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:16.666648  7652 log.cc:1199] T 3009228e555646f4870d29db171cddfb P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/3009228e555646f4870d29db171cddfb
I20260709 13:14:16.668699  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet 3009228e555646f4870d29db171cddfb (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:16.677276  6154 catalog_manager.cc:5697] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:16.679278  7555 raft_consensus.cc:993] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:16.679773  7555 raft_consensus.cc:1081] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:16.682308  6396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36172
I20260709 13:14:16.682802  6396 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:16.683145  6396 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:16.690907  6396 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:16.693324  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:16.693879  6324 raft_consensus.cc:3055] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:16.694034  6396 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:16.694185  6324 raft_consensus.cc:740] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:16.695001  6324 consensus_queue.cc:260] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:16.695779  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:16.696118  6324 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:16.696375  6936 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:16.705184  6936 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:16.706385  6371 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:16.707211  7619 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:16.707399  6324 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:16.707695  7619 raft_consensus.cc:697] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:16.708546  7619 consensus_queue.cc:237] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:16.719095  6154 catalog_manager.cc:5697] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.727222  7555 raft_consensus.cc:993] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:16.727671  7554 raft_consensus.cc:1081] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:16.729168  6255 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:16.729612  6255 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:16.729890  6255 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:16.735553  6255 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:16.736955  6255 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:16.738085  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:16.738049  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:16.738797  6396 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:16.738888  6325 raft_consensus.cc:3055] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:16.739272  6325 raft_consensus.cc:740] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:16.739904  6325 consensus_queue.cc:260] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:16.740772  6325 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:16.745093  6325 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:16.745150  6396 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:16.746258  6221 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:16.747035  7604 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:16.747474  7604 raft_consensus.cc:697] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:16.748303  7604 consensus_queue.cc:237] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:16.759526  6154 catalog_manager.cc:5697] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 2 to 3, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.770258  7569 raft_consensus.cc:1064] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:16.772778  7569 consensus_queue.cc:237] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:16.778643  6936 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:16.779243  6325 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:16.780092  7568 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:16.781005  7619 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:16.785092  7555 raft_consensus.cc:993] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:16.785533  7555 raft_consensus.cc:1081] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:16.798631  6255 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:16.799474  6253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:16.800086  6253 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:16.800478  6253 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:16.801205  7658 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:16.806917  6253 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:16.811046  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:16.811594  6324 raft_consensus.cc:3055] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:16.811863  6324 raft_consensus.cc:740] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:16.812368  6253 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:16.812969  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:16.827073  6396 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:16.812582  6324 consensus_queue.cc:260] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:16.828400  6324 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:16.825423  7658 raft_consensus.cc:2955] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.841066  6325 raft_consensus.cc:2955] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.869359  6154 catalog_manager.cc:5697] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.850449  6324 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:16.871867  6219 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:16.872663  7604 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:16.873138  7604 raft_consensus.cc:697] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:16.873997  7604 consensus_queue.cc:237] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:16.855230  6396 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:16.860154  6936 raft_consensus.cc:2955] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.863970  6255 raft_consensus.cc:2955] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.897434  6150 catalog_manager.cc:5697] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 2 to 3, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.919059  6396 consensus_queue.cc:237] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:16.930891  6252 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:16.932245  7658 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:16.933223  6939 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:16.933328  6252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49990
I20260709 13:14:16.933908  6252 raft_consensus.cc:606] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership
I20260709 13:14:16.937279  6249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49990
I20260709 13:14:16.937830  6249 raft_consensus.cc:606] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership
I20260709 13:14:16.937662  7658 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:14:16.939283  6139 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 090a0dad86b546e6b091b67e69cc1bcc already in progress
I20260709 13:14:16.943796  7569 raft_consensus.cc:2955] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.953117  6252 raft_consensus.cc:2955] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.959424  6936 raft_consensus.cc:2955] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:16.965572  6140 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b8b0bb0f383c43abb44e0ab66a228225 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:16.971042  6253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49990
I20260709 13:14:16.971660  6253 raft_consensus.cc:606] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership
W20260709 13:14:16.977916  6202 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:14:16.978323  6202 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 090a0dad86b546e6b091b67e69cc1bcc already in progress
W20260709 13:14:16.978515  6202 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 090a0dad86b546e6b091b67e69cc1bcc already in progress
I20260709 13:14:16.979615  6154 catalog_manager.cc:5697] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:16.991869  6317 tablet_service.cc:1558] Processing DeleteTablet for tablet b8b0bb0f383c43abb44e0ab66a228225 with delete_type TABLET_DATA_TOMBSTONED (TS a13ffe92eb374309a5c8476d9fbbb2b8 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:57216
I20260709 13:14:17.002023  7668 tablet_replica.cc:333] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:14:17.002802  7668 raft_consensus.cc:2243] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:17.003358  7668 raft_consensus.cc:2272] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:17.005913  7668 ts_tablet_manager.cc:1916] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:17.017099  7668 ts_tablet_manager.cc:1929] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:14:17.017477  7668 log.cc:1199] T b8b0bb0f383c43abb44e0ab66a228225 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/wals/b8b0bb0f383c43abb44e0ab66a228225
I20260709 13:14:17.018857  6138 catalog_manager.cc:5028] TS a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): tablet b8b0bb0f383c43abb44e0ab66a228225 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:17.160475  7499 raft_consensus.cc:1064] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:17.174783  6324 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:17.182258  6936 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:17.184283  6255 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:17.186780  7619 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:17.197696  7658 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:17.197922  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 46067.1us
I20260709 13:14:17.200999  6402 raft_consensus.cc:1275] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:17.202566  7641 consensus_queue.cc:1048] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:17.211304  7658 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:17.234763  6329 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:17.269629  7499 consensus_queue.cc:237] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:17.277959  7569 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:17.278343  6324 raft_consensus.cc:1275] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:17.279537  6329 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:17.336467  6939 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:17.344907  6402 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:17.352949  7672 consensus_queue.cc:1048] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:14:17.357832  6400 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:17.360468  7640 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:14:17.365988  7641 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:17.382882  7672 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:17.383759  7604 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:14:17.465184  6331 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:17.479208  6936 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Advancing to term 3
I20260709 13:14:17.511212  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:17.606146  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 178264us
W20260709 13:14:17.631296  7690 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.121s	user 0.001s	sys 0.002s
W20260709 13:14:17.635468  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 186232us
I20260709 13:14:17.610010  7672 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:14:17.665570  6330 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:17.676873  6402 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:14:17.714388  7691 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.172s	user 0.000s	sys 0.003s
I20260709 13:14:17.703174  6936 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:17.727959  7672 raft_consensus.cc:2955] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:17.729561  7671 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:14:17.755576  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 72978.5us
I20260709 13:14:17.745088  7671 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
W20260709 13:14:17.843223  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 82201.2us
I20260709 13:14:17.851742  6935 raft_consensus.cc:2955] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:17.867496  7640 raft_consensus.cc:1064] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
W20260709 13:14:17.868024  7640 raft_consensus.cc:1068] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b: Unable to promote non-voter 8600a3fead0e48a7aa813822ec44d0fe: Service unavailable: leader transfer in progress
W20260709 13:14:17.881335  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 123953us
I20260709 13:14:17.882602  7604 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:17.912356  6330 raft_consensus.cc:2955] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:17.918170  6399 raft_consensus.cc:2955] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:17.923620  6154 catalog_manager.cc:5697] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:14:17.920312  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 150019us
I20260709 13:14:17.981339  7499 raft_consensus.cc:993] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:17.981805  7499 raft_consensus.cc:1081] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:18.034816  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:18.041955  7640 raft_consensus.cc:1064] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
W20260709 13:14:18.042480  7640 raft_consensus.cc:1068] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b: Unable to promote non-voter 8600a3fead0e48a7aa813822ec44d0fe: Service unavailable: leader transfer in progress
I20260709 13:14:18.047112  6399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:18.047863  6399 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.048187  6399 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:18.054883  6399 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:18.057930  6402 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:18.062423  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:18.063053  6249 raft_consensus.cc:3055] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:18.063330  6249 raft_consensus.cc:740] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:18.064092  6249 consensus_queue.cc:260] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:18.068019  6249 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:18.077651  6399 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:18.086683  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:18.090714  6331 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:18.097784  6331 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:18.085099  6249 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:18.098850  6368 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:18.099790  7693 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:18.100246  7693 raft_consensus.cc:697] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:18.101151  7693 consensus_queue.cc:237] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:18.119297  6154 catalog_manager.cc:5697] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 4, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 4 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.172998  6256 consensus_queue.cc:237] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:18.178778  6935 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:18.180678  7640 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:18.185838  6331 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:18.193791  7640 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:18.196660  6331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:18.197314  6331 raft_consensus.cc:606] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:18.205219  7499 raft_consensus.cc:2955] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:18.211814  6329 raft_consensus.cc:2955] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:18.219296  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4340bb97f0154dbb981570b2ee2f49c5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:18.215476  6935 raft_consensus.cc:2955] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:18.228503  6153 catalog_manager.cc:5697] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:18.231597  7674 raft_consensus.cc:993] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:18.232344  7708 raft_consensus.cc:1081] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:18.234505  6256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:18.234982  6256 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.235296  6256 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:18.315646  6391 tablet_service.cc:1558] Processing DeleteTablet for tablet 4340bb97f0154dbb981570b2ee2f49c5 with delete_type TABLET_DATA_TOMBSTONED (TS b940f12ed61a49c4b3c11f13ef50fa92 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36156
I20260709 13:14:18.300122  6256 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:18.327288  6256 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:18.328614  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:18.329234  6399 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:18.329437  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:18.329947  6331 raft_consensus.cc:3055] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:18.330225  6331 raft_consensus.cc:740] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:18.331125  6331 consensus_queue.cc:260] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:18.332125  6331 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:18.343536  6331 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:18.344691  6219 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:18.356201  6399 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:18.358682  7499 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:18.360450  7499 raft_consensus.cc:697] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:18.371842  7499 consensus_queue.cc:237] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:18.374150  7719 tablet_replica.cc:333] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:14:18.376452  7719 raft_consensus.cc:2243] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:18.378046  7719 raft_consensus.cc:2272] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:18.389493  7719 ts_tablet_manager.cc:1916] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:18.402981  6399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:14:18.403589  6399 raft_consensus.cc:606] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:18.408586  6256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:18.409119  6256 raft_consensus.cc:606] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:18.410703  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:18.412446  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:18.416574  7719 ts_tablet_manager.cc:1929] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:14:18.415858  6154 catalog_manager.cc:5697] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 5, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 5 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.417183  7719 log.cc:1199] T 4340bb97f0154dbb981570b2ee2f49c5 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/wals/4340bb97f0154dbb981570b2ee2f49c5
I20260709 13:14:18.419075  6140 catalog_manager.cc:5028] TS b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): tablet 4340bb97f0154dbb981570b2ee2f49c5 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:18.486004  6935 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Advancing to term 4
I20260709 13:14:18.488193  7672 raft_consensus.cc:993] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:18.488710  7672 raft_consensus.cc:1081] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:18.490167  6399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:18.490588  6399 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.490861  6399 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.492096  6935 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:18.493221  7693 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:18.496543  6399 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:18.497021  6331 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:18.498498  7693 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:18.499006  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:18.499543  6256 raft_consensus.cc:3055] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.499823  6256 raft_consensus.cc:740] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:18.499902  7706 raft_consensus.cc:1064] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
W20260709 13:14:18.500385  7706 raft_consensus.cc:1068] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92: Unable to promote non-voter 8600a3fead0e48a7aa813822ec44d0fe: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:18.500816  6399 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:18.501832  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:18.501654  6256 consensus_queue.cc:260] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:18.502367  6327 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.502869  6256 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.509388  6256 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:18.510527  6369 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:18.511400  7706 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.511847  7706 raft_consensus.cc:697] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:18.512670  6256 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:18.512658  7706 consensus_queue.cc:237] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:18.514120  7693 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:18.516273  6327 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:18.535473  7694 raft_consensus.cc:1064] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:18.538466  7694 consensus_queue.cc:237] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:18.545336  6153 catalog_manager.cc:5697] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:18.547973  6935 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:18.549373  7685 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:18.549897  6331 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:18.551189  6249 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:18.556253  7685 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:18.562314  7694 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:18.564298  7685 raft_consensus.cc:2955] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:18.568686  6331 raft_consensus.cc:2955] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:18.570477  6249 raft_consensus.cc:2955] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:18.588384  6153 catalog_manager.cc:5697] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index 3 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:18.590237  6942 raft_consensus.cc:2955] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:18.606688  6399 consensus_queue.cc:237] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:18.615279  6942 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:18.615430  6331 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:18.617658  7706 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:18.619277  7706 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:18.625762  7693 raft_consensus.cc:2955] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:18.630180  6942 raft_consensus.cc:2955] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:18.630443  6327 raft_consensus.cc:2955] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:18.648005  6140 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 090a0dad86b546e6b091b67e69cc1bcc with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:18.648005  6150 catalog_manager.cc:5697] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 6 to 7, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 4 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:18.658262  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet 090a0dad86b546e6b091b67e69cc1bcc with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:49990
I20260709 13:14:18.660495  7724 tablet_replica.cc:333] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:14:18.662199  7724 raft_consensus.cc:2243] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:18.663017  7724 raft_consensus.cc:2272] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:18.667747  7724 ts_tablet_manager.cc:1916] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:18.676625  7693 raft_consensus.cc:993] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:18.677255  7685 raft_consensus.cc:1081] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:18.678582  6327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57226
I20260709 13:14:18.679126  6327 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.679472  6327 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:18.683444  7724 ts_tablet_manager.cc:1929] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:14:18.683907  7724 log.cc:1199] T 090a0dad86b546e6b091b67e69cc1bcc P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/090a0dad86b546e6b091b67e69cc1bcc
I20260709 13:14:18.686021  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet 090a0dad86b546e6b091b67e69cc1bcc (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:18.686156  6327 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:18.687902  6327 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:18.688522  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:18.688792  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:18.689033  6249 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:18.689410  6399 raft_consensus.cc:3055] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:18.689734  6399 raft_consensus.cc:740] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:18.690467  6399 consensus_queue.cc:260] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:18.691455  6399 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:18.693902  6249 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:14:18.695436  6295 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:18.700445  7674 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:18.700933  7674 raft_consensus.cc:697] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:18.701560  6399 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:14:18.701776  7674 consensus_queue.cc:237] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:18.715608  6154 catalog_manager.cc:5697] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 4 to 5, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 5 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.819947  6399 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:14:18.821036  7671 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:18.831224  6331 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:14:18.832669  7707 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:18.989825  6256 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.990916  7693 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:19.004472  6331 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:19.006969  7706 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:19.146423  6399 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:14:19.147873  7674 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:19.158958  6256 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:14:19.160851  7674 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:19.388918  6327 consensus_queue.cc:237] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:19.394758  6399 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:14:19.395145  6297 consensus_peers.cc:597] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef76416cb5194a2cb26550333d72c307. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.395663  6249 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:19.397061  7676 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:19.397987  7674 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:19.405695  7676 raft_consensus.cc:2955] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.407583  6249 raft_consensus.cc:2955] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.408903  6399 raft_consensus.cc:2955] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.413358  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:19.428966  6154 catalog_manager.cc:5697] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 2 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.444839  6249 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:19.463960  6399 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:19.465633  7672 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:19.466470  6327 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:14:19.466841  6222 consensus_peers.cc:597] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c17ed9277f5d4839b300200e6c909c0f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.468060  7672 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:19.475842  7499 raft_consensus.cc:2955] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.477396  6402 raft_consensus.cc:2955] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.484802  6327 raft_consensus.cc:2955] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.495312  6399 consensus_queue.cc:237] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:19.505290  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:19.506064  6150 catalog_manager.cc:5697] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
W20260709 13:14:19.532673  6371 consensus_peers.cc:597] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: efde1f99d92b4d97b29f2a2f0d1c1c62. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.535693  6249 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:19.537091  6327 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:19.537329  7527 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:19.539058  7706 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:19.553097  7693 raft_consensus.cc:2955] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.554764  6256 raft_consensus.cc:2955] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.555430  6327 raft_consensus.cc:2955] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.578109  6329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:19.578724  6329 raft_consensus.cc:606] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:19.580068  6153 catalog_manager.cc:5697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.584692  6399 consensus_queue.cc:237] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:19.585104  6402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:14:19.589922  6402 raft_consensus.cc:606] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:19.591527  6371 consensus_peers.cc:597] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5af589183a05415d9cb49d32caedd78f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.592155  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:19.594509  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:19.594525  6256 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:19.595906  7527 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:19.595508  6327 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:19.597532  7693 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:19.610810  7693 raft_consensus.cc:2955] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.620113  6249 raft_consensus.cc:2955] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.623484  6327 raft_consensus.cc:2955] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.636179  6153 catalog_manager.cc:5697] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:19.820632  7706 raft_consensus.cc:993] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:19.821115  7706 raft_consensus.cc:1081] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:19.822546  6327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57226
I20260709 13:14:19.823052  6327 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:19.823433  6327 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:19.830938  6327 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:19.832787  6327 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:19.833349  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:19.833859  6249 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:19.834791  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:19.835348  6399 raft_consensus.cc:3055] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:19.835640  6399 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:19.836376  6399 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:19.837494  6399 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:19.842739  6249 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:19.844257  6295 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:19.845054  7674 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:19.846187  6399 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:19.847340  7674 raft_consensus.cc:697] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:19.848315  7674 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:19.860942  6150 catalog_manager.cc:5697] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 2 to 3, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 3 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:19.940539  7752 ts_tablet_manager.cc:933] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:19.944785  7674 raft_consensus.cc:993] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:19.945313  7674 raft_consensus.cc:1081] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:19.947254  7752 tablet_copy_client.cc:323] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.2:39965
I20260709 13:14:19.947726  6256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:19.948288  6256 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:19.948627  6256 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:19.949275  6341 tablet_copy_service.cc:140] P a13ffe92eb374309a5c8476d9fbbb2b8: Received BeginTabletCopySession request for tablet ef76416cb5194a2cb26550333d72c307 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41502)
I20260709 13:14:19.949833  6341 tablet_copy_service.cc:161] P a13ffe92eb374309a5c8476d9fbbb2b8: Beginning new tablet copy session on tablet ef76416cb5194a2cb26550333d72c307 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41502: session id = 8600a3fead0e48a7aa813822ec44d0fe-ef76416cb5194a2cb26550333d72c307
I20260709 13:14:19.959899  6341 tablet_copy_source_session.cc:215] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:19.960762  6256 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:19.963364  7752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef76416cb5194a2cb26550333d72c307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:19.963266  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:19.963871  6329 raft_consensus.cc:3055] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:19.964157  6329 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:19.964267  6256 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:19.964823  6329 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:19.966003  6329 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:19.965900  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:19.966569  6399 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:19.972654  6329 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:19.972771  6399 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:19.973874  6219 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:19.974660  7672 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:19.975109  7672 raft_consensus.cc:697] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:19.976013  7672 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:19.986683  6150 catalog_manager.cc:5697] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.043813  7755 ts_tablet_manager.cc:933] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:20.061707  7755 tablet_copy_client.cc:323] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.3:34111
I20260709 13:14:20.062016  7752 tablet_copy_client.cc:806] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:20.062644  7752 tablet_copy_client.cc:670] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:20.064412  6415 tablet_copy_service.cc:140] P b940f12ed61a49c4b3c11f13ef50fa92: Received BeginTabletCopySession request for tablet 5af589183a05415d9cb49d32caedd78f from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41486)
I20260709 13:14:20.064982  6415 tablet_copy_service.cc:161] P b940f12ed61a49c4b3c11f13ef50fa92: Beginning new tablet copy session on tablet 5af589183a05415d9cb49d32caedd78f from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41486: session id = 8600a3fead0e48a7aa813822ec44d0fe-5af589183a05415d9cb49d32caedd78f
I20260709 13:14:20.066283  7752 tablet_copy_client.cc:538] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:20.075911  7752 tablet_bootstrap.cc:492] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:20.077248  6415 tablet_copy_source_session.cc:215] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:20.083781  7755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af589183a05415d9cb49d32caedd78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.095985  7756 ts_tablet_manager.cc:933] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:20.110813  7758 ts_tablet_manager.cc:933] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:20.129546  7756 tablet_copy_client.cc:323] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.3:34111
I20260709 13:14:20.131577  6415 tablet_copy_service.cc:140] P b940f12ed61a49c4b3c11f13ef50fa92: Received BeginTabletCopySession request for tablet efde1f99d92b4d97b29f2a2f0d1c1c62 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41486)
I20260709 13:14:20.132117  6415 tablet_copy_service.cc:161] P b940f12ed61a49c4b3c11f13ef50fa92: Beginning new tablet copy session on tablet efde1f99d92b4d97b29f2a2f0d1c1c62 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41486: session id = 8600a3fead0e48a7aa813822ec44d0fe-efde1f99d92b4d97b29f2a2f0d1c1c62
I20260709 13:14:20.147157  7758 tablet_copy_client.cc:323] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:14:20.154919  6415 tablet_copy_source_session.cc:215] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:20.158975  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet c17ed9277f5d4839b300200e6c909c0f from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:14:20.159591  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet c17ed9277f5d4839b300200e6c909c0f from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-c17ed9277f5d4839b300200e6c909c0f
I20260709 13:14:20.162868  7756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efde1f99d92b4d97b29f2a2f0d1c1c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.167939  6265 tablet_copy_source_session.cc:215] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:20.178498  7756 tablet_copy_client.cc:806] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:20.178951  7755 tablet_copy_client.cc:806] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:20.181397  7758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c17ed9277f5d4839b300200e6c909c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.182847  7755 tablet_copy_client.cc:670] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:20.183580  7756 tablet_copy_client.cc:670] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:20.187032  7752 tablet_bootstrap.cc:492] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:20.188513  7752 tablet_bootstrap.cc:492] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:20.189296  7752 ts_tablet_manager.cc:1403] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.114s	user 0.047s	sys 0.046s
I20260709 13:14:20.189600  7755 tablet_copy_client.cc:538] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:20.194640  7756 tablet_copy_client.cc:538] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:20.212733  7755 tablet_bootstrap.cc:492] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:20.216953  7756 tablet_bootstrap.cc:492] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:20.220510  7752 raft_consensus.cc:359] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:20.221464  7752 raft_consensus.cc:740] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:20.222131  7752 consensus_queue.cc:260] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:20.224699  7752 ts_tablet_manager.cc:1434] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.006s
I20260709 13:14:20.236526  7758 tablet_copy_client.cc:806] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:20.237349  7758 tablet_copy_client.cc:670] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:20.242131  6341 tablet_copy_service.cc:342] P a13ffe92eb374309a5c8476d9fbbb2b8: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-ef76416cb5194a2cb26550333d72c307 received from {username='slave'} at 127.0.0.1:41502
I20260709 13:14:20.242635  6341 tablet_copy_service.cc:434] P a13ffe92eb374309a5c8476d9fbbb2b8: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-ef76416cb5194a2cb26550333d72c307 on tablet ef76416cb5194a2cb26550333d72c307 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:20.246109  6399 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:20.252028  7735 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:20.260453  7755 tablet_bootstrap.cc:492] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:20.261214  7758 tablet_copy_client.cc:538] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:20.261415  7755 tablet_bootstrap.cc:492] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:20.275627  7758 tablet_bootstrap.cc:492] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:20.283475  7755 ts_tablet_manager.cc:1403] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.023s
I20260709 13:14:20.286731  7755 raft_consensus.cc:359] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:20.289521  7755 raft_consensus.cc:740] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:20.290273  7755 consensus_queue.cc:260] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:20.289170  7756 tablet_bootstrap.cc:492] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:20.292003  7756 tablet_bootstrap.cc:492] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:20.292732  7756 ts_tablet_manager.cc:1403] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.076s	user 0.024s	sys 0.001s
I20260709 13:14:20.302536  7756 raft_consensus.cc:359] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:20.299427  7755 ts_tablet_manager.cc:1434] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:14:20.304255  6256 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:20.303471  7756 raft_consensus.cc:740] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:20.305488  6415 tablet_copy_service.cc:342] P b940f12ed61a49c4b3c11f13ef50fa92: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-5af589183a05415d9cb49d32caedd78f received from {username='slave'} at 127.0.0.1:41486
I20260709 13:14:20.306017  6415 tablet_copy_service.cc:434] P b940f12ed61a49c4b3c11f13ef50fa92: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-5af589183a05415d9cb49d32caedd78f on tablet 5af589183a05415d9cb49d32caedd78f with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:20.307381  7756 consensus_queue.cc:260] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:20.310885  7756 ts_tablet_manager.cc:1434] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:14:20.327883  6415 tablet_copy_service.cc:342] P b940f12ed61a49c4b3c11f13ef50fa92: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-efde1f99d92b4d97b29f2a2f0d1c1c62 received from {username='slave'} at 127.0.0.1:41486
I20260709 13:14:20.328354  7758 tablet_bootstrap.cc:492] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:20.328364  6415 tablet_copy_service.cc:434] P b940f12ed61a49c4b3c11f13ef50fa92: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-efde1f99d92b4d97b29f2a2f0d1c1c62 on tablet efde1f99d92b4d97b29f2a2f0d1c1c62 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:20.329310  7758 tablet_bootstrap.cc:492] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:20.330137  7758 ts_tablet_manager.cc:1403] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.013s
I20260709 13:14:20.333366  7758 raft_consensus.cc:359] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:20.334218  7758 raft_consensus.cc:740] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:20.334892  7758 consensus_queue.cc:260] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:20.336790  7758 ts_tablet_manager.cc:1434] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:14:20.338665  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-c17ed9277f5d4839b300200e6c909c0f received from {username='slave'} at 127.0.0.1:38692
I20260709 13:14:20.339074  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-c17ed9277f5d4839b300200e6c909c0f on tablet c17ed9277f5d4839b300200e6c909c0f with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:20.352078  7768 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:20.462190  6329 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:20.463330  7499 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:20.489101  6935 raft_consensus.cc:1217] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:20.503624  6399 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:20.504966  6935 raft_consensus.cc:1217] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:20.511909  7499 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:20.541109  6942 raft_consensus.cc:1217] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:20.595623  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:20.602433  6942 raft_consensus.cc:1217] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:20.668527  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:20.724982  6253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:20.725615  6253 raft_consensus.cc:606] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:20.728564  6329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:20.729208  6329 raft_consensus.cc:606] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:20.731717  6399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:14:20.732239  6399 raft_consensus.cc:606] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:20.733367  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:20.734508  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:20.745427  7773 raft_consensus.cc:993] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:20.745937  7672 raft_consensus.cc:1081] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:20.747498  6399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:20.748003  6399 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:20.748286  6399 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:20.754756  6399 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:20.756608  6399 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:20.758383  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:20.758685  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:20.758906  6329 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:20.759305  6253 raft_consensus.cc:3055] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:20.759646  6253 raft_consensus.cc:740] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:20.760486  6253 consensus_queue.cc:260] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:20.761757  6253 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:20.768640  6253 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:20.769640  6369 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:20.769162  6329 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:20.770392  7693 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:20.774158  7693 raft_consensus.cc:697] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:20.774906  7693 consensus_queue.cc:237] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:20.786298  6150 catalog_manager.cc:5697] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 4, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 4 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.956396  7676 raft_consensus.cc:1064] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:20.958406  7676 consensus_queue.cc:237] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:20.964905  6942 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:20.965487  7693 raft_consensus.cc:993] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:20.965968  7706 raft_consensus.cc:1081] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:20.966393  7768 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:20.967981  6399 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:20.969110  6327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57226
I20260709 13:14:20.969900  6327 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:20.970278  6327 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:20.984112  6327 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:20.985910  6327 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:20.989423  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:20.990002  6253 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:20.993988  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:20.994515  6399 raft_consensus.cc:3055] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:20.994859  6399 raft_consensus.cc:740] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:20.993836  7674 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:20.995672  6399 consensus_queue.cc:260] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:20.997169  6399 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.004369  6253 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:21.007097  6295 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:21.008951  7784 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:21.015873  6256 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:21.018532  6399 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:21.020609  7784 raft_consensus.cc:697] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:21.021544  7784 consensus_queue.cc:237] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:21.025420  7674 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:14:21.052201  6150 catalog_manager.cc:5697] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 1 to 2, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 2 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.071902  7672 raft_consensus.cc:1064] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:21.073793  7674 raft_consensus.cc:2955] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.074538  7672 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:21.083977  6402 raft_consensus.cc:2955] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.091534  6942 raft_consensus.cc:2955] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.093245  6150 catalog_manager.cc:5697] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.122583  6329 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:21.124436  6256 raft_consensus.cc:2955] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.126063  6396 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:21.127015  7793 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.138722  7794 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.143739  7706 raft_consensus.cc:1064] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:21.148476  6329 consensus_queue.cc:237] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:21.149415  6942 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:21.153280  7793 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:21.159017  7706 consensus_queue.cc:237] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:21.173806  6935 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:21.175822  7787 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:21.181653  6396 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:21.183755  7788 raft_consensus.cc:2955] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.185195  6935 raft_consensus.cc:2955] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.186661  7676 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:21.202422  7693 raft_consensus.cc:1064] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:21.204633  7693 consensus_queue.cc:237] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:21.220571  6401 raft_consensus.cc:2955] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.222497  6153 catalog_manager.cc:5697] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 4 to 5, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 2 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.225221  6935 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:21.226428  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ef76416cb5194a2cb26550333d72c307 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:21.227761  6327 raft_consensus.cc:2955] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.229503  7527 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.227638  6253 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:21.223502  7793 raft_consensus.cc:2955] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.234740  7527 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.237792  6329 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:21.240522  6935 raft_consensus.cc:2955] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.246160  7527 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.268388  7706 raft_consensus.cc:2955] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.270496  7788 raft_consensus.cc:993] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:21.270993  7788 raft_consensus.cc:1081] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:21.273520  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet ef76416cb5194a2cb26550333d72c307 with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49990
I20260709 13:14:21.276983  6253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:21.280344  6253 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.285043  6150 catalog_manager.cc:5697] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.281013  6253 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.289954  6399 raft_consensus.cc:2955] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:14:21.312633  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 56520.9us
I20260709 13:14:21.318292  6256 raft_consensus.cc:2955] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.324278  6253 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:21.335039  6329 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:21.335826  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:21.336467  6327 raft_consensus.cc:3055] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:21.336787  6327 raft_consensus.cc:740] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:21.337589  6327 consensus_queue.cc:260] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:21.339191  6327 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.339715  6252 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:21.332856  7808 tablet_replica.cc:333] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:14:21.342186  6935 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:21.341596  6939 raft_consensus.cc:2955] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.343614  7808 raft_consensus.cc:2243] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.349071  7808 raft_consensus.cc:2272] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.345906  7706 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.351922  6252 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:21.348172  6327 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:21.344427  6253 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:21.354285  7808 ts_tablet_manager.cc:1916] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:21.355453  6219 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:21.356702  7793 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:21.357290  7793 raft_consensus.cc:697] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:21.358194  7793 consensus_queue.cc:237] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:21.364423  6253 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:21.364475  6942 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:21.367156  6331 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:21.367549  7794 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:21.368637  7672 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:21.370410  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:21.370997  6401 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.379501  7672 raft_consensus.cc:2955] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.383186  6331 raft_consensus.cc:2955] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.387151  6401 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:21.389961  6942 raft_consensus.cc:2955] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.399144  7805 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.400902  7693 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.403925  7693 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.407337  7808 ts_tablet_manager.cc:1929] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:14:21.407903  7808 log.cc:1199] T ef76416cb5194a2cb26550333d72c307 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/ef76416cb5194a2cb26550333d72c307
I20260709 13:14:21.409613  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet ef76416cb5194a2cb26550333d72c307 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:21.410267  6327 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:21.410683  6151 catalog_manager.cc:5697] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.411688  6327 raft_consensus.cc:2955] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.429819  6391 tablet_service.cc:1558] Processing DeleteTablet for tablet c17ed9277f5d4839b300200e6c909c0f with delete_type TABLET_DATA_TOMBSTONED (TS b940f12ed61a49c4b3c11f13ef50fa92 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36156
I20260709 13:14:21.429778  7706 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:21.436741  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c17ed9277f5d4839b300200e6c909c0f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:21.442077  6151 catalog_manager.cc:5697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.457373  7813 tablet_replica.cc:333] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:14:21.462278  7813 raft_consensus.cc:2243] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.463021  7813 raft_consensus.cc:2272] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.471462  7806 raft_consensus.cc:2955] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.476418  6331 raft_consensus.cc:2955] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.477084  6153 catalog_manager.cc:5697] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 2 to 3, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.484665  6401 consensus_queue.cc:237] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:21.492847  6249 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:21.493371  6942 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:21.495406  7801 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:21.498282  7813 ts_tablet_manager.cc:1916] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:21.498765  7801 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:21.508478  7693 raft_consensus.cc:2955] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.519256  6249 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:21.535319  7676 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:21.549993  6401 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:21.562896  6942 raft_consensus.cc:2955] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.579406  6939 raft_consensus.cc:2955] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.580804  7813 ts_tablet_manager.cc:1929] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:14:21.581416  7813 log.cc:1199] T c17ed9277f5d4839b300200e6c909c0f P b940f12ed61a49c4b3c11f13ef50fa92: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/wals/c17ed9277f5d4839b300200e6c909c0f
I20260709 13:14:21.586345  6153 catalog_manager.cc:5697] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.593713  7786 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:21.625313  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 96487.1us
I20260709 13:14:21.627027  6140 catalog_manager.cc:5028] TS b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): tablet c17ed9277f5d4839b300200e6c909c0f (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:21.626169  6154 catalog_manager.cc:5697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.627921  6140 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet efde1f99d92b4d97b29f2a2f0d1c1c62 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:21.627972  6249 raft_consensus.cc:2955] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.641323  6317 tablet_service.cc:1558] Processing DeleteTablet for tablet efde1f99d92b4d97b29f2a2f0d1c1c62 with delete_type TABLET_DATA_TOMBSTONED (TS a13ffe92eb374309a5c8476d9fbbb2b8 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:57216
I20260709 13:14:21.663031  6256 raft_consensus.cc:2955] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.671422  7822 tablet_replica.cc:333] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:14:21.689505  7822 raft_consensus.cc:2243] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.701812  7822 raft_consensus.cc:2272] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.709017  7822 ts_tablet_manager.cc:1916] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:21.730005  6399 consensus_queue.cc:237] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:21.739578  6942 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:21.740118  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:21.742769  7801 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:21.746206  6256 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:21.748095  7801 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:21.752032  7818 raft_consensus.cc:2955] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.756201  6942 raft_consensus.cc:2955] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.766371  6256 raft_consensus.cc:2955] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:21.769192  6140 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5af589183a05415d9cb49d32caedd78f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:21.781730  7822 ts_tablet_manager.cc:1929] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:14:21.782245  7822 log.cc:1199] T efde1f99d92b4d97b29f2a2f0d1c1c62 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/wals/efde1f99d92b4d97b29f2a2f0d1c1c62
I20260709 13:14:21.783969  6138 catalog_manager.cc:5028] TS a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): tablet efde1f99d92b4d97b29f2a2f0d1c1c62 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:21.789686  6154 catalog_manager.cc:5697] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.811698  6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 5af589183a05415d9cb49d32caedd78f with delete_type TABLET_DATA_TOMBSTONED (TS a13ffe92eb374309a5c8476d9fbbb2b8 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:57216
I20260709 13:14:21.812546  7822 tablet_replica.cc:333] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:14:21.813421  7822 raft_consensus.cc:2243] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.814079  7822 raft_consensus.cc:2272] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.817960  7822 ts_tablet_manager.cc:1916] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:21.828464  7822 ts_tablet_manager.cc:1929] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:14:21.828816  7822 log.cc:1199] T 5af589183a05415d9cb49d32caedd78f P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/wals/5af589183a05415d9cb49d32caedd78f
I20260709 13:14:21.830135  6138 catalog_manager.cc:5028] TS a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): tablet 5af589183a05415d9cb49d32caedd78f (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:21.835021  6396 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:21.836061  7791 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:21.845583  6329 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:21.847195  7793 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:21.859921  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:21.910027  6329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:21.911219  6329 raft_consensus.cc:606] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:21.913477  6252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:21.913909  6252 raft_consensus.cc:606] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Received request to transfer leadership to TS 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:21.915880  6402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55cead5798bd4451a23aee760d202f18"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:14:21.916304  6402 raft_consensus.cc:606] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:21.918426  6252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:21.918856  6252 raft_consensus.cc:606] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:21.920764  6329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:21.921242  6329 raft_consensus.cc:606] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:21.922298  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:21.923635  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:21.976442  7788 raft_consensus.cc:993] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:21.976948  7676 raft_consensus.cc:1081] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:21.978223  6256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:21.978606  6256 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.978822  6256 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:21.983664  6256 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:21.985368  6256 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:21.986050  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:21.986665  6329 raft_consensus.cc:3055] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:21.987007  6329 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:21.987316  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:21.990156  6402 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:21.989272  6329 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:21.992127  6329 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:21.993315  7793 raft_consensus.cc:993] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:21.993801  7793 raft_consensus.cc:1081] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:21.995217  6396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:21.995698  6396 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.996018  6396 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:21.997341  6402 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:21.999058  6221 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:21.999786  7793 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:21.999938  6329 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:22.000295  7793 raft_consensus.cc:697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:22.001582  7676 raft_consensus.cc:993] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:22.001235  7793 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:22.002465  7676 raft_consensus.cc:1081] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:22.002308  6396 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:22.003998  6256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:22.004586  6256 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:22.004684  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:22.005010  6256 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:22.005277  6252 raft_consensus.cc:3055] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:22.005599  6252 raft_consensus.cc:740] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:22.006407  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:22.006596  6252 consensus_queue.cc:260] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:22.007118  6329 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:22.007715  6252 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:22.005648  6396 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:22.013911  6256 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:22.016362  6256 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:22.016461  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:22.017021  6331 raft_consensus.cc:3055] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:22.017328  6331 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:22.017917  6331 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:22.018646  6331 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:22.020143  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:22.020680  6396 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:22.022888  6154 catalog_manager.cc:5697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 4, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:22.026145  6331 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:22.028228  6329 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:22.028966  6219 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:22.029305  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:22.029990  7793 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:22.030157  7818 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:22.030897  7793 raft_consensus.cc:697] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:22.030933  7818 raft_consensus.cc:697] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:22.032194  7818 consensus_queue.cc:237] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:22.034605  7793 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:22.037693  6252 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:22.038697  6396 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:22.052459  6154 catalog_manager.cc:5697] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 4, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 4 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.052974  6150 catalog_manager.cc:5697] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 4, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:22.385779  7706 raft_consensus.cc:993] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:22.386238  7818 raft_consensus.cc:1081] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:22.387748  6331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55cead5798bd4451a23aee760d202f18"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57226
I20260709 13:14:22.388234  6331 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:22.388548  6331 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:22.393399  6331 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:22.395641  6331 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:22.395865  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:22.396554  6252 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:22.397356  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:22.397935  6402 raft_consensus.cc:3055] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:22.398252  6402 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:22.399029  6402 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:22.400147  6402 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:22.404915  6252 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:22.406255  6402 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:22.406189  6295 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:22.407215  7676 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:22.407647  7676 raft_consensus.cc:697] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:22.410085  7676 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:22.411206  6329 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:22.415457  7791 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:22.433597  6154 catalog_manager.cc:5697] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 3 to 4, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 4 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:22.438730  6396 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:22.447626  7791 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:22.480378  7793 raft_consensus.cc:993] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:14:22.480825  7791 raft_consensus.cc:1081] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Signalling peer 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:14:22.482167  6942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:41298
I20260709 13:14:22.482748  6942 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:22.483079  6942 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:22.489655  6942 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:22.491671  6942 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:22.492166  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:22.492753  6252 raft_consensus.cc:3055] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:22.493002  6252 raft_consensus.cc:740] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:22.492905  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:22.493724  6396 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:22.493853  6252 consensus_queue.cc:260] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:22.494848  6252 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:22.497211  6402 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:22.499375  6396 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:22.500653  6907 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:22.500648  6252 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:22.501574  7750 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:22.502610  7791 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:22.505723  7750 raft_consensus.cc:697] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:22.507450  7750 consensus_queue.cc:237] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:22.515625  6252 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:22.520959  7706 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:22.523432  6331 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:22.524943  7791 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:22.538589  6150 catalog_manager.cc:5697] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 2 to 3, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 3 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.547785  6329 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:22.549780  7818 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:22.801988  6396 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:22.803103  7833 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:22.811415  6252 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:22.813023  7788 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:22.896268  6329 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:22.901477  6396 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:14:22.901953  6297 consensus_peers.cc:597] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cead5798bd4451a23aee760d202f18. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.903273  6252 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:22.902693  7833 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:22.904896  7833 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:22.910521  6396 raft_consensus.cc:2955] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:22.909032  7788 raft_consensus.cc:2955] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:22.918773  6252 raft_consensus.cc:2955] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:22.924427  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:22.925894  6256 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:22.930546  6404 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:22.932060  7750 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:14:22.936877  6222 consensus_peers.cc:597] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea04d9d509e04fbdafdf863603b94c70. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.939591  6329 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:22.942587  6154 catalog_manager.cc:5697] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index -1 to 4, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 4 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:22.952015  7843 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:22.954042  6399 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:22.955726  7843 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:22.963505  7791 raft_consensus.cc:2955] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:22.973177  6331 raft_consensus.cc:2955] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:22.988088  6396 raft_consensus.cc:2955] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:23.014674  6399 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:23.019304  6252 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:23.044364  6154 catalog_manager.cc:5697] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:23.050107  7750 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:14:23.028883  7850 log.cc:927] Time spent T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:14:23.076725  6329 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:23.080506  6256 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:23.082182  7856 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:23.087697  7801 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:23.101742  7801 raft_consensus.cc:2955] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:23.115913  6329 raft_consensus.cc:2955] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:23.118494  6252 raft_consensus.cc:2955] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
W20260709 13:14:23.132915  6371 consensus_peers.cc:597] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72b743ddeba148d8a8fb0d816501812b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.149775  6150 catalog_manager.cc:5697] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:23.155328  6252 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
W20260709 13:14:23.170912  6222 consensus_peers.cc:597] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c399f07ba644d25ba3579e60d6962bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.171612  6329 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:23.171545  6396 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:23.172914  7832 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:23.173785  7843 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:23.181239  7832 raft_consensus.cc:2955] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:23.183323  6399 raft_consensus.cc:2955] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:23.184695  6329 raft_consensus.cc:2955] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:23.201488  6154 catalog_manager.cc:5697] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:23.218420  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:23.280510  6396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:14:23.281113  6396 raft_consensus.cc:606] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:23.283754  6329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "334e41443e364890b884c69082b3bb30"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:23.284310  6329 raft_consensus.cc:606] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:23.287678  6252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:23.288213  6252 raft_consensus.cc:606] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership to TS 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:23.290531  6252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0c4567153664b518d2f6515e419da60"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:23.291060  6252 raft_consensus.cc:606] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:23.293360  6396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce99643832824368978841e0265f9d2d"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:14:23.293861  6396 raft_consensus.cc:606] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:23.294929  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:23.296439  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:23.385619  7854 raft_consensus.cc:993] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:23.386423  7852 raft_consensus.cc:1081] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:23.393217  6252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:49996
I20260709 13:14:23.393865  6252 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:23.394302  6252 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:23.426059  7871 ts_tablet_manager.cc:933] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:23.427759  6252 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:23.432703  7871 tablet_copy_client.cc:323] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.2:39965
I20260709 13:14:23.435878  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:23.436434  6399 raft_consensus.cc:3055] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:23.436522  6252 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:23.436790  6399 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:23.437088  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:23.438330  6939 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:23.437651  6399 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:23.439885  6399 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:23.440411  6341 tablet_copy_service.cc:140] P a13ffe92eb374309a5c8476d9fbbb2b8: Received BeginTabletCopySession request for tablet 55cead5798bd4451a23aee760d202f18 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41502)
I20260709 13:14:23.440945  6341 tablet_copy_service.cc:161] P a13ffe92eb374309a5c8476d9fbbb2b8: Beginning new tablet copy session on tablet 55cead5798bd4451a23aee760d202f18 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41502: session id = 8600a3fead0e48a7aa813822ec44d0fe-55cead5798bd4451a23aee760d202f18
I20260709 13:14:23.450035  6939 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:23.451309  6222 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:23.452237  7843 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:23.452872  7843 raft_consensus.cc:697] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:23.452230  6399 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:23.453745  7843 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:23.456544  6341 tablet_copy_source_session.cc:215] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:23.461923  7871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55cead5798bd4451a23aee760d202f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.468755  6151 catalog_manager.cc:5697] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 5, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 5 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.479619  7871 tablet_copy_client.cc:806] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:23.480218  7871 tablet_copy_client.cc:670] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:23.484277  7871 tablet_copy_client.cc:538] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:23.495056  7874 ts_tablet_manager.cc:933] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:23.496915  7874 tablet_copy_client.cc:323] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:14:23.499291  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet ea04d9d509e04fbdafdf863603b94c70 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:14:23.499821  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet ea04d9d509e04fbdafdf863603b94c70 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-ea04d9d509e04fbdafdf863603b94c70
I20260709 13:14:23.503573  7871 tablet_bootstrap.cc:492] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:23.516009  6265 tablet_copy_source_session.cc:215] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:23.519529  7874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea04d9d509e04fbdafdf863603b94c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.536270  7871 tablet_bootstrap.cc:492] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.540172  7871 tablet_bootstrap.cc:492] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:23.540988  7871 ts_tablet_manager.cc:1403] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.012s
I20260709 13:14:23.541658  7874 tablet_copy_client.cc:806] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:23.542273  7874 tablet_copy_client.cc:670] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:23.545428  7871 raft_consensus.cc:359] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:23.546419  7871 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:23.547168  7874 tablet_copy_client.cc:538] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:23.547168  7871 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:23.550467  7871 ts_tablet_manager.cc:1434] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:14:23.556087  6341 tablet_copy_service.cc:342] P a13ffe92eb374309a5c8476d9fbbb2b8: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-55cead5798bd4451a23aee760d202f18 received from {username='slave'} at 127.0.0.1:41502
I20260709 13:14:23.556521  6341 tablet_copy_service.cc:434] P a13ffe92eb374309a5c8476d9fbbb2b8: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-55cead5798bd4451a23aee760d202f18 on tablet 55cead5798bd4451a23aee760d202f18 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:23.560079  7877 ts_tablet_manager.cc:933] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:23.566438  7874 tablet_bootstrap.cc:492] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:23.574934  7877 tablet_copy_client.cc:323] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.3:34111
I20260709 13:14:23.576617  6415 tablet_copy_service.cc:140] P b940f12ed61a49c4b3c11f13ef50fa92: Received BeginTabletCopySession request for tablet 72b743ddeba148d8a8fb0d816501812b from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41486)
I20260709 13:14:23.577179  6415 tablet_copy_service.cc:161] P b940f12ed61a49c4b3c11f13ef50fa92: Beginning new tablet copy session on tablet 72b743ddeba148d8a8fb0d816501812b from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41486: session id = 8600a3fead0e48a7aa813822ec44d0fe-72b743ddeba148d8a8fb0d816501812b
I20260709 13:14:23.580914  7867 raft_consensus.cc:993] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:23.581550  7867 raft_consensus.cc:1081] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:23.583524  6399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0c4567153664b518d2f6515e419da60"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:23.584064  6399 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:23.584406  6399 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:23.588987  6415 tablet_copy_source_session.cc:215] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:23.592598  7877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b743ddeba148d8a8fb0d816501812b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.596081  6399 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:23.599059  6399 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:23.604210  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:23.604825  6252 raft_consensus.cc:3055] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:23.605118  6252 raft_consensus.cc:740] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:23.606948  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:23.607501  6331 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:23.605829  6252 consensus_queue.cc:260] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:23.622589  7877 tablet_copy_client.cc:806] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:23.623294  7877 tablet_copy_client.cc:670] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:23.630973  7874 tablet_bootstrap.cc:492] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.631454  7870 raft_consensus.cc:993] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:23.634052  7864 raft_consensus.cc:1081] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:23.634444  7877 tablet_copy_client.cc:538] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:23.635661  6252 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:23.635999  6249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "334e41443e364890b884c69082b3bb30"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:23.636533  6249 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:23.636891  6249 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.640566  6331 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:23.631870  7874 tablet_bootstrap.cc:492] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:23.642035  7874 ts_tablet_manager.cc:1403] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.076s	user 0.029s	sys 0.009s
I20260709 13:14:23.642107  6252 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:23.643452  6369 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:23.644793  7855 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:23.646167  7855 raft_consensus.cc:697] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:23.645921  7874 raft_consensus.cc:359] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:23.646904  7874 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:23.647583  7874 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:23.643272  6249 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:23.653157  7874 ts_tablet_manager.cc:1434] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.005s
I20260709 13:14:23.654819  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-ea04d9d509e04fbdafdf863603b94c70 received from {username='slave'} at 127.0.0.1:38692
I20260709 13:14:23.655233  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-ea04d9d509e04fbdafdf863603b94c70 on tablet ea04d9d509e04fbdafdf863603b94c70 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:23.655251  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:23.655889  6329 raft_consensus.cc:3055] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:23.656179  6329 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:23.656965  6329 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:23.656639  7855 consensus_queue.cc:237] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:23.658130  6329 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.661021  7877 tablet_bootstrap.cc:492] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:23.666671  6249 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:23.667832  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:23.668424  6399 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.668383  6329 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:23.675607  6219 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:23.676447  7843 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:23.676944  7843 raft_consensus.cc:697] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:23.677839  7843 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:23.683270  6399 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:23.683977  6151 catalog_manager.cc:5697] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 2 to 3, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:23.700292  6150 catalog_manager.cc:5697] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.701375  7855 raft_consensus.cc:993] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:23.701887  7855 raft_consensus.cc:1081] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:23.703543  6329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce99643832824368978841e0265f9d2d"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57226
I20260709 13:14:23.704142  6329 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:23.704547  6329 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:23.711526  6329 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:23.715441  7877 tablet_bootstrap.cc:492] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.716351  7877 tablet_bootstrap.cc:492] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:23.717015  7877 ts_tablet_manager.cc:1403] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.004s
I20260709 13:14:23.717653  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:23.718252  6399 raft_consensus.cc:3055] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:23.718521  6399 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:23.719244  6399 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:23.720285  6399 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:23.720680  7867 raft_consensus.cc:993] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:14:23.721161  7867 raft_consensus.cc:1081] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Signalling peer 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:14:23.722913  6939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:41298
I20260709 13:14:23.723395  6939 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:23.723706  6939 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:23.726928  6399 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:23.727984  6296 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:23.728770  7870 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:23.729643  7870 raft_consensus.cc:697] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:23.730480  7870 consensus_queue.cc:237] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:23.732151  6329 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:23.720288  7877 raft_consensus.cc:359] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:23.733896  7877 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:23.734611  7877 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:23.737880  6939 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:23.740494  7877 ts_tablet_manager.cc:1434] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:14:23.744625  6415 tablet_copy_service.cc:342] P b940f12ed61a49c4b3c11f13ef50fa92: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-72b743ddeba148d8a8fb0d816501812b received from {username='slave'} at 127.0.0.1:41486
I20260709 13:14:23.745028  6415 tablet_copy_service.cc:434] P b940f12ed61a49c4b3c11f13ef50fa92: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-72b743ddeba148d8a8fb0d816501812b on tablet 72b743ddeba148d8a8fb0d816501812b with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:23.753400  7874 ts_tablet_manager.cc:933] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:23.763032  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:23.765201  6249 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:23.765684  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:23.766264  6252 raft_consensus.cc:3055] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:23.766556  6252 raft_consensus.cc:740] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:23.767242  6252 consensus_queue.cc:260] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:23.767588  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:23.768131  6329 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:23.768270  6252 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:23.776227  6252 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:14:23.777240  6906 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:23.778012  7879 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:23.778481  7879 raft_consensus.cc:697] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:23.779280  7879 consensus_queue.cc:237] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:23.781318  7874 tablet_copy_client.cc:323] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:14:23.782927  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet 1c399f07ba644d25ba3579e60d6962bd from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:14:23.783458  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet 1c399f07ba644d25ba3579e60d6962bd from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-1c399f07ba644d25ba3579e60d6962bd
I20260709 13:14:23.785183  6329 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:14:23.787652  6939 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:23.790989  6265 tablet_copy_source_session.cc:215] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:23.791455  6151 catalog_manager.cc:5697] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 3 to 4, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 4 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:23.795291  6249 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:23.803023  7874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c399f07ba644d25ba3579e60d6962bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.795835  6150 catalog_manager.cc:5697] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 2 to 3, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 3 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.821949  7874 tablet_copy_client.cc:806] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:23.822515  7874 tablet_copy_client.cc:670] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:23.826045  7874 tablet_copy_client.cc:538] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:23.835009  7874 tablet_bootstrap.cc:492] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:23.854702  7874 tablet_bootstrap.cc:492] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.855679  7874 tablet_bootstrap.cc:492] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:23.856326  7874 ts_tablet_manager.cc:1403] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.005s
I20260709 13:14:23.859263  7874 raft_consensus.cc:359] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:23.860121  7874 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:23.860651  7874 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:23.862478  7874 ts_tablet_manager.cc:1434] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:14:23.864037  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-1c399f07ba644d25ba3579e60d6962bd received from {username='slave'} at 127.0.0.1:38692
I20260709 13:14:23.864406  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-1c399f07ba644d25ba3579e60d6962bd on tablet 1c399f07ba644d25ba3579e60d6962bd with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:23.916692  6939 raft_consensus.cc:1217] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:14:23.943848  6939 raft_consensus.cc:1217] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:14:23.984434  6399 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:23.986330  7867 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:23.999452  6939 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:24.001088  7867 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:24.058071  6935 raft_consensus.cc:1217] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:14:24.140074  6331 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:24.141214  7867 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:24.155359  6396 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:24.156838  7832 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:24.197042  6249 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:24.199350  7879 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:24.208539  6249 raft_consensus.cc:1275] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:24.209743  6331 raft_consensus.cc:1275] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:24.210032  7852 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.211119  7855 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.240167  6396 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:24.253754  7869 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.255535  6329 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:24.263140  7879 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:24.297340  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:24.314206  6249 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:24.323755  7676 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.342440  6935 raft_consensus.cc:1217] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:24.369279  7870 raft_consensus.cc:1064] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:24.371886  7870 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:24.378962  6935 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:24.380401  7869 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:24.383177  6399 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:24.383782  6252 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:24.384588  7869 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:24.386706  7864 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:24.409000  7864 raft_consensus.cc:2955] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.411628  6939 raft_consensus.cc:2955] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.412588  6404 raft_consensus.cc:2955] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.427081  6151 catalog_manager.cc:5697] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.433753  6252 raft_consensus.cc:2955] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.449479  6331 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:24.460407  6404 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:24.461958  6939 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:24.463853  7864 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:24.465687  7870 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:24.473551  7676 raft_consensus.cc:2955] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.474900  6935 raft_consensus.cc:2955] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.477463  6404 raft_consensus.cc:2955] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.506002  6154 catalog_manager.cc:5697] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 5 to 6, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 4 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.510607  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 55cead5798bd4451a23aee760d202f18 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:24.512145  7832 raft_consensus.cc:1064] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:24.514775  7832 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:24.527508  7801 raft_consensus.cc:1064] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:24.529950  7801 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:24.539510  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:24.548229  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet 55cead5798bd4451a23aee760d202f18 with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:49990
I20260709 13:14:24.569490  6399 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:24.574229  7843 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:24.571856  6935 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:24.577713  6331 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:24.581804  7867 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:24.591320  7867 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:24.604631  7916 tablet_replica.cc:333] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:14:24.613912  6255 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:24.615612  7801 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:24.616923  6935 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:24.622885  6329 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:24.622700  7852 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:24.627241  7852 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:24.662444  7852 raft_consensus.cc:2955] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.679500  6330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:24.680130  6330 raft_consensus.cc:606] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:24.683445  6939 raft_consensus.cc:2955] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.688450  7843 raft_consensus.cc:2955] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.689752  6252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:24.690371  6252 raft_consensus.cc:606] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:24.696446  6329 raft_consensus.cc:2955] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.706216  6331 raft_consensus.cc:2955] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.700538  6404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:14:24.708976  6404 raft_consensus.cc:606] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:24.709997  6399 raft_consensus.cc:2955] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.713934  6252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:24.714457  6252 raft_consensus.cc:606] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:24.715644  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:14:24.712646  6255 raft_consensus.cc:2955] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.717254  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:24.720636  6153 catalog_manager.cc:5697] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.740890  6153 catalog_manager.cc:5697] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.743430  7916 raft_consensus.cc:2243] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:24.744248  7916 raft_consensus.cc:2272] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:24.748701  6939 raft_consensus.cc:2955] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.863050  7916 ts_tablet_manager.cc:1916] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:24.881343  7916 ts_tablet_manager.cc:1929] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:14:24.882552  7916 log.cc:1199] T 55cead5798bd4451a23aee760d202f18 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/55cead5798bd4451a23aee760d202f18
I20260709 13:14:24.898216  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet 55cead5798bd4451a23aee760d202f18 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
W20260709 13:14:24.907338  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 60274.9us
I20260709 13:14:24.918342  7870 raft_consensus.cc:993] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:24.918855  7870 raft_consensus.cc:1081] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:24.918349  6396 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:24.928403  6249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:24.929004  6249 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.929370  6249 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:24.930143  6935 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:24.936395  6255 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:24.940604  7924 raft_consensus.cc:1064] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:24.941169  7912 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:24.942670  7924 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:24.935832  6249 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:24.936580  6329 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:24.949724  7913 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:24.950711  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:24.951300  6329 raft_consensus.cc:3055] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:24.950634  7801 raft_consensus.cc:2955] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.951588  6329 raft_consensus.cc:740] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:24.954025  6329 consensus_queue.cc:260] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:24.955603  6329 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:24.957106  6331 raft_consensus.cc:2955] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.961613  6935 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:24.962987  7925 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:24.969551  6249 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:24.979919  6331 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:24.979580  6935 raft_consensus.cc:2955] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:24.986423  6329 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:24.987778  6219 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:24.989256  7843 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:24.989691  7843 raft_consensus.cc:697] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:24.990494  6329 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:24.990459  7843 consensus_queue.cc:237] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:24.991520  6942 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:24.992019  7832 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:24.993271  7867 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:24.993675  6151 catalog_manager.cc:5697] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 4 to 5, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:25.015456  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet 72b743ddeba148d8a8fb0d816501812b with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49990
I20260709 13:14:25.016641  7916 tablet_replica.cc:333] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:14:25.019479  7832 raft_consensus.cc:2955] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:25.020025  6331 raft_consensus.cc:2955] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:25.025564  6140 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 72b743ddeba148d8a8fb0d816501812b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:25.001454  7924 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 13:14:25.055627  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 103493us
I20260709 13:14:25.057631  7916 raft_consensus.cc:2243] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.058414  7916 raft_consensus.cc:2272] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.059262  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:25.060026  6396 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:25.062410  7916 ts_tablet_manager.cc:1916] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:25.073118  6396 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:25.078271  6399 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:25.078173  6150 catalog_manager.cc:5697] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 6 to 7, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:25.078858  6942 raft_consensus.cc:2955] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:25.098883  7843 raft_consensus.cc:993] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:25.099347  7843 raft_consensus.cc:1081] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:25.101822  7920 raft_consensus.cc:2955] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:25.104497  7867 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:25.107551  7867 raft_consensus.cc:993] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:25.108062  7867 raft_consensus.cc:1081] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:25.111230  6153 catalog_manager.cc:5697] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 4, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.113101  6396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:25.112495  6330 raft_consensus.cc:2955] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:25.112934  6942 raft_consensus.cc:2955] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:25.113652  6396 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.114305  6396 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:25.115367  6401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:25.115882  6401 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.116241  6401 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:25.125599  6401 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:25.127570  6401 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:25.128533  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:25.129177  6249 raft_consensus.cc:3055] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:25.129534  6249 raft_consensus.cc:740] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:25.130203  6249 consensus_queue.cc:260] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:25.131723  7916 ts_tablet_manager.cc:1929] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:14:25.132175  7916 log.cc:1199] T 72b743ddeba148d8a8fb0d816501812b P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/72b743ddeba148d8a8fb0d816501812b
I20260709 13:14:25.133452  6396 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:25.134526  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ea04d9d509e04fbdafdf863603b94c70 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:25.136116  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:25.136715  6252 raft_consensus.cc:3055] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:25.137022  6252 raft_consensus.cc:740] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:25.137712  6252 consensus_queue.cc:260] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:25.138823  6252 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:25.141434  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:25.141646  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:25.141973  6330 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:25.142308  6329 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:25.142717  6396 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:25.142932  6391 tablet_service.cc:1558] Processing DeleteTablet for tablet ea04d9d509e04fbdafdf863603b94c70 with delete_type TABLET_DATA_TOMBSTONED (TS b940f12ed61a49c4b3c11f13ef50fa92 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:36156
I20260709 13:14:25.155089  6399 raft_consensus.cc:2955] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:25.160781  6249 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:25.165071  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet 72b743ddeba148d8a8fb0d816501812b (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:25.169749  6330 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:25.173923  6368 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:25.175148  7852 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:25.175614  7852 raft_consensus.cc:697] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:25.176432  7852 consensus_queue.cc:237] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:25.176156  6151 catalog_manager.cc:5697] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:25.177942  7912 raft_consensus.cc:993] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:25.179165  7912 raft_consensus.cc:1081] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:25.213398  6330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57226
I20260709 13:14:25.212991  6329 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:25.214191  6330 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.214628  6330 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:25.215220  6368 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:25.219653  7855 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:25.221305  7855 raft_consensus.cc:697] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:25.222204  7855 consensus_queue.cc:237] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:25.227487  6249 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:25.230011  6151 catalog_manager.cc:5697] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 4, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 4 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.220875  6330 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:25.235842  6252 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:25.235875  7933 tablet_replica.cc:333] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:14:25.237748  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:25.238317  6252 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:25.238499  6330 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:25.239462  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:25.240010  6399 raft_consensus.cc:3055] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:25.240307  6399 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:25.241001  6399 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:25.242020  6399 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:25.244819  6252 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:25.246982  6295 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:25.247788  7869 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:25.248265  7869 raft_consensus.cc:697] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:25.249202  7869 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:25.253942  7933 raft_consensus.cc:2243] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.254853  7933 raft_consensus.cc:2272] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.254762  6249 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:25.258311  7933 ts_tablet_manager.cc:1916] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:25.259270  6153 catalog_manager.cc:5697] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 6, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 6 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.253991  6399 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:25.264395  6942 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:25.266690  7929 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:25.273108  6330 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:25.273413  7832 raft_consensus.cc:2955] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:25.274624  7925 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:25.278621  6330 raft_consensus.cc:2955] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:25.279453  6942 raft_consensus.cc:2955] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:25.284009  6153 catalog_manager.cc:5697] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 2 to 3, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 3 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.287801  7933 ts_tablet_manager.cc:1929] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:14:25.288770  7933 log.cc:1199] T ea04d9d509e04fbdafdf863603b94c70 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/wals/ea04d9d509e04fbdafdf863603b94c70
I20260709 13:14:25.290524  6140 catalog_manager.cc:5028] TS b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): tablet ea04d9d509e04fbdafdf863603b94c70 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:25.299118  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1c399f07ba644d25ba3579e60d6962bd with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:25.306097  6153 catalog_manager.cc:5697] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:25.322988  6391 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c399f07ba644d25ba3579e60d6962bd with delete_type TABLET_DATA_TOMBSTONED (TS b940f12ed61a49c4b3c11f13ef50fa92 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36156
I20260709 13:14:25.323812  7933 tablet_replica.cc:333] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:14:25.324709  7933 raft_consensus.cc:2243] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.325300  7933 raft_consensus.cc:2272] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.328193  7933 ts_tablet_manager.cc:1916] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:25.343005  7933 ts_tablet_manager.cc:1929] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:14:25.343523  7933 log.cc:1199] T 1c399f07ba644d25ba3579e60d6962bd P b940f12ed61a49c4b3c11f13ef50fa92: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/wals/1c399f07ba644d25ba3579e60d6962bd
I20260709 13:14:25.345016  6140 catalog_manager.cc:5028] TS b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): tablet 1c399f07ba644d25ba3579e60d6962bd (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:25.383284  6399 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:25.384497  7832 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:25.393975  6330 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:25.395352  7924 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:25.574398  6249 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:25.575696  7911 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:25.588219  6331 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:25.589709  7913 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:25.718115  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:25.767721  6249 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:25.768987  7913 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:25.779424  6329 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:25.781364  7855 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:25.833006  6256 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:25.834172  7869 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:25.843003  6401 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:25.844700  7948 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:26.009800  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:26.050215  6329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:26.050817  6329 raft_consensus.cc:606] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:26.053100  6401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0c4567153664b518d2f6515e419da60"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:14:26.053665  6401 raft_consensus.cc:606] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:26.056174  6256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:26.056617  6256 raft_consensus.cc:606] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Received request to transfer leadership to TS 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:26.057703  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:26.058787  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:26.153877  7870 raft_consensus.cc:993] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:26.154326  7948 raft_consensus.cc:1081] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:26.155704  6256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:26.156222  6256 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:26.156489  6256 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.161710  6256 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:26.163197  6256 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:26.163735  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:26.164254  6329 raft_consensus.cc:3055] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:26.164506  6329 raft_consensus.cc:740] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:26.165055  6329 consensus_queue.cc:260] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:26.165766  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:26.166091  6329 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.166232  6399 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.170418  6329 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:26.170800  6399 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:26.171937  6221 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:26.172688  7925 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:26.173163  7925 raft_consensus.cc:697] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:26.173995  7925 consensus_queue.cc:237] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:26.183718  6151 catalog_manager.cc:5697] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:26.400600  7924 raft_consensus.cc:993] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:14:26.401048  7924 raft_consensus.cc:1081] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Signalling peer 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:14:26.405393  6935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:41298
I20260709 13:14:26.405923  6935 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:26.406266  6935 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:26.472059  6404 consensus_queue.cc:237] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:26.497397  7855 raft_consensus.cc:993] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:26.498672  7962 raft_consensus.cc:1081] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:26.505381  6331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0c4567153664b518d2f6515e419da60"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57226
I20260709 13:14:26.505926  6331 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:26.506247  6331 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:26.420387  6935 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:26.570107  6331 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:26.571115  6935 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:26.580520  6331 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:26.596604  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:26.597295  6396 raft_consensus.cc:3055] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:26.597611  6396 raft_consensus.cc:740] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:26.597957  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:26.598505  6249 raft_consensus.cc:3055] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:26.598371  6396 consensus_queue.cc:260] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:26.598850  6249 raft_consensus.cc:740] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:26.599490  6396 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:26.599601  6249 consensus_queue.cc:260] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:26.600744  6249 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:26.611269  6399 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.615659  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:26.616222  6330 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:26.625789  6325 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:26.627154  7954 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:14:26.628953  6371 consensus_peers.cc:597] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1230017e50f4469992de6002ca8cd7b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:26.630985  6330 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:26.633941  6905 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:26.635047  7879 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:26.633967  6249 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:26.635793  7879 raft_consensus.cc:697] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:26.637146  7879 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:26.636664  7958 raft_consensus.cc:2955] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:26.638123  6325 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.638561  6330 raft_consensus.cc:2955] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:26.643245  7964 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:14:26.647334  6396 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:26.648089  6249 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:26.650768  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:26.652881  6248 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:26.654469  7959 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:26.655854  6296 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:26.660279  7948 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:26.660768  7948 raft_consensus.cc:697] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:26.661605  7948 consensus_queue.cc:237] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:26.663110  7956 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.669780  6396 consensus_queue.cc:237] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:26.674299  6248 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:26.681082  6150 catalog_manager.cc:5697] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index -1 to 4, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:26.686081  6371 consensus_peers.cc:597] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ad52cf302674a048c4b3a989596b435. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:26.691093  6248 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:14:26.692219  6330 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:14:26.696250  7954 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:26.698410  7954 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:26.698589  6256 raft_consensus.cc:2955] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:26.716245  7959 raft_consensus.cc:2955] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:26.722807  6330 raft_consensus.cc:2955] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:26.737841  6153 catalog_manager.cc:5697] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 2 to 3, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 3 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.742027  6248 raft_consensus.cc:2955] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:26.772660  6253 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:26.798822  6404 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:26.798825  6222 consensus_peers.cc:597] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bade3854ad1b4b2492dd0ecd47e1398b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:26.800320  6330 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:26.801201  7964 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.803026  7964 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.806274  6151 catalog_manager.cc:5697] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 3 to 4, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 4 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:26.823423  7960 raft_consensus.cc:2955] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:26.825213  6330 raft_consensus.cc:2955] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:26.827066  6404 raft_consensus.cc:2955] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:26.845233  6253 consensus_queue.cc:237] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:26.854732  6404 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:26.854717  6153 catalog_manager.cc:5697] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 6 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:26.856302  7956 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.858805  6331 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:26.860862  7924 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:26.864444  6222 consensus_peers.cc:597] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbc89cb8d0e64feba7a58705d738d699. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:26.872067  7924 raft_consensus.cc:2955] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:26.875038  6396 raft_consensus.cc:2955] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:26.877491  6154 catalog_manager.cc:5697] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:26.909858  6331 raft_consensus.cc:2955] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:26.920006  6151 catalog_manager.cc:5697] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:27.049612  6256 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:27.050839  6331 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:27.051148  7879 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:27.052384  7944 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:27.160531  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:27.232582  6404 raft_consensus.cc:1275] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:27.259866  7993 ts_tablet_manager.cc:933] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:27.265010  7955 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:27.268757  7994 ts_tablet_manager.cc:933] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:27.304186  6248 raft_consensus.cc:1275] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:27.312218  7998 ts_tablet_manager.cc:933] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:27.325939  7993 tablet_copy_client.cc:323] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.3:34111
I20260709 13:14:27.331168  6415 tablet_copy_service.cc:140] P b940f12ed61a49c4b3c11f13ef50fa92: Received BeginTabletCopySession request for tablet 1230017e50f4469992de6002ca8cd7b6 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41486)
I20260709 13:14:27.331933  6415 tablet_copy_service.cc:161] P b940f12ed61a49c4b3c11f13ef50fa92: Beginning new tablet copy session on tablet 1230017e50f4469992de6002ca8cd7b6 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41486: session id = 8600a3fead0e48a7aa813822ec44d0fe-1230017e50f4469992de6002ca8cd7b6
I20260709 13:14:27.344950  7974 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:14:27.377277  6415 tablet_copy_source_session.cc:215] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:27.378659  7997 ts_tablet_manager.cc:933] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:27.382565  7994 tablet_copy_client.cc:323] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.3:34111
I20260709 13:14:27.386216  7998 tablet_copy_client.cc:323] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:14:27.387408  6414 tablet_copy_service.cc:140] P b940f12ed61a49c4b3c11f13ef50fa92: Received BeginTabletCopySession request for tablet 4ad52cf302674a048c4b3a989596b435 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41486)
I20260709 13:14:27.388271  6414 tablet_copy_service.cc:161] P b940f12ed61a49c4b3c11f13ef50fa92: Beginning new tablet copy session on tablet 4ad52cf302674a048c4b3a989596b435 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41486: session id = 8600a3fead0e48a7aa813822ec44d0fe-4ad52cf302674a048c4b3a989596b435
I20260709 13:14:27.401280  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet cbc89cb8d0e64feba7a58705d738d699 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:14:27.401934  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet cbc89cb8d0e64feba7a58705d738d699 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-cbc89cb8d0e64feba7a58705d738d699
I20260709 13:14:27.413683  6265 tablet_copy_source_session.cc:215] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:14:27.427866  6426 debug-util.cc:398] Leaking SignalData structure 0x7b0800249c20 after lost signal to thread 5115
W20260709 13:14:27.429206  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb780 after lost signal to thread 6188
I20260709 13:14:27.417884  7993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1230017e50f4469992de6002ca8cd7b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:27.434192  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4480 after lost signal to thread 6280
W20260709 13:14:27.435782  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4d00 after lost signal to thread 6355
I20260709 13:14:27.439340  7998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc89cb8d0e64feba7a58705d738d699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:27.422670  7997 tablet_copy_client.cc:323] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:14:27.427227  6414 tablet_copy_source_session.cc:215] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:27.447624  7994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad52cf302674a048c4b3a989596b435. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:27.456686  6426 debug-util.cc:398] Leaking SignalData structure 0x7b080034f6c0 after lost signal to thread 6429
W20260709 13:14:27.459868  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002c53c0 after lost signal to thread 6966
I20260709 13:14:27.469434  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet bade3854ad1b4b2492dd0ecd47e1398b from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:14:27.474195  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet bade3854ad1b4b2492dd0ecd47e1398b from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-bade3854ad1b4b2492dd0ecd47e1398b
I20260709 13:14:27.493654  7998 tablet_copy_client.cc:806] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:27.503494  7998 tablet_copy_client.cc:670] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:27.515729  7998 tablet_copy_client.cc:538] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:27.535331  7998 tablet_bootstrap.cc:492] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
W20260709 13:14:27.544554  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 47195.3us
I20260709 13:14:27.545042  7994 tablet_copy_client.cc:806] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:27.545871  7994 tablet_copy_client.cc:670] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:27.593246  7994 tablet_copy_client.cc:538] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:27.595150  7993 tablet_copy_client.cc:806] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:27.596387  7993 tablet_copy_client.cc:670] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:27.599689  6265 tablet_copy_source_session.cc:215] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:27.603663  7997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bade3854ad1b4b2492dd0ecd47e1398b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:27.605270  7993 tablet_copy_client.cc:538] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:27.625785  7997 tablet_copy_client.cc:806] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:27.626551  7997 tablet_copy_client.cc:670] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:27.631358  7994 tablet_bootstrap.cc:492] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:27.636133  7997 tablet_copy_client.cc:538] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:27.649807  7997 tablet_bootstrap.cc:492] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:27.659814  7998 tablet_bootstrap.cc:492] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.660950  7998 tablet_bootstrap.cc:492] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:27.659814  7993 tablet_bootstrap.cc:492] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:27.663411  7998 ts_tablet_manager.cc:1403] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.128s	user 0.021s	sys 0.007s
I20260709 13:14:27.668390  7998 raft_consensus.cc:359] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:27.679749  7998 raft_consensus.cc:740] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:27.680593  7998 consensus_queue.cc:260] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:27.692237  6942 raft_consensus.cc:1217] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:27.711995  7998 ts_tablet_manager.cc:1434] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.048s	user 0.002s	sys 0.006s
I20260709 13:14:27.714250  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-cbc89cb8d0e64feba7a58705d738d699 received from {username='slave'} at 127.0.0.1:38692
I20260709 13:14:27.714761  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-cbc89cb8d0e64feba7a58705d738d699 on tablet cbc89cb8d0e64feba7a58705d738d699 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:27.765027  7997 tablet_bootstrap.cc:492] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.766347  7997 tablet_bootstrap.cc:492] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:27.767076  7997 ts_tablet_manager.cc:1403] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.118s	user 0.013s	sys 0.021s
I20260709 13:14:27.776002  7993 tablet_bootstrap.cc:492] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.777575  7993 tablet_bootstrap.cc:492] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:27.778527  7993 ts_tablet_manager.cc:1403] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.119s	user 0.025s	sys 0.014s
I20260709 13:14:27.781771  7997 raft_consensus.cc:359] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:27.782986  7997 raft_consensus.cc:740] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:27.785096  7997 consensus_queue.cc:260] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:27.788445  7997 ts_tablet_manager.cc:1434] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:14:27.800561  7993 raft_consensus.cc:359] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:27.801586  7993 raft_consensus.cc:740] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:27.802399  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-bade3854ad1b4b2492dd0ecd47e1398b received from {username='slave'} at 127.0.0.1:38692
I20260709 13:14:27.802320  7993 consensus_queue.cc:260] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:27.802875  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-bade3854ad1b4b2492dd0ecd47e1398b on tablet bade3854ad1b4b2492dd0ecd47e1398b with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:27.804440  7994 tablet_bootstrap.cc:492] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=1 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.805400  7994 tablet_bootstrap.cc:492] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:27.806083  7994 ts_tablet_manager.cc:1403] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.178s	user 0.034s	sys 0.010s
I20260709 13:14:27.808964  7994 raft_consensus.cc:359] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:27.810590  7993 ts_tablet_manager.cc:1434] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:14:27.812350  7994 raft_consensus.cc:740] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:27.812449  6414 tablet_copy_service.cc:342] P b940f12ed61a49c4b3c11f13ef50fa92: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-1230017e50f4469992de6002ca8cd7b6 received from {username='slave'} at 127.0.0.1:41486
I20260709 13:14:27.813012  6414 tablet_copy_service.cc:434] P b940f12ed61a49c4b3c11f13ef50fa92: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-1230017e50f4469992de6002ca8cd7b6 on tablet 1230017e50f4469992de6002ca8cd7b6 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:27.813176  7994 consensus_queue.cc:260] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:27.816463  7994 ts_tablet_manager.cc:1434] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:14:27.826570  6414 tablet_copy_service.cc:342] P b940f12ed61a49c4b3c11f13ef50fa92: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-4ad52cf302674a048c4b3a989596b435 received from {username='slave'} at 127.0.0.1:41486
I20260709 13:14:27.827029  6414 tablet_copy_service.cc:434] P b940f12ed61a49c4b3c11f13ef50fa92: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-4ad52cf302674a048c4b3a989596b435 on tablet 4ad52cf302674a048c4b3a989596b435 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:27.900036  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:27.959370  6396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:14:27.959975  6396 raft_consensus.cc:606] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:27.962996  6256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:27.963476  6256 raft_consensus.cc:606] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:27.966199  6325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce99643832824368978841e0265f9d2d"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:27.966704  6325 raft_consensus.cc:606] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:27.969044  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:27.970791  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:27.976997  7948 raft_consensus.cc:993] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:27.977540  7948 raft_consensus.cc:1081] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:27.979182  6248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce99643832824368978841e0265f9d2d"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:27.979729  6248 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:27.980091  6248 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:27.986495  6248 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:27.988262  6248 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:27.988968  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:27.989593  6325 raft_consensus.cc:3055] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:27.989867  6325 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:27.990598  6325 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:27.991611  6325 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:27.993980  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:27.994544  6396 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:28.002489  6325 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:28.008141  6219 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:28.010183  7832 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:28.011058  7832 raft_consensus.cc:697] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:28.013569  7832 consensus_queue.cc:237] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:28.029016  6396 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:28.095389  6154 catalog_manager.cc:5697] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 4, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:28.154902  6942 raft_consensus.cc:1217] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEARNER]: Deduplicated request from leader. Original: 6.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 13:14:28.228730  7832 raft_consensus.cc:1064] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:28.238384  8005 raft_consensus.cc:993] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:28.238965  8005 raft_consensus.cc:1081] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:28.241026  6325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57226
I20260709 13:14:28.241654  6325 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.242055  6325 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:28.278631  7832 consensus_queue.cc:237] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:28.445640  6399 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:28.449654  7832 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:28.473657  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 59627.9us
I20260709 13:14:28.476737  6942 raft_consensus.cc:1217] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:14:28.481663  6325 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:28.487600  6325 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:28.491086  7960 raft_consensus.cc:993] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:28.508105  7925 raft_consensus.cc:1081] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:28.508234  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:28.508809  6400 raft_consensus.cc:3055] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:28.511147  6400 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:28.513443  6400 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:28.514591  6402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:28.515273  6402 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.515697  6402 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.515787  6400 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:28.592453  6402 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:28.604740  6402 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:28.656119  6400 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:28.699856  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:28.700546  6329 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.728845  6331 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:28.729394  6323 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:28.723649  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:28.739209  6942 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:28.756611  6939 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:14:28.756871  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 65451us
I20260709 13:14:28.758764  6938 raft_consensus.cc:1217] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:14:28.762389  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 96039.6us
W20260709 13:14:28.776293  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 293033us
I20260709 13:14:28.777923  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:28.778518  6251 raft_consensus.cc:3055] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:28.778815  6251 raft_consensus.cc:740] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:28.779628  6251 consensus_queue.cc:260] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:28.782408  6296 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:28.781755  6251 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.785290  8030 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:28.788134  6404 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:28.791007  6329 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:28.794096  6942 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:28.798910  6251 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:28.810695  6322 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:28.813862  7960 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:28.814653  7925 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:28.801733  8030 raft_consensus.cc:697] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:28.816054  8030 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:28.818159  6368 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:28.819058  8021 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:28.818120  8032 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:14:28.822810  7925 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:28.824290  8021 raft_consensus.cc:697] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:28.825322  8021 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:28.830370  7954 raft_consensus.cc:1064] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:28.832849  7954 consensus_queue.cc:237] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:28.949998  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 53040.7us
W20260709 13:14:28.974668  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 97617.8us
I20260709 13:14:28.990552  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:29.037660  6330 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:14:29.039510  8038 log.cc:927] Time spent T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:14:29.051914  6938 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEARNER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:14:29.062848  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 74133.3us
W20260709 13:14:29.081729  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 60675.8us
W20260709 13:14:29.088629  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 56430.7us
I20260709 13:14:29.105289  8019 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:14:29.135890  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 179866us
I20260709 13:14:29.141554  6151 catalog_manager.cc:5697] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 3 to 4, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 4 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:29.139454  6153 catalog_manager.cc:5697] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:29.133903  8028 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 13:14:29.199551  8010 log.cc:927] Time spent T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:14:29.201509  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 52953.8us
W20260709 13:14:29.232824  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 87518.1us
I20260709 13:14:29.236397  7925 raft_consensus.cc:2955] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:14:29.269383  8051 log.cc:927] Time spent T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:14:29.282800  6942 raft_consensus.cc:2955] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:29.289489  6324 raft_consensus.cc:2955] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:29.294414  8033 raft_consensus.cc:1064] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:29.337499  6255 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:14:29.313809  6185 debug-util.cc:398] Leaking SignalData structure 0x7b0800036cc0 after lost signal to thread 5115
W20260709 13:14:29.339982  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 97580us
I20260709 13:14:29.313187  8033 consensus_queue.cc:237] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:29.343148  6254 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:14:29.353762  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 68355.7us
W20260709 13:14:29.358152  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 68626.1us
W20260709 13:14:29.378449  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 44039.5us
I20260709 13:14:29.382548  6330 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:14:29.389904  6185 debug-util.cc:398] Leaking SignalData structure 0x7b08000f9fc0 after lost signal to thread 6188
I20260709 13:14:29.403010  8067 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:29.389315  8021 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:14:29.430749  8005 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.450881  6936 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:29.452431  8059 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:29.444722  6185 debug-util.cc:398] Leaking SignalData structure 0x7b080029a980 after lost signal to thread 6280
W20260709 13:14:29.454820  6185 debug-util.cc:398] Leaking SignalData structure 0x7b0800221580 after lost signal to thread 6355
I20260709 13:14:29.459564  6322 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:14:29.461300  6185 debug-util.cc:398] Leaking SignalData structure 0x7b0800065060 after lost signal to thread 6429
I20260709 13:14:29.463414  6404 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:14:29.463459  6185 debug-util.cc:398] Leaking SignalData structure 0x7b0800361820 after lost signal to thread 6966
W20260709 13:14:29.473788  8066 log.cc:927] Time spent T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:14:29.489245  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 96477.3us
I20260709 13:14:29.479065  6396 raft_consensus.cc:2955] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:29.493772  8003 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:14:29.482412  8033 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:14:29.500981  6252 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:14:29.527113  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 132059us
I20260709 13:14:29.531855  8019 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:29.574043  6935 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:14:29.585321  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 50510us
I20260709 13:14:29.662917  8062 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:14:29.687549  6942 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Advancing to term 2
I20260709 13:14:29.677151  6939 raft_consensus.cc:2955] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:29.718158  6942 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:29.749581  6154 catalog_manager.cc:5697] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:29.728704  8021 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:14:29.801322  7954 raft_consensus.cc:2955] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:29.873046  8050 raft_consensus.cc:1064] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:29.873624  8069 raft_consensus.cc:2955] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:14:29.876170  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 84049.8us
W20260709 13:14:29.877380  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 93956.6us
I20260709 13:14:29.882030  6324 raft_consensus.cc:2955] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:29.891672  6404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36156
I20260709 13:14:29.910778  6251 consensus_queue.cc:237] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:29.913887  6941 raft_consensus.cc:2955] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:29.931115  8050 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:29.935681  6404 raft_consensus.cc:606] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:14:29.940753  6253 raft_consensus.cc:2955] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:29.940526  6247 raft_consensus.cc:2955] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:29.947129  6939 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:29.948789  7954 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:29.953315  6154 catalog_manager.cc:5697] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:29.955629  6154 catalog_manager.cc:5697] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:29.958302  6404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36156
I20260709 13:14:29.958750  6254 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:29.958863  6404 raft_consensus.cc:606] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:14:29.959923  7954 raft_consensus.cc:993] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:14:29.960527  8074 raft_consensus.cc:1081] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Signalling peer 8600a3fead0e48a7aa813822ec44d0fe to start an election
W20260709 13:14:29.961730  6140 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for bade3854ad1b4b2492dd0ecd47e1398b already in progress
I20260709 13:14:29.961961  7959 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:29.965013  6939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:58276
I20260709 13:14:29.965898  6939 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:29.966799  6939 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:29.973065  6939 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:29.979382  6404 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:29.980932  8056 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:29.985513  6941 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:29.990598  8042 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:29.992689  8015 raft_consensus.cc:2955] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:29.997946  6404 consensus_queue.cc:237] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:29.999835  6396 raft_consensus.cc:2955] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.004699  6401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36156
I20260709 13:14:30.007154  6404 consensus_queue.cc:237] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:30.007946  6401 raft_consensus.cc:606] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Received request to transfer leadership
W20260709 13:14:30.009469  6296 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.4.254.62:46653, user_credentials={real_user=slave}} blocked reactor thread for 73408us
I20260709 13:14:30.014081  6937 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:30.005882  6935 raft_consensus.cc:2955] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.016901  7959 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:30.027370  6254 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:30.031376  7959 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:30.045261  7954 raft_consensus.cc:2955] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:14:30.049734  6202 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:14:30.050230  6202 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for bade3854ad1b4b2492dd0ecd47e1398b already in progress
W20260709 13:14:30.050515  6202 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for bade3854ad1b4b2492dd0ecd47e1398b already in progress
I20260709 13:14:30.051019  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cbc89cb8d0e64feba7a58705d738d699 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:30.055871  6251 raft_consensus.cc:2955] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.060813  6941 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:30.062873  8074 consensus_queue.cc:1059] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:30.086823  7954 raft_consensus.cc:3055] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:30.087390  7954 raft_consensus.cc:740] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:30.088382  7954 consensus_queue.cc:260] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:30.091661  8050 raft_consensus.cc:2955] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.098948  6941 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:14:30.100620  6937 raft_consensus.cc:2955] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.132939  8091 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:30.138983  6140 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1230017e50f4469992de6002ca8cd7b6 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:30.107929  6247 raft_consensus.cc:2955] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.109767  6154 catalog_manager.cc:5697] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 2 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:30.112011  6324 raft_consensus.cc:2955] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.114394  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:30.142956  6251 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:30.144217  8069 raft_consensus.cc:2955] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.149688  6251 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:30.152186  6941 raft_consensus.cc:2955] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.114871  6939 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:30.115981  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:30.116511  6322 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:30.158352  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:30.163877  6323 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:30.164449  7954 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:30.182611  6322 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:14:30.199510  6140 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ad52cf302674a048c4b3a989596b435 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:30.200953  6151 catalog_manager.cc:5697] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 3 to 4, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New cstate: current_term: 1 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.212654  6323 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:30.218573  8092 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:14:30.223345  6905 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:30.224458  8026 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:30.224936  8026 raft_consensus.cc:697] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:30.225831  8026 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:30.237341  6323 raft_consensus.cc:2955] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.256549  6399 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:30.258350  6317 tablet_service.cc:1558] Processing DeleteTablet for tablet cbc89cb8d0e64feba7a58705d738d699 with delete_type TABLET_DATA_TOMBSTONED (TS a13ffe92eb374309a5c8476d9fbbb2b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57216
I20260709 13:14:30.282171  8095 tablet_replica.cc:333] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:14:30.261646  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:30.290480  6151 catalog_manager.cc:5697] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 6 to 7, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 6 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.293277  8095 raft_consensus.cc:2243] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:30.296340  8095 raft_consensus.cc:2272] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:30.300335  6151 catalog_manager.cc:5697] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 4 to 2, term changed from 2 to 3, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from VOTER to NON_VOTER, now has a pending config: VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1), VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2), VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3), VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 3 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.388602  8095 ts_tablet_manager.cc:1916] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:30.390851  6251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:30.391505  6251 raft_consensus.cc:606] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:30.413451  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ad52cf302674a048c4b3a989596b435 with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:49990
I20260709 13:14:30.425201  6150 catalog_manager.cc:5697] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index 5 to 6, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.426788  6150 catalog_manager.cc:5697] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index 2 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1), VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2), VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3), VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 3 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.435119  8095 ts_tablet_manager.cc:1929] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:30.461086  8095 log.cc:1199] T cbc89cb8d0e64feba7a58705d738d699 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/wals/cbc89cb8d0e64feba7a58705d738d699
I20260709 13:14:30.454550  6327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:30.462991  6327 raft_consensus.cc:606] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:30.462946  6138 catalog_manager.cc:5028] TS a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): tablet cbc89cb8d0e64feba7a58705d738d699 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:30.466051  6399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:14:30.466620  6399 raft_consensus.cc:606] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Received request to transfer leadership to TS 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:30.469897  6327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:30.470438  6327 raft_consensus.cc:606] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:30.478577  6251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:30.479272  6251 raft_consensus.cc:606] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Received request to transfer leadership to TS 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:30.480585  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:30.482344  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:30.501448  6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 1230017e50f4469992de6002ca8cd7b6 with delete_type TABLET_DATA_TOMBSTONED (TS a13ffe92eb374309a5c8476d9fbbb2b8 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:57216
I20260709 13:14:30.502446  8095 tablet_replica.cc:333] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:14:30.503259  8095 raft_consensus.cc:2243] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:30.503953  8095 raft_consensus.cc:2272] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:30.507455  8095 ts_tablet_manager.cc:1916] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:30.524921  8095 ts_tablet_manager.cc:1929] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:14:30.525401  8095 log.cc:1199] T 1230017e50f4469992de6002ca8cd7b6 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/wals/1230017e50f4469992de6002ca8cd7b6
I20260709 13:14:30.527048  6138 catalog_manager.cc:5028] TS a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): tablet 1230017e50f4469992de6002ca8cd7b6 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:30.533505  8096 tablet_replica.cc:333] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:14:30.540220  8096 raft_consensus.cc:2243] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:30.541186  8096 raft_consensus.cc:2272] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:30.548924  8096 ts_tablet_manager.cc:1916] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:30.554286  7948 raft_consensus.cc:993] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:30.554831  7948 raft_consensus.cc:1081] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:30.556977  6251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:30.557613  6251 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:30.558029  6251 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:30.565840  6251 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:30.578814  8096 ts_tablet_manager.cc:1929] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:14:30.585853  8096 log.cc:1199] T 4ad52cf302674a048c4b3a989596b435 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/4ad52cf302674a048c4b3a989596b435
I20260709 13:14:30.585791  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:30.586583  6327 raft_consensus.cc:3055] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:30.586905  6327 raft_consensus.cc:740] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:30.587776  6251 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:30.587726  6327 consensus_queue.cc:260] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:30.589360  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet 4ad52cf302674a048c4b3a989596b435 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:30.589478  6327 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:30.592644  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:30.593300  6399 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:30.601323  6399 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:30.602797  6221 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:30.603832  8031 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:30.604367  8031 raft_consensus.cc:697] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:30.605399  8031 consensus_queue.cc:237] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:30.611748  6327 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:30.635214  8092 raft_consensus.cc:993] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:14:30.636083  8092 raft_consensus.cc:1081] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Signalling peer 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:14:30.637989  6939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:58276
I20260709 13:14:30.638516  6939 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:30.638856  6939 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:30.646641  6939 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:30.648825  6939 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:30.649976  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:30.650573  6399 raft_consensus.cc:3055] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:30.650862  6399 raft_consensus.cc:740] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:30.651567  6399 consensus_queue.cc:260] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:30.652645  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:30.653281  6253 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:30.652688  6399 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:30.663164  6253 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:14:30.663556  6399 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:14:30.664742  6906 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:30.665632  8081 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:30.666111  8081 raft_consensus.cc:697] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:30.667032  8081 consensus_queue.cc:237] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:30.671032  6150 catalog_manager.cc:5697] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 4, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.693042  6150 catalog_manager.cc:5697] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 3 to 4, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 4 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:30.807641  7948 raft_consensus.cc:993] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:30.808151  7948 raft_consensus.cc:1081] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:30.812619  6253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:30.813192  6253 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:30.814643  6253 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.819058  6396 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:30.823367  8026 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:30.824458  6327 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:30.825855  8081 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:30.844250  8053 raft_consensus.cc:993] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:14:30.844730  8053 raft_consensus.cc:1081] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Signalling peer 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:14:30.846510  6939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:41298
I20260709 13:14:30.847187  6939 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:30.847592  6939 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:30.854753  6939 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:30.857066  6254 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:30.890040  8081 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:14:30.915407  8081 raft_consensus.cc:2955] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:30.934495  6939 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:30.964214  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:30.975736  6327 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:31.001895  6323 raft_consensus.cc:2955] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:31.020453  8032 raft_consensus.cc:993] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:31.021184  8015 raft_consensus.cc:1081] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:31.027654  6253 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:31.029855  6253 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:31.030452  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:31.031072  6331 raft_consensus.cc:3055] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.031358  6331 raft_consensus.cc:740] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:31.032061  6331 consensus_queue.cc:260] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:31.033341  6331 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.036392  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:31.036918  6939 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.046164  6331 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:31.048305  6219 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:31.058211  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:31.058873  6251 raft_consensus.cc:3055] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:31.059168  6251 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:31.059870  6251 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:31.060950  6251 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:31.072732  6327 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:31.078909  6322 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:31.081588  6905 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:31.083487  8049 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:31.083968  8049 raft_consensus.cc:697] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:31.084069  6941 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:31.084827  8049 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:31.086571  6939 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:31.096853  6397 raft_consensus.cc:1275] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:31.097865  6397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:31.098362  6397 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:31.098703  6397 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:31.109210  6322 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:31.049971  8031 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.077399  6251 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:31.111483  8031 raft_consensus.cc:697] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:31.113185  8081 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:31.117296  8031 consensus_queue.cc:237] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:31.121580  6397 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:31.125595  8026 raft_consensus.cc:2955] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:31.130667  6253 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:31.132917  6397 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:31.134771  6327 raft_consensus.cc:2955] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:31.135622  8032 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:31.136838  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:31.156479  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:31.157296  6253 raft_consensus.cc:3055] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:31.157716  6253 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:31.163105  6253 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:31.164762  6253 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:31.164376  6397 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:31.162551  6322 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:31.191504  6253 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:31.193045  6369 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:31.199810  8110 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:14:31.205952  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 43744.3us
I20260709 13:14:31.209208  6251 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:31.210683  6150 catalog_manager.cc:5697] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.215215  6327 raft_consensus.cc:1275] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:31.207453  7959 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:31.218959  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 51730.7us
I20260709 13:14:31.220374  6153 catalog_manager.cc:5697] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 4 to 6, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New cstate: current_term: 3 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:31.206530  8111 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:14:31.239233  8112 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:31.246095  8101 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.073s	user 0.004s	sys 0.000s
I20260709 13:14:31.246012  6154 catalog_manager.cc:5697] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 4 to 5, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 5 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:31.223414  7959 raft_consensus.cc:697] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:14:31.281787  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 78578.2us
I20260709 13:14:31.218502  8109 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:14:31.288385  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 74114.5us
W20260709 13:14:31.285408  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 70683.2us
W20260709 13:14:31.300246  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 65887.9us
I20260709 13:14:31.306545  6322 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:31.307489  7959 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:31.307826  6141 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bade3854ad1b4b2492dd0ecd47e1398b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:14:31.356971  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 59737.5us
I20260709 13:14:31.395814  6151 catalog_manager.cc:5697] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 4, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 4 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:31.377939  6254 raft_consensus.cc:2955] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:31.483400  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:31.538293  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 44492.5us
W20260709 13:14:31.565717  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 132827us
W20260709 13:14:31.650269  8128 log.cc:927] Time spent T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.072s	user 0.002s	sys 0.002s
I20260709 13:14:31.652762  6939 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:14:31.657701  8129 log.cc:927] Time spent T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:14:31.665649  8130 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:14:31.666445  8132 log.cc:927] Time spent T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:14:31.673518  6322 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:14:31.674540  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 140400us
I20260709 13:14:31.686506  8081 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:14:31.690900  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 149983us
I20260709 13:14:31.687683  6254 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:14:31.763607  8112 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:31.829044  6323 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:31.830859  8109 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:31.831352  6391 tablet_service.cc:1558] Processing DeleteTablet for tablet bade3854ad1b4b2492dd0ecd47e1398b with delete_type TABLET_DATA_TOMBSTONED (TS b940f12ed61a49c4b3c11f13ef50fa92 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36156
I20260709 13:14:31.836665  6253 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:31.862988  8142 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:14:31.896850  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 50437.7us
W20260709 13:14:31.904145  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 60055.1us
I20260709 13:14:31.914199  8153 tablet_replica.cc:333] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:14:31.915424  8153 raft_consensus.cc:2243] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.916165  8153 raft_consensus.cc:2272] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.927426  6329 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:31.946628  8143 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:31.950790  8153 ts_tablet_manager.cc:1916] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:32.048977  8153 ts_tablet_manager.cc:1929] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:14:32.049516  8153 log.cc:1199] T bade3854ad1b4b2492dd0ecd47e1398b P b940f12ed61a49c4b3c11f13ef50fa92: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/wals/bade3854ad1b4b2492dd0ecd47e1398b
I20260709 13:14:32.053655  6329 consensus_queue.cc:237] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:32.059612  6140 catalog_manager.cc:5028] TS b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): tablet bade3854ad1b4b2492dd0ecd47e1398b (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:32.098531  6400 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:32.101938  8115 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:14:32.104513  6297 consensus_peers.cc:597] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2c1e4f96c604cc898081f72ae4eacf2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.105934  6253 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:32.108954  8114 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:32.124920  8114 raft_consensus.cc:2955] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:32.134533  6253 raft_consensus.cc:2955] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:32.205664  6253 consensus_queue.cc:237] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:32.205724  6401 raft_consensus.cc:2955] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:32.210642  6151 catalog_manager.cc:5697] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 5 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
W20260709 13:14:32.234511  6222 consensus_peers.cc:597] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2b0ed24d02e419bb6f1e4b24f0bcff5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.273011  6329 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:32.274801  8053 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:32.295040  6401 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:32.299197  8015 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:32.417590  8139 raft_consensus.cc:2955] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:32.442953  6323 raft_consensus.cc:2955] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:32.461696  6401 raft_consensus.cc:2955] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:32.468532  6153 catalog_manager.cc:5697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:32.473551  6329 consensus_queue.cc:237] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:32.488873  6401 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:32.490586  8120 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:32.493507  6297 consensus_peers.cc:597] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47b0eafc00f84cdab5bdb591a10c058d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.494077  6247 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:32.502526  8114 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:14:32.537830  8114 raft_consensus.cc:2955] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:32.564810  6247 raft_consensus.cc:2955] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:32.573834  6253 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:32.573956  6396 raft_consensus.cc:2955] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:32.598260  6396 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:14:32.601328  6222 consensus_peers.cc:597] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 334e41443e364890b884c69082b3bb30. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.603581  6323 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:32.597203  6153 catalog_manager.cc:5697] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index -1 to 2, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:32.604791  8139 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:32.606844  8032 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:32.636773  8032 raft_consensus.cc:2955] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:32.638783  6400 raft_consensus.cc:2955] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:32.642901  6329 raft_consensus.cc:2955] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:32.658710  6151 catalog_manager.cc:5697] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:32.716830  8173 ts_tablet_manager.cc:933] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:32.738219  8173 tablet_copy_client.cc:323] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.2:39965
I20260709 13:14:32.740021  6341 tablet_copy_service.cc:140] P a13ffe92eb374309a5c8476d9fbbb2b8: Received BeginTabletCopySession request for tablet c2c1e4f96c604cc898081f72ae4eacf2 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41502)
I20260709 13:14:32.740579  6341 tablet_copy_service.cc:161] P a13ffe92eb374309a5c8476d9fbbb2b8: Beginning new tablet copy session on tablet c2c1e4f96c604cc898081f72ae4eacf2 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41502: session id = 8600a3fead0e48a7aa813822ec44d0fe-c2c1e4f96c604cc898081f72ae4eacf2
I20260709 13:14:32.748513  6341 tablet_copy_source_session.cc:215] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:32.754330  8173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c1e4f96c604cc898081f72ae4eacf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.771373  8173 tablet_copy_client.cc:806] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:32.772009  8173 tablet_copy_client.cc:670] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:32.775336  8173 tablet_copy_client.cc:538] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:32.782713  8173 tablet_bootstrap.cc:492] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:32.820991  8173 tablet_bootstrap.cc:492] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:32.821935  8173 tablet_bootstrap.cc:492] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:32.822616  8173 ts_tablet_manager.cc:1403] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.016s
I20260709 13:14:32.828338  8173 raft_consensus.cc:359] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:32.829272  8173 raft_consensus.cc:740] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:32.829973  8173 consensus_queue.cc:260] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:32.832649  8173 ts_tablet_manager.cc:1434] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:14:32.834375  6341 tablet_copy_service.cc:342] P a13ffe92eb374309a5c8476d9fbbb2b8: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-c2c1e4f96c604cc898081f72ae4eacf2 received from {username='slave'} at 127.0.0.1:41502
I20260709 13:14:32.834800  6341 tablet_copy_service.cc:434] P a13ffe92eb374309a5c8476d9fbbb2b8: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-c2c1e4f96c604cc898081f72ae4eacf2 on tablet c2c1e4f96c604cc898081f72ae4eacf2 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:32.837646  8173 ts_tablet_manager.cc:933] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:32.864169  8173 tablet_copy_client.cc:323] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:14:32.873749  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet b2b0ed24d02e419bb6f1e4b24f0bcff5 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:14:32.874490  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet b2b0ed24d02e419bb6f1e4b24f0bcff5 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-b2b0ed24d02e419bb6f1e4b24f0bcff5
I20260709 13:14:32.888213  6265 tablet_copy_source_session.cc:215] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:32.903091  8173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b0ed24d02e419bb6f1e4b24f0bcff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.937292  8173 tablet_copy_client.cc:806] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:32.937867  8173 tablet_copy_client.cc:670] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:32.942564  8173 tablet_copy_client.cc:538] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:32.951925  8173 tablet_bootstrap.cc:492] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:32.986308  8173 tablet_bootstrap.cc:492] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:32.987314  8173 tablet_bootstrap.cc:492] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:32.988597  8173 ts_tablet_manager.cc:1403] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.005s
I20260709 13:14:32.990942  8176 ts_tablet_manager.cc:933] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:32.991765  8173 raft_consensus.cc:359] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:32.992647  8173 raft_consensus.cc:740] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:32.993532  8173 consensus_queue.cc:260] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:32.996390  8173 ts_tablet_manager.cc:1434] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:33.005592  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-b2b0ed24d02e419bb6f1e4b24f0bcff5 received from {username='slave'} at 127.0.0.1:38692
I20260709 13:14:33.005878  8176 tablet_copy_client.cc:323] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:14:33.006027  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-b2b0ed24d02e419bb6f1e4b24f0bcff5 on tablet b2b0ed24d02e419bb6f1e4b24f0bcff5 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:33.009260  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet 334e41443e364890b884c69082b3bb30 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:14:33.009815  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet 334e41443e364890b884c69082b3bb30 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-334e41443e364890b884c69082b3bb30
I20260709 13:14:33.021624  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:33.023211  6265 tablet_copy_source_session.cc:215] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:33.032682  8176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334e41443e364890b884c69082b3bb30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.074563  8176 tablet_copy_client.cc:806] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:33.075196  8176 tablet_copy_client.cc:670] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:33.082454  8176 tablet_copy_client.cc:538] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:33.087627  8173 ts_tablet_manager.cc:933] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:33.088866  6253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:33.089510  6253 raft_consensus.cc:606] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:33.091051  8173 tablet_copy_client.cc:323] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.2:39965
I20260709 13:14:33.093428  6341 tablet_copy_service.cc:140] P a13ffe92eb374309a5c8476d9fbbb2b8: Received BeginTabletCopySession request for tablet 47b0eafc00f84cdab5bdb591a10c058d from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41502)
I20260709 13:14:33.094029  6341 tablet_copy_service.cc:161] P a13ffe92eb374309a5c8476d9fbbb2b8: Beginning new tablet copy session on tablet 47b0eafc00f84cdab5bdb591a10c058d from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41502: session id = 8600a3fead0e48a7aa813822ec44d0fe-47b0eafc00f84cdab5bdb591a10c058d
I20260709 13:14:33.099706  6253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:33.100281  6253 raft_consensus.cc:606] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:33.102685  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:33.104236  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:33.106132  8176 tablet_bootstrap.cc:492] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:33.119176  6341 tablet_copy_source_session.cc:215] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:33.186496  6937 raft_consensus.cc:1217] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 13:14:33.311566  6937 raft_consensus.cc:1217] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:14:33.382388  8173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b0eafc00f84cdab5bdb591a10c058d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:33.589239  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 56668.8us
I20260709 13:14:33.596468  8173 tablet_copy_client.cc:806] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:33.597034  8173 tablet_copy_client.cc:670] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
W20260709 13:14:33.702646  8176 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.133s	sys 0.307s
W20260709 13:14:33.703012  8176 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.133s	sys 0.307s
I20260709 13:14:33.712059  8190 raft_consensus.cc:1064] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:33.713585  8176 tablet_bootstrap.cc:492] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:33.715724  8176 tablet_bootstrap.cc:492] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:33.715703  8190 consensus_queue.cc:237] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:33.730284  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 125307us
I20260709 13:14:33.731729  8176 ts_tablet_manager.cc:1403] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.626s	user 0.153s	sys 0.311s
W20260709 13:14:33.732532  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 109510us
I20260709 13:14:33.736071  8176 raft_consensus.cc:359] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
W20260709 13:14:33.756451  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 133110us
I20260709 13:14:33.744443  8176 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:33.766455  8137 raft_consensus.cc:993] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:33.766059  8176 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:33.767017  8015 raft_consensus.cc:1081] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:14:33.768775  8176 ts_tablet_manager.cc:1434] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.037s	user 0.000s	sys 0.006s
I20260709 13:14:33.803404  6937 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:33.807015  8200 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:33.813838  8173 tablet_copy_client.cc:538] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:33.822791  8173 tablet_bootstrap.cc:492] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:33.832325  6403 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:33.846863  6403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:14:33.847518  6403 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:33.847927  6403 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:33.860138  6403 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:33.865339  6403 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:33.873879  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:33.874456  6939 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:33.876224  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:33.876772  6247 raft_consensus.cc:3055] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:33.935284  6247 raft_consensus.cc:740] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:33.937095  6247 consensus_queue.cc:260] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:33.937445  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-334e41443e364890b884c69082b3bb30 received from {username='slave'} at 127.0.0.1:38692
I20260709 13:14:33.941581  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-334e41443e364890b884c69082b3bb30 on tablet 334e41443e364890b884c69082b3bb30 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:33.943203  6939 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:33.943907  6935 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:33.947288  8190 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:14:33.953979  6371 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:33.952910  8191 raft_consensus.cc:1064] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:33.957978  8191 consensus_queue.cc:237] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:33.960737  8196 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:33.947479  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 73148us
I20260709 13:14:33.961278  8196 raft_consensus.cc:697] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:33.970039  8196 consensus_queue.cc:237] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:33.945066  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 51302.8us
I20260709 13:14:33.997386  6251 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:34.014225  6937 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:34.014882  6939 raft_consensus.cc:1217] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:34.014792  8185 consensus_queue.cc:1059] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:34.016469  8137 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:34.017306  6247 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:34.036752  8191 raft_consensus.cc:993] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:34.037390  8137 raft_consensus.cc:1081] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:34.044762  8173 tablet_bootstrap.cc:492] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:34.045703  8173 tablet_bootstrap.cc:492] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:34.046098  6323 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:34.046340  8173 ts_tablet_manager.cc:1403] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.224s	user 0.020s	sys 0.026s
I20260709 13:14:34.049012  6403 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:34.049340  6323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57230
I20260709 13:14:34.049036  8173 raft_consensus.cc:359] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:34.050127  8173 raft_consensus.cc:740] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:34.050194  6323 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:34.050684  6323 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:34.050794  8173 consensus_queue.cc:260] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:34.052019  8190 raft_consensus.cc:2955] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.056453  8173 ts_tablet_manager.cc:1434] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:14:34.059345  8192 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:34.072012  6939 raft_consensus.cc:2955] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.075673  6341 tablet_copy_service.cc:342] P a13ffe92eb374309a5c8476d9fbbb2b8: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-47b0eafc00f84cdab5bdb591a10c058d received from {username='slave'} at 127.0.0.1:41502
I20260709 13:14:34.076148  6341 tablet_copy_service.cc:434] P a13ffe92eb374309a5c8476d9fbbb2b8: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-47b0eafc00f84cdab5bdb591a10c058d on tablet 47b0eafc00f84cdab5bdb591a10c058d with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:34.079666  8203 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:34.085043  6403 raft_consensus.cc:2955] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.090678  6151 catalog_manager.cc:5697] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 4, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 4 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:34.095383  6323 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:34.096568  6154 catalog_manager.cc:5697] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:14:34.100315  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.105090  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:34.120469  6247 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:34.121387  6323 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:34.122597  8191 raft_consensus.cc:2955] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.131701  6323 raft_consensus.cc:2955] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.145251  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:34.145964  6403 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:34.153083  6403 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:14:34.156702  8185 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:34.159646  6939 raft_consensus.cc:2955] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.162209  6296 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:34.163065  8203 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:34.163691  8203 raft_consensus.cc:697] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:34.164451  8203 consensus_queue.cc:237] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:34.196694  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:34.197360  6247 raft_consensus.cc:3055] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:34.197747  6247 raft_consensus.cc:740] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:34.198514  6247 consensus_queue.cc:260] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:34.206037  6247 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:34.215631  6252 raft_consensus.cc:2955] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.218570  6403 raft_consensus.cc:2955] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.225675  6247 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:14:34.239290  6150 catalog_manager.cc:5697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.276700  6327 consensus_queue.cc:237] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:34.290302  6403 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:34.291237  6937 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:34.291638  8203 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:34.294387  8200 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:34.318209  8203 raft_consensus.cc:2955] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.320235  6403 raft_consensus.cc:2955] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.333954  6937 raft_consensus.cc:2955] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.343045  6939 raft_consensus.cc:1217] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:34.350672  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c2c1e4f96c604cc898081f72ae4eacf2 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:34.357270  6150 catalog_manager.cc:5697] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 4 to 5, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 5 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:34.365185  6153 catalog_manager.cc:5697] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 6 to 7, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 5 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.390672  6935 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:34.392765  8199 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:34.413316  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet c2c1e4f96c604cc898081f72ae4eacf2 with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:49990
I20260709 13:14:34.444828  8221 tablet_replica.cc:333] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:14:34.458257  8221 raft_consensus.cc:2243] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:34.458927  6247 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:34.463874  8142 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:34.459213  8221 raft_consensus.cc:2272] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:34.474529  8221 ts_tablet_manager.cc:1916] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:34.503479  8221 ts_tablet_manager.cc:1929] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 13:14:34.504835  8221 log.cc:1199] T c2c1e4f96c604cc898081f72ae4eacf2 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/c2c1e4f96c604cc898081f72ae4eacf2
I20260709 13:14:34.507498  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet c2c1e4f96c604cc898081f72ae4eacf2 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:34.602727  6403 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:14:34.604283  8190 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:34.659049  6247 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:14:34.672395  8017 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:34.676684  8192 raft_consensus.cc:1064] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:34.679276  8192 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:34.701574  6935 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:34.703233  8185 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:34.710794  6402 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:34.711515  6327 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:34.713066  8185 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:14:34.718015  8192 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:34.746869  6323 raft_consensus.cc:2955] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.744513  8192 raft_consensus.cc:2955] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.763939  6150 catalog_manager.cc:5697] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.764261  6935 raft_consensus.cc:2955] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.768115  6402 raft_consensus.cc:2955] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.826028  6252 consensus_queue.cc:237] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:34.840637  6935 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:34.843031  8185 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:34.850350  6403 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:34.852910  8191 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:34.850060  6251 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:34.863065  8185 raft_consensus.cc:2955] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.873320  6935 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:34.875850  6327 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:34.878991  8233 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:34.882266  8192 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:14:34.891683  6402 raft_consensus.cc:2955] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.911134  6327 raft_consensus.cc:2955] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.915727  6150 catalog_manager.cc:5697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.918627  8235 raft_consensus.cc:2955] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:34.921708  8190 raft_consensus.cc:1064] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:34.924531  8190 consensus_queue.cc:237] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:34.943915  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b2b0ed24d02e419bb6f1e4b24f0bcff5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:34.954492  6937 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:34.956606  8200 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:34.981554  6402 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:34.997473  8190 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:35.009711  6153 catalog_manager.cc:5697] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:35.015558  6317 tablet_service.cc:1558] Processing DeleteTablet for tablet b2b0ed24d02e419bb6f1e4b24f0bcff5 with delete_type TABLET_DATA_TOMBSTONED (TS a13ffe92eb374309a5c8476d9fbbb2b8 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:57216
I20260709 13:14:35.024024  6935 raft_consensus.cc:2955] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:35.029387  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 334e41443e364890b884c69082b3bb30 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:14:35.029834  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 83982.4us
I20260709 13:14:35.024024  6941 raft_consensus.cc:2955] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:35.057696  6391 tablet_service.cc:1558] Processing DeleteTablet for tablet 334e41443e364890b884c69082b3bb30 with delete_type TABLET_DATA_TOMBSTONED (TS b940f12ed61a49c4b3c11f13ef50fa92 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36156
I20260709 13:14:35.075054  6252 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:35.095204  8244 tablet_replica.cc:333] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:14:35.097009  8244 raft_consensus.cc:2243] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:35.100746  8244 raft_consensus.cc:2272] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:35.103169  8200 raft_consensus.cc:2955] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:35.118981  8017 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:35.131412  8244 ts_tablet_manager.cc:1916] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:35.113855  6402 raft_consensus.cc:2955] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:35.132558  8245 tablet_replica.cc:333] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:14:35.143033  8245 raft_consensus.cc:2243] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:35.144416  8245 raft_consensus.cc:2272] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:35.178817  6937 raft_consensus.cc:2955] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:35.179023  6153 catalog_manager.cc:5697] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:35.196877  6252 raft_consensus.cc:2955] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:35.209818  8244 ts_tablet_manager.cc:1929] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:14:35.210430  8244 log.cc:1199] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/wals/b2b0ed24d02e419bb6f1e4b24f0bcff5
I20260709 13:14:35.212867  8245 ts_tablet_manager.cc:1916] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:35.221971  6138 catalog_manager.cc:5028] TS a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): tablet b2b0ed24d02e419bb6f1e4b24f0bcff5 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:35.238682  8245 ts_tablet_manager.cc:1929] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:14:35.244441  8245 log.cc:1199] T 334e41443e364890b884c69082b3bb30 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/wals/334e41443e364890b884c69082b3bb30
I20260709 13:14:35.246168  6140 catalog_manager.cc:5028] TS b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): tablet 334e41443e364890b884c69082b3bb30 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:35.351066  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:35.457489  6327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:35.458086  6327 raft_consensus.cc:606] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:35.461460  6402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:14:35.462065  6402 raft_consensus.cc:606] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:35.468377  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:35.469689  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:35.660382  8142 raft_consensus.cc:993] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:35.660910  8142 raft_consensus.cc:1081] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:35.662492  6323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57226
I20260709 13:14:35.662928  6323 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:35.663213  6323 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:35.669950  6323 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:35.672173  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:35.672803  6251 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:35.677400  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:35.677982  6403 raft_consensus.cc:3055] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:35.678251  6403 raft_consensus.cc:740] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:35.678964  6403 consensus_queue.cc:260] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:35.679979  6403 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:35.689114  6323 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:35.691612  6403 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:14:35.692960  6296 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:35.694516  8246 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:35.695003  8246 raft_consensus.cc:697] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:35.695785  8246 consensus_queue.cc:237] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:35.717401  6251 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:14:35.709792  6323 consensus_queue.cc:237] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:35.732831  6937 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:35.734385  8246 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:35.738160  6150 catalog_manager.cc:5697] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 4 to 5, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 5 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.743211  8190 raft_consensus.cc:2955] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:35.747141  6251 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:35.750037  8017 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:35.752836  6935 raft_consensus.cc:2955] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:35.760689  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 47b0eafc00f84cdab5bdb591a10c058d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:35.770090  6251 raft_consensus.cc:2955] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:35.805680  6153 catalog_manager.cc:5697] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index 3 to 4, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New cstate: current_term: 1 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:35.829895  6391 tablet_service.cc:1558] Processing DeleteTablet for tablet 47b0eafc00f84cdab5bdb591a10c058d with delete_type TABLET_DATA_TOMBSTONED (TS b940f12ed61a49c4b3c11f13ef50fa92 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36156
I20260709 13:14:35.850428  8253 tablet_replica.cc:333] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:14:35.853343  8253 raft_consensus.cc:2243] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:35.854027  8253 raft_consensus.cc:2272] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:35.856834  8253 ts_tablet_manager.cc:1916] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:35.871217  8253 ts_tablet_manager.cc:1929] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:35.871556  8253 log.cc:1199] T 47b0eafc00f84cdab5bdb591a10c058d P b940f12ed61a49c4b3c11f13ef50fa92: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/wals/47b0eafc00f84cdab5bdb591a10c058d
I20260709 13:14:35.873029  6140 catalog_manager.cc:5028] TS b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): tablet 47b0eafc00f84cdab5bdb591a10c058d (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:14:36.042492  8190 raft_consensus.cc:993] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:36.043125  8246 raft_consensus.cc:1081] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:14:36.044644  6247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:14:36.045164  6247 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:36.045526  6247 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.052158  6247 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:14:36.055593  6247 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:36.058890  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:36.059437  6403 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.062433  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:36.063110  6331 raft_consensus.cc:3055] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:36.063393  6331 raft_consensus.cc:740] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:36.064163  6331 consensus_queue.cc:260] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:14:36.066124  6331 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.067621  6403 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:36.069578  6221 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:36.070295  8185 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:36.070766  8185 raft_consensus.cc:697] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:36.071630  8185 consensus_queue.cc:237] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:14:36.072625  6331 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:36.082376  6150 catalog_manager.cc:5697] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.196584  6403 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:36.197803  8017 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:36.226884  6247 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:36.229583  8190 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:36.469944  6331 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:36.470638  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:36.471369  8185 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.511269  6402 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:36.522541  8241 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.913350  6403 consensus_queue.cc:237] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:36.942799  6327 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:36.945056  8260 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:36.947849  6247 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:14:36.948655  6371 consensus_peers.cc:597] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4bc84db94ed44cf9bab11e4626d2ba6e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:36.952067  8199 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:36.958256  8196 raft_consensus.cc:2955] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:36.960857  6323 raft_consensus.cc:2955] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:37.003480  6150 catalog_manager.cc:5697] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 4 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:37.022419  6252 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
W20260709 13:14:37.050792  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 44240.8us
W20260709 13:14:37.057883  6222 consensus_peers.cc:597] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19435892007a4e0a9b2b4d0b26ccd0c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:37.063220  6402 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:37.063539  6327 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:37.065625  8185 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:37.067431  8185 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:37.073711  6247 raft_consensus.cc:2955] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:37.112315  8273 raft_consensus.cc:2955] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:37.118636  6323 raft_consensus.cc:2955] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:37.132031  6252 consensus_queue.cc:237] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:37.139741  6403 raft_consensus.cc:2955] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:37.145224  6150 catalog_manager.cc:5697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index -1 to 4, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
W20260709 13:14:37.170676  6222 consensus_peers.cc:597] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b91f0c50e2de47c299569a0a5d7af6b8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:37.173322  6403 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:37.174485  6323 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:37.179994  8185 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:37.182088  8274 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:37.214506  8273 raft_consensus.cc:2955] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:37.216224  6323 raft_consensus.cc:2955] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:37.290237  6402 consensus_queue.cc:237] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
W20260709 13:14:37.297534  6371 consensus_peers.cc:597] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3c8c870200141efa8a5f7cc58ece4a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:37.337109  6252 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:37.346097  8196 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:37.366175  8285 ts_tablet_manager.cc:933] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:37.373085  6252 raft_consensus.cc:2955] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:37.365862  8269 raft_consensus.cc:2955] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:37.334059  6153 catalog_manager.cc:5697] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:37.337579  6323 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:37.594044  8285 tablet_copy_client.cc:323] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.3:34111
I20260709 13:14:37.594669  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:39.354660  8290 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:39.355365  8290 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.361040  8290 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:39.361694  8290 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:39.379027  8290 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.382342  8290 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:39.385020  8290 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:39.385740  8290 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.387919  8290 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:39.382787  8293 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:39.384203  8292 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:39.390590  8292 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.393611  8292 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:39.394779  8293 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:39.399297  8293 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:39.405794  8293 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:39.410517  8293 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.428622  8299 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:39.429863  8299 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:39.461386  8299 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:39.466019  8290 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:39.467620  8295 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:39.467841  8290 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.468295  8295 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.470893  8290 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:39.471114  8295 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:39.473043  8296 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:39.463119  8293 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:39.466010  8292 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:39.818107  8299 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:39.820740  8293 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:39.820678  8299 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:39.821406  8293 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.823243  8299 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:39.823777  8293 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:39.823745  8299 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:39.825356  8299 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:39.816955  8296 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:39.827000  8294 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:39.827710  8294 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:39.829586  8292 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.830273  8299 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:39.833766  8296 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:39.834059  8292 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:39.835675  8294 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:39.830602  8293 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:39.837781  8293 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:39.840178  8293 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:39.845446  8296 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:39.847402  8294 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:39.847762  8304 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:39.848349  8294 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.848551  8304 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:39.848384  6295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.452s	user 0.015s	sys 0.018s
W20260709 13:14:39.850426  6295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.454s	user 0.015s	sys 0.018s
W20260709 13:14:39.850768  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 2.45463e+06us
I20260709 13:14:39.851207  8304 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:39.852916  8304 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:39.846449  8296 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.853693  8304 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.856510  8296 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:39.862032  8301 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:39.862361  8302 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:39.862622  8293 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:39.863025  8301 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.865993  8301 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:39.866636  8301 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:39.867350  8301 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:39.858251  8294 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:39.850526  8298 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:39.863273  8293 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:39.871515  8293 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:39.872380  8298 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.873548  8302 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.885656  8302 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:39.857120  8304 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:39.879035  6252 consensus_meta.cc:287] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 2.502s	user 0.012s	sys 0.020s
I20260709 13:14:39.880329  8301 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:39.875252  8298 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:39.887358  8300 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:39.889487  8297 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:39.892773  8300 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.890847  8299 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:39.894464  8293 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:39.895104  8293 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:39.894222  8299 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:39.898321  6251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:39.899221  6251 raft_consensus.cc:606] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:39.899319  8304 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:39.899972  8304 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.901062  8296 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:39.901736  8296 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:39.901903  8307 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:39.893363  8297 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.924386  8297 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:39.926591  8299 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:39.904943  8294 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:39.937386  8291 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:39.935320  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1182) took 2566 ms. Trace:
I20260709 13:14:39.946044  8293 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.004142  8306 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.025547  8300 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.014757  8312 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.039224  8312 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:39.948024  8294 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.041935  8312 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.044056  8305 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.044692  8305 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.045235  8310 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.045846  8310 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.047245  8305 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.047820  8305 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.047969  8303 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.048358  8305 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.054296  8305 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:39.983287  8307 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.057996  8307 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.012969  8315 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.048753  8303 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.101819  8303 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.050585  8299 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.105660  8299 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:40.108527  8299 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.105005  8303 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.111042  8303 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.112241  8322 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.112881  8322 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.113871  8301 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.114423  8301 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.115478  8322 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.116499  8301 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.012801  8296 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.042964  8306 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.121536  8306 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.015368  8313 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.122378  8313 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:40.123075  8303 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.123667  8304 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.124270  8315 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.124801  8313 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.070462  8323 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.074416  8326 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.125602  8323 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.125736  8326 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.126763  8315 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.127892  8323 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.128253  8326 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.082065  8297 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.089883  8294 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.129531  8297 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.092938  8295 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.134987  8295 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.138407  8307 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.139091  8307 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.140164  8297 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.141433  8307 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:39.960460  8291 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:40.035506  6252 rpcz_store.cc:276] 0709 13:14:37.368285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.372242 (+  3957us) service_pool.cc:224] Handling call
0709 13:14:37.372662 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.372917 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:14:39.890259 (+2517342us) log.cc:844] Serialized 14 byte log entry
0709 13:14:39.933940 (+ 43681us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:39.933988 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:39.934023 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.934083 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:39.934185 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":902,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":1382,"thread_start_us":43205,"threads_started":1,"wal-append.queue_time_us":121129}
I20260709 13:14:40.076902  8292 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.148924  8292 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.153280  8302 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.153702  6150 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55326 (request call id 373) took 2760 ms. Trace:
I20260709 13:14:40.154031  8302 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.154121  6150 rpcz_store.cc:276] 0709 13:14:37.393646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.393890 (+   244us) service_pool.cc:224] Handling call
0709 13:14:39.986474 (+2592584us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b54002c15d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4f090 00007f4575bedf3a 00007f457b9a41cc 00007f457baa237e 00007f4579f632a4 00007f4579f63232 00007f4579f63161 00007f4579f630dc 00007f4579f62392 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:40.153526 (+167052us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26509,"reported_tablets":1,"spinlock_wait_cycles":5377408}
I20260709 13:14:40.151684  8292 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.156327  8302 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.156553  8291 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.158001  8311 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.158140  8308 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.159046  8290 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.158835  8308 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.159740  8317 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.159633  8290 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.160331  8317 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.161348  8190 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.161868  8190 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.162549  8317 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.163710  8190 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.164149  8308 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.165743  8190 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.158669  8311 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.166837  8264 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:14:40.141728  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 97372.7us
I20260709 13:14:40.167454  8264 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.168355  8311 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.168882  8311 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.169690  8264 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.169602  8311 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.170420  8190 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.170971  8290 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.166285  8313 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.148985  6153 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55342 (request call id 346) took 2822 ms. Trace:
I20260709 13:14:40.171049  8317 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.180473  8317 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.180948  8307 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.094362  8318 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.180773  8313 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.184849  8264 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.181689  8307 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.181844  8318 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.196529  8318 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.197934  8190 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.199117  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.199536  8190 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.199957  6941 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:14:40.200270  8190 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.201972  8313 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.177579  8308 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.147538  8295 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.186232  8294 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.203949  8308 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:40.204173  8294 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.206166  8308 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.185786  8317 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.190127  8302 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.173466  8320 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.207165  8302 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.207455  8320 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.208884  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.209753  8320 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.173518  8292 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.210778  8292 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.211651  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.212456  6251 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:40.191330  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.188349  8304 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.192210  8311 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.187304  8296 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.214152  8304 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.214851  8307 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.214613  8296 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.216434  8190 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.178495  6153 rpcz_store.cc:276] 0709 13:14:37.326754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.327596 (+   842us) service_pool.cc:224] Handling call
0709 13:14:40.148895 (+2821299us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:37.389674 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:37.390589 (+   915us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:37.390651 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:14:37.390685 (+    34us) tablet.cc:662] Decoding operations
0709 13:14:37.391264 (+   579us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:37.391372 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:37.391401 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:37.391766 (+   365us) tablet.cc:701] Row locks acquired
0709 13:14:37.391835 (+    69us) write_op.cc:260] PREPARE: finished
0709 13:14:37.392032 (+   197us) write_op.cc:270] Start()
0709 13:14:37.392212 (+   180us) write_op.cc:276] Timestamp: P: 1783602877391956 usec, L: 0
0709 13:14:37.392261 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 13:14:37.393028 (+   767us) log.cc:844] Serialized 591 byte log entry
0709 13:14:37.402754 (+  9726us) op_driver.cc:464] REPLICATION: finished
0709 13:14:37.403436 (+   682us) write_op.cc:301] APPLY: starting
0709 13:14:37.403580 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:37.403764 (+   184us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:37.403968 (+   204us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:37.404343 (+   375us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:37.404773 (+   430us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:37.404866 (+    93us) write_op.cc:312] APPLY: finished
0709 13:14:37.405245 (+   379us) log.cc:844] Serialized 23 byte log entry
0709 13:14:37.405494 (+   249us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:37.405629 (+   135us) write_op.cc:454] Released schema lock
0709 13:14:37.405708 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:37.406225 (+   517us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:37.406271 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":315,"apply.run_cpu_time_us":2737,"apply.run_wall_time_us":2736,"num_ops":1,"prepare.queue_time_us":5910,"prepare.run_cpu_time_us":3834,"prepare.run_wall_time_us":8433,"replication_time_us":10284}]]}
I20260709 13:14:40.187618  8310 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.209635  6247 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:40.187359  8291 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.185619  8319 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.206228  8294 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.216516  8296 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.212903  8292 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.177434  8315 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.216869  8304 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.241851  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.243911  8190 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.244021  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.218045  8329 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.225405  8300 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.225601  8312 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.248018  6251 raft_consensus.cc:2410] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:14:40.247836  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.249631  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.249547  8312 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.245375  8297 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.250268  6247 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:40.250783  8297 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:14:40.247447  8307 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.237972  8311 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.240587  8264 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.255837  8297 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:40.255702  8321 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.240644  8290 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.261466  8290 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.254875  8323 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.262636  8323 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.263725  8290 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.264806  8323 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.245193  8314 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.257342  8190 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.245112  8316 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.259537  8313 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.259150  8319 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.259994  8295 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.255705  8325 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.260458  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.260015  8299 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.274904  8314 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.265823  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.277949  8299 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.270100  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.254813  8320 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.240521  8315 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.269023  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.254045  8312 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.260367  8324 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.281471  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.269198  8331 ts_tablet_manager.cc:933] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:40.254909  6938 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:40.273069  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.274205  8316 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.274703  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.274581  8321 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.275159  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.248500  8291 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.291775  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.274582  8295 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.279502  8326 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.267172  8311 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.258128  8292 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.265930  8300 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.282821  8333 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.279654  8297 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.284466  6323 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:14:40.282822  8325 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.255339  8329 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.308277  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.308357  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.308900  6248 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 1.
I20260709 13:14:40.309368  8300 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.280249  8323 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.286782  8299 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.287914  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.288239  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.288751  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.289209  8320 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:14:40.290539  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.291052  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.291316  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.293880  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.275388  8327 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.282374  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.294188  6251 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:40.299880  8326 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.301653  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.301872  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.301571  8292 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.302349  8314 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.302280  8324 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.306048  8332 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.306041  8297 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.285266  8303 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.286502  8308 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.277302  8307 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.324584  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.457453  6941 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:40.445412  6253 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:40.439867  6937 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:40.446496  6936 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:40.458842  8331 tablet_copy_client.cc:323] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:14:40.459023  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.462191  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.463402  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.463804  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.464001  6248 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:40.322449  8311 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.382701  8291 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.322496  8329 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.498427  6322 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:40.454232  8295 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.323803  8319 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.465236  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.498044  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.503402  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.468874  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.465025  6942 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:14:40.505793  8190 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.303228  8313 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.383304  8336 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.504949  8297 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.509557  8317 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.464454  8326 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.515408  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.516278  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.516687  8325 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.517602  8313 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.517822  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.465462  8314 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.513737  6255 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:40.520758  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.521469  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.498065  8308 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.512498  8302 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.522105  8292 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.523073  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.461710  8323 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.502485  8315 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.457662  8327 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.502631  8311 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.526342  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.463440  8303 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.323109  8333 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.518831  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.526404  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.580430  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.586760  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.586863  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.594141  6323 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:40.585609  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.462756  6934 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:40.586760  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.466372  8332 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:40.596892  6322 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:40.583447  8334 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.599229  8303 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.586963  8324 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.590512  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:40.590771  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 219097us
I20260709 13:14:40.590904  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.591221  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.591472  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.552054  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.582232  6222 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:40.551308  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.551532  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.593338  6325 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:40.601564  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.552440  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.580111  8316 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.594657  8320 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:40.523073  8321 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.606160  6328 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:40.606881  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.603641  6936 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:40.601260  6326 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:14:40.552281  8317 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.612061  8311 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.612661  8332 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.603909  8324 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.614722  8328 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:40.615170  8328 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.614868  8324 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.615593  8311 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.615571  8328 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:40.616274  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.543955  8340 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.620409  6414 tablet_copy_service.cc:140] P b940f12ed61a49c4b3c11f13ef50fa92: Received BeginTabletCopySession request for tablet 4bc84db94ed44cf9bab11e4626d2ba6e from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41486)
I20260709 13:14:40.621598  6222 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:40.603008  8314 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.553088  8336 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.599705  8334 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.694854  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.737846  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.631022  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.665263  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.747568  6251 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
W20260709 13:14:40.666867  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 167170us
I20260709 13:14:40.642313  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.695295  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.697149  8308 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.617022  8324 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.754200  8304 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:40.754630  8304 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.754973  8304 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.621027  6414 tablet_copy_service.cc:161] P b940f12ed61a49c4b3c11f13ef50fa92: Beginning new tablet copy session on tablet 4bc84db94ed44cf9bab11e4626d2ba6e from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41486: session id = 8600a3fead0e48a7aa813822ec44d0fe-4bc84db94ed44cf9bab11e4626d2ba6e
I20260709 13:14:40.750406  6396 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
W20260709 13:14:40.750402  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 128859us
I20260709 13:14:40.695398  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet b91f0c50e2de47c299569a0a5d7af6b8 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:14:40.617308  8340 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.724105  8327 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.692977  8339 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.739192  8323 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.762602  6222 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:40.625653  8264 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.694283  8333 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.761912  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet b91f0c50e2de47c299569a0a5d7af6b8 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-b91f0c50e2de47c299569a0a5d7af6b8
I20260709 13:14:40.792958  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.793687  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.792583  8339 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.792826  8291 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:40.796207  8291 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.794745  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.796618  8291 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:40.795270  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.797972  8339 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.798017  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.799382  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.800050  8340 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.800427  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.801064  6402 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:14:40.795478  8307 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.795542  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.762902  8324 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.807229  8342 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.807298  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.807936  8342 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.801818  8343 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.810778  8343 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.812799  8342 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.812829  8343 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.814252  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.814872  6396 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:40.815693  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.816234  6396 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:40.817368  8344 ts_tablet_manager.cc:933] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:40.817158  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.805932  6297 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:40.817026  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.818425  6396 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:40.820647  8341 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:40.821044  8341 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.821480  8341 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.823563  8327 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:40.824175  8327 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.825106  8323 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:40.830320  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.832015  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.835037  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.836486  8343 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:40.838263  8291 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.839505  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.840173  8334 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.841351  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.841738  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.841929  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.821776  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.822785  6297 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:40.851403  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.850149  6327 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:40.854059  8336 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.854691  6328 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:40.825901  8323 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.857961  8334 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:40.858395  6265 tablet_copy_source_session.cc:215] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:40.860024  8334 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.859387  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.866250  6402 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 1.
I20260709 13:14:40.861268  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.861467  8327 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.863268  6295 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:40.868019  6295 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:40.863440  8328 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.859298  8323 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:40.860443  8314 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:40.866456  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 71738.2us
I20260709 13:14:40.869009  6295 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:40.869581  6396 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:40.872613  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.865799  8334 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:40.878600  6222 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:40.874255  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.874716  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.876070  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.876317  8307 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:40.880190  8307 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.880591  8307 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:40.880664  8333 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:40.881325  8333 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:40.881982  8333 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:40.882247  8291 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.884727  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.885663  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.887838  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.888437  6325 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:40.889425  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.889631  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.890168  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.890497  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.890741  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.891637  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.891870  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.893293  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.893916  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.894363  6222 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:40.894382  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.896468  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.873391  8308 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:40.899308  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.845782  8324 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:40.896068  8304 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.897254  6402 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 1.
I20260709 13:14:40.899561  8308 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:40.899812  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.901997  8308 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:40.902251  8347 ts_tablet_manager.cc:933] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:40.902033  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.898042  6295 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:40.875788  8341 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:40.902706  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.961388  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.992921  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.958523  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:40.993777  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 97090.1us
I20260709 13:14:40.978498  8307 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:40.994632  8314 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:40.980854  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 86525.2us
I20260709 13:14:40.994846  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.995208  6328 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:40.995555  6222 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:40.958185  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.996356  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.999166  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.929683  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.000365  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:40.963624  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.958817  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.958279  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.993386  6402 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:41.018901  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:40.995222  8314 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:41.035037  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:41.003278  6331 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:40.993106  6404 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:40.966872  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.035219  8314 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:40.903498  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.960886  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.035308  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:40.958633  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:40.991600  8345 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:41.079962  8345 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:41.080421  8345 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.080510  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.056309  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.976729  6414 tablet_copy_source_session.cc:215] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:41.083005  6404 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:40.886469  8328 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:40.990104  8304 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:41.065467  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:14:40.962052  6963 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8f40 after lost signal to thread 5115
I20260709 13:14:41.112144  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:41.112898  6940 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:40.897732  8291 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:41.115028  8291 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:41.094764  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.103973  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.124799  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.133040  6396 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:40.930770  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:40.927177  8344 tablet_copy_client.cc:323] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
I20260709 13:14:41.351141  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.351151  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.116851  8291 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.366899  6219 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:41.367170  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.368343  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.369736  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.370826  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.371840  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.372859  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.373363  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.373461  6401 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:41.375801  6396 raft_consensus.cc:2955] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:41.373493  8324 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:41.377295  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:41.378041  6325 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:41.378540  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:41.366153  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:41.131425  8304 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:41.381903  6940 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:41.386168  6330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47628993693e4f69a935e61e4071de94"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:41.385922  8308 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:41.386718  6330 raft_consensus.cc:606] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:41.383746  8347 tablet_copy_client.cc:323] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.3:34111
I20260709 13:14:41.388557  8308 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:41.389356  8341 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:41.390254  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.390579  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.391896  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.395784  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.394506  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.392050  8349 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:41.395577  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.404824  8349 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:41.407392  8349 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.408082  8307 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:41.393028  6219 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:41.406822  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.409578  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.405898  6252 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:41.410614  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.410157  6401 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:41.404394  6399 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:41.413322  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.414635  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.383509  8334 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:41.418046  8334 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:41.392125  8333 consensus_meta.cc:287] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.000s
I20260709 13:14:41.418812  8333 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:41.419539  8291 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:41.420776  8333 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:41.391049  6963 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9620 after lost signal to thread 6188
I20260709 13:14:41.455101  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:41.423708  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.426856  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:41.427211  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.428122  8345 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:41.429057  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.459969  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.431414  8314 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:41.381484  8304 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:41.432413  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.436970  6414 tablet_copy_service.cc:140] P b940f12ed61a49c4b3c11f13ef50fa92: Received BeginTabletCopySession request for tablet f3c8c870200141efa8a5f7cc58ece4a6 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41486)
I20260709 13:14:41.441604  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.443782  8317 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:41.446735  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:41.448412  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 55561.8us
I20260709 13:14:41.458351  6369 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:41.422317  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.384579  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.429088  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.472642  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.460908  6401 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:41.462611  6221 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:41.474334  6330 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:41.474380  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.455484  8302 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:41.471906  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.477373  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.464113  8304 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:41.470785  6369 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:41.478945  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.479067  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.479578  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.479772  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:41.479537  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.481943  6221 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:41.483804  6221 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:41.484479  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.484658  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.486580  6295 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:41.488360  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:41.486373  8345 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:41.490851  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:41.491010  8345 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:41.491437  8345 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:41.491803  8345 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:41.492043  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet 19435892007a4e0a9b2b4d0b26ccd0c0 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:14:41.492261  6295 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:41.492578  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet 19435892007a4e0a9b2b4d0b26ccd0c0 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-19435892007a4e0a9b2b4d0b26ccd0c0
I20260709 13:14:41.473990  8336 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:41.471961  6414 tablet_copy_service.cc:161] P b940f12ed61a49c4b3c11f13ef50fa92: Beginning new tablet copy session on tablet f3c8c870200141efa8a5f7cc58ece4a6 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41486: session id = 8600a3fead0e48a7aa813822ec44d0fe-f3c8c870200141efa8a5f7cc58ece4a6
I20260709 13:14:41.480367  8350 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:41.537246  8291 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:41.547698  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:41.541273  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:42.288305  6296 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:41.539681  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:42.366019  6256 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:42.367002  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:42.368125  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:41.533888  6295 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:42.371584  8333 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:42.371696  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 837858us
I20260709 13:14:42.372745  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:14:41.548687  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 66389us
I20260709 13:14:42.378496  8368 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:42.379056  6369 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:41.593642  6414 tablet_copy_source_session.cc:215] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:14:41.585232  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 183531us
I20260709 13:14:42.384416  6905 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:42.386054  6905 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:14:41.550509  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 57274.1us
I20260709 13:14:42.386906  8367 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:41.581714  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 84846.9us
I20260709 13:14:42.388154  6907 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:41.576828  6963 debug-util.cc:398] Leaking SignalData structure 0x7b0800170260 after lost signal to thread 6280
W20260709 13:14:42.392185  6963 debug-util.cc:398] Leaking SignalData structure 0x7b0800387340 after lost signal to thread 6355
I20260709 13:14:41.543932  8264 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:42.395102  8264 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:42.395614  8264 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:41.497975  8302 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:41.590402  8304 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:42.401726  8304 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:41.567962  8314 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:41.490845  8317 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:42.404104  8355 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:42.404552  8355 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:42.404948  8355 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:41.583499  8345 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:42.411438  8345 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:41.587946  8349 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:42.414583  8349 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:41.555653  8350 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:42.416254  8350 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:42.134056  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:42.134407  6265 tablet_copy_source_session.cc:215] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:42.425719  6252 raft_consensus.cc:2393] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 4: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:42.427183  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 1935) took 1068 ms. Trace:
I20260709 13:14:42.427585  6252 rpcz_store.cc:276] 0709 13:14:41.359219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.426397 (+1067178us) service_pool.cc:224] Handling call
0709 13:14:42.426701 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.426869 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.426895 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.426935 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:42.426972 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.427026 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.427125 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:42.168999  6294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.014s	sys 0.029s
W20260709 13:14:42.429543  6294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.014s	sys 0.030s
I20260709 13:14:42.189978  6328 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:42.432754  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.433497  6328 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:42.434659  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.435745  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:42.204952  6221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.011s	sys 0.004s
W20260709 13:14:42.441111  6221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.012s	sys 0.004s
W20260709 13:14:42.441753  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 957907us
I20260709 13:14:42.220438  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.444708  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.445343  6322 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:42.446194  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.447271  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.448277  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.221901  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.222186  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.449537  6329 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:42.449978  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.450379  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.451222  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.451521  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.452111  6329 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:42.452400  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.222468  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.453426  6323 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:42.454401  8356 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:42.454725  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.454870  8356 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:42.455346  8356 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:42.455780  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.223040  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:42.456853  6248 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:42.457298  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 1934) took 1335 ms. Trace:
I20260709 13:14:42.457588  6248 rpcz_store.cc:276] 0709 13:14:41.121999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.222799 (+1100800us) service_pool.cc:224] Handling call
0709 13:14:42.457232 (+234433us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:42.457643  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 69548.9us
I20260709 13:14:42.458613  6907 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:42.459156  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1202) took 1023 ms. Trace:
I20260709 13:14:42.459544  6248 rpcz_store.cc:276] 0709 13:14:41.435785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.458393 (+1022608us) service_pool.cc:224] Handling call
0709 13:14:42.458690 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.458858 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.458886 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.458923 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:42.458954 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.459010 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.459103 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:42.223728  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.461993  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.462524  6327 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:42.223750  6325 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:42.251368  6324 raft_consensus.cc:1240] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:42.255095  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:42.466045  6250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 1924) took 1481 ms (client timeout 1821 ms). Trace:
W20260709 13:14:42.466463  6250 rpcz_store.cc:269] 0709 13:14:40.984912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.994318 (+  9406us) service_pool.cc:224] Handling call
0709 13:14:42.254934 (+1260616us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b5800004e98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:14:42.465965 (+211031us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66952448}
I20260709 13:14:42.468068  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1204) took 1031 ms. Trace:
I20260709 13:14:42.468406  6250 rpcz_store.cc:276] 0709 13:14:41.436218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.467267 (+1031049us) service_pool.cc:224] Handling call
0709 13:14:42.467545 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.467731 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.467757 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.467798 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:42.467854 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.467911 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.468015 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:42.272672  6368 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.842s (SENT)
I20260709 13:14:42.296288  8365 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:42.299762  6296 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:42.301546  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:42.301955  6297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.043s	sys 0.079s
I20260709 13:14:42.471223  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1217) took 1026 ms. Trace:
I20260709 13:14:42.314019  6150 catalog_manager.cc:5697] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 2 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:42.471761  6297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.044s	sys 0.079s
I20260709 13:14:42.471778  6254 rpcz_store.cc:276] 0709 13:14:41.444457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.288782 (+844325us) service_pool.cc:224] Handling call
0709 13:14:42.471167 (+182385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:42.316709  6331 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:42.328763  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:42.331032  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:42.331669  6222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.296s	user 0.026s	sys 0.028s
W20260709 13:14:42.334132  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 866810us
I20260709 13:14:42.344846  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.351094  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:41.571130  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:42.474961  6222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.456s	user 0.027s	sys 0.028s
W20260709 13:14:42.475294  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 1.45605e+06us
I20260709 13:14:42.387317  8367 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:42.476735  8367 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:42.476770  6219 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:42.477806  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:42.390098  6369 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:14:42.481786  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 91760.9us
I20260709 13:14:42.482672  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:42.483081  6369 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:42.483409  6942 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:42.484179  6369 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:42.484990  8366 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:42.485605  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:41.488035  8324 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:42.487310  8324 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:42.487672  8324 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:42.488333  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:42.257673  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:42.489319  8327 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:42.489732  8327 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:42.489962  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 1927) took 1479 ms. Trace:
I20260709 13:14:42.490502  6251 rpcz_store.cc:276] 0709 13:14:41.011054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.257398 (+1246344us) service_pool.cc:224] Handling call
0709 13:14:42.489865 (+232467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:42.491446  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:14:42.469002  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 83009.8us
I20260709 13:14:42.474651  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1218) took 1029 ms. Trace:
I20260709 13:14:42.493563  6255 rpcz_store.cc:276] 0709 13:14:41.444770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.328458 (+883688us) service_pool.cc:224] Handling call
0709 13:14:42.474489 (+146031us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:42.307859  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:42.475342  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1206) took 1038 ms. Trace:
I20260709 13:14:42.380895  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 1923) took 1385 ms. Trace:
I20260709 13:14:42.496706  6256 rpcz_store.cc:276] 0709 13:14:40.984636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.368877 (+1384241us) service_pool.cc:224] Handling call
0709 13:14:42.369555 (+   678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.369744 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.369768 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.369919 (+   151us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:42.369972 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.370021 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.370118 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:42.471866  8365 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:42.497764  8365 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:42.497888  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.498153  8365 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:42.436844  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.501302  6253 rpcz_store.cc:276] 0709 13:14:41.436669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.570767 (+134098us) service_pool.cc:224] Handling call
0709 13:14:42.475286 (+904519us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:42.471211  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 171525us
I20260709 13:14:42.505813  6296 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:42.507215  6296 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:42.508438  6296 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:42.509167  8333 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:42.509541  8333 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:42.509902  8333 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:42.510174  8324 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:42.485766  8366 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:42.495445  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:42.500769  8367 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:42.515169  8328 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:42.515574  8328 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:42.515925  8328 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:42.486433  6934 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:42.490103  8327 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:42.518151  8333 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:42.492903  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1207) took 1032 ms. Trace:
I20260709 13:14:42.521294  6247 rpcz_store.cc:276] 0709 13:14:41.441768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.330754 (+888986us) service_pool.cc:224] Handling call
0709 13:14:42.474569 (+143815us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:42.489012  6939 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:42.528916  8333 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:42.529666  8333 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:42.533171  8355 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:42.539240  6939 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:42.456321  6323 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:14:42.452908  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:42.546113  6329 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:42.551154  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1203) took 1112 ms. Trace:
I20260709 13:14:42.551651  6248 rpcz_store.cc:276] 0709 13:14:41.436010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.460453 (+1024443us) service_pool.cc:224] Handling call
0709 13:14:42.460734 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.460940 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.460975 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.461023 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:42.461070 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.547925 (+ 86855us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.548039 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:42.476344  6963 debug-util.cc:398] Leaking SignalData structure 0x7b0800336de0 after lost signal to thread 6429
W20260709 13:14:42.553947  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 45566.3us
I20260709 13:14:42.555444  6296 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:42.557067  6296 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:42.568440  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 1940) took 1092 ms. Trace:
I20260709 13:14:42.568940  6255 rpcz_store.cc:276] 0709 13:14:41.480839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.545099 (+1064260us) service_pool.cc:224] Handling call
0709 13:14:42.567815 (+ 22716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.568023 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.568059 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.568114 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:42.568160 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.568227 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.568367 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:42.577028  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 118503us
I20260709 13:14:42.577661  8372 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:42.578125  8372 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:42.578500  8372 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:42.579336  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 191976us
W20260709 13:14:42.581502  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 137909us
W20260709 13:14:42.582758  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 89150.5us
W20260709 13:14:42.583210  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 310641us
I20260709 13:14:42.582244  6221 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:42.585819  8371 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:42.586266  8371 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:42.586629  8371 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:42.587596  6221 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:42.577049  8373 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:42.590219  8373 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:42.590648  8373 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:42.592525  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:42.595120  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1208) took 1153 ms. Trace:
I20260709 13:14:42.595484  6247 rpcz_store.cc:276] 0709 13:14:41.442051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.544586 (+1102535us) service_pool.cc:224] Handling call
0709 13:14:42.594642 (+ 50056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.594811 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.594837 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.594875 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:42.594907 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.594955 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.595068 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:42.596395  6907 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:42.548442  8368 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:42.598436  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 1939) took 1122 ms. Trace:
I20260709 13:14:42.601383  6253 rpcz_store.cc:276] 0709 13:14:41.475888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.544962 (+1069074us) service_pool.cc:224] Handling call
0709 13:14:42.598007 (+ 53045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.598157 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.598180 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.598216 (+    36us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:42.598247 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.598302 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.598385 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:42.599102  6256 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:42.570626  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1210) took 1128 ms. Trace:
I20260709 13:14:42.607939  6251 rpcz_store.cc:276] 0709 13:14:41.442586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.544613 (+1102027us) service_pool.cc:224] Handling call
0709 13:14:42.570176 (+ 25563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.570340 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.570363 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.570401 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:42.570434 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.570482 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.570573 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:42.600580  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 1937) took 1125 ms. Trace:
W20260709 13:14:42.617602  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 139855us
I20260709 13:14:42.618729  6219 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:42.621731  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1211) took 1178 ms. Trace:
I20260709 13:14:42.622368  6256 rpcz_store.cc:276] 0709 13:14:41.442835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.544822 (+1101987us) service_pool.cc:224] Handling call
0709 13:14:42.598950 (+ 54128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.621371 (+ 22421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.621645 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:42.550397  8304 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:42.633623  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 46081.2us
I20260709 13:14:42.634989  8383 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:42.610620  6249 rpcz_store.cc:276] 0709 13:14:41.475530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.544855 (+1069325us) service_pool.cc:224] Handling call
0709 13:14:42.600144 (+ 55289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.600306 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.600330 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.600367 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:42.600398 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.600445 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.600530 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:42.636059  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:42.636694  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 77134.7us
I20260709 13:14:42.567193  8314 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:42.637069  6907 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:42.639539  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:42.645248  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:42.639680  6221 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:42.640537  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:42.647200  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 168836us
I20260709 13:14:42.648056  6222 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:42.648311  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:42.649005  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:42.649217  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 69276.8us
I20260709 13:14:42.650075  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:42.650516  6906 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:42.651461  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 68073.1us
I20260709 13:14:42.653952  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:42.622514  8333 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:42.636258  6325 raft_consensus.cc:2955] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:14:42.644981  8314 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:42.647578  8383 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:14:42.657092  6963 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe9a0 after lost signal to thread 6966
I20260709 13:14:42.681974  8372 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:42.683552  8371 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:42.684036  8384 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:42.683575  8365 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:42.685242  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:42.685498  8381 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:42.685853  8381 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:42.686195  8381 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:42.692793  6934 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:42.696053  8373 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:42.697294  8372 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:42.697808  8349 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:42.698011  8372 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:42.700667  8367 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:42.656832  8333 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:42.701401  8333 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:42.701333  8365 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:42.698503  8372 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:42.703323  8372 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:42.705713  8264 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:42.654685  8324 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:42.707052  6327 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:42.673708  8302 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:42.646345  8327 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:42.706507  8356 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:42.714291  8368 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:42.714831  8355 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:42.715142  8354 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:42.714304  8264 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:42.716504  8373 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:42.710511  6942 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
W20260709 13:14:42.788283  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 143909us
I20260709 13:14:42.675441  8350 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:42.717199  8371 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:42.762413  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 87227.5us
I20260709 13:14:42.789044  6296 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:42.687290  8314 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:42.762432  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 125444us
W20260709 13:14:42.717785  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 69941.3us
I20260709 13:14:42.795673  6222 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:42.795938  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 177297us
I20260709 13:14:42.687302  8383 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:42.797086  6219 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:42.718590  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 68173.5us
I20260709 13:14:42.792016  6296 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:42.798499  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:42.687374  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:42.800542  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:42.800782  6295 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:42.803285  6369 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:42.805418  6252 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:42.711256  8302 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:42.808342  6222 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:42.812330  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:42.813445  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:42.814711  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:42.815282  6253 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:42.816289  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:42.820497  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:42.821394  6251 raft_consensus.cc:1240] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:42.823853  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 151709us
I20260709 13:14:42.824786  6905 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:42.825323  6219 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:42.787735  8354 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:42.796391  6933 raft_consensus.cc:1240] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:42.830673  6906 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:42.795846  8368 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:42.800418  8365 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:42.823001  6222 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:42.834587  8354 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:42.834781  6256 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:42.835282  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:42.818343  8302 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:42.843303  6249 raft_consensus.cc:1240] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:42.804805  8324 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:42.826390  8371 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:42.807822  8264 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:42.792547  8381 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:42.829730  8304 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:42.836716  8370 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:14:42.859853  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 48698.6us
I20260709 13:14:42.861634  6905 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:42.861184  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 54622.3us
I20260709 13:14:42.842419  8365 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:14:42.868021  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 45080.4us
I20260709 13:14:42.868733  6222 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:42.869324  8390 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:42.870064  8347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c8c870200141efa8a5f7cc58ece4a6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:42.870797  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 45557.9us
I20260709 13:14:42.872063  6219 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:42.869887  6222 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:42.873104  6219 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:42.847008  8389 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:42.893666  8328 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:42.895879  8328 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:42.861260  8304 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:42.896478  8304 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:42.861439  8369 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:42.897316  8369 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:42.897689  8369 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:42.898205  8381 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:42.902176  8370 raft_consensus.cc:697] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:42.860819  8264 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:42.872490  8365 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:42.938339  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 68532.8us
W20260709 13:14:42.960132  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 159918us
I20260709 13:14:42.907106  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 1936) took 1547 ms. Trace:
I20260709 13:14:42.880089  8389 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:42.899686  8371 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:42.930075  8392 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:42.903872  8355 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:42.885972  8350 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:42.927444  8375 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:42.884699  8356 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:42.962308  6252 rpcz_store.cc:276] 0709 13:14:41.359394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.428663 (+1069269us) service_pool.cc:224] Handling call
0709 13:14:42.428958 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.809605 (+380647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.906807 (+ 97202us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54000e3dd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:42.907035 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":865355008}
I20260709 13:14:42.885262  8393 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:42.963238  8328 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:42.903191  8370 consensus_queue.cc:237] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:42.877725  8394 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:42.936610  8264 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:42.962917  8345 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:42.981977  8355 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:14:42.998513  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 126759us
I20260709 13:14:43.001385  8393 raft_consensus.cc:697] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:43.063635  8355 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.064491  8393 consensus_queue.cc:237] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:42.961897  8372 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.001560  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc84db94ed44cf9bab11e4626d2ba6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:43.001525  8333 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:43.068682  8372 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:42.987846  8371 raft_consensus.cc:697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:42.966807  8389 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.066207  6906 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.070245  8333 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:43.073288  8383 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:43.076427  6253 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:43.076511  6906 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:43.079012  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 81331.9us
I20260709 13:14:43.080045  6906 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.082127  6906 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.083685  6906 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:43.091626  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 218575us
I20260709 13:14:43.093650  6219 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:43.078430  8372 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:43.081648  8390 raft_consensus.cc:2764] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:14:43.096557  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 222217us
I20260709 13:14:43.081799  8394 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:43.099030  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 245129us
I20260709 13:14:43.098089  8377 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:43.101524  8324 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:43.089882  8345 raft_consensus.cc:697] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:43.110881  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.111572  6253 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:43.111742  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:14:43.110397  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 248832us
I20260709 13:14:43.112632  6905 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:43.113500  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.125684  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.127071  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:43.131299  6219 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.132395  6219 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.132395  6221 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.134795  6941 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:43.134650  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:43.136505  6905 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:43.139328  8314 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:43.139951  6369 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:43.139853  8399 consensus_queue.cc:1059] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:43.140261  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:43.141553  8314 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:43.090104  8365 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:43.137936  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.142150  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.143220  8365 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:43.139909  8366 consensus_queue.cc:1059] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:14:43.145018  6252 raft_consensus.cc:1240] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.150951  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:43.151958  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:43.137452  6253 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:43.155725  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:43.158423  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:43.158981  6405 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.152726  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:14:43.135478  6352 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9740 after lost signal to thread 5115
I20260709 13:14:43.159916  6255 raft_consensus.cc:1240] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:43.165769  6219 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:43.167209  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 202717us
I20260709 13:14:43.169689  8387 consensus_queue.cc:1059] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:43.130434  8375 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:43.181798  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:43.182415  6939 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:43.174767  6905 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.183604  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:43.184418  6905 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.174760  6296 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:43.173051  6936 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:43.099328  8401 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:43.190307  6295 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:43.192847  6905 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:43.199915  6150 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55346 (request call id 389) took 1701 ms. Trace:
I20260709 13:14:43.130086  8324 consensus_queue.cc:1059] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:14:43.166754  8349 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:43.135965  8367 consensus_queue.cc:1059] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:14:43.172305  8370 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:43.172591  8406 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:43.200812  8390 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:43.200980  8393 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:43.189723  8384 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:43.191355  8394 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:43.175913  8366 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:43.199501  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:43.212648  8356 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:43.179092  8405 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:43.230866  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:43.235924  8387 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:43.263326  8387 raft_consensus.cc:697] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:43.264261  8387 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:43.246523  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 45093.8us
I20260709 13:14:43.221525  8407 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:43.173432  8371 consensus_queue.cc:237] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.255681  8394 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:43.237990  8345 consensus_queue.cc:237] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.159451  8404 consensus_queue.cc:1059] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:14:43.262866  6933 raft_consensus.cc:2393] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 5: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:43.268860  6405 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
W20260709 13:14:43.272243  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 81991.9us
I20260709 13:14:43.271809  6296 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.255373  8324 raft_consensus.cc:3055] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:43.295125  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:43.295524  8324 raft_consensus.cc:740] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:43.295959  6935 raft_consensus.cc:2393] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 3: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:43.296427  8324 consensus_queue.cc:260] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.202085  6150 rpcz_store.cc:276] 0709 13:14:41.484965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.488852 (+  3887us) service_pool.cc:224] Handling call
0709 13:14:43.186504 (+1697652us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:42.572410 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:42.573239 (+   829us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:42.573292 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:14:42.573322 (+    30us) tablet.cc:662] Decoding operations
0709 13:14:42.573794 (+   472us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:42.573890 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:42.573945 (+    55us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:42.574188 (+   243us) tablet.cc:701] Row locks acquired
0709 13:14:42.574216 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:14:42.574403 (+   187us) write_op.cc:270] Start()
0709 13:14:42.574549 (+   146us) write_op.cc:276] Timestamp: P: 1783602882574346 usec, L: 0
0709 13:14:42.574585 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:14:42.575469 (+   884us) log.cc:844] Serialized 591 byte log entry
0709 13:14:43.063236 (+487767us) op_driver.cc:464] REPLICATION: finished
0709 13:14:43.084709 (+ 21473us) write_op.cc:301] APPLY: starting
0709 13:14:43.084786 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:43.084900 (+   114us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:43.085033 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:43.088064 (+  3031us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:43.088227 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:43.088272 (+    45us) write_op.cc:312] APPLY: finished
0709 13:14:43.088470 (+   198us) log.cc:844] Serialized 23 byte log entry
0709 13:14:43.088631 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:43.088704 (+    73us) write_op.cc:454] Released schema lock
0709 13:14:43.088739 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:43.089097 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:43.090259 (+  1162us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":21216,"apply.run_cpu_time_us":4351,"apply.run_wall_time_us":4352,"num_ops":1,"prepare.queue_time_us":60671,"prepare.run_cpu_time_us":36161,"prepare.run_wall_time_us":80506,"raft.queue_time_us":227169,"raft.run_cpu_time_us":7435,"raft.run_wall_time_us":117201,"replication_time_us":413706,"thread_start_us":286879,"threads_started":4,"wal-append.queue_time_us":102984}]]}
I20260709 13:14:43.297749  8324 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:43.253512  8403 raft_consensus.cc:3055] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:43.287043  8327 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:43.290256  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:43.273204  6939 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:14:43.293177  8364 raft_consensus.cc:3055] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:43.262220  8405 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:43.271183  8407 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:43.317570  8407 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.299220  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.235518  8302 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:43.301522  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.261337  8366 raft_consensus.cc:697] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:43.310065  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:43.314508  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:43.315850  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:43.316872  8405 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.338563  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.306692  8372 raft_consensus.cc:2764] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:14:43.320946  6296 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.307700  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:43.322283  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.336090  6940 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.300190  8403 raft_consensus.cc:740] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:43.468577  6937 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:43.467509  6936 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:43.413312  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:43.428843  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 47328.9us
W20260709 13:14:43.529510  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 345952us
W20260709 13:14:43.445086  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 235636us
I20260709 13:14:43.300076  8394 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:43.485852  8369 consensus_meta.cc:287] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.000s
I20260709 13:14:43.485821  6934 raft_consensus.cc:1240] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:43.531692  6330 raft_consensus.cc:1240] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.364305  6247 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:43.397985  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:43.530966  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:14:43.534047  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 213159us
I20260709 13:14:43.540373  6323 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.534526  6325 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:43.304132  8317 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:43.548985  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:43.549803  6401 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:43.500553  8411 log.cc:927] Time spent T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 13:14:43.319919  6352 debug-util.cc:398] Leaking SignalData structure 0x7b080011d540 after lost signal to thread 6188
I20260709 13:14:43.541821  6397 raft_consensus.cc:2393] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:43.510200  8417 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:43.537847  8416 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:43.543154  6249 raft_consensus.cc:1240] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
W20260709 13:14:43.537425  8304 consensus_meta.cc:287] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.640s	user 0.006s	sys 0.004s
I20260709 13:14:43.502019  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:43.551438  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:43.564270  6396 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:43.552062  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:43.340013  8364 raft_consensus.cc:740] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:43.542166  6296 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.569733  8317 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:43.570686  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.571746  8317 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:43.557014  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:43.562477  6325 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:43.564828  6403 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:43.572584  8317 consensus_queue.cc:1059] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:43.573523  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:43.565348  6219 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:43.574591  8317 raft_consensus.cc:3055] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:43.574812  6402 raft_consensus.cc:1240] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:43.574990  8317 raft_consensus.cc:740] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:43.509898  8409 consensus_queue.cc:1059] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:14:43.575718  8405 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.575992  8317 consensus_queue.cc:260] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:43.576591  8409 consensus_queue.cc:1243] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:43.568506  6937 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:43.577164  8409 raft_consensus.cc:3055] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:43.577497  8409 raft_consensus.cc:740] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:43.577569  8317 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:43.578261  8405 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:43.578450  6296 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.579466  6403 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:14:43.580134  8417 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:43.580533  6352 debug-util.cc:398] Leaking SignalData structure 0x7b080036fbc0 after lost signal to thread 6280
W20260709 13:14:43.581686  6352 debug-util.cc:398] Leaking SignalData structure 0x7b080034f180 after lost signal to thread 6355
W20260709 13:14:43.582772  6352 debug-util.cc:398] Leaking SignalData structure 0x7b080033ec00 after lost signal to thread 6429
I20260709 13:14:43.585450  6221 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:43.589991  6396 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:43.590596  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:43.591207  8406 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:43.591713  8406 raft_consensus.cc:697] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:43.487005  8366 consensus_queue.cc:237] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:43.592242  8389 consensus_meta.cc:287] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.001s
I20260709 13:14:43.560411  8331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91f0c50e2de47c299569a0a5d7af6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:43.563191  6933 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.585738  8402 raft_consensus.cc:3055] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:43.594669  6401 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:43.598101  8402 raft_consensus.cc:740] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:43.594627  6219 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.536909  8369 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:43.606904  6219 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:43.608166  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 55411.4us
I20260709 13:14:43.609642  6255 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:43.610186  6219 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:43.602010  8368 consensus_meta.cc:287] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.749s	user 0.009s	sys 0.001s
W20260709 13:14:43.605276  8354 consensus_meta.cc:287] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.744s	user 0.005s	sys 0.005s
I20260709 13:14:43.599403  8415 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:43.631835  6402 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.592671  8389 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.566241  8304 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:43.612926  8393 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:43.635836  6352 debug-util.cc:398] Leaking SignalData structure 0x7b0800303de0 after lost signal to thread 6966
W20260709 13:14:43.636790  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 79580.1us
W20260709 13:14:43.618192  8264 consensus_meta.cc:287] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.554s	user 0.003s	sys 0.007s
I20260709 13:14:43.619774  8328 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:43.645645  8347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58276 (request call id 373) took 2816 ms. Trace:
I20260709 13:14:43.647727  8304 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:43.648016  6251 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 4: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:43.650871  8389 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:43.634028  8354 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.678889  8399 raft_consensus.cc:3055] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:43.679291  8399 raft_consensus.cc:740] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:14:43.661424  6352 debug-util.cc:398] Leaking SignalData structure 0x7b08002e06a0 after lost signal to thread 8285
I20260709 13:14:43.651897  6939 raft_consensus.cc:1240] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:43.682124  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 72055.2us
I20260709 13:14:43.611753  8404 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:43.654549  6323 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:43.592556  8406 consensus_queue.cc:237] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:43.635795  8418 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:14:43.651065  8407 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:43.682217  6935 raft_consensus.cc:1240] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:43.599164  8402 consensus_queue.cc:260] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:43.667622  8355 consensus_meta.cc:287] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.003s
I20260709 13:14:43.655471  8393 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:43.635044  8416 consensus_queue.cc:1059] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:14:43.651556  8403 consensus_queue.cc:260] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.679651  8354 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:43.632642  8368 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:43.691181  6219 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.695544  6219 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.684204  8302 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:43.666971  8412 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:43.667958  8264 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:14:43.692670  8393 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.666488  8366 consensus_queue.cc:1059] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:14:43.706648  6249 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:43.707072  8264 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:43.709136  6253 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.730228  6329 raft_consensus.cc:1240] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.709889  6907 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:43.712702  6936 raft_consensus.cc:1240] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:43.731475  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:43.713732  6933 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.715116  6940 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:43.698933  8328 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:43.715667  8420 consensus_queue.cc:1059] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:14:43.716387  8354 consensus_queue.cc:1059] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:43.693423  8355 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.719482  6934 raft_consensus.cc:1240] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.719692  6401 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:43.725718  6331 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:43.727572  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:43.698105  6328 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:43.698590  8345 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:43.734169  6907 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:43.763856  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.764451  6907 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:43.729467  8414 consensus_queue.cc:1059] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:14:43.699790  8412 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.737800  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.770285  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.738442  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:43.738904  8372 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:43.772982  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.735567  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:43.740486  8344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19435892007a4e0a9b2b4d0b26ccd0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:43.742870  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:43.749703  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:43.751075  6326 raft_consensus.cc:1240] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.672065  8347 rpcz_store.cc:276] 0709 13:14:40.829016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.831139 (+  2123us) service_pool.cc:224] Handling call
0709 13:14:40.902594 (+ 71455us) ts_tablet_manager.cc:934] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
0709 13:14:42.868620 (+1966026us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:43.135751 (+267131us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:43.159048 (+ 23297us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:43.644789 (+485741us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:43.645106 (+   317us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:43.645466 (+   360us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:43.645536 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":197235,"tablet-copy.queue_time_us":70594,"thread_start_us":318604,"threads_started":2}
I20260709 13:14:43.743718  8328 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:43.782824  8407 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:43.782912  8328 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:43.756548  8354 raft_consensus.cc:3055] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:43.760022  8369 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:43.696643  8399 consensus_queue.cc:260] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:43.786068  8354 raft_consensus.cc:740] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:14:43.786762  8327 consensus_queue.cc:1175] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:14:43.786981  8354 consensus_queue.cc:260] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.788209  8354 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:43.750032  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:14:43.791649  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.764467  6331 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:43.773864  8377 consensus_queue.cc:1059] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:14:43.792415  8377 consensus_queue.cc:1243] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer b940f12ed61a49c4b3c11f13ef50fa92 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:43.792677  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.792851  8377 raft_consensus.cc:3055] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:43.793418  8304 consensus_queue.cc:1059] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:14:43.803018  8377 raft_consensus.cc:740] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:43.803408  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:43.803978  8377 consensus_queue.cc:260] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.804541  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:43.805220  8377 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.805792  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:43.701766  8421 consensus_queue.cc:1059] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:14:43.770936  6325 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:43.771201  6323 raft_consensus.cc:2393] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:43.772600  8391 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:43.773993  6329 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:43.806221  8384 raft_consensus.cc:3055] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:43.813215  8384 raft_consensus.cc:740] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:43.813318  8420 consensus_queue.cc:1059] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:43.813243  8421 raft_consensus.cc:3055] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:43.814551  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:43.816035  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.816354  6247 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:43.815546  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.818989  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.819700  6323 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:43.820683  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:43.774471  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 138005us
I20260709 13:14:43.775738  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.775830  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.823370  6326 raft_consensus.cc:2393] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:43.776547  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:43.823303  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.777642  6941 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 3: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:43.762506  8413 consensus_queue.cc:1059] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:14:43.770078  8405 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:43.773399  8372 raft_consensus.cc:697] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:43.735199  6938 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:43.785037  8368 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:43.794694  8349 consensus_queue.cc:1059] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:14:43.795395  8412 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:43.836941  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:43.796196  8355 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:43.790071  8302 consensus_queue.cc:1059] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:14:43.799783  8285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58276 (request call id 370) took 6449 ms. Trace:
I20260709 13:14:43.845359  8285 rpcz_store.cc:276] 0709 13:14:37.350625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.351670 (+  1045us) service_pool.cc:224] Handling call
0709 13:14:37.366829 (+ 15159us) ts_tablet_manager.cc:934] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
0709 13:14:42.857435 (+5490606us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:43.525256 (+667821us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:43.525395 (+   139us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:43.799041 (+273646us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:43.799331 (+   290us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:43.799632 (+   301us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:43.799700 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":91627,"tablet-copy.queue_time_us":13411,"thread_start_us":148071,"threads_started":2}
I20260709 13:14:43.846714  8403 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:43.801244  8414 consensus_queue.cc:1059] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:43.802162  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.837649  6330 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:43.814291  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:43.754055  8430 consensus_queue.cc:1059] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:43.817433  6249 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:43.768853  8324 consensus_queue.cc:1059] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:14:43.827499  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:43.828461  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.771057  8366 consensus_queue.cc:1059] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:14:43.841342  6327 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:43.849756  6331 raft_consensus.cc:2393] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 2: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:43.848623  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.851450  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.851974  6331 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:43.829288  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.829401  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:43.866957  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 58101.2us
I20260709 13:14:43.830710  6297 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:43.816900  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:43.833060  8372 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.834161  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:43.866847  8404 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:14:43.827036  8369 consensus_queue.cc:1059] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:14:43.834952  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:43.870572  8419 raft_consensus.cc:3055] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:43.814670  8421 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:43.835338  8405 raft_consensus.cc:697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:43.835911  8345 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:43.783929  8427 consensus_queue.cc:1059] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:14:43.831365  8407 consensus_queue.cc:1059] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:14:43.844954  8383 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:43.821386  6325 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:43.877300  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.878574  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.880853  6325 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.843959  8376 raft_consensus.cc:3055] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:43.881290  8376 raft_consensus.cc:740] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:43.849990  8347 tablet_copy_client.cc:806] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:43.884045  8347 tablet_copy_client.cc:670] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:43.817423  8391 raft_consensus.cc:697] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:43.837958  8413 raft_consensus.cc:3055] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:43.853029  8364 consensus_queue.cc:260] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.856498  8402 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.857578  6369 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:43.857892  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.857827  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:43.858719  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.859447  8412 raft_consensus.cc:3055] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:43.859586  8414 raft_consensus.cc:3055] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:43.859925  8366 consensus_queue.cc:1243] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:43.860905  8394 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.862967  8399 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.864668  8426 raft_consensus.cc:3055] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:43.866214  8349 raft_consensus.cc:3055] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:43.869343  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.903415  6937 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.869716  6297 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.867879  6219 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.873692  8418 consensus_queue.cc:1059] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 13:14:43.871320  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 46764.5us
I20260709 13:14:43.870903  6940 raft_consensus.cc:2393] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 5: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:43.892299  8414 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:43.875841  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:43.871219  8368 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:43.870941  8419 raft_consensus.cc:740] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:43.888913  6324 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:43.889454  6330 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:43.891105  6331 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:43.885948  8407 raft_consensus.cc:3055] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:43.929555  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.929623  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.866616  8431 consensus_queue.cc:1059] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:14:43.887176  8369 raft_consensus.cc:3055] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:14:43.894608  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 139894us
I20260709 13:14:43.891883  8364 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.884012  8376 consensus_queue.cc:260] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:14:43.928903  8407 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:43.940575  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.940704  8407 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.887070  8413 raft_consensus.cc:740] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:43.907300  6297 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:43.892688  8430 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:43.909071  6323 raft_consensus.cc:1240] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.872462  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:43.907591  6295 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.933218  6253 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.945183  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.902289  8421 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:43.903287  8349 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:43.946964  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.934396  6219 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.947136  8349 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.947319  8419 consensus_queue.cc:260] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.948344  8349 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.948640  8419 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.939885  8376 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.941027  6252 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:43.899989  6325 raft_consensus.cc:1240] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:43.907780  8317 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:43.890053  8412 raft_consensus.cc:740] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:43.905771  8426 raft_consensus.cc:740] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:43.941102  8366 consensus_queue.cc:1059] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:14:43.948583  6219 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.946391  8421 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:43.906461  8383 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:43.949888  6368 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:43.926846  8394 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:14:43.954399  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 46883.9us
W20260709 13:14:43.954331  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 47092.3us
I20260709 13:14:43.955368  8368 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:43.956084  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.925850  8393 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:43.957587  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.960374  6906 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.949267  8404 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:43.931957  8369 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:43.973922  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:14:43.941839  8427 consensus_queue.cc:1175] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:14:43.971664  6297 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:43.909991  8417 consensus_queue.cc:1059] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:14:43.925038  8405 consensus_queue.cc:237] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.951159  8430 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:43.985116  6255 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.958263  8418 consensus_queue.cc:1059] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:14:43.986966  6297 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.989890  6297 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:43.990703  8398 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:43.990942  6297 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:43.991298  8328 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:43.992268  8423 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:43.992395  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:43.976776  8354 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:43.991699  8398 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:43.979947  8304 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:43.993703  6297 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.975274  8317 raft_consensus.cc:697] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:43.978610  8407 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:43.995168  6252 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 3: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:43.982654  8366 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:43.986112  8430 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:44.005863  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:44.007745  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:43.989693  8416 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:43.994822  8368 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:44.011945  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 63446.4us
I20260709 13:14:43.983317  8394 consensus_queue.cc:1059] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 13:14:44.014456  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:44.015528  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.016403  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:44.003328  8314 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:44.026731  6331 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:44.027842  6331 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:44.012164  8354 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:44.030607  8345 consensus_queue.cc:1059] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:14:44.022244  8387 raft_consensus.cc:3055] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:43.996932  8423 consensus_queue.cc:1059] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:14:44.041740  8423 raft_consensus.cc:3055] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:44.042127  8423 raft_consensus.cc:740] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:44.034090  8347 tablet_copy_client.cc:538] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:43.992583  8413 consensus_queue.cc:260] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:43.972420  8391 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.012419  8369 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.047472  8393 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:44.049479  6331 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:44.045058  8392 raft_consensus.cc:3055] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:44.051523  8366 consensus_queue.cc:1059] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:44.052680  6255 raft_consensus.cc:1240] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:44.019767  8431 consensus_queue.cc:1059] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:14:44.036729  8387 raft_consensus.cc:740] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:44.005635  8426 consensus_queue.cc:260] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:44.078953  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:44.086886  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 372311us
I20260709 13:14:43.996599  8412 consensus_queue.cc:260] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:44.055532  8392 raft_consensus.cc:740] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:44.055155  8331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41298 (request call id 408) took 3868 ms. Trace:
I20260709 13:14:44.042932  8423 consensus_queue.cc:260] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.053301  8345 consensus_queue.cc:1059] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 13:14:44.102931  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.103080  6905 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:44.104260  6905 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:44.065151  8304 consensus_queue.cc:1059] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:14:44.107928  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:44.097718  8366 raft_consensus.cc:3055] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:44.108528  6331 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.102398  8369 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:44.129494  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.108561  8389 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:44.107559  8426 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:44.055032  8317 consensus_queue.cc:237] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.167264  8328 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:44.099586  8393 consensus_queue.cc:1059] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:14:44.110528  8366 raft_consensus.cc:740] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:44.159502  8304 raft_consensus.cc:3055] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:44.124322  8390 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:44.169695  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:44.204988  6250 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:44.205386  6329 raft_consensus.cc:2393] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:44.100512  8331 rpcz_store.cc:276] 0709 13:14:40.185832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.185987 (+   155us) service_pool.cc:224] Handling call
0709 13:14:40.291760 (+105773us) ts_tablet_manager.cc:934] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
0709 13:14:43.298215 (+3006455us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:43.860833 (+562618us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:43.860950 (+   117us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:44.006753 (+145803us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:44.019357 (+ 12604us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:44.045818 (+ 26461us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:44.054255 (+  8437us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":3796,"tablet-copy.queue_time_us":82548,"thread_start_us":227370,"threads_started":2}
I20260709 13:14:44.175726  8344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41298 (request call id 427) took 3851 ms. Trace:
I20260709 13:14:44.206194  8331 tablet_copy_client.cc:806] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:44.206802  8331 tablet_copy_client.cc:670] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:44.206126  8344 rpcz_store.cc:276] 0709 13:14:40.324318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.601863 (+277545us) service_pool.cc:224] Handling call
0709 13:14:40.828545 (+226682us) ts_tablet_manager.cc:934] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
0709 13:14:43.739300 (+2910755us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:43.936910 (+197610us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:43.937054 (+   144us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:44.175018 (+237964us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:44.175284 (+   266us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:44.175605 (+   321us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:44.175666 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":50405,"tablet-copy.queue_time_us":174641,"thread_start_us":141804,"threads_started":2}
I20260709 13:14:44.207629  8344 tablet_copy_client.cc:806] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:44.208083  8344 tablet_copy_client.cc:670] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:44.106994  8355 consensus_queue.cc:1059] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 13:14:44.186604  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 236777us
I20260709 13:14:44.209971  6368 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:44.191987  6371 leader_election.cc:336] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.577s (SENT)
I20260709 13:14:44.114557  8387 consensus_queue.cc:260] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:44.204417  8396 raft_consensus.cc:3055] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:44.204596  8304 raft_consensus.cc:740] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:44.123592  8409 consensus_queue.cc:260] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.187729  8423 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:44.234719  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 130494us
I20260709 13:14:44.237588  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:44.229650  6371 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:44.245098  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:44.247320  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:44.250968  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 85397.8us
I20260709 13:14:44.202656  8389 raft_consensus.cc:697] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:44.232722  8390 raft_consensus.cc:697] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:44.250999  8396 raft_consensus.cc:740] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:44.271010  6942 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:14:44.262024  8438 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:14:44.273013  6942 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:44.188700  8392 consensus_queue.cc:260] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:44.263010  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:14:44.277911  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 85976.5us
W20260709 13:14:44.273442  8442 log.cc:927] Time spent T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:14:44.284502  8419 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:44.277285  8304 consensus_queue.cc:260] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:44.275254  8387 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:44.296267  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 456) took 1152 ms. Trace:
I20260709 13:14:44.296663  6941 rpcz_store.cc:276] 0709 13:14:43.138999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.139165 (+   166us) service_pool.cc:224] Handling call
0709 13:14:44.290810 (+1151645us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b540055c154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:44.290935 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1420039040}
I20260709 13:14:44.297500  8367 consensus_queue.cc:1059] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:44.298477  8389 consensus_queue.cc:237] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.265340  8448 consensus_queue.cc:1059] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:14:44.299489  6253 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:44.272058  8366 consensus_queue.cc:260] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:44.299608  8390 consensus_queue.cc:237] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.291805  8419 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:14:44.319957  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 110123us
I20260709 13:14:44.309795  6328 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:44.320837  6368 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:44.302456  8304 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.322293  6368 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.323465  6368 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.295717  8396 consensus_queue.cc:260] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:44.326637  8396 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.315284  8448 consensus_queue.cc:1243] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer a13ffe92eb374309a5c8476d9fbbb2b8 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:14:44.329551  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:44.332661  6368 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:44.336046  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.335999  8364 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.338219  8437 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:44.338452  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:44.339031  8375 raft_consensus.cc:3055] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:44.339259  8437 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.339474  8375 raft_consensus.cc:740] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:44.339614  6368 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.339701  8437 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:44.340240  8437 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.341565  6368 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.347229  6254 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:44.312335  8430 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.353438  6905 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.354390  6905 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:44.356482  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.357185  6368 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.329267  8419 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:44.359226  6368 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:44.363453  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:44.365155  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.365331  8452 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.368709  6329 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:44.363433  8453 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:44.340376  8375 consensus_queue.cc:260] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.361404  8356 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:44.372448  8347 tablet_bootstrap.cc:492] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:44.369210  8367 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:14:44.377566  8445 log.cc:927] Time spent T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:14:44.378086  8367 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.377018  6331 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:44.358079  8285 tablet_copy_client.cc:806] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:44.381047  6219 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:44.377498  6256 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:44.381897  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.355861  8354 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:44.386086  6256 raft_consensus.cc:1240] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:44.390003  6331 raft_consensus.cc:1240] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:44.394085  8450 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:44.394550  8450 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:44.394964  8450 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:44.383656  8375 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.386185  8376 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:44.391034  8285 tablet_copy_client.cc:670] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:44.396325  8314 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:44.406148  8404 raft_consensus.cc:3055] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:44.406592  8404 raft_consensus.cc:740] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:44.395565  8419 consensus_queue.cc:1059] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:14:44.395965  8394 consensus_queue.cc:1059] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:14:44.409710  8376 raft_consensus.cc:697] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:44.408993  8314 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.407364  8404 consensus_queue.cc:260] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:44.426515  8419 consensus_queue.cc:1243] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:44.439631  8430 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:44.440733  8376 consensus_queue.cc:237] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:44.451683  8413 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:44.389849  8384 consensus_queue.cc:260] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:44.438138  8402 consensus_meta.cc:287] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:14:44.414738  8453 consensus_queue.cc:1059] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:14:44.475137  8404 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.471311  8384 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.481647  8452 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:44.486526  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 77529us
I20260709 13:14:44.493834  8367 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.502976  6322 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:44.503494  6399 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:44.529597  8327 raft_consensus.cc:3055] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:44.533717  8327 raft_consensus.cc:740] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:44.534512  8327 consensus_queue.cc:260] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:44.535811  8327 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.536145  8450 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:44.518018  8428 raft_consensus.cc:3055] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:44.583386  6247 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:44.587525  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:44.588414  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.565178  8403 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:44.601459  8403 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.602020  8372 raft_consensus.cc:3055] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:44.607827  8372 raft_consensus.cc:740] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:44.608698  8372 consensus_queue.cc:260] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.609845  8372 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:44.615024  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.601955  8428 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:44.619480  6906 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.628167  6253 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:44.629179  8450 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:44.633654  6326 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:44.636118  6322 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:44.637457  8448 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:44.638276  6399 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:44.638316  6405 raft_consensus.cc:1240] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:44.639358  6253 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:44.640188  6295 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:44.650738  6400 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:44.655524  8412 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:44.637972  8448 raft_consensus.cc:697] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:44.661303  8331 tablet_copy_client.cc:538] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:44.661444  8402 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:44.662011  8402 raft_consensus.cc:697] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:44.662905  8402 consensus_queue.cc:237] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:14:44.648913  8345 raft_consensus.cc:3055] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:44.665154  8345 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:44.665417  6933 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:44.650498  8428 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.668020  8420 raft_consensus.cc:3055] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:44.668421  8420 raft_consensus.cc:740] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:44.669638  8403 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:44.670823  8364 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:44.650452  8424 raft_consensus.cc:3055] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:14:44.687753  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 328580us
I20260709 13:14:44.688548  6368 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.689864  6368 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.691259  6368 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.692423  6368 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.691499  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:44.693826  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:44.695304  6368 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:44.701050  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 60935.9us
I20260709 13:14:44.703462  6368 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:44.730557  6247 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:44.731714  6368 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.640406  8437 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.733327  6368 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.673772  8448 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.736485  6368 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.736025  6249 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:44.684733  8424 raft_consensus.cc:740] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:44.738143  6368 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.726666  8450 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:44.777827  6368 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.728605  8434 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:44.696455  8413 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:44.730748  8327 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:44.732864  8344 tablet_copy_client.cc:538] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:44.685518  8399 consensus_queue.cc:1059] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:14:44.691077  8364 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:44.771072  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.772537  8443 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:44.736567  8391 consensus_queue.cc:1059] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:14:44.734229  8367 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.791306  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:44.778972  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 46442.8us
I20260709 13:14:44.696312  8403 consensus_queue.cc:1059] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:14:44.782907  8314 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:44.794188  6400 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:44.794559  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:44.801762  8458 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:14:44.802436  6325 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:44.736819  8452 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:44.734817  8416 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:14:44.760308  8324 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:44.770344  8285 tablet_copy_client.cc:538] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:44.695895  8420 consensus_queue.cc:260] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.739550  8356 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:14:44.784637  6247 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:44.769568  8404 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:44.817317  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.817378  8404 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.819028  8437 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:44.819483  8404 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:44.733081  8394 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:14:44.734305  8354 consensus_queue.cc:1059] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:14:44.785624  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.785091  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.821353  6297 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:44.771962  8453 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.734656  8432 raft_consensus.cc:3055] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:44.776845  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:44.683967  8345 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:44.828222  8302 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.834002  8368 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:44.833801  8302 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.836030  8302 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:44.776772  8419 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:14:44.790604  8450 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:44.805828  8424 consensus_queue.cc:260] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.810446  8459 raft_consensus.cc:3055] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:44.811239  8420 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.844211  6219 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:44.811030  8414 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:44.808497  8403 consensus_queue.cc:1243] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 3.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:14:44.855484  8391 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:14:44.857697  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 585369us
I20260709 13:14:44.813169  8405 raft_consensus.cc:3055] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:44.858525  8405 raft_consensus.cc:740] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:44.858609  8314 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:44.859340  8405 consensus_queue.cc:260] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.859916  8366 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.860733  8405 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.824115  6368 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:44.827732  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 534045us
W20260709 13:14:44.863034  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 55791.6us
I20260709 13:14:44.804461  8367 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:44.831300  6322 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:44.846040  8459 raft_consensus.cc:740] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:44.847684  8424 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.847957  8451 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:44.828083  8432 raft_consensus.cc:740] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:44.850405  8354 raft_consensus.cc:3055] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:44.851824  8409 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.853466  6905 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:44.854828  8372 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:44.829424  8437 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.861363  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:44.886620  6937 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 3: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:44.848099  6154 catalog_manager.cc:5697] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 4 to 5, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 5 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:44.877791  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.880607  6936 raft_consensus.cc:1240] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:44.881052  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:44.874003  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.884430  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:44.888064  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.891921  6326 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:44.892459  6329 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:44.892946  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:44.893416  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:44.897622  6322 raft_consensus.cc:2393] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:44.898699  6405 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:44.902623  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:44.867739  8367 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.875535  8345 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:44.871510  8354 raft_consensus.cc:740] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:44.876008  8419 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.880134  8462 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 13:14:44.905910  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.899108  8355 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:44.870486  8459 consensus_queue.cc:260] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:44.907290  6151 catalog_manager.cc:5697] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 2 to 3, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:44.910142  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:44.911384  6941 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:44.885460  8414 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:44.914085  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:44.880931  8356 consensus_queue.cc:1059] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:14:44.881625  8418 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:14:44.915952  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:44.905459  8391 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:14:44.917903  6297 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:44.969002  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 51172.8us
I20260709 13:14:44.920043  8354 consensus_queue.cc:260] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:44.890196  8451 raft_consensus.cc:697] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:14:44.923722  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.868062  8404 consensus_queue.cc:1059] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:14:44.932840  6153 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55326 (request call id 374) took 2098 ms. Trace:
I20260709 13:14:44.936159  6399 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:44.936756  6398 raft_consensus.cc:1240] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:44.973217  6153 rpcz_store.cc:276] 0709 13:14:42.834571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.834743 (+   172us) service_pool.cc:224] Handling call
0709 13:14:44.932756 (+2098013us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30279,"reported_tablets":6}
I20260709 13:14:44.974133  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:44.936777  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:44.944629  6323 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:44.947540  6396 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:44.947991  6403 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:44.885607  8371 consensus_queue.cc:1059] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:14:44.976369  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:44.950892  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:44.956259  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:44.956349  6934 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:44.957960  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:44.964427  6325 raft_consensus.cc:1240] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:44.957497  8392 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.981436  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:44.926502  8412 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.979732  6935 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:44.931420  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:44.980712  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:14:44.981101  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:44.987629  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.988731  6936 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:44.927476  8377 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:14:44.966650  8355 raft_consensus.cc:697] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:44.993350  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:44.975688  8314 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.000564  6405 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:45.000751  6396 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:45.003238  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:45.008574  6404 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:45.013401  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:45.013705  6368 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:44.983255  8434 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.014375  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:45.009438  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:14:45.020522  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 116270us
I20260709 13:14:45.021857  6396 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:45.023084  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:14:45.023417  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 81796.2us
I20260709 13:14:45.026803  6368 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:45.032626  8428 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:45.032763  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:45.034184  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:45.034719  6405 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:45.037739  6396 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:45.038235  6942 raft_consensus.cc:1240] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:45.039256  8375 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.039757  8375 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.041996  8375 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:45.029860  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:45.047680  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2150) took 1025 ms. Trace:
I20260709 13:14:44.990650  8387 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:14:45.016425  8396 raft_consensus.cc:3055] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:45.031208  6328 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 2: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:44.990075  8412 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.053361  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:45.050992  6323 rpcz_store.cc:276] 0709 13:14:44.022732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.022831 (+    99us) service_pool.cc:224] Handling call
0709 13:14:44.023021 (+   190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:44.975043 (+952022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:45.047452 (+ 72409us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54002913d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:45.047624 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118467328}
I20260709 13:14:45.052243  6222 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
W20260709 13:14:45.038069  8384 consensus_meta.cc:287] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.000s
I20260709 13:14:45.030681  8452 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:45.030831  8437 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.047574  8399 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:45.081415  6405 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:45.051111  8463 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.082437  6368 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:45.096145  6403 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
W20260709 13:14:45.082659  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.057785  8396 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:45.028406  8434 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.079239  6296 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:45.073909  8444 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:45.123952  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 44787.2us
I20260709 13:14:45.127146  6296 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:45.125468  6397 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:45.129752  6296 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:45.132146  6296 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:45.133673  6296 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:45.135035  6296 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:45.121974  8452 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.118826  8461 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.126283  8444 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.128464  8416 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:45.125094  8327 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.131881  8314 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:45.060163  8451 consensus_queue.cc:237] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:45.135881  8368 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.140671  8407 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.121733  8463 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.143983  8369 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.140290  8423 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:45.151041  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:45.151643  8444 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.153884  8449 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:45.163435  8399 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.119810  8355 consensus_queue.cc:237] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.171535  8416 raft_consensus.cc:697] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:14:45.204476  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 61384.6us
I20260709 13:14:45.153664  8302 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:14:45.207978  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:45.151054  8461 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.215341  6371 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:45.162926  8327 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:45.206864  6221 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:45.218967  6249 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:45.227794  6221 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:45.197922  8423 raft_consensus.cc:697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:14:45.232201  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.234720  6369 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:45.167438  8396 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:44.971873  8324 consensus_queue.cc:1175] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" responder_term: 5 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:45.198110  6938 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
W20260709 13:14:44.881052  8403 consensus_queue.cc:1175] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" responder_term: 5 status { last_received { term: 4 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:45.227088  8420 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.233507  8371 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:45.205492  8399 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.270623  8416 consensus_queue.cc:237] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:45.202818  8449 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.235502  8460 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:45.240353  8419 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.248792  8285 tablet_bootstrap.cc:492] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:45.232316  8476 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:45.272683  8399 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:45.280479  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.248637  8412 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:45.239079  8349 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:14:45.286787  6323 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:45.285426  8350 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:45.275019  6251 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:45.287153  6222 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:45.265221  8475 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:45.280014  8371 raft_consensus.cc:697] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:45.298745  8375 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:45.307507  8475 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.253772  8443 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:14:45.315860  8375 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.343322  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:45.345495  6403 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:45.299278  8460 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.352572  8331 tablet_bootstrap.cc:492] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:14:45.318009  8434 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:45.346113  8472 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:14:45.300109  8423 consensus_queue.cc:237] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:45.345963  8375 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:45.332880  8475 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:45.360617  6150 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55342 (request call id 347) took 1606 ms. Trace:
I20260709 13:14:45.387607  6150 rpcz_store.cc:276] 0709 13:14:43.754625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.754800 (+   175us) service_pool.cc:224] Handling call
0709 13:14:45.360555 (+1605755us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":327608,"reported_tablets":3}
I20260709 13:14:45.366485  8344 tablet_bootstrap.cc:492] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
W20260709 13:14:45.368887  8366 consensus_meta.cc:287] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.003s
W20260709 13:14:45.354138  8364 consensus_meta.cc:287] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.002s
W20260709 13:14:45.378093  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.354920  8461 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:45.386773  8327 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:45.356220  8371 consensus_queue.cc:237] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:45.419714  6404 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:45.400668  8364 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.397794  8449 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:45.463261  8466 log.cc:927] Time spent T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.306s	user 0.002s	sys 0.001s
I20260709 13:14:45.474542  8460 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:45.475663  8463 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:45.502135  8372 raft_consensus.cc:3055] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:45.502702  8372 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:14:45.504298  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.503729  8372 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.505232  8372 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.516101  6221 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:45.528975  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:45.529870  6326 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:45.531399  6368 leader_election.cc:304] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:45.534405  8392 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:45.534972  8392 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.535084  8459 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:45.535462  8392 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:45.541436  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:45.508229  8450 consensus_meta.cc:287] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.661s	user 0.008s	sys 0.002s
W20260709 13:14:45.545239  6251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 378) took 1616 ms (client timeout 1591 ms). Trace:
W20260709 13:14:45.546630  6251 rpcz_store.cc:269] 0709 13:14:43.928778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.929229 (+   451us) service_pool.cc:224] Handling call
0709 13:14:45.544993 (+1615764us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400172fd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:45.545159 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2628174464}
I20260709 13:14:45.512974  6400 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
W20260709 13:14:45.570107  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 346674us
I20260709 13:14:45.542143  8364 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:45.484480  8444 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:45.586493  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:45.579941  8424 consensus_meta.cc:287] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.714s	user 0.011s	sys 0.000s
I20260709 13:14:45.566798  8450 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:45.412237  8432 consensus_queue.cc:260] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:45.583487  8428 consensus_meta.cc:287] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 13:14:45.580260  8364 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.597078  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:45.598404  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:45.599103  6940 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:14:45.602435  8345 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:45.603026  8345 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:45.603622  8414 consensus_meta.cc:287] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.000s
W20260709 13:14:45.614792  8367 consensus_meta.cc:287] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.694s	user 0.005s	sys 0.005s
I20260709 13:14:45.499763  8475 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.620380  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:45.620311  8367 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:45.621176  6934 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:45.622485  8367 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:45.623147  6402 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:45.623546  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:45.620342  6371 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:45.628502  6399 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:14:45.630539  6398 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:14:45.597096  8447 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.610582  8364 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.615983  8345 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:45.629875  8437 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.628374  8414 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.632953  8367 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:45.634617  8452 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.661314  8367 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.663862  8367 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:45.655210  8447 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.665725  6325 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:14:45.663043  8377 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.670282  8377 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.660094  8345 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.684088  8345 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:45.690263  8345 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:45.660547  8414 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:45.694521  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:45.697697  6934 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:14:45.698022  8377 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:45.702443  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.702687  8354 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:45.707027  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:45.708194  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:45.710116  8444 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:45.713217  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.715636  6296 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:45.717051  6296 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:45.718159  6405 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:45.688345  8475 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:45.722605  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:45.730309  6405 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:45.731400  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:45.732049  6405 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.728078  6939 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:14:45.731758  6221 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:45.737299  8375 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.737697  8367 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.739548  8375 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:45.740455  8364 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:45.741291  8349 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:45.741647  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:45.729072  8404 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:14:45.719883  8407 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:45.728902  8428 consensus_queue.cc:1059] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:14:45.725272  8460 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:45.745170  8447 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:45.745306  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:45.712745  8392 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.719935  8444 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.788298  6396 raft_consensus.cc:1240] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:45.763667  8349 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:45.794862  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:45.795699  6247 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 3: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:45.765534  6938 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:45.774814  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:45.780277  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.785415  6403 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:45.761582  8367 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:45.806173  8409 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.782238  8347 tablet_bootstrap.cc:492] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:45.812258  6397 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:45.805949  8349 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:45.835335  8384 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:45.835960  8384 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.840652  8384 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:45.845674  6250 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:45.797233  8407 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.832715  8428 consensus_queue.cc:1059] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:45.814438  8461 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.812397  8404 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.829351  8409 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:45.852231  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:45.812318  8368 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.853345  6405 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
W20260709 13:14:45.854038  6369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.026s	sys 0.033s
I20260709 13:14:45.779924  6934 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:14:45.856387  6401 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
W20260709 13:14:45.864583  6369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.027s	sys 0.033s
I20260709 13:14:45.862028  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:45.867552  6397 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:45.861387  6402 raft_consensus.cc:2376] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3. Re-sending same reply.
I20260709 13:14:45.807183  8444 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.869596  6371 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:14:45.871896  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 643759us
I20260709 13:14:45.886849  6371 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:45.890703  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:45.891132  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:45.891906  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:45.892557  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:45.910562  6253 raft_consensus.cc:2393] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:45.909839  6249 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:45.909799  6405 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:45.866456  8345 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.893213  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:45.890610  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:45.860075  8407 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:45.863101  8372 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:14:45.879906  8367 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:45.922231  8367 raft_consensus.cc:697] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:45.913475  6252 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:14:45.866623  8404 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:45.913160  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:45.914454  8403 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:45.926766  8349 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:45.926868  8403 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:45.928053  6251 raft_consensus.cc:1240] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:45.929841  8364 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:45.867441  8368 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:45.924752  8367 consensus_queue.cc:237] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.925545  8444 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:45.867043  8461 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:45.930312  8349 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:45.919790  8347 tablet_bootstrap.cc:492] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:45.935961  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:45.936575  6403 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:45.937949  8414 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:45.915833  8434 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:45.938855  8434 raft_consensus.cc:697] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:45.939899  8434 consensus_queue.cc:237] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:45.940960  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:45.942022  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:45.942281  8392 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:45.942617  6401 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:45.943518  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:45.944061  6401 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:45.945686  6403 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.946276  8396 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.951936  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:45.952142  6369 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:45.954104  8409 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:45.955085  8461 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:45.955682  8409 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.956624  6401 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:14:45.965368  6401 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:45.965504  6369 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:45.966683  6369 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:45.969800  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:45.970497  6252 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.968637  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:45.993248  6907 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:45.993610  8347 ts_tablet_manager.cc:1403] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 1.621s	user 0.028s	sys 0.028s
I20260709 13:14:45.996821  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2162) took 1045 ms. Trace:
I20260709 13:14:45.999796  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:46.000589  6398 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:46.004331  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:45.997310  6396 rpcz_store.cc:276] 0709 13:14:44.951850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.065950 (+114100us) service_pool.cc:224] Handling call
0709 13:14:45.788141 (+722191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:45.788751 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:45.996585 (+207834us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b5400401d50. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:45.996751 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660226432}
I20260709 13:14:46.009415  6221 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:46.010289  6221 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:46.010553  6401 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:45.956135  8409 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:46.012427  6398 raft_consensus.cc:1240] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:46.012686  6907 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:46.015947  8324 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.017421  6221 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:46.018425  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:46.025812  6252 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:46.027076  6369 leader_election.cc:304] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:46.028354  8392 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:46.029716  6221 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:45.913110  8345 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:45.994966  8475 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:45.994818  8459 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:45.993680  8404 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:46.006673  8452 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:46.028985  8474 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:46.029294  8349 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:46.030148  6328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.031s	sys 0.035s
I20260709 13:14:46.037670  8444 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:46.052289  6400 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:46.038611  8377 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:46.045469  8450 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:46.040122  8392 raft_consensus.cc:697] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:46.016539  8324 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:46.038772  8372 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:14:46.062229  8377 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.071640  8368 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:46.071882  8418 raft_consensus.cc:3055] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:46.072522  8324 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:46.076761  8384 raft_consensus.cc:3055] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:46.079331  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:46.058106  8432 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.057644  8452 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.057272  8403 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:46.057078  8428 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:46.059175  8474 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:46.066114  6328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.031s	sys 0.035s
I20260709 13:14:46.060362  8444 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.056613  8394 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:46.111804  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.045435  8375 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:14:46.083362  8349 raft_consensus.cc:697] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:14:46.113692  6219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.016s	sys 0.055s
W20260709 13:14:46.133829  6219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.017s	sys 0.055s
W20260709 13:14:46.134160  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 843693us
I20260709 13:14:46.123729  8452 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:46.088004  8475 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.087983  8377 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:46.088162  8450 raft_consensus.cc:697] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:46.126797  8404 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.110117  8418 raft_consensus.cc:740] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:46.113220  8384 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:46.171298  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:46.110330  8355 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.023s	sys 0.048s
W20260709 13:14:46.112421  8451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.012s	sys 0.033s
I20260709 13:14:46.123064  8368 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.123359  8428 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.125535  8474 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:46.129926  8444 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:46.131367  8391 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.021s	sys 0.018s
W20260709 13:14:46.129885  8395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.031s	sys 0.039s
I20260709 13:14:46.191448  8347 raft_consensus.cc:359] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:46.193818  8376 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.182399  8404 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:46.181944  8407 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:46.189874  6397 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
W20260709 13:14:46.198343  6942 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.019s	sys 0.011s
W20260709 13:14:46.137076  8476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.018s	sys 0.045s
W20260709 13:14:46.183341  8355 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.023s	sys 0.048s
I20260709 13:14:46.133646  8394 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:46.242242  6942 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.019s	sys 0.011s
I20260709 13:14:46.199872  8428 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:46.170815  8464 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.014s	sys 0.030s
W20260709 13:14:46.196611  8451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.013s	sys 0.033s
I20260709 13:14:46.245236  8478 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:46.200505  8448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.015s	sys 0.029s
W20260709 13:14:46.200351  8416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.017s	sys 0.029s
I20260709 13:14:46.251633  8372 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:46.171602  8475 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:46.251749  8349 consensus_queue.cc:237] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:46.184079  8392 consensus_queue.cc:237] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:46.395991  6906 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.003s	sys 0.031s
I20260709 13:14:46.603972  6942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 469) took 1529 ms. Trace:
W20260709 13:14:46.376766  6222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.024s	sys 0.061s
W20260709 13:14:46.395828  6936 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.013s	sys 0.034s
W20260709 13:14:46.609771  6936 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.018s	sys 0.035s
W20260709 13:14:46.317248  6151 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.018s	sys 0.033s
W20260709 13:14:46.609097  6906 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.364s	user 0.007s	sys 0.033s
W20260709 13:14:46.691819  6151 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.306s	user 0.027s	sys 0.037s
I20260709 13:14:46.609457  6942 rpcz_store.cc:276] 0709 13:14:45.074144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.074839 (+   695us) service_pool.cc:224] Handling call
0709 13:14:45.075217 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:45.245194 (+169977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:45.245231 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:45.249665 (+  4434us) log.cc:844] Serialized 26 byte log entry
0709 13:14:46.243249 (+993584us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:46.243291 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.260270 (+ 16979us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54007288d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:46.260317 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:46.579578 (+319261us) raft_consensus.cc:1685] finished
0709 13:14:46.579613 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:46.603847 (+ 24234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55736,"raft.run_cpu_time_us":595,"raft.run_wall_time_us":45648,"spinlock_wait_cycles":285928192,"thread_start_us":1005470,"threads_started":2,"wal-append.queue_time_us":1325502}
W20260709 13:14:46.243048  8476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.019s	sys 0.046s
W20260709 13:14:46.234018  8395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.031s	sys 0.040s
I20260709 13:14:46.248601  8396 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:46.609594  6222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.313s	user 0.026s	sys 0.062s
W20260709 13:14:46.299276  8371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.008s	sys 0.021s
I20260709 13:14:46.258361  8375 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:46.236603  8391 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.021s	sys 0.024s
W20260709 13:14:46.427839  8486 log.cc:927] Time spent T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:14:46.698021  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 1.41083e+06us
I20260709 13:14:46.463171  8402 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:14:46.612334  8416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.258s	user 0.019s	sys 0.040s
I20260709 13:14:46.385411  8479 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:46.437500  8407 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:46.686827  8364 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.605294  8489 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:46.610505  8448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.459s	user 0.018s	sys 0.037s
W20260709 13:14:46.608446  8464 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.263s	user 0.018s	sys 0.040s
W20260709 13:14:46.694336  6294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.005s	sys 0.034s
W20260709 13:14:46.746357  6294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.006s	sys 0.034s
I20260709 13:14:46.697278  8476 raft_consensus.cc:697] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:46.580049  8355 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:46.528807  8482 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:46.422686  8423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.017s	sys 0.010s
I20260709 13:14:46.241700  8347 raft_consensus.cc:740] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:46.278371  8409 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:46.573378  8404 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:46.751803  8356 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.006s	sys 0.029s
I20260709 13:14:46.200235  8368 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:46.771040  8423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.264s	user 0.021s	sys 0.012s
W20260709 13:14:46.698403  6250 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.008s	sys 0.026s
I20260709 13:14:46.742854  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:46.819880  6939 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:46.706382  8371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.018s	sys 0.023s
I20260709 13:14:46.298938  8345 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:46.750334  6322 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:46.702245  8394 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:46.421933  8474 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:46.756227  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:46.753353  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:46.767832  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:46.759830  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:46.896766  6326 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:46.758793  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:46.748409  8407 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:46.365588  8428 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:46.629455  8372 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:46.235918  8384 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:46.774979  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:46.428642  8483 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:14:46.804600  6219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.003s	sys 0.033s
I20260709 13:14:46.807749  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:46.753500  8364 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:46.236260  8376 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:46.288226  8418 consensus_queue.cc:260] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:46.775998  8355 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:46.752106  8413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.025s	sys 0.021s
I20260709 13:14:46.748725  8324 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:46.813500  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:46.712157  8396 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:46.735595  8375 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:46.822383  6399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.016s	sys 0.020s
W20260709 13:14:47.007745  6399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.016s	sys 0.020s
W20260709 13:14:46.830225  6401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.024s	sys 0.011s
W20260709 13:14:47.008819  6401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.025s	sys 0.012s
I20260709 13:14:46.806696  8448 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:14:46.957481  8494 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:14:46.812810  8452 consensus_meta.cc:287] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.640s	user 0.019s	sys 0.000s
I20260709 13:14:46.768889  6941 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:46.897737  6326 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:46.819557  6250 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.009s	sys 0.026s
I20260709 13:14:46.896801  6331 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
W20260709 13:14:46.905553  6221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.017s	sys 0.019s
I20260709 13:14:46.745117  8402 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:46.753389  8479 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:46.805677  6398 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.020s	sys 0.010s
W20260709 13:14:47.029579  6398 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.020s	sys 0.010s
W20260709 13:14:47.004249  8413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.319s	user 0.025s	sys 0.021s
I20260709 13:14:46.816766  8404 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:46.276475  8450 consensus_queue.cc:237] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:46.917245  6219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.004s	sys 0.033s
W20260709 13:14:46.885447  8460 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.026s	sys 0.059s
I20260709 13:14:46.881110  8409 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.954469  8384 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:46.936506  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:46.879083  8347 consensus_queue.cc:260] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
W20260709 13:14:47.078388  6296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.184s	user 0.023s	sys 0.108s
W20260709 13:14:47.078742  6296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.185s	user 0.023s	sys 0.108s
W20260709 13:14:47.055326  8460 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.125s	user 0.030s	sys 0.071s
I20260709 13:14:46.996893  8364 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:46.997323  6295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.172s	user 0.019s	sys 0.034s
W20260709 13:14:47.128829  6295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.303s	user 0.019s	sys 0.034s
W20260709 13:14:47.129225  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 1.30352e+06us
I20260709 13:14:47.055707  8345 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.752305  8489 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:46.812047  8356 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.006s	sys 0.029s
I20260709 13:14:47.017356  8407 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:46.881624  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:14:46.998620  8444 consensus_meta.cc:287] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.763s	user 0.010s	sys 0.000s
I20260709 13:14:46.776212  8482 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:47.053442  6404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.043s	sys 0.080s
W20260709 13:14:47.182101  6404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.044s	sys 0.081s
I20260709 13:14:47.035063  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:46.999313  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 486) took 1721 ms. Trace:
W20260709 13:14:47.050642  6400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.000s	sys 0.020s
W20260709 13:14:47.183229  6400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.000s	sys 0.021s
W20260709 13:14:47.055956  6940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.203s	user 0.009s	sys 0.012s
I20260709 13:14:47.056370  6936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 472) took 1879 ms. Trace:
I20260709 13:14:47.184712  6936 rpcz_store.cc:276] 0709 13:14:45.177352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.177498 (+   146us) service_pool.cc:224] Handling call
0709 13:14:45.201677 (+ 24179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:45.201916 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:45.201943 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:45.508596 (+306653us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b2c00047a38. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f45744dea11 00007f45744ee372 00007f4575c20a01 00007f4575be543a 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2
0709 13:14:45.513656 (+  5060us) log.cc:844] Serialized 26 byte log entry
0709 13:14:46.610248 (+1096592us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:46.610289 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.610374 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.019364 (+408990us) raft_consensus.cc:1685] finished
0709 13:14:47.019397 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.056279 (+ 36882us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12480896,"thread_start_us":1096225,"threads_started":1,"wal-append.queue_time_us":1504121}
I20260709 13:14:47.008338  8478 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:47.186893  8478 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:47.189276  6940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.336s	user 0.009s	sys 0.012s
W20260709 13:14:47.023043  8432 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.006s	sys 0.032s
I20260709 13:14:47.073701  6939 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
W20260709 13:14:47.193361  8432 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.006s	sys 0.033s
I20260709 13:14:47.194422  8432 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:47.141980  8475 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:46.997968  8483 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:46.958125  8391 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:14:47.117173  8285 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.034s	user 0.015s	sys 0.015s
I20260709 13:14:47.014251  8324 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:47.272498  8492 log.cc:927] Time spent T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
I20260709 13:14:47.146026  8345 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:47.285600  8285 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.203s	user 0.022s	sys 0.016s
W20260709 13:14:47.148582  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 439899us
W20260709 13:14:47.161427  6396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.105s	user 0.014s	sys 0.017s
I20260709 13:14:47.085840  8463 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:14:47.021497  6221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.018s	sys 0.019s
I20260709 13:14:47.023149  8448 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:47.031497  8452 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:47.055552  8404 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:47.131664  8497 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.078148  8409 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:47.110553  8484 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.126s
I20260709 13:14:47.033470  8476 consensus_queue.cc:237] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:47.203347  8444 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:46.882285  8395 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:14:47.302024  6396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.246s	user 0.014s	sys 0.017s
W20260709 13:14:47.320459  6403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.291s	user 0.012s	sys 0.028s
W20260709 13:14:47.412602  6403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.384s	user 0.012s	sys 0.028s
I20260709 13:14:47.075733  6219 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:47.391871  8368 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:47.421231  8499 log.cc:927] Time spent T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
I20260709 13:14:47.422399  8428 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:47.410252  8372 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:47.333149  8463 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:47.386722  8497 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:47.639418  6297 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.081s	user 0.006s	sys 0.031s
W20260709 13:14:47.715739  6297 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.006s	sys 0.032s
W20260709 13:14:47.716015  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 1.15813e+06us
W20260709 13:14:47.676899  6222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.011s	sys 0.009s
W20260709 13:14:47.717151  6222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.011s	sys 0.009s
W20260709 13:14:47.677089  6368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.005s	sys 0.031s
I20260709 13:14:47.203742  8407 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
W20260709 13:14:47.306655  8377 consensus_meta.cc:287] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 1.125s	user 0.011s	sys 0.000s
W20260709 13:14:47.734449  6905 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.012s	sys 0.012s
W20260709 13:14:47.734845  6905 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.012s	sys 0.012s
W20260709 13:14:47.735236  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 985751us
I20260709 13:14:47.141508  8364 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.271133  8475 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:47.327574  8500 log.cc:927] Time spent T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 13:14:47.408885  6402 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.325s	user 0.006s	sys 0.041s
W20260709 13:14:47.760555  6402 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.692s	user 0.006s	sys 0.041s
W20260709 13:14:47.718819  6220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.011s	sys 0.011s
W20260709 13:14:47.761229  6220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.011s	sys 0.011s
I20260709 13:14:47.318851  8423 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:47.682294  6371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.007s	sys 0.024s
W20260709 13:14:47.766063  6371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.062s	user 0.008s	sys 0.025s
W20260709 13:14:47.730161  8349 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.000s	sys 0.011s
W20260709 13:14:47.722422  6368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.005s	sys 0.032s
I20260709 13:14:47.445080  8416 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:47.709188  8344 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.000s	sys 0.032s
W20260709 13:14:47.326213  8434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.130s	user 0.013s	sys 0.026s
I20260709 13:14:47.497290  8355 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:47.732756  6325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.000s	sys 0.010s
I20260709 13:14:47.396675  8432 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:14:47.738068  6327 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.004s	sys 0.006s
W20260709 13:14:47.446584  8367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.490s	user 0.017s	sys 0.021s
I20260709 13:14:47.738585  8428 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:47.712486  8324 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:47.758857  8497 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:47.720933  8478 consensus_meta.cc:287] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.533s	user 0.006s	sys 0.004s
W20260709 13:14:47.591444  8511 log.cc:927] Time spent T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
W20260709 13:14:47.536432  6938 consensus_meta.cc:287] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 1.689s	user 0.014s	sys 0.000s
W20260709 13:14:47.449980  8464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.027s	sys 0.115s
I20260709 13:14:47.721484  6400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 393) took 1531 ms. Trace:
I20260709 13:14:47.589054  8514 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:47.583618  8396 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:47.300010  8391 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:47.591374  8317 consensus_queue.cc:1059] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.221s
W20260709 13:14:47.928383  8344 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.000s	sys 0.045s
I20260709 13:14:47.729569  8479 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:47.737135  8474 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:47.711189  8371 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.782354  8347 ts_tablet_manager.cc:1434] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 1.788s	user 0.024s	sys 0.026s
I20260709 13:14:47.770354  8402 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:47.765465  8356 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.760739  8377 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:47.373255  6252 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.015s	sys 0.003s
I20260709 13:14:47.754245  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:47.839512  6369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.002s	sys 0.014s
W20260709 13:14:47.766366  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 1.06225e+06us
W20260709 13:14:47.899753  6398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.001s	sys 0.027s
I20260709 13:14:47.765543  6933 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:47.969194  8324 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.838209  8345 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:47.917829  8349 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.003s	sys 0.014s
W20260709 13:14:47.918742  8367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.970s	user 0.022s	sys 0.026s
I20260709 13:14:47.779395  8364 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:47.783078  8372 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.752764  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:47.918911  8376 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:47.445650  8395 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:47.945384  8416 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:47.818112  8423 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:47.950255  8432 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:47.923245  8434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.741s	user 0.015s	sys 0.040s
I20260709 13:14:47.802165  8448 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:47.839217  8460 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.003s	sys 0.013s
W20260709 13:14:47.944895  8464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.036s	sys 0.128s
I20260709 13:14:47.780937  8475 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:47.978075  8482 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:47.945077  8484 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:47.820305  8515 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:47.945372  6938 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:14:48.112516  8542 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.356451  8501 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.356587  8551 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:47.949879  8428 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:47.791550  6296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.005s	sys 0.010s
I20260709 13:14:47.945161  6400 rpcz_store.cc:276] 0709 13:14:46.182544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.182753 (+   209us) service_pool.cc:224] Handling call
0709 13:14:46.183114 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.183537 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.183562 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.184017 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.183714 (+999697us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:47.184283 (+   569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.184389 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.713523 (+529134us) raft_consensus.cc:1685] finished
0709 13:14:47.713545 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.713800 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":727,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":9890,"thread_start_us":942206,"threads_started":1,"wal-append.queue_time_us":1504045}
I20260709 13:14:47.944936  8522 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:47.197337  6328 rpcz_store.cc:276] 0709 13:14:45.216095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.220013 (+  3918us) service_pool.cc:224] Handling call
0709 13:14:45.245281 (+ 25268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:45.288230 (+ 42949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:45.293111 (+  4881us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:45.313036 (+ 19925us) log.cc:844] Serialized 26 byte log entry
0709 13:14:46.133536 (+820500us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:46.135180 (+  1644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.165890 (+ 30710us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:46.879522 (+713632us) raft_consensus.cc:1685] finished
0709 13:14:46.882694 (+  3172us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:46.936958 (+ 54264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":347,"raft.queue_time_us":9261,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":5481,"thread_start_us":812165,"threads_started":1,"wal-append.queue_time_us":985720}
I20260709 13:14:47.996136  8514 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:47.945425  8478 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:48.202615  6370 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.023s	sys 0.050s
W20260709 13:14:48.358881  6369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.362s	user 0.002s	sys 0.027s
I20260709 13:14:48.215613  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 387) took 2309 ms. Trace:
W20260709 13:14:48.650393  6222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.006s	sys 0.016s
W20260709 13:14:48.236580  6906 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.012s	sys 0.007s
W20260709 13:14:48.195807  6329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.175s	user 0.003s	sys 0.025s
W20260709 13:14:48.650831  6404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.454s	user 0.006s	sys 0.024s
W20260709 13:14:48.443540  6398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.372s	user 0.006s	sys 0.033s
W20260709 13:14:48.744469  8526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.000s	sys 0.010s
I20260709 13:14:48.214069  6403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 383) took 3127 ms. Trace:
W20260709 13:14:48.764914  6252 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.930s	user 0.023s	sys 0.005s
W20260709 13:14:48.670531  6325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.654s	user 0.004s	sys 0.025s
I20260709 13:14:48.214188  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2174) took 2441 ms. Trace:
W20260709 13:14:48.650519  6330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.002s	sys 0.026s
I20260709 13:14:48.213984  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2168) took 2688 ms. Trace:
W20260709 13:14:48.237612  6940 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.011s	sys 0.007s
W20260709 13:14:47.759967  6250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.008s	sys 0.009s
W20260709 13:14:48.774761  6222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.014s	sys 0.020s
W20260709 13:14:48.087859  8507 log.cc:927] Time spent T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:14:48.267149  8368 raft_consensus.cc:3055] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:14:48.046629  8510 log.cc:927] Time spent T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.720s	user 0.000s	sys 0.002s
W20260709 13:14:48.086519  8532 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.171s	user 0.002s	sys 0.000s
W20260709 13:14:48.777616  6370 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.274s	user 0.027s	sys 0.085s
W20260709 13:14:48.777467  6404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.581s	user 0.010s	sys 0.029s
W20260709 13:14:48.443455  6327 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.487s	user 0.007s	sys 0.020s
W20260709 13:14:48.067718  8505 log.cc:927] Time spent T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.474s	user 0.000s	sys 0.002s
W20260709 13:14:48.243016  8331 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.016s	sys 0.024s
W20260709 13:14:48.085836  8513 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:14:48.465976  8553 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.780400  8515 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:48.798168  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1254) took 2336 ms. Trace:
I20260709 13:14:48.798689  6252 rpcz_store.cc:276] 0709 13:14:46.461901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.462048 (+   147us) service_pool.cc:224] Handling call
0709 13:14:46.462354 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:48.797549 (+2335195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:48.797614 (+    65us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:48.797692 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:48.797731 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:48.797847 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.798035 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":419459,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":37037,"thread_start_us":2316194,"threads_started":1}
I20260709 13:14:48.776003  6403 rpcz_store.cc:276] 0709 13:14:45.086720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.947938 (+861218us) service_pool.cc:224] Handling call
0709 13:14:45.948183 (+   245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:45.948485 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:45.948509 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:45.994682 (+ 46173us) log.cc:844] Serialized 26 byte log entry
0709 13:14:46.077620 (+ 82938us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b48001d01d8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457ab0eaa1 00007f457ab05b37 00007f457ab059ca 00007f457abfd26f 00007f457abfcf37 00007f457ac1155c 00007f457ac11508 00007f457ac11488 00007f457ac11443 00007f457ac106ec 00007f4579b3aa96
0709 13:14:47.413015 (+1335395us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:47.413070 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.413160 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:48.213177 (+800017us) raft_consensus.cc:1685] finished
0709 13:14:48.213247 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.213861 (+   614us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":742,"raft.run_cpu_time_us":1908,"raft.run_wall_time_us":120440,"spinlock_wait_cycles":16660736,"thread_start_us":1383905,"threads_started":1,"wal-append.queue_time_us":1952642}
W20260709 13:14:48.784360  6330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.009s	sys 0.029s
I20260709 13:14:48.248858  8375 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:48.255347  8391 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:48.749010  8377 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:48.236230  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 470265us
I20260709 13:14:48.463048  8450 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:48.784754  6329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.765s	user 0.007s	sys 0.054s
W20260709 13:14:48.449621  6297 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 2.059s (SENT) [suppressed 39 similar messages]
I20260709 13:14:48.465726  8503 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.488068  8372 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:48.791208  8542 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:48.065440  8392 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.784169  8368 raft_consensus.cc:740] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:14:48.793170  6938 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 415) took 3051 ms (client timeout 2095 ms). Trace:
I20260709 13:14:48.002625  8404 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:48.793748  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2167) took 3268 ms. Trace:
I20260709 13:14:48.009455  8489 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:48.777222  6396 rpcz_store.cc:276] 0709 13:14:45.525404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.007647 (+482243us) service_pool.cc:224] Handling call
0709 13:14:46.007910 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.008236 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.008263 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.021048 (+ 12785us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.412663 (+1391615us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:47.412706 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.412771 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:48.213159 (+800388us) raft_consensus.cc:1685] finished
0709 13:14:48.213247 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.213686 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":429,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":29082,"thread_start_us":1356337,"threads_started":1,"wal-append.queue_time_us":1996223}
I20260709 13:14:48.783644  8356 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:48.797983  8416 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:48.800146  8515 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:48.011289  8483 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:48.756620  8395 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:48.326699  8407 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:48.449388  8502 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:48.465396  8557 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:14:48.811981  8331 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.221s	user 0.033s	sys 0.043s
I20260709 13:14:48.780467  8526 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:48.105347  8535 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:48.106854  8524 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:48.075194  8463 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:47.988904  8452 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:48.022437  8409 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:48.035902  8444 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:48.817853  6399 rpcz_store.cc:276] 0709 13:14:45.525162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.005511 (+480349us) service_pool.cc:224] Handling call
0709 13:14:46.005786 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.006003 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.006026 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.017713 (+ 11687us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.008428 (+990715us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:47.008491 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.008592 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:48.793225 (+1784633us) raft_consensus.cc:1685] finished
0709 13:14:48.793265 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.793542 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":952291,"threads_started":1,"wal-append.queue_time_us":1173324}
I20260709 13:14:48.686178  8371 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:48.830457  6250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.694s	user 0.022s	sys 0.027s
I20260709 13:14:48.804384  8418 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:48.739076  8324 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:48.826421  8344 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.293s	user 0.004s	sys 0.000s
W20260709 13:14:48.835572  6296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.634s	user 0.026s	sys 0.025s
I20260709 13:14:48.845582  6251 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:48.845734  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 504) took 1095 ms. Trace:
I20260709 13:14:48.850329  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 386) took 2944 ms. Trace:
I20260709 13:14:48.850805  6398 rpcz_store.cc:276] 0709 13:14:45.906265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.014774 (+108509us) service_pool.cc:224] Handling call
0709 13:14:46.014997 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.015199 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:47.029991 (+1014792us) log.cc:844] Serialized 14 byte log entry
0709 13:14:48.830798 (+1800807us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:48.841581 (+ 10783us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:48.848450 (+  6869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:48.850094 (+  1644us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.850264 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":118828,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2013,"thread_start_us":2722285,"threads_started":2,"wal-append.queue_time_us":1081456}
W20260709 13:14:48.817704  6938 rpcz_store.cc:269] 0709 13:14:45.741250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.741378 (+   128us) service_pool.cc:224] Handling call
0709 13:14:48.784228 (+3042850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:48.776945  6401 rpcz_store.cc:276] 0709 13:14:45.772770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.011352 (+238582us) service_pool.cc:224] Handling call
0709 13:14:46.011984 (+   632us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.020210 (+  8226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.020236 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.038037 (+ 17801us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.009397 (+971360us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:47.009453 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.009542 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:48.118796 (+1109254us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b24001e8258. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f457297e9c4 00007f457297cacb 00007f4572b37dc9 00007f4572b37a55 00007f4572b36fb0 00007f45757ad488 00007f45757adbe8 00007f4575785398 00007f457578076a 00007f457577fbb6
0709 13:14:48.213464 (+ 94668us) raft_consensus.cc:1685] finished
0709 13:14:48.213506 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.213972 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7816,"raft.queue_time_us":7912,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":16579,"spinlock_wait_cycles":70979328,"thread_start_us":947467,"threads_started":1,"wal-append.queue_time_us":1090060}
W20260709 13:14:48.846633  6221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.470s	user 0.023s	sys 0.009s
I20260709 13:14:48.768147  6402 rpcz_store.cc:276] 0709 13:14:45.906525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.016680 (+110155us) service_pool.cc:224] Handling call
0709 13:14:46.028515 (+ 11835us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.030688 (+  2173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.030729 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.040359 (+  9630us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.760939 (+1720580us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:47.818053 (+ 57114us) log.cc:844] Serialized 14 byte log entry
0709 13:14:48.214904 (+396851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:48.215079 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:48.215165 (+    86us) raft_consensus.cc:1685] finished
0709 13:14:48.215186 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.215417 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1732,"prepare.queue_time_us":57423,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":302954,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":10914,"thread_start_us":2088368,"threads_started":2,"wal-append.queue_time_us":2046881}
W20260709 13:14:48.817569  8347 ts_tablet_manager.cc:1467] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Tablet startup took 2555ms
W20260709 13:14:48.848104  6907 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.060s	user 0.009s	sys 0.018s
W20260709 13:14:48.846609  6295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.613s	user 0.017s	sys 0.012s
W20260709 13:14:48.858873  6221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.549s	user 0.024s	sys 0.009s
W20260709 13:14:48.860802  6907 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.141s	user 0.009s	sys 0.018s
W20260709 13:14:48.844146  8460 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.615s	user 0.010s	sys 0.023s
I20260709 13:14:48.828529  8503 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:48.864368  8563 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.865083  8563 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:48.866500  8503 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:48.860628  6295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.694s	user 0.017s	sys 0.012s
I20260709 13:14:48.826694  8551 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:48.849467  6330 rpcz_store.cc:276] 0709 13:14:47.750136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:47.750310 (+   174us) service_pool.cc:224] Handling call
0709 13:14:47.750715 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:47.750945 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:47.751363 (+   418us) log.cc:844] Serialized 14 byte log entry
0709 13:14:48.845021 (+1093658us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:48.845178 (+   157us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:48.845262 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:48.845392 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.845600 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":226,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":10817,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":5124,"thread_start_us":1050910,"threads_started":1}
I20260709 13:14:48.879755  6933 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:48.880630  8542 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:48.880484  8502 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:48.881317  8558 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.000s	sys 0.021s
W20260709 13:14:48.881803  8558 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.000s	sys 0.022s
I20260709 13:14:48.864864  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1246) took 2981 ms. Trace:
I20260709 13:14:48.884271  8502 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:48.884052  8524 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:48.884519  6250 rpcz_store.cc:276] 0709 13:14:45.883700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.893662 (+  9962us) service_pool.cc:224] Handling call
0709 13:14:45.907114 (+ 13452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:45.907319 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:47.053183 (+1145864us) log.cc:844] Serialized 14 byte log entry
0709 13:14:48.864242 (+1811059us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:48.864380 (+   138us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:48.864479 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:48.864599 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.864806 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4141,"prepare.queue_time_us":1112207,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":39,"raft.queue_time_us":11683,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":8666,"thread_start_us":2878680,"threads_started":2,"wal-append.queue_time_us":1048250}
I20260709 13:14:48.886849  8524 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:48.887849  8561 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:48.888827  8561 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:48.889582  8356 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:48.890327  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 497) took 2128 ms. Trace:
I20260709 13:14:48.891460  8561 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:48.892490  8460 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.893189  8428 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:48.893018  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:48.893596  8372 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:48.893442  8535 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:48.894022  6252 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:48.894268  8407 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:48.896052  8535 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:48.896559  8407 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:48.897081  8557 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:48.898155  8423 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:48.898324  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:48.899183  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:48.899724  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:48.900043  8557 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:48.902712  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:48.899190  6322 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
W20260709 13:14:48.896718  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.853073  8483 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:48.901580  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:48.900720  8375 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:48.902844  8324 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:48.867759  8416 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:48.868040  6368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.024s	sys 0.037s
I20260709 13:14:48.900358  6250 raft_consensus.cc:2393] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:48.844624  8450 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:14:48.836109  8501 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:48.890795  6329 rpcz_store.cc:276] 0709 13:14:46.762152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.895217 (+133065us) service_pool.cc:224] Handling call
0709 13:14:46.895543 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.895965 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.896004 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.924185 (+ 28181us) log.cc:844] Serialized 26 byte log entry
0709 13:14:48.855187 (+1931002us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:48.861821 (+  6634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:48.878672 (+ 16851us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:48.878728 (+    56us) raft_consensus.cc:1685] finished
0709 13:14:48.878766 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.890252 (+ 11486us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":69785,"thread_start_us":1794168,"threads_started":1,"wal-append.queue_time_us":1114811}
W20260709 13:14:48.912047  6368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.025s	sys 0.038s
I20260709 13:14:48.908319  8407 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:48.912670  8367 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:48.915859  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:48.910419  6219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.371s	user 0.006s	sys 0.033s
W20260709 13:14:48.915895  6906 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.196s	user 0.017s	sys 0.035s
I20260709 13:14:48.921335  6323 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
W20260709 13:14:48.921389  6222 consensus_peers.cc:597] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:48.922122  8404 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.922511  6324 raft_consensus.cc:2410] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:14:48.922658  8413 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:14:48.922959  6940 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.197s	user 0.020s	sys 0.031s
I20260709 13:14:48.853498  8392 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
W20260709 13:14:48.927706  6219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.474s	user 0.006s	sys 0.033s
W20260709 13:14:48.911047  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 1.74456e+06us
I20260709 13:14:48.884980  8502 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:48.855808  8553 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:48.913205  8557 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:14:48.921039  6933 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 477) took 2174 ms (client timeout 2477 ms). Trace:
I20260709 13:14:48.944231  8560 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.956291  8407 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:48.958698  8565 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.958472  8413 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:48.959254  8324 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.926110  8522 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:48.960179  8404 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:48.960280  8502 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:48.925482  8368 consensus_queue.cc:260] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:48.965317  8375 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:48.966117  6247 raft_consensus.cc:1240] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:14:48.967037  8434 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:48.967594  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:48.967751  8566 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:48.968369  8524 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:48.997701  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:48.998579  6328 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.998145  8524 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:48.999563  8324 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:49.001349  8513 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:14:48.935969  8535 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:48.893218  8460 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:48.910140  8526 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:48.947100  8483 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:49.001472  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.022315  6324 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:49.022681  8553 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:49.023814  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:48.928216  8416 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:49.025745  8542 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:49.026397  8542 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:49.026948  8416 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:48.933735  8367 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:48.979486  8372 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:49.018849  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2167) took 2270 ms. Trace:
I20260709 13:14:49.010396  6221 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:49.013516  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:49.020659  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:48.998605  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.017791  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:49.220739  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:49.015666  6331 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:49.015508  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2166) took 3490 ms. Trace:
I20260709 13:14:49.045562  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:49.009733  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 62192.4us
I20260709 13:14:49.068511  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:49.182717  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 869522us
W20260709 13:14:49.225287  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.021517  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.009312  6942 raft_consensus.cc:1240] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:14:49.344141  6252 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:49.029421  8367 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:49.005707  6151 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55346 (request call id 390) took 5099 ms. Trace:
I20260709 13:14:49.014006  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:49.014400  6940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 413) took 3420 ms. Trace:
I20260709 13:14:49.341218  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.013722  6905 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:49.035526  6296 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:49.004761  6154 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49212 (request call id 201) took 4971 ms. Trace:
I20260709 13:14:49.017910  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:49.014467  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:49.060058  8384 consensus_meta.cc:287] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.993s	user 0.011s	sys 0.008s
I20260709 13:14:49.003587  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.357451  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 498) took 2595 ms. Trace:
I20260709 13:14:49.356354  6400 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:14:49.323750  8368 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:49.031821  8407 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:49.015525  6250 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:49.005987  8392 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:49.310782  8526 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:49.365327  6941 raft_consensus.cc:2410] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:14:49.015059  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:49.006484  8478 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:49.326380  8371 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:49.337101  8375 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:49.017117  8364 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:49.062613  8553 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:49.043263  8551 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:49.306985  6325 rpcz_store.cc:276] 0709 13:14:46.748129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.749631 (+  1502us) service_pool.cc:224] Handling call
0709 13:14:46.808715 (+ 59084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.809175 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.809260 (+    85us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.818573 (+  9313us) log.cc:844] Serialized 26 byte log entry
0709 13:14:48.843195 (+2024622us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:48.979066 (+135871us) log.cc:844] Serialized 14 byte log entry
0709 13:14:49.018377 (+ 39311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.018504 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:49.018577 (+    73us) raft_consensus.cc:1685] finished
0709 13:14:49.018595 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:49.018767 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19295,"raft.queue_time_us":49316,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":50538,"thread_start_us":1955321,"threads_started":2,"wal-append.queue_time_us":1226510}
I20260709 13:14:49.333554  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:49.013224  8450 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:49.018258  8464 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:49.366714  6256 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
W20260709 13:14:49.350677  6297 connection.cc:256] RPC call timeout handler was delayed by -1.0259354799998164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
I20260709 13:14:49.062391  8572 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.360998  6255 raft_consensus.cc:2410] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:14:48.997762  8566 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:49.012238  8501 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:49.004618  8475 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:49.008873  8356 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:14:48.969898  6933 rpcz_store.cc:269] 0709 13:14:46.746200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.753878 (+  7678us) service_pool.cc:224] Handling call
0709 13:14:48.920790 (+2166912us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b540072b354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:48.920968 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1329523968}
I20260709 13:14:49.379343  6403 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:49.043771  8557 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:49.379609  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.375182  8367 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.361534  8372 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:49.012575  8460 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:49.008051  8522 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:49.016870  8560 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:49.410187  8502 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:49.411423  8377 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:49.371007  6402 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:49.426023  8367 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:49.428107  8557 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:49.428337  8367 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:49.428220  6252 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:49.413618  8551 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.409004  8553 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:49.384891  6253 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:49.015153  8413 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:49.009485  8463 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:49.409037  8432 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:49.389928  6251 consensus_meta.cc:287] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.003s
I20260709 13:14:49.010821  8535 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:49.381253  6222 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:49.335258  6404 rpcz_store.cc:276] 0709 13:14:45.524909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.004393 (+479484us) service_pool.cc:224] Handling call
0709 13:14:46.004745 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.067852 (+ 63107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.067894 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.085319 (+ 17425us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.182669 (+1097350us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:47.196582 (+ 13913us) log.cc:844] Serialized 14 byte log entry
0709 13:14:48.846695 (+1650113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.015070 (+168375us) spinlock_profiling.cc:243] Waited 60.8 ms on lock 0x7b5400386654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:49.015115 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:49.015161 (+    46us) raft_consensus.cc:1685] finished
0709 13:14:49.015277 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:49.015451 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12750,"prepare.queue_time_us":20397,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":876780,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":50245,"spinlock_wait_cycles":139746176,"thread_start_us":2652651,"threads_started":2,"wal-append.queue_time_us":1611311}
I20260709 13:14:49.418409  8364 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.032291  8565 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:49.352749  6154 rpcz_store.cc:276] 0709 13:14:44.033524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.033695 (+   171us) service_pool.cc:224] Handling call
0709 13:14:49.004484 (+4970789us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:48.119374 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:48.120081 (+   707us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:48.120124 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:14:48.120163 (+    39us) tablet.cc:662] Decoding operations
0709 13:14:48.120582 (+   419us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:48.120649 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:48.120690 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:48.120907 (+   217us) tablet.cc:701] Row locks acquired
0709 13:14:48.120933 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:14:48.121108 (+   175us) write_op.cc:270] Start()
0709 13:14:48.127333 (+  6225us) write_op.cc:276] Timestamp: P: 1783602888121041 usec, L: 0
0709 13:14:48.127366 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:14:48.131589 (+  4223us) log.cc:844] Serialized 530 byte log entry
0709 13:14:48.883182 (+751593us) op_driver.cc:464] REPLICATION: finished
0709 13:14:48.941275 (+ 58093us) write_op.cc:301] APPLY: starting
0709 13:14:48.941412 (+   137us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:48.941579 (+   167us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:48.941713 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:48.941935 (+   222us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:48.942083 (+   148us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:48.942116 (+    33us) write_op.cc:312] APPLY: finished
0709 13:14:48.942266 (+   150us) log.cc:844] Serialized 23 byte log entry
0709 13:14:48.942465 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:48.942586 (+   121us) write_op.cc:454] Released schema lock
0709 13:14:48.942623 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:48.943196 (+   573us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:48.943220 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":528629,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":57777,"apply.run_cpu_time_us":1867,"apply.run_wall_time_us":1864,"num_ops":1,"prepare.queue_time_us":2726609,"prepare.run_cpu_time_us":3170,"prepare.run_wall_time_us":12508,"replication_time_us":755527,"thread_start_us":57308,"threads_started":1}]]}
I20260709 13:14:49.005101  8434 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:49.365303  8542 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:49.399276  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 388993us
I20260709 13:14:49.035164  8416 consensus_queue.cc:1059] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.349s
I20260709 13:14:49.446902  8416 raft_consensus.cc:3055] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:49.447336  8416 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:49.408701  8418 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:14:49.408989  6405 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 389) took 3500 ms (client timeout 2021 ms). Trace:
I20260709 13:14:49.409268  8407 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:49.363822  6327 rpcz_store.cc:276] 0709 13:14:46.762431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.897358 (+134927us) service_pool.cc:224] Handling call
0709 13:14:46.956211 (+ 58853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.956412 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:48.824913 (+1868501us) log.cc:844] Serialized 14 byte log entry
0709 13:14:49.318464 (+493551us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:49.324119 (+  5655us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:49.331554 (+  7435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.344843 (+ 13289us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:49.357264 (+ 12421us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":637303,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":22486,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"thread_start_us":2232254,"threads_started":2}
I20260709 13:14:49.448256  8418 raft_consensus.cc:697] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:49.410257  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.412668  8331 tablet_bootstrap.cc:492] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:49.419118  6248 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
W20260709 13:14:49.448642  6405 rpcz_store.cc:269] 0709 13:14:45.908715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.912916 (+  4201us) service_pool.cc:224] Handling call
0709 13:14:49.405599 (+3492683us) spinlock_profiling.cc:243] Waited 2.92 s on lock 0x7b54003ad4d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:49.408708 (+  3109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6724321664}
I20260709 13:14:49.456103  8463 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:49.347404  6940 rpcz_store.cc:276] 0709 13:14:45.618761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.626143 (+  7382us) service_pool.cc:224] Handling call
0709 13:14:45.626577 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:45.694405 (+ 67828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:45.694451 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:45.812392 (+117941us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b2c00047a38. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f45744dea11 00007f45744ee372 00007f4575c20a01 00007f4575be543a 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2
0709 13:14:45.829921 (+ 17529us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.189774 (+1359853us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:47.190188 (+   414us) log.cc:844] Serialized 14 byte log entry
0709 13:14:48.087287 (+897099us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:14:48.966206 (+878919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.014043 (+ 47837us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b54005618d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:49.014097 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:49.014138 (+    41us) raft_consensus.cc:1685] finished
0709 13:14:49.014151 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:49.014324 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":200,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":541937,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":37117,"spinlock_wait_cycles":371401728,"thread_start_us":2543832,"threads_started":2,"wal-append.queue_time_us":1880923}
I20260709 13:14:49.404307  8324 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:49.425448  6397 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:14:49.418812  8524 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:49.389495  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 408173us
I20260709 13:14:49.433952  8501 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:14:49.392221  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 378585us
I20260709 13:14:49.424721  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:49.346653  6151 rpcz_store.cc:276] 0709 13:14:43.906058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.909705 (+  3647us) service_pool.cc:224] Handling call
0709 13:14:49.005509 (+5095804us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:47.068903 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:47.421650 (+352747us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:47.443523 (+ 21873us) write_op.cc:435] Acquired schema lock
0709 13:14:47.447398 (+  3875us) tablet.cc:662] Decoding operations
0709 13:14:47.687207 (+239809us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:47.708471 (+ 21264us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:47.713798 (+  5327us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:47.760888 (+ 47090us) tablet.cc:701] Row locks acquired
0709 13:14:47.760914 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:14:47.831565 (+ 70651us) write_op.cc:270] Start()
0709 13:14:47.905516 (+ 73951us) write_op.cc:276] Timestamp: P: 1783602887820973 usec, L: 0
0709 13:14:47.914077 (+  8561us) op_driver.cc:348] REPLICATION: starting
0709 13:14:47.914843 (+   766us) log.cc:844] Serialized 530 byte log entry
0709 13:14:48.105746 (+190903us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f4572adb0ac 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b
0709 13:14:48.148350 (+ 42604us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b1800346c00. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:14:48.155976 (+  7626us) op_driver.cc:464] REPLICATION: finished
0709 13:14:48.918812 (+762836us) write_op.cc:301] APPLY: starting
0709 13:14:48.919035 (+   223us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:48.919227 (+   192us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:48.919268 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:48.919618 (+   350us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:48.919990 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:48.920094 (+   104us) write_op.cc:312] APPLY: finished
0709 13:14:48.920466 (+   372us) log.cc:844] Serialized 23 byte log entry
0709 13:14:48.920772 (+   306us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:48.920929 (+   157us) write_op.cc:454] Released schema lock
0709 13:14:48.920986 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:48.961245 (+ 40259us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:48.961294 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":498047,"reported_tablets":2,"spinlock_wait_cycles":3840,"child_traces":[["op",{"apply.queue_time_us":762375,"apply.run_cpu_time_us":2893,"apply.run_wall_time_us":30622,"num_ops":1,"prepare.queue_time_us":1629413,"prepare.run_cpu_time_us":17154,"prepare.run_wall_time_us":1083654,"raft.queue_time_us":730197,"raft.run_cpu_time_us":32201,"raft.run_wall_time_us":786875,"replication_time_us":241246,"spinlock_wait_cycles":197390592,"thread_start_us":2237540,"threads_started":4,"wal-append.queue_time_us":202663}]]}
W20260709 13:14:49.431175  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 2.35531e+06us
I20260709 13:14:49.430408  8377 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.445315  8409 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:49.445103  8356 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:49.447382  8434 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:49.407780  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:49.454557  6247 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
W20260709 13:14:49.432564  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 397186us
I20260709 13:14:49.469942  6939 raft_consensus.cc:2410] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:14:49.474104  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 108971us
I20260709 13:14:49.435067  8464 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:49.477200  6371 connection.cc:256] RPC call timeout handler was delayed by -1.0689396329999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
I20260709 13:14:49.435318  8572 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:49.459028  8407 raft_consensus.cc:697] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:49.469655  8377 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.490960  6396 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 5: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:49.453698  8551 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:49.479310  8364 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:49.501971  6222 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:49.502573  6369 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:49.475560  8409 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:49.513648  8522 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:49.515132  8418 consensus_queue.cc:237] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:49.528803  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 158355us
I20260709 13:14:49.494262  8416 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:49.500818  8501 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:49.539448  8463 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:49.540126  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.545625  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.545851  8356 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:49.546492  8372 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:49.547152  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.547868  6325 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:49.549445  8460 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:49.550035  8460 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:49.551668  8344 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.411s	user 0.006s	sys 0.002s
I20260709 13:14:49.552309  8344 tablet_bootstrap.cc:492] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=1 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:49.552249  8460 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:49.552690  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.553370  6330 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:49.554798  8331 tablet_bootstrap.cc:492] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:49.540877  6323 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:49.555703  8331 ts_tablet_manager.cc:1403] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 4.203s	user 0.063s	sys 0.072s
I20260709 13:14:49.552141  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:49.559137  8557 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.559738  8557 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:49.560313  8501 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:49.561259  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 82176.4us
I20260709 13:14:49.599151  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.558568  8535 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:49.601024  6323 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
W20260709 13:14:49.609316  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 90136.6us
W20260709 13:14:49.622043  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 103964us
I20260709 13:14:49.548779  8572 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:49.554069  8464 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:14:49.654301  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 158323us
W20260709 13:14:48.857046  8347 ts_tablet_manager.cc:1469] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Trace:
0709 13:14:40.829016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.831139 (+  2123us) service_pool.cc:224] Handling call
0709 13:14:40.902594 (+ 71455us) ts_tablet_manager.cc:934] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
0709 13:14:42.868620 (+1966026us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:43.135751 (+267131us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:43.159048 (+ 23297us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:43.644789 (+485741us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:43.645106 (+   317us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:43.645466 (+   360us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:43.645536 (+    70us) inbound_call.cc:177] Queueing success response
0709 13:14:44.372075 (+726539us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:14:45.994078 (+1622003us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:14:46.028697 (+ 34619us) tablet_replica.cc:261] Starting instrumentation
0709 13:14:46.058475 (+ 29778us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":197235,"mutex_wait_us":513771,"raft.queue_time_us":58372,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":27587,"tablet-copy.queue_time_us":70594,"tablet-download-pool.queue_time_us":174,"tablet-download-pool.run_cpu_time_us":2874,"tablet-download-pool.run_wall_time_us":146543,"thread_start_us":318604,"threads_started":2}
I20260709 13:14:49.600944  8560 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:49.657738  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:49.561735  8566 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:49.601498  8371 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:49.601119  8364 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:49.540340  8565 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:49.597488  8573 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:49.605980  8553 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:49.661094  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 150450us
I20260709 13:14:49.668251  8573 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:49.669332  8568 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:49.669847  8364 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:49.669956  8568 raft_consensus.cc:697] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:49.670395  8364 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.670846  8364 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.671198  8568 consensus_queue.cc:237] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:49.672346  8317 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:49.673424  8460 consensus_queue.cc:1059] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:49.674275  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.676422  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.676469  8460 raft_consensus.cc:3055] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:49.676610  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.677057  8460 raft_consensus.cc:740] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:49.677085  6252 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:14:49.677486  6253 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:14:49.677563  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.678226  6247 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:49.678375  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.678156  8460 consensus_queue.cc:260] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:49.679170  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.679524  8460 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:49.679541  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.679919  6247 raft_consensus.cc:2393] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:49.680457  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.678354  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.681625  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:49.663959  6907 connection.cc:256] RPC call timeout handler was delayed by -1.4059534119999171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260709 13:14:49.682025  6253 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:49.682199  6248 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:14:49.683223  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.687615  8364 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:49.695441  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.703796  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.704669  6324 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:49.707543  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.708411  6247 raft_consensus.cc:2393] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 3: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:49.536007  8407 consensus_queue.cc:237] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:49.711550  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.713469  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.715204  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:49.689806  8416 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.715821  6396 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 1.
W20260709 13:14:49.725347  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 55380.7us
I20260709 13:14:49.725723  6323 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:49.730214  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.736408  6253 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:49.751432  6247 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:49.711643  8535 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:49.826983  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:49.789556  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:49.789332  6255 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:49.785416  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.786497  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.790177  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.785238  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:49.871838  6330 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:49.872239  6398 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:14:49.785772  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:14:49.855851  6297 leader_election.cc:336] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.503s (SENT)
I20260709 13:14:49.790180  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:49.790771  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 80646.8us
I20260709 13:14:49.814767  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.874293  6256 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
W20260709 13:14:49.791769  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 62275.1us
I20260709 13:14:49.790653  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:49.844838  6396 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
W20260709 13:14:49.826241  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 73165.4us
W20260709 13:14:49.785629  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 75643.1us
I20260709 13:14:49.870129  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.843412  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:49.940207  6252 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:49.790160  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:49.940315  6219 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:49.941084  6397 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 1.
I20260709 13:14:49.784816  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:49.941509  8522 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:49.941934  8522 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:49.941990  6403 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:49.942401  8522 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.884470  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.943102  6327 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:49.875002  6369 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:14:49.944170  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 69233.5us
I20260709 13:14:49.944847  6369 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:49.945684  6369 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:49.947425  6369 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:49.883193  6297 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:49.883801  6400 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:49.898193  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.898203  6324 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:49.899746  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:49.949271  8590 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:49.949496  6404 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:14:49.790309  8364 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:49.950363  8577 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:49.950598  8364 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:49.950846  8577 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:49.951061  8364 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.951318  8577 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:49.951436  8364 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:49.757248  8551 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:14:49.953395  8368 consensus_meta.cc:287] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.003s
I20260709 13:14:49.921756  6402 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:49.922840  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:49.925901  8580 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:14:49.927366  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.928164  8587 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:49.928738  8584 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:14:49.929462  8578 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:14:49.843274  8553 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:49.929806  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:49.930567  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:49.932356  8418 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.932610  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:49.933497  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:49.934173  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:49.929508  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:14:49.948685  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 92906.3us
I20260709 13:14:49.984071  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:49.953336  8568 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:49.987459  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.920168  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:49.954816  6398 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:14:49.957288  6369 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:14:49.959331  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.783671  8377 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:50.002621  6326 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:49.964705  6405 raft_consensus.cc:2393] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:49.956148  8344 tablet_bootstrap.cc:492] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
W20260709 13:14:50.004913  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 65862.1us
I20260709 13:14:49.986785  8418 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:50.007169  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.007097  8584 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:50.010952  8557 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:50.011679  6936 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:50.013386  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.003587  8568 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.021384  6323 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
W20260709 13:14:50.021826  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 64689.8us
I20260709 13:14:50.026808  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.026930  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.027478  6330 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:14:50.027773  6326 raft_consensus.cc:2410] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:14:50.029769  8563 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:50.031042  8564 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:50.031477  8564 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.031826  8564 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:50.036535  8418 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:50.037207  8368 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:50.037495  6219 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:50.037689  8368 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.038122  8368 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:50.038748  6219 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:50.039909  6219 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:50.040629  8375 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.041009  8375 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.041234  8407 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:50.041873  8384 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:50.042400  8384 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.042461  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.042810  8384 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.042999  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 407) took 1077 ms. Trace:
I20260709 13:14:50.043347  6940 raft_consensus.cc:2393] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:50.044087  8568 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.045233  6934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 488) took 1029 ms. Trace:
I20260709 13:14:50.045480  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:50.046166  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2180) took 1089 ms. Trace:
I20260709 13:14:50.047534  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1255) took 2285 ms. Trace:
I20260709 13:14:50.046569  6401 rpcz_store.cc:276] 0709 13:14:48.973534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.993941 (+ 20407us) service_pool.cc:224] Handling call
0709 13:14:49.006881 (+ 12940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:49.062082 (+ 55201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:49.062133 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:49.406130 (+343997us) log.cc:844] Serialized 26 byte log entry
0709 13:14:49.555287 (+149157us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b1800256540. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572a72c0a 00007f457c1b2219 00007f4579ab958f 00007f4572af8571 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd
0709 13:14:49.597087 (+ 41800us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:49.597162 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.597241 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:50.045849 (+448608us) raft_consensus.cc:1685] finished
0709 13:14:50.045869 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:50.046086 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68716,"raft.queue_time_us":398666,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":8919,"spinlock_wait_cycles":5418880,"thread_start_us":159053,"threads_started":1,"wal-append.queue_time_us":275489}
I20260709 13:14:50.047916  6251 rpcz_store.cc:276] 0709 13:14:47.762420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:47.762854 (+   434us) service_pool.cc:224] Handling call
0709 13:14:47.763221 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:49.453269 (+1690048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:49.457522 (+  4253us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:49.461380 (+  3858us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:49.461425 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:50.047290 (+585865us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000f7154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:50.047331 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:50.047484 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1708,"raft.queue_time_us":4760,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":3407,"spinlock_wait_cycles":2443420928}
I20260709 13:14:50.049988  6254 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:50.049558  8331 raft_consensus.cc:359] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:50.037708  8344 ts_tablet_manager.cc:1403] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 4.671s	user 0.053s	sys 0.072s
I20260709 13:14:50.050513  8331 raft_consensus.cc:740] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:50.051509  6219 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:50.041412  8375 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.054208  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2183) took 1015 ms. Trace:
I20260709 13:14:50.050773  8584 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:50.004518  8551 raft_consensus.cc:2764] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:14:50.060695  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 409) took 1094 ms. Trace:
I20260709 13:14:50.074779  6296 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:50.043386  6249 rpcz_store.cc:276] 0709 13:14:48.965323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.966558 (+  1235us) service_pool.cc:224] Handling call
0709 13:14:48.966903 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:49.017764 (+ 50861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:49.017793 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:49.017827 (+    34us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:49.017858 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:50.042617 (+1024759us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b54000f6254. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:50.042675 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:50.042816 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116422528}
I20260709 13:14:50.045637  6934 rpcz_store.cc:276] 0709 13:14:49.015208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.035428 (+ 20220us) service_pool.cc:224] Handling call
0709 13:14:50.044275 (+1008847us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b580006e498. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abbefc0 00007f457aba9929 00007f457aba93d2 00007f4574120bd4
0709 13:14:50.044483 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:50.044709 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:50.044741 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:50.044803 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:50.044836 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:50.044897 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:50.045027 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7827200}
I20260709 13:14:50.051887  6907 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:50.063246  6324 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:14:50.054612  6399 rpcz_store.cc:276] 0709 13:14:49.010807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.013590 (+  2783us) service_pool.cc:224] Handling call
0709 13:14:49.311731 (+298141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:49.336209 (+ 24478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:49.336247 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:49.396092 (+ 59845us) log.cc:844] Serialized 26 byte log entry
0709 13:14:49.503143 (+107051us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:49.503183 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.503244 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:50.026255 (+523011us) raft_consensus.cc:1685] finished
0709 13:14:50.026279 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:50.026417 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":106546,"threads_started":1,"wal-append.queue_time_us":161908}
I20260709 13:14:50.066280  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.066573  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.069309  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.070084  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.019284  8553 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:50.075440  6254 rpcz_store.cc:276] 0709 13:14:48.966180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.985806 (+ 19626us) service_pool.cc:224] Handling call
0709 13:14:50.049688 (+1063882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:50.050400 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:50.051689 (+  1289us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000f7150. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:50.060610 (+  8921us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2422823808}
W20260709 13:14:50.024551  6328 consensus_meta.cc:287] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.025s	user 0.011s	sys 0.003s
I20260709 13:14:49.964010  8535 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:50.081833  6940 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:50.086249  6941 raft_consensus.cc:2393] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:50.068607  8364 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:50.049551  8483 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:50.036571  8409 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:50.094324  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.074383  8377 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:50.118328  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.121306  6939 raft_consensus.cc:2393] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:50.041940  8407 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:50.085826  8418 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:14:50.124728  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 114635us
I20260709 13:14:50.089371  8392 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:50.073951  8368 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:50.086313  6328 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:50.093039  8584 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:50.118330  8483 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:50.071259  8384 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:50.086808  8587 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:50.124959  8418 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:50.129904  8364 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:50.126340  8392 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:14:50.149847  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 82503.4us
I20260709 13:14:50.136145  8584 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.137907  8483 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.143682  8563 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:14:50.144001  6328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1166) took 1255 ms (client timeout 1617 ms). Trace:
W20260709 13:14:50.165081  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 145847us
I20260709 13:14:50.153918  8418 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:50.096768  8331 consensus_queue.cc:260] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
W20260709 13:14:50.172621  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 121179us
I20260709 13:14:50.164661  8392 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.178051  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.164709  8584 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:50.179818  6324 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:50.164074  8603 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:50.171450  8483 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:50.191082  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:50.173844  6328 rpcz_store.cc:269] 0709 13:14:48.882186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.909785 (+ 27599us) service_pool.cc:224] Handling call
0709 13:14:50.137121 (+1227336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:50.190400  6219 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:50.192430  6324 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:50.189337  6907 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:50.195784  8535 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:50.200467  6907 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:50.182168  8603 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:50.210901  8384 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:50.211747  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.212388  6330 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:50.213300  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.213440  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:50.213934  6326 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:50.214782  8602 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:50.215230  8602 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:50.215611  8602 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:50.208894  8603 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:50.213943  6399 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.225260  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:50.226141  6401 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:50.182219  8563 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:50.230928  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.231731  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:50.232507  6405 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 3: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:50.229430  6222 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:50.241268  8608 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.241745  8608 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:50.242094  8608 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.242851  8522 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:50.246592  6369 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:50.252731  6369 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:50.259294  8452 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:50.259553  6369 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:50.259783  8452 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.260123  8452 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:50.260335  8563 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:50.260682  6369 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:50.261008  8563 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:50.261933  8535 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.262310  8535 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.262634  8535 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.262892  8563 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:50.263319  8563 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:50.263702  8563 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.265352  8557 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.265849  8557 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.266242  8557 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:50.266913  8607 log.cc:927] Time spent T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:14:50.285476  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:50.286152  6405 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:50.287446  6402 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:14:50.288578  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:50.289829  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:50.289743  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:50.225420  8565 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.291869  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:50.305002  6398 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:50.311128  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:50.314226  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:50.315048  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:50.268272  8585 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:50.318681  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:50.321338  6326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:35916
I20260709 13:14:50.322695  8535 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:50.226231  8568 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:14:50.325410  6401 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:14:50.327385  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 127001us
I20260709 13:14:50.329209  6397 raft_consensus.cc:2393] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:14:50.316363  8416 consensus_meta.cc:287] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.002s
I20260709 13:14:50.329520  6405 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:14:50.350829  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:50.351511  6330 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:50.331131  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.353400  6941 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:50.331866  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.331183  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.354457  6935 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:50.337777  8285 tablet_bootstrap.cc:492] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:50.342087  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.313432  8565 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:50.344076  8601 log.cc:927] Time spent T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:14:50.345184  8557 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:50.325049  8585 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:50.473887  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.346647  8331 ts_tablet_manager.cc:1434] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.789s	user 0.007s	sys 0.003s
I20260709 13:14:50.346475  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:50.339963  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 381857us
I20260709 13:14:50.349661  8577 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:50.268569  8384 consensus_queue.cc:1059] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:14:50.381032  6907 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:50.498284  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.318568  8368 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:50.421013  6399 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
W20260709 13:14:50.478112  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 216559us
W20260709 13:14:50.500484  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 310108us
I20260709 13:14:50.560169  6219 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:50.496469  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.368598  6322 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:50.451855  6942 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:50.533618  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.498348  8603 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:50.527529  6325 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:14:50.535311  6396 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:50.450177  6326 raft_consensus.cc:606] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:50.572950  6326 raft_consensus.cc:614] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:50.569281  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.574980  6219 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:50.578419  6941 raft_consensus.cc:2393] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 2: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:14:50.527074  8331 ts_tablet_manager.cc:1467] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Tablet startup took 969ms
I20260709 13:14:50.583061  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:50.362515  8522 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:50.366641  8371 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:14:50.579535  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 227504us
I20260709 13:14:50.603668  6907 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:50.585024  6403 raft_consensus.cc:2393] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:14:50.586967  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 357594us
I20260709 13:14:50.588763  6219 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:50.356722  8404 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:50.529037  8585 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:50.520252  8407 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:50.609725  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:50.609895  6907 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:50.607532  8432 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:50.611685  8432 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:50.612083  8432 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:50.364019  8392 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:50.472908  8602 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:50.607848  8371 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:50.617589  8371 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:50.618007  8602 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:50.618891  6935 raft_consensus.cc:2393] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 2: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:50.619200  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.557543  6328 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:50.622716  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.577808  8603 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:50.357052  8564 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:50.610337  6325 raft_consensus.cc:2376] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4. Re-sending same reply.
I20260709 13:14:50.572901  8535 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:14:50.631387  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 320340us
I20260709 13:14:50.359166  8608 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:50.666826  8608 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:50.667773  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.604045  8356 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.536386  8584 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:50.569490  8344 raft_consensus.cc:359] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:50.768395  8557 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:50.769235  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:50.584061  6934 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:14:50.608604  8384 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:50.737564  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:50.669790  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 59989.5us
I20260709 13:14:50.790952  6907 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:50.791275  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:50.671495  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 82931.3us
I20260709 13:14:50.793934  6219 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:50.792007  6325 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:14:50.649832  8464 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:50.656896  8617 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:50.805580  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 67822.6us
I20260709 13:14:50.691474  8377 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.742869  8535 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:50.671406  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.767127  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.772365  8344 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:50.771400  8356 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.814230  8564 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:50.817224  8568 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:50.817708  8285 tablet_bootstrap.cc:492] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:14:50.817585  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.818075  8618 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.818212  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.818910  8565 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:50.819810  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.808876  8478 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.692099  8522 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.830282  6330 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:50.908339  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.909511  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.910619  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.911381  6330 raft_consensus.cc:2410] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:14:50.912068  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.912746  6330 raft_consensus.cc:2393] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:50.834013  6368 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:14:50.913497  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 93182.9us
I20260709 13:14:50.913246  8344 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:50.914191  6368 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:50.915216  8344 ts_tablet_manager.cc:1434] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.864s	user 0.005s	sys 0.005s
W20260709 13:14:50.915556  8344 ts_tablet_manager.cc:1467] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Tablet startup took 864ms
I20260709 13:14:50.915925  6368 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:50.917323  8565 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.917750  8565 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.918141  8565 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.918249  8616 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:50.882891  8618 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.920387  8618 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.921401  8564 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:50.921928  8564 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:50.922403  8564 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:50.876760  8611 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:50.923957  8611 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:50.924350  8611 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:50.925421  8623 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:50.925925  8623 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:50.926386  8623 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:50.803196  8392 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:50.805008  8464 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.770500  8452 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:50.932655  8464 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:50.690902  8563 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:50.934778  6404 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 3: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:50.935643  8563 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:50.934144  8452 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:14:50.884296  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 93545.4us
I20260709 13:14:50.885669  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.937232  6325 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:50.937160  6907 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:50.938205  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.939254  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.940265  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.809803  8617 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:50.941354  8617 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.943275  6933 raft_consensus.cc:2368] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7.
I20260709 13:14:50.943737  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.944135  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.944442  6936 raft_consensus.cc:2368] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4.
I20260709 13:14:50.804144  8614 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:50.948943  8614 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.888535  6324 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:50.809449  8377 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:50.845674  8375 consensus_meta.cc:287] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.753s	user 0.010s	sys 0.000s
I20260709 13:14:50.902449  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.902966  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 404) took 1957 ms. Trace:
W20260709 13:14:50.904848  8418 consensus_meta.cc:287] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.716s	user 0.005s	sys 0.001s
I20260709 13:14:50.905620  8285 ts_tablet_manager.cc:1403] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 5.676s	user 0.074s	sys 0.047s
I20260709 13:14:50.839419  8356 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.906037  8478 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:50.934065  6368 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:50.947499  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:50.991564  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.947491  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:50.948890  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.671208  8610 raft_consensus.cc:3055] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:14:50.962831  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 191811us
I20260709 13:14:50.888958  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:51.014398  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:51.069020  6401 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.992620  6399 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:14:50.877498  8535 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:50.952598  8377 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.951663  8602 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:51.075441  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:51.077725  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:51.078408  6330 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:14:51.079293  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.951537  8614 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:51.087746  8392 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.088313  8392 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:51.090622  6414 tablet_copy_service.cc:342] P b940f12ed61a49c4b3c11f13ef50fa92: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-f3c8c870200141efa8a5f7cc58ece4a6 received from {username='slave'} at 127.0.0.1:41486
I20260709 13:14:51.091318  6414 tablet_copy_service.cc:434] P b940f12ed61a49c4b3c11f13ef50fa92: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-f3c8c870200141efa8a5f7cc58ece4a6 on tablet f3c8c870200141efa8a5f7cc58ece4a6 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:51.076001  8610 raft_consensus.cc:740] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:51.130311  8514 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:51.130438  8610 consensus_queue.cc:260] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.131963  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:50.986847  8418 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.134099  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:51.134712  6325 raft_consensus.cc:2376] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6. Re-sending same reply.
I20260709 13:14:50.962945  6250 rpcz_store.cc:276] 0709 13:14:48.963853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.964521 (+   668us) service_pool.cc:224] Handling call
0709 13:14:48.964927 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:49.374752 (+409825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:50.902702 (+1527950us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b5400172fd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:50.902905 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115474176}
I20260709 13:14:50.947573  8522 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.984479  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:51.153196  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:50.983491  8375 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:51.132606  6327 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:14:51.164444  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:51.165813  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:51.166405  6327 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:14:51.167248  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:51.167780  6327 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:51.136251  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:51.170221  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 101099us
I20260709 13:14:51.014106  8626 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:14:51.171885  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:51.171980  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 378115us
W20260709 13:14:51.170406  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 236611us
I20260709 13:14:51.161391  8418 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:51.112510  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:51.132061  8610 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:51.140537  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:51.188855  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:51.112864  8602 raft_consensus.cc:697] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:51.188997  6368 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:51.190706  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:51.187682  6371 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:50.987612  8585 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.192781  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:51.193441  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:51.170289  8522 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:51.196041  6400 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:51.198230  6371 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:51.170107  8627 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.190857  6219 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:51.201617  6905 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:51.203729  6371 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:14:51.203656  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 133859us
I20260709 13:14:51.190047  8626 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:51.191926  8584 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:51.208243  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:51.209275  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:51.209836  8622 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:51.211155  6938 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:51.211448  8563 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:51.212046  8598 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 1.085s	user 0.001s	sys 0.000s
I20260709 13:14:51.213326  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:51.232090  8432 consensus_meta.cc:287] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.014s
I20260709 13:14:51.220120  8375 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:51.222477  8478 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:51.225039  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:51.231890  8603 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:51.229768  6907 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:51.198807  8452 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:51.236905  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:51.218819  8577 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:14:51.241111  8483 consensus_meta.cc:287] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.031s	user 0.011s	sys 0.012s
I20260709 13:14:51.240634  6326 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:51.244000  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2189) took 1458 ms. Trace:
I20260709 13:14:51.305516  6329 rpcz_store.cc:276] 0709 13:14:49.785801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.824377 (+ 38576us) service_pool.cc:224] Handling call
0709 13:14:49.824789 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:49.825144 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:49.825179 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:49.825655 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:14:49.961601 (+135946us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:49.961641 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.961712 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:51.211415 (+1249703us) spinlock_profiling.cc:243] Waited 7.32 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:14:51.243701 (+ 32286us) raft_consensus.cc:1685] finished
0709 13:14:51.243721 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.243941 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16838016,"thread_start_us":130327,"threads_started":1,"wal-append.queue_time_us":195627}
I20260709 13:14:51.243873  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:51.244313  8618 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.244705  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:51.247501  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:51.248847  8606 log.cc:927] Time spent T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 1.058s	user 0.000s	sys 0.001s
I20260709 13:14:51.249233  8418 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:51.250087  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:51.229820  6400 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
W20260709 13:14:50.915838  8344 ts_tablet_manager.cc:1469] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Trace:
0709 13:14:40.324318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.601863 (+277545us) service_pool.cc:224] Handling call
0709 13:14:40.828545 (+226682us) ts_tablet_manager.cc:934] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
0709 13:14:43.739300 (+2910755us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:43.936910 (+197610us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:43.937054 (+   144us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:44.175018 (+237964us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:44.175284 (+   266us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:44.175605 (+   321us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:44.175666 (+    61us) inbound_call.cc:177] Queueing success response
0709 13:14:45.366114 (+1190448us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:14:50.050982 (+4684868us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:14:50.128907 (+ 77925us) tablet_replica.cc:261] Starting instrumentation
0709 13:14:50.129536 (+   629us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":50405,"mutex_wait_us":10135,"raft.queue_time_us":16185,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"tablet-copy.queue_time_us":174641,"tablet-download-pool.queue_time_us":459,"tablet-download-pool.run_cpu_time_us":3342,"tablet-download-pool.run_wall_time_us":489233,"thread_start_us":141804,"threads_started":2}
I20260709 13:14:51.236125  8622 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:14:51.241545  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 53076.1us
I20260709 13:14:51.242306  8392 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:51.262676  6325 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:51.321619  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:51.240839  6933 raft_consensus.cc:2376] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8. Re-sending same reply.
I20260709 13:14:51.234579  8626 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:51.257913  8356 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.264752  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:51.273837  8285 raft_consensus.cc:359] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:51.277374  8602 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.283043  8584 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:51.293955  8478 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:50.585942  8331 ts_tablet_manager.cc:1469] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Trace:
0709 13:14:40.185832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.185987 (+   155us) service_pool.cc:224] Handling call
0709 13:14:40.291760 (+105773us) ts_tablet_manager.cc:934] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
0709 13:14:43.298215 (+3006455us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:43.860833 (+562618us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:43.860950 (+   117us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:44.006753 (+145803us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:44.019357 (+ 12604us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:44.045818 (+ 26461us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:44.054255 (+  8437us) inbound_call.cc:177] Queueing success response
0709 13:14:45.352189 (+1297934us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:14:49.557318 (+4205129us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:14:49.824986 (+267668us) tablet_replica.cc:261] Starting instrumentation
0709 13:14:49.825584 (+   598us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":3796,"mutex_wait_us":4432,"raft.queue_time_us":7817,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5667,"tablet-copy.queue_time_us":82548,"tablet-download-pool.queue_time_us":166,"tablet-download-pool.run_cpu_time_us":971,"tablet-download-pool.run_wall_time_us":453727,"thread_start_us":227370,"threads_started":2}
I20260709 13:14:51.296173  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:51.240931  8568 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:51.313833  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:51.365773  6326 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:14:51.284371  8464 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.315889  6907 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:51.300432  6151 catalog_manager.cc:5697] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 2 to 3, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:51.330577  6327 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:51.263041  8603 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:51.321475  6397 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:14:51.369398  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:51.367663  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 51892.8us
I20260709 13:14:51.317034  8623 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.393262  6937 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Advancing to term 3
I20260709 13:14:51.258399  8432 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.236397  8627 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:51.409379  6151 catalog_manager.cc:5697] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 4, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 4 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:51.322180  8418 raft_consensus.cc:697] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:51.457543  6326 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:14:51.458629  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 520) took 1103 ms. Trace:
I20260709 13:14:51.360800  8285 raft_consensus.cc:740] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:14:51.439761  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 514) took 1124 ms. Trace:
W20260709 13:14:51.458000  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 46100.8us
I20260709 13:14:51.462427  6327 rpcz_store.cc:276] 0709 13:14:50.314996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.377541 (+1062545us) service_pool.cc:224] Handling call
0709 13:14:51.377909 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.439395 (+ 61486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.439424 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:51.439470 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:51.439512 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.439575 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.439702 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:51.392436  8632 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:51.469461  8632 raft_consensus.cc:697] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:51.469676  8573 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:51.470499  8632 consensus_queue.cc:237] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.370434  8392 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:51.472326  8392 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:51.374634  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1195) took 1038 ms. Trace:
I20260709 13:14:51.474119  6329 rpcz_store.cc:276] 0709 13:14:50.336561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.333792 (+997231us) service_pool.cc:224] Handling call
0709 13:14:51.374572 (+ 40780us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:51.322453  8622 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:51.459079  6326 rpcz_store.cc:276] 0709 13:14:50.355442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.311099 (+955657us) service_pool.cc:224] Handling call
0709 13:14:51.458537 (+147438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:51.477396  6326 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:51.460522  6325 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:51.459420  6907 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:51.481513  8583 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:51.481977  8583 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:51.482420  8583 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:51.365331  8478 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:51.490931  6398 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:51.377038  8603 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:51.443463  6151 catalog_manager.cc:5697] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.369549  6328 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:51.493093  8478 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:51.502332  6151 catalog_manager.cc:5697] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 5, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 5 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.514555  6151 catalog_manager.cc:5697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 2 to 3, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.314327  8483 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:51.499286  8371 consensus_meta.cc:287] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.877s	user 0.015s	sys 0.007s
I20260709 13:14:51.501281  6934 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 4: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:51.389360  8584 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.499719  8535 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:51.516559  6151 catalog_manager.cc:5697] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 2 to 3, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 3 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:51.402504  8565 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:51.523504  6297 leader_election.cc:336] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 2.059s (SENT)
I20260709 13:14:51.511433  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1198) took 1144 ms. Trace:
I20260709 13:14:51.625605  6297 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:14:51.605336  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 140413us
W20260709 13:14:51.628296  6401 consensus_meta.cc:287] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.001s
I20260709 13:14:51.628818  6401 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:14:51.629051  6368 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:51.630505  6907 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:14:51.549829  8611 consensus_meta.cc:287] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.625s	user 0.003s	sys 0.007s
I20260709 13:14:51.631984  6151 catalog_manager.cc:5697] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 2 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:51.597777  8564 consensus_meta.cc:287] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.675s	user 0.009s	sys 0.002s
W20260709 13:14:51.601187  8617 consensus_meta.cc:287] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.641s	user 0.006s	sys 0.016s
I20260709 13:14:51.642076  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 518) took 1317 ms. Trace:
I20260709 13:14:51.646275  8464 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:51.652114  8614 consensus_meta.cc:287] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.000s
W20260709 13:14:51.655730  6396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2195) took 1368 ms (client timeout 1724 ms). Trace:
W20260709 13:14:51.656210  6396 rpcz_store.cc:269] 0709 13:14:50.286993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.288359 (+  1366us) service_pool.cc:224] Handling call
0709 13:14:51.655507 (+1367148us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b5400182c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:51.655640 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547734400}
I20260709 13:14:51.653013  8478 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.658258  8372 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:51.658838  8372 raft_consensus.cc:697] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:51.659730  8372 consensus_queue.cc:237] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.660059  8478 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:51.662164  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:51.662707  6397 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:51.664239  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:51.665664  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:51.666846  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:14:51.667002  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 434307us
I20260709 13:14:51.668208  6935 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEARNER]: Advancing to term 3
I20260709 13:14:51.668567  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 424) took 1171 ms. Trace:
I20260709 13:14:51.659967  8416 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:51.669697  6404 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2193) took 1383 ms (client timeout 1588 ms). Trace:
W20260709 13:14:51.670145  6404 rpcz_store.cc:269] 0709 13:14:50.286378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.289618 (+  3240us) service_pool.cc:224] Handling call
0709 13:14:51.669532 (+1379914us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54001f4354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:51.669643 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481389312}
W20260709 13:14:51.673418  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.673828  8464 consensus_queue.cc:1059] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:51.677039  8587 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:51.668939  6941 rpcz_store.cc:276] 0709 13:14:50.497558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.501109 (+  3551us) service_pool.cc:224] Handling call
0709 13:14:51.668343 (+1167234us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b5400289bd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:51.668485 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10112896}
I20260709 13:14:51.652526  8614 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.687806  6371 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:51.689687  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 519) took 1363 ms. Trace:
I20260709 13:14:51.690294  6327 rpcz_store.cc:276] 0709 13:14:50.326017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.463354 (+1137337us) service_pool.cc:224] Handling call
0709 13:14:51.645011 (+181657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.689238 (+ 44227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.689284 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:51.689342 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:51.689387 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.689472 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.689618 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:51.677234  8617 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.643817  6323 rpcz_store.cc:276] 0709 13:14:50.316952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.414854 (+1097902us) service_pool.cc:224] Handling call
0709 13:14:51.498643 (+ 83789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.498802 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.498849 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:51.498886 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:51.504492 (+  5606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.504561 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.634464 (+129903us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:51.547200  8371 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.666785  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:14:51.724992  8522 consensus_meta.cc:287] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.001s
W20260709 13:14:51.724098  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 95026.6us
I20260709 13:14:51.728181  6368 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:51.721477  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:51.729915  6401 raft_consensus.cc:2393] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 5: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:51.680889  6151 catalog_manager.cc:5697] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 4, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.627485  6328 rpcz_store.cc:276] 0709 13:14:50.359767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.264456 (+904689us) service_pool.cc:224] Handling call
0709 13:14:51.504388 (+239932us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:51.740442  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 52733.3us
I20260709 13:14:51.758955  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:51.760267  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:51.761198  6323 raft_consensus.cc:2393] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:51.760248  6327 raft_consensus.cc:2410] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:14:51.734299  8563 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:51.640848  8611 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.553718  8285 consensus_queue.cc:260] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:51.680270  8564 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:51.767239  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:51.735090  8356 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:51.769313  8617 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:51.769428  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 1985) took 1704 ms. Trace:
I20260709 13:14:51.773998  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:51.780405  6401 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:51.778743  6251 rpcz_store.cc:276] 0709 13:14:50.064609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.762238 (+1697629us) service_pool.cc:224] Handling call
0709 13:14:51.762513 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.769092 (+  6579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.769147 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:51.769188 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:51.769219 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.769273 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.769376 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:51.772313  6905 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:51.731043  8384 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:51.734864  8618 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:51.777674  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:51.783083  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:51.791842  6323 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 3: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:51.726924  8522 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.794567  6936 raft_consensus.cc:1240] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:51.796983  6254 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:51.799872  6397 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:51.771493  8392 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:51.779466  8565 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:51.716768  8418 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:51.754740  8603 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.805027  6251 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:51.815258  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:51.815848  6323 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:51.819666  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 145242us
I20260709 13:14:51.802320  8617 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.806803  8623 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:51.825994  6251 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:51.816745  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:51.793491  8384 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:51.824142  8553 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:51.827183  8364 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:51.881019  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:51.874174  8627 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:51.874253  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:51.901628  8638 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:14:51.902458  8384 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:51.828629  8617 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:52.066711  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 294443us
I20260709 13:14:52.186574  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 523) took 1349 ms. Trace:
I20260709 13:14:52.187245  6939 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:52.063308  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 539715us
I20260709 13:14:52.828281  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:52.829064  6254 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:52.263510  6323 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
W20260709 13:14:52.830358  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 1.10218e+06us
I20260709 13:14:52.831118  6327 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:52.832406  6368 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:52.077533  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 201478us
I20260709 13:14:52.258795  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 517) took 1942 ms. Trace:
I20260709 13:14:52.835014  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 521) took 2356 ms. Trace:
I20260709 13:14:52.187995  6325 rpcz_store.cc:276] 0709 13:14:50.837686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.483790 (+646104us) service_pool.cc:224] Handling call
0709 13:14:51.484143 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:51.484433 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.484471 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:51.485000 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:14:51.630311 (+145311us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:51.630347 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.630413 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:51.903998 (+273585us) raft_consensus.cc:1685] finished
0709 13:14:51.904020 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:52.186510 (+282490us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":141438,"threads_started":1,"wal-append.queue_time_us":271805}
W20260709 13:14:52.251310  6403 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2196) took 1964 ms (client timeout 2036 ms). Trace:
W20260709 13:14:52.840771  6403 rpcz_store.cc:269] 0709 13:14:50.287298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.290496 (+  3198us) service_pool.cc:224] Handling call
0709 13:14:52.251119 (+1960623us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54003ae3d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:52.251248 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619098496}
I20260709 13:14:52.836946  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:52.834059  6324 rpcz_store.cc:276] 0709 13:14:50.315950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.412528 (+1096578us) service_pool.cc:224] Handling call
0709 13:14:51.412907 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.633483 (+220576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.633535 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:51.633620 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:51.633671 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.258564 (+624893us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400293bd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:52.258603 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:52.258737 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490811776}
I20260709 13:14:52.842214  6325 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:52.842495  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2210) took 1070 ms. Trace:
I20260709 13:14:52.240438  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:52.835431  6329 rpcz_store.cc:276] 0709 13:14:50.479033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.476487 (+997454us) service_pool.cc:224] Handling call
0709 13:14:51.505610 (+ 29123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.517252 (+ 11642us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:51.771789 (+254537us) log.cc:844] Serialized 14 byte log entry
0709 13:14:52.834689 (+1062900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:52.834738 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:52.834800 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.834860 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:52.834963 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":252236,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"thread_start_us":541398,"threads_started":2}
I20260709 13:14:52.843079  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:52.844193  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 527) took 1172 ms. Trace:
I20260709 13:14:52.844646  6325 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:14:52.613222  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:52.262516  6939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 504) took 1487 ms. Trace:
W20260709 13:14:52.404273  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 136577us
I20260709 13:14:52.840041  6368 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:52.247396  8377 consensus_meta.cc:287] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 1.134s	user 0.009s	sys 0.000s
W20260709 13:14:52.153578  6937 consensus_meta.cc:287] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.012s
W20260709 13:14:52.036666  8622 consensus_meta.cc:287] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.560s	user 0.004s	sys 0.005s
I20260709 13:14:52.205005  6940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 493) took 1461 ms. Trace:
I20260709 13:14:52.866107  6248 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
W20260709 13:14:52.847591  8565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.003s	sys 0.011s
I20260709 13:14:52.842944  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:14:52.869290  6906 connection.cc:256] RPC call timeout handler was delayed by -2.0545572410001114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 13:14:52.871420  6324 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:52.871686  6906 connection.cc:256] RPC call timeout handler was delayed by -2.0491572410001027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
I20260709 13:14:52.506266  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:52.850521  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:52.256150  8626 consensus_meta.cc:287] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.864s	user 0.003s	sys 0.003s
W20260709 13:14:51.904745  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 146782us
I20260709 13:14:52.857892  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2203) took 1185 ms. Trace:
I20260709 13:14:52.859252  6252 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 3: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:52.043509  8285 ts_tablet_manager.cc:1434] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 1.057s	user 0.010s	sys 0.008s
W20260709 13:14:52.243940  8568 consensus_meta.cc:287] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.867s	user 0.005s	sys 0.002s
I20260709 13:14:52.861081  6941 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:52.857933  6939 rpcz_store.cc:276] 0709 13:14:50.775446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.257645 (+482199us) service_pool.cc:224] Handling call
0709 13:14:51.673227 (+415582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:52.187720 (+514493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.261577 (+ 73857us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b5400289bd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:52.262340 (+   763us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b5400289bd0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:52.262462 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2136682624}
I20260709 13:14:52.862358  6937 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:52.892479  6937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 508) took 2116 ms. Trace:
I20260709 13:14:52.844552  6329 rpcz_store.cc:276] 0709 13:14:51.672278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.843402 (+1171124us) service_pool.cc:224] Handling call
0709 13:14:52.843732 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:52.843905 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:52.843932 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:52.843975 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:52.844003 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.844050 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:52.844143 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:52.248751  8583 consensus_meta.cc:287] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.766s	user 0.006s	sys 0.004s
W20260709 13:14:52.252351  8610 consensus_meta.cc:287] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.054s	user 0.007s	sys 0.000s
I20260709 13:14:51.917158  8464 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:51.960242  8535 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:52.842945  6323 rpcz_store.cc:276] 0709 13:14:51.772370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.792634 (+ 20264us) service_pool.cc:224] Handling call
0709 13:14:52.842420 (+1049786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:52.900939  6219 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:52.901399  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:52.902238  6323 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:52.263906  8478 raft_consensus.cc:3055] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:51.934032  8371 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:52.250588  8483 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:51.994933  8563 raft_consensus.cc:697] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:51.903854  8603 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:52.108332  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:52.658614  8452 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.478233  8663 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.914173  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:51.926157  8614 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:52.227659  8522 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:52.166401  8611 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:52.166802  8564 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:14:52.872154  6906 connection.cc:256] RPC call timeout handler was delayed by -2.0167572410000503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
I20260709 13:14:51.916972  6933 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:52.845069  8585 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:52.886242  6325 rpcz_store.cc:276] 0709 13:14:51.672813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.844035 (+1171222us) service_pool.cc:224] Handling call
0709 13:14:52.844286 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:52.857645 (+ 13359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.857837 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:52.866015  6940 rpcz_store.cc:276] 0709 13:14:50.744163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.653762 (+909599us) service_pool.cc:224] Handling call
0709 13:14:51.654097 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.654326 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:51.878410 (+224084us) log.cc:844] Serialized 14 byte log entry
0709 13:14:52.204579 (+326169us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:52.204644 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:52.204704 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.204791 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:52.204935 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":381189,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":188,"raft.queue_time_us":491,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"thread_start_us":497286,"threads_started":2}
I20260709 13:14:52.889293  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:51.917091  8356 consensus_queue.cc:1059] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.953s
I20260709 13:14:52.862936  8368 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.892805  6937 rpcz_store.cc:276] 0709 13:14:50.776461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.362050 (+585589us) service_pool.cc:224] Handling call
0709 13:14:51.393080 (+ 31030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:52.892215 (+1499135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.892419 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:52.867599  8364 consensus_meta.cc:287] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.972s	user 0.005s	sys 0.005s
I20260709 13:14:52.852329  8654 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:52.871124  8565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.004s	sys 0.011s
I20260709 13:14:52.897614  8568 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:52.870545  8622 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:52.898010  8583 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:52.898900  8464 raft_consensus.cc:697] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:52.900065  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2208) took 1173 ms. Trace:
I20260709 13:14:53.164243  6329 rpcz_store.cc:276] 0709 13:14:51.726174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.893688 (+1167514us) service_pool.cc:224] Handling call
0709 13:14:52.899563 (+  5875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:52.899735 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:52.899760 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:52.899807 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:52.899837 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.899888 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:52.899980 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:52.902282  6219 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:14:52.904856  6151 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.007s	sys 0.013s
W20260709 13:14:53.165449  6151 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.007s	sys 0.013s
W20260709 13:14:52.891217  8285 ts_tablet_manager.cc:1467] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Tablet startup took 1907ms
I20260709 13:14:52.872706  6934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 499) took 1203 ms. Trace:
W20260709 13:14:52.894605  8645 log.cc:927] Time spent T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.421s	user 0.000s	sys 0.001s
I20260709 13:14:52.909504  6324 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:53.174577  6935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 502) took 1511 ms. Trace:
I20260709 13:14:53.174727  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2216) took 1107 ms. Trace:
I20260709 13:14:52.880050  8641 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:52.869287  6938 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 433) took 2048 ms (client timeout 1731 ms). Trace:
I20260709 13:14:52.933595  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:52.014734  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:52.934459  6252 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 3: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:52.865147  8377 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:52.904505  8404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.007s	sys 0.021s
I20260709 13:14:52.912730  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:52.936652  6254 raft_consensus.cc:2393] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 4: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:52.936510  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:53.190857  6325 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.115356  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 526) took 1443 ms. Trace:
I20260709 13:14:52.938176  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.117712  8432 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:53.111933  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:53.191550  6327 rpcz_store.cc:276] 0709 13:14:51.671992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.807871 (+135879us) service_pool.cc:224] Handling call
0709 13:14:52.830960 (+1023089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:52.831467 (+   507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.115157 (+283690us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400038c50. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:53.115288 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2324477184}
I20260709 13:14:53.192317  6330 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:53.113742  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.022033  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:53.193492  6939 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:14:53.193904  6939 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 439) took 1507 ms (client timeout 1731 ms). Trace:
I20260709 13:14:52.944833  8663 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
W20260709 13:14:53.021585  6933 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 442) took 1332 ms (client timeout 1540 ms). Trace:
W20260709 13:14:53.073730  8669 log.cc:927] Time spent T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 13:14:53.034862  8476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.002s	sys 0.009s
I20260709 13:14:53.074308  8584 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:53.044519  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.218070  6942 raft_consensus.cc:2393] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 4: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:53.075129  8617 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:53.027647  8364 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:53.036518  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2213) took 1179 ms. Trace:
I20260709 13:14:53.033809  8564 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:14:53.151273  6906 leader_election.cc:336] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.591s (SENT)
I20260709 13:14:52.890057  8626 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:52.999522  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:53.240780  6937 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 441) took 1552 ms (client timeout 1889 ms). Trace:
I20260709 13:14:52.903908  8610 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:14:52.909956  8463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.008s	sys 0.025s
W20260709 13:14:53.035532  6322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2200) took 3102 ms (client timeout 2214 ms). Trace:
W20260709 13:14:53.243602  6322 rpcz_store.cc:269] 0709 13:14:49.930749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.026341 (+ 95592us) service_pool.cc:224] Handling call
0709 13:14:53.032552 (+3006211us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54002918d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:53.032694 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660426624}
I20260709 13:14:53.244650  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:53.245234  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:53.245816  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:53.027351  8563 consensus_queue.cc:237] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.246376  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.246685  8626 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:53.247454  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:53.247759  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 311846us
I20260709 13:14:53.033252  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:53.248493  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:53.249107  6255 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:52.903666  8478 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:14:53.152031  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 214625us
I20260709 13:14:53.029973  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:53.155088  8672 log.cc:927] Time spent T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:14:53.163718  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 323726us
W20260709 13:14:53.166823  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 264590us
I20260709 13:14:53.255564  8478 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.256186  6219 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:53.256690  8478 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:53.166981  6936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 503) took 2391 ms. Trace:
I20260709 13:14:53.258854  6936 rpcz_store.cc:276] 0709 13:14:50.775188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.256246 (+481058us) service_pool.cc:224] Handling call
0709 13:14:51.256540 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.805452 (+548912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.166751 (+1361299us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b5400538ed4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:53.166925 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1225932544}
I20260709 13:14:53.260033  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:14:53.260697  6936 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 507) took 1489 ms (client timeout 1827 ms). Trace:
W20260709 13:14:53.249784  8463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.019s	sys 0.048s
I20260709 13:14:53.180989  8641 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:53.168064  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 503) took 1504 ms. Trace:
W20260709 13:14:53.168578  6296 connection.cc:256] RPC call timeout handler was delayed by -1.3907464430001255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260709 13:14:53.159018  8368 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:52.937992  8452 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:53.173815  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 136488us
I20260709 13:14:53.175587  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 410) took 2084 ms. Trace:
W20260709 13:14:53.321547  6371 leader_election.cc:336] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.731s (SENT)
I20260709 13:14:53.320595  6405 rpcz_store.cc:276] 0709 13:14:51.090783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.091042 (+   259us) service_pool.cc:224] Handling call
0709 13:14:51.091395 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.091646 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:51.459909 (+368263us) log.cc:844] Serialized 14 byte log entry
0709 13:14:52.860987 (+1401078us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b180039b320. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f457578523a 00007f4575befa2a
0709 13:14:53.175283 (+314296us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.175334 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:53.175378 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.175436 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.175537 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11739,"prepare.queue_time_us":369316,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":6702,"raft.queue_time_us":68,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4244,"spinlock_wait_cycles":41009536,"thread_start_us":660599,"threads_started":2,"wal-append.queue_time_us":1668149}
I20260709 13:14:53.321967  6371 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:53.159418  8560 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:53.323688  8560 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.327172  8626 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:53.175177  6324 rpcz_store.cc:276] 0709 13:14:52.067464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.842717 (+775253us) service_pool.cc:224] Handling call
0709 13:14:53.174673 (+331956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.328907  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:53.329475  6324 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.175110  6935 rpcz_store.cc:276] 0709 13:14:51.663278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.667701 (+  4423us) service_pool.cc:224] Handling call
0709 13:14:51.668042 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:52.135670 (+467628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:52.135700 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:52.192202 (+ 56502us) log.cc:844] Serialized 26 byte log entry
0709 13:14:52.911134 (+718932us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:53.171733 (+260599us) log.cc:844] Serialized 14 byte log entry
0709 13:14:53.174174 (+  2441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.174274 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:53.174327 (+    53us) raft_consensus.cc:1685] finished
0709 13:14:53.174344 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.174506 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133895,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5605,"thread_start_us":899509,"threads_started":3,"wal-append.queue_time_us":825311}
I20260709 13:14:53.181073  6249 raft_consensus.cc:2393] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:53.183426  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.331043  6252 raft_consensus.cc:2393] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 3: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:53.186160  8611 raft_consensus.cc:3055] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:53.329172  6219 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:14:53.188112  6369 connection.cc:256] RPC call timeout handler was delayed by -1.3580660210000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 13:14:53.334132  6369 connection.cc:256] RPC call timeout handler was delayed by -1.2288382120000279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2319s for a response
W20260709 13:14:53.334751  6369 connection.cc:256] RPC call timeout handler was delayed by -1.0605730689999291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
I20260709 13:14:53.189265  6250 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
W20260709 13:14:53.194278  6939 rpcz_store.cc:269] 0709 13:14:51.686705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.933002 (+1246297us) service_pool.cc:224] Handling call
0709 13:14:53.193849 (+260847us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:52.941668  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:53.167940  8522 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:53.209438  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.212865  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:53.208627  6907 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:14:53.189824  8404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.007s	sys 0.021s
I20260709 13:14:53.219002  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:53.211542  6933 rpcz_store.cc:269] 0709 13:14:51.691818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.816608 (+124790us) service_pool.cc:224] Handling call
0709 13:14:52.941812 (+1125204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.221202  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:53.345100  6254 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:53.230285  6942 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 497) took 2456 ms (client timeout 3139 ms). Trace:
I20260709 13:14:53.234207  6325 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:14:53.347307  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:53.348008  6325 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:53.235406  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:14:53.217959  8476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.008s	sys 0.018s
I20260709 13:14:53.237941  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:53.241300  6937 rpcz_store.cc:269] 0709 13:14:51.688944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.999163 (+1310219us) service_pool.cc:224] Handling call
0709 13:14:53.240723 (+241560us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.240121  8584 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.901541  8666 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.252902  6253 raft_consensus.cc:2393] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:14:53.261197  8602 consensus_queue.cc:1175] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 5 index: 7 } }
I20260709 13:14:53.169998  8678 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:14:53.261011  6936 rpcz_store.cc:269] 0709 13:14:51.771119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.259748 (+1488629us) service_pool.cc:224] Handling call
0709 13:14:53.260647 (+   899us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.261933  6941 rpcz_store.cc:276] 0709 13:14:51.663566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.692336 (+ 28770us) service_pool.cc:224] Handling call
0709 13:14:52.853854 (+1161518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:52.891703 (+ 37849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.167827 (+276124us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400530cd0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:53.167993 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2603546368}
I20260709 13:14:53.295614  8610 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:53.168915  8285 ts_tablet_manager.cc:1469] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Trace:
0709 13:14:37.350625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.351670 (+  1045us) service_pool.cc:224] Handling call
0709 13:14:37.366829 (+ 15159us) ts_tablet_manager.cc:934] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
0709 13:14:42.857435 (+5490606us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:43.525256 (+667821us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:43.525395 (+   139us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:43.799041 (+273646us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:43.799331 (+   290us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:43.799632 (+   301us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:43.799700 (+    68us) inbound_call.cc:177] Queueing success response
0709 13:14:44.357969 (+558269us) spinlock_profiling.cc:243] Waited 993 us on lock 0x7b4c00253380. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4573eb1a20 00007f4573ec2a29 00007f4573e675e6 00007f4573e7cb13 00007f4573e7c945 00007f4573eef7ad 00007f457abc3198 00007f457abc3137 00007f457abc309c 00007f457abc3038 00007f457abc2300
0709 13:14:45.224299 (+866330us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:14:51.015155 (+5790856us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:14:51.160461 (+145306us) tablet_replica.cc:261] Starting instrumentation
0709 13:14:51.161085 (+   624us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":91627,"mutex_wait_us":2610,"raft.queue_time_us":101603,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":15739,"spinlock_wait_cycles":3898368,"tablet-copy.queue_time_us":13411,"tablet-download-pool.queue_time_us":12167,"tablet-download-pool.run_cpu_time_us":1862,"tablet-download-pool.run_wall_time_us":344318,"thread_start_us":148071,"threads_started":2}
I20260709 13:14:53.298484  8583 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:53.338634  8677 log.cc:927] Time spent T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:14:53.294943  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:53.178826  6938 rpcz_store.cc:269] 0709 13:14:50.818533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.948983 (+130450us) service_pool.cc:224] Handling call
0709 13:14:52.847862 (+1898879us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b5400530cd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:52.863238 (+ 15376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92332288}
I20260709 13:14:53.262562  8464 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.338166  8375 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:53.172719  6934 rpcz_store.cc:276] 0709 13:14:51.662336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.662457 (+   121us) service_pool.cc:224] Handling call
0709 13:14:51.662792 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:51.663016 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.663046 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:51.663569 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:14:51.884381 (+220812us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:51.884445 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.895113 (+ 10668us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:52.846825 (+951712us) raft_consensus.cc:1685] finished
0709 13:14:52.846858 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:52.865566 (+ 18708us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":213118,"threads_started":1,"wal-append.queue_time_us":546430}
I20260709 13:14:53.301110  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.235011  6328 rpcz_store.cc:276] 0709 13:14:51.855761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.926029 (+ 70268us) service_pool.cc:224] Handling call
0709 13:14:53.035396 (+1109367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.255613  6368 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:53.301713  8663 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:53.302222  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:53.305553  8680 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.084s	user 0.003s	sys 0.000s
I20260709 13:14:53.306067  8683 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.268707  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:53.293921  8377 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:53.295455  8641 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:53.296928  8622 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:53.313316  6296 connection.cc:256] RPC call timeout handler was delayed by -1.3421464430000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:14:53.453774  6296 connection.cc:256] RPC call timeout handler was delayed by -1.3214464430002408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
I20260709 13:14:53.312557  6330 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:14:53.314607  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2205) took 1622 ms. Trace:
W20260709 13:14:53.319160  6297 connection.cc:256] RPC call timeout handler was delayed by -1.1180442559998482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
W20260709 13:14:53.336345  6295 leader_election.cc:336] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.618s (SENT)
I20260709 13:14:53.337661  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:53.340119  6326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2209) took 1613 ms (client timeout 1679 ms). Trace:
I20260709 13:14:53.340031  6251 raft_consensus.cc:2393] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 3: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:53.342304  6940 raft_consensus.cc:2393] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 3: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:14:53.340469  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 131911us
I20260709 13:14:53.344036  6369 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:53.344069  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 91819.1us
I20260709 13:14:53.350891  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:53.397821  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:53.454162  6296 connection.cc:256] RPC call timeout handler was delayed by -1.1828464430000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260709 13:14:53.488214  6296 connection.cc:256] RPC call timeout handler was delayed by -1.0811464430000797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 13:14:53.488770  6296 connection.cc:256] RPC call timeout handler was delayed by -1.011846443000195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 13:14:53.491015  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 154721us
W20260709 13:14:53.491281  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 140492us
W20260709 13:14:53.499730  6297 connection.cc:256] RPC call timeout handler was delayed by -1.0844675969999571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2671s for a response
I20260709 13:14:53.295480  8617 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:14:53.428916  6324 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
W20260709 13:14:53.345806  6942 rpcz_store.cc:269] 0709 13:14:50.773667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.244450 (+470783us) service_pool.cc:224] Handling call
0709 13:14:53.230009 (+1985559us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54005b0254. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:53.230200 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4379311872}
I20260709 13:14:53.383446  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:53.433082  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:53.505580  6935 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
W20260709 13:14:53.506036  6935 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 437) took 1820 ms (client timeout 2425 ms). Trace:
W20260709 13:14:53.506388  6935 rpcz_store.cc:269] 0709 13:14:51.686122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.352147 (+1666025us) service_pool.cc:224] Handling call
0709 13:14:53.505986 (+153839us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.333699  8611 raft_consensus.cc:740] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:53.508203  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.397861  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:53.240509  8676 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:53.334887  8560 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:53.441393  6247 raft_consensus.cc:2368] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4.
I20260709 13:14:53.442159  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:53.444806  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:53.345009  8626 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.450199  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:14:53.512473  6297 leader_election.cc:336] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 2.227s (SENT)
I20260709 13:14:53.382292  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 1992) took 1453 ms. Trace:
W20260709 13:14:53.452383  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 203988us
W20260709 13:14:53.452448  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 196891us
W20260709 13:14:53.512893  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:53.512956  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 508) took 1314 ms. Trace:
I20260709 13:14:53.530812  6941 rpcz_store.cc:276] 0709 13:14:52.198505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.429061 (+1230556us) service_pool.cc:224] Handling call
0709 13:14:53.512902 (+ 83841us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.458221  6325 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:14:53.500165  6939 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 4: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:14:53.490224  6326 rpcz_store.cc:269] 0709 13:14:51.726490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.182120 (+1455630us) service_pool.cc:224] Handling call
0709 13:14:53.340062 (+157942us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:53.501035  6371 leader_election.cc:336] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.797s (SENT)
W20260709 13:14:53.532471  6939 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 438) took 1846 ms (client timeout 2008 ms). Trace:
I20260709 13:14:53.532394  6371 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:53.533918  6371 leader_election.cc:336] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.889s (SENT)
I20260709 13:14:53.534044  8452 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:53.534739  8452 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:53.534919  6371 leader_election.cc:336] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 2.008s (SENT)
W20260709 13:14:53.535468  8686 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:14:53.435742  8666 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.536371  6250 rpcz_store.cc:276] 0709 13:14:51.891556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.894255 (+  2699us) service_pool.cc:224] Handling call
0709 13:14:53.342389 (+1448134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.537283  8626 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.538229  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.538363  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.539338  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:53.453959  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:53.539912  6247 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:53.540328  6936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 510) took 1137 ms. Trace:
W20260709 13:14:53.533064  6939 rpcz_store.cc:269] 0709 13:14:51.686418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.342206 (+1655788us) service_pool.cc:224] Handling call
0709 13:14:53.532413 (+190207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:53.501528  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 157545us
I20260709 13:14:53.540741  6936 rpcz_store.cc:276] 0709 13:14:52.402590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.435473 (+1032883us) service_pool.cc:224] Handling call
0709 13:14:53.540268 (+104795us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.443301  8432 consensus_queue.cc:1059] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:14:53.569624  8476 raft_consensus.cc:3055] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:53.339617  8522 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.488217  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.569890  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:53.570079  8476 raft_consensus.cc:740] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:53.570581  6253 raft_consensus.cc:2393] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:53.570992  8476 consensus_queue.cc:260] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.571417  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.572080  6253 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:14:53.572295  8476 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:53.508123  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:53.573386  6256 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:53.572830  8611 consensus_queue.cc:260] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.574239  8611 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:53.351895  6329 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:53.509675  6323 raft_consensus.cc:2393] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:53.506462  8463 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:14:53.510911  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:53.510782  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.441749  8610 raft_consensus.cc:697] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:53.452165  8564 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:53.450547  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:53.440446  8584 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.509488  6249 raft_consensus.cc:2376] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3. Re-sending same reply.
I20260709 13:14:53.584558  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.452638  8375 raft_consensus.cc:697] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:53.513341  8418 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:53.585300  8564 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:53.585515  8418 raft_consensus.cc:697] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:53.451753  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:53.586047  8522 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:53.586102  8463 raft_consensus.cc:697] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:53.586498  8418 consensus_queue.cc:237] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.587414  6934 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:53.587203  8463 consensus_queue.cc:237] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.588042  6934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 505) took 1924 ms. Trace:
I20260709 13:14:53.588429  6934 rpcz_store.cc:276] 0709 13:14:51.664127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.586729 (+1922602us) service_pool.cc:224] Handling call
0709 13:14:53.587067 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.587783 (+   716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.587987 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.513636  8377 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:53.585827  8564 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:53.539623  8626 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:53.593339  6249 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:53.594451  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.595047  6249 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:53.595077  6254 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:53.595911  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.596252  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.542896  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.598280  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.598834  6255 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:53.585814  8375 consensus_queue.cc:237] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:53.599653  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.600708  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:53.544760  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:53.543944  6369 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:53.598392  6934 raft_consensus.cc:1217] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
W20260709 13:14:53.601754  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 57891.8us
I20260709 13:14:53.602042  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:53.602670  6369 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:53.440804  8678 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.548396  6266 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-19435892007a4e0a9b2b4d0b26ccd0c0 received from {username='slave'} at 127.0.0.1:38692
I20260709 13:14:53.551534  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.603636  6266 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-19435892007a4e0a9b2b4d0b26ccd0c0 on tablet 19435892007a4e0a9b2b4d0b26ccd0c0 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:53.603896  6248 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:14:53.604429  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 74570.2us
I20260709 13:14:53.552434  8368 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:53.539911  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.553432  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:53.553838  6933 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:53.533105  8676 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.543293  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:53.557402  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:53.558089  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:53.558614  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:53.556033  6247 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:53.562040  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:53.563611  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:53.630985  6330 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:53.499730  6219 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 2.114s (SENT) [suppressed 45 similar messages]
I20260709 13:14:53.598501  6256 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:53.631001  6324 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:53.632308  6942 raft_consensus.cc:2393] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 4: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:53.605167  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:14:53.633337  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 133643us
I20260709 13:14:53.565382  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:14:53.566730  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 129124us
I20260709 13:14:53.634562  6936 raft_consensus.cc:2410] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:14:53.485267  8683 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:53.570595  6935 raft_consensus.cc:2393] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:14:53.506984  6940 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 440) took 1816 ms (client timeout 1797 ms). Trace:
W20260709 13:14:53.636437  6940 rpcz_store.cc:269] 0709 13:14:51.686995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.936407 (+1249412us) service_pool.cc:224] Handling call
0709 13:14:53.492424 (+556017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.572929  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.539620  8666 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:53.508209  8670 consensus_queue.cc:1059] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:14:53.582894  6323 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:53.649765  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2211) took 1859 ms. Trace:
I20260709 13:14:53.650115  6323 rpcz_store.cc:276] 0709 13:14:51.790015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.582306 (+1792291us) service_pool.cc:224] Handling call
0709 13:14:53.582713 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.649520 (+ 66807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.649712 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.583664  6938 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 4: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:14:53.529414  6906 connection.cc:256] RPC call timeout handler was delayed by -1.8124572410001747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
I20260709 13:14:53.584453  8610 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.596681  6249 raft_consensus.cc:2393] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:14:53.501699  6295 leader_election.cc:336] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.641s (SENT)
W20260709 13:14:53.658336  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 156631us
W20260709 13:14:53.658869  6295 leader_election.cc:336] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.724s (SENT)
I20260709 13:14:53.603102  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:53.603760  6254 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:53.606649  6369 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:53.605369  6327 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:14:53.604744  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.489959  6331 rpcz_store.cc:276] 0709 13:14:51.692703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.845738 (+1153035us) service_pool.cc:224] Handling call
0709 13:14:52.865334 (+ 19596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:52.865523 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:14:53.178176 (+312653us) log.cc:844] Serialized 14 byte log entry
0709 13:14:53.314158 (+135982us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.314233 (+    75us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:53.314295 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.314379 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.314533 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31975,"prepare.queue_time_us":305203,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":115907,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":15934,"thread_start_us":432208,"threads_started":2,"wal-append.queue_time_us":174266}
I20260709 13:14:53.663146  6248 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:53.502121  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.559056  6937 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:53.511924  8663 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:53.659715  6295 leader_election.cc:336] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.795s (SENT)
I20260709 13:14:53.637460  6219 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:53.642117  6368 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:53.642839  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:53.565979  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:53.669176  6326 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:53.653812  6297 leader_election.cc:336] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.524s (SENT)
I20260709 13:14:53.602586  6934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 506) took 1938 ms. Trace:
I20260709 13:14:53.668309  6252 raft_consensus.cc:2393] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 3: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:53.668270  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:53.669219  6942 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Advancing to term 6
W20260709 13:14:53.673767  6295 leader_election.cc:336] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.908s (SENT)
W20260709 13:14:53.670969  6297 leader_election.cc:336] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.641s (SENT)
W20260709 13:14:53.676657  6297 leader_election.cc:336] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.724s (SENT)
I20260709 13:14:53.677114  6297 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:53.673877  6322 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.671607  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.675151  6325 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:53.604924  8678 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:53.611423  8626 raft_consensus.cc:2764] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:14:53.605154  8622 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:53.675463  6368 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:53.646330  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 89000.2us
I20260709 13:14:53.660698  6905 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:53.604913  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-b91f0c50e2de47c299569a0a5d7af6b8 received from {username='slave'} at 127.0.0.1:38692
W20260709 13:14:53.686619  6297 leader_election.cc:336] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.743s (SENT)
W20260709 13:14:53.688807  6295 leader_election.cc:336] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.963s (SENT)
I20260709 13:14:53.678439  6219 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:53.694486  6256 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
W20260709 13:14:53.690440  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 83867.7us
I20260709 13:14:53.657543  8432 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:53.657660  8452 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:14:53.691135  6906 connection.cc:256] RPC call timeout handler was delayed by -1.6360572410001168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
I20260709 13:14:53.759157  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:53.759325  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:53.763046  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 84639us
I20260709 13:14:53.767726  6221 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:53.757236  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:53.754522  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 67944.6us
I20260709 13:14:53.743324  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:53.772142  6297 leader_election.cc:336] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 2.100s (SENT)
I20260709 13:14:53.770453  6219 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:53.743325  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:53.769076  6906 connection.cc:256] RPC call timeout handler was delayed by -1.1754055489998336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260709 13:14:53.773299  6937 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
W20260709 13:14:53.774158  6906 connection.cc:256] RPC call timeout handler was delayed by -1.0242055490000439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
I20260709 13:14:53.755092  6330 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:14:53.790235  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:53.589321  8377 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:53.773695  6249 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:14:53.757555  6295 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:53.756376  6369 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:14:53.799702  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 124304us
I20260709 13:14:53.689963  8404 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:53.791642  6940 raft_consensus.cc:2376] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6. Re-sending same reply.
I20260709 13:14:53.727110  8368 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:53.831701  8611 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:53.832911  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 76612.6us
I20260709 13:14:53.833446  8626 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:53.737900  8563 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:53.790552  6328 raft_consensus.cc:2410] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:14:53.728506  8584 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:53.834467  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 145681us
I20260709 13:14:53.672500  8666 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.262s
I20260709 13:14:53.836499  6327 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:54.028448  6942 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEARNER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:14:54.116993  6942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 436) took 2431 ms. Trace:
W20260709 13:14:54.116894  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 324610us
I20260709 13:14:53.933537  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2212) took 2111 ms. Trace:
W20260709 13:14:53.957540  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.116925  6369 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:54.117869  6324 rpcz_store.cc:276] 0709 13:14:51.822350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.632592 (+1810242us) service_pool.cc:224] Handling call
0709 13:14:53.632877 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.633061 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:14:53.656895 (+ 23834us) log.cc:844] Serialized 14 byte log entry
0709 13:14:53.933200 (+276305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.933251 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:53.933292 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.933357 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.933477 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62383,"prepare.queue_time_us":35302,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":18954,"raft.queue_time_us":578,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":26343,"thread_start_us":275324,"threads_started":1}
W20260709 13:14:53.930099  6371 leader_election.cc:336] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 2.134s (SENT)
I20260709 13:14:53.871776  6941 raft_consensus.cc:2410] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:14:53.790199  8452 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.121719  6371 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:54.114292  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 313717us
I20260709 13:14:53.757431  8364 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:54.124821  6368 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:54.117690  6942 rpcz_store.cc:276] 0709 13:14:51.685773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.639391 (+1953618us) service_pool.cc:224] Handling call
0709 13:14:53.669081 (+ 29690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:54.116736 (+447655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.116940 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.947989  6330 raft_consensus.cc:3055] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:54.147394  6330 raft_consensus.cc:740] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:53.797699  8617 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:53.958467  6326 raft_consensus.cc:2410] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:14:54.037086  6322 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:53.885452  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-b91f0c50e2de47c299569a0a5d7af6b8 on tablet b91f0c50e2de47c299569a0a5d7af6b8 with peer 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:14:54.138295  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 477664us
W20260709 13:14:54.152418  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 384799us
I20260709 13:14:53.801465  8663 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:53.937417  8483 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:53.790756  8564 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:54.182713  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:53.869518  8678 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:53.835070  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:54.073616  8377 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:54.119153  8368 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:54.206131  6324 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:14:54.097514  8375 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:54.211462  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2017) took 1141 ms. Trace:
I20260709 13:14:54.215811  6251 rpcz_store.cc:276] 0709 13:14:53.070163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.510561 (+440398us) service_pool.cc:224] Handling call
0709 13:14:54.211197 (+700636us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54002107d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:54.211384 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839359872}
I20260709 13:14:54.127679  8452 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:54.073033  8683 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:53.887518  8522 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:54.236259  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:54.238966  6251 raft_consensus.cc:2393] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 4: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:54.203706  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2225) took 1010 ms. Trace:
I20260709 13:14:54.152913  8611 raft_consensus.cc:697] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:54.218590  6330 consensus_queue.cc:260] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:54.254518  6330 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:54.206822  8404 raft_consensus.cc:697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:54.233213  8563 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:54.241171  6324 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:54.164100  8617 raft_consensus.cc:697] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:54.243713  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:54.235765  6933 consensus_meta.cc:287] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.579s	user 0.005s	sys 0.005s
I20260709 13:14:54.227306  8375 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.262300  6251 raft_consensus.cc:2376] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4. Re-sending same reply.
I20260709 13:14:54.239879  8683 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.266824  6330 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:54.258443  6938 raft_consensus.cc:2393] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:54.250345  8663 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:14:54.273329  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 142919us
I20260709 13:14:53.672585  6934 rpcz_store.cc:276] 0709 13:14:51.664402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.597678 (+1933276us) service_pool.cc:224] Handling call
0709 13:14:53.598250 (+   572us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:53.602129 (+  3879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.602172 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.602224 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:53.602257 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.602323 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.602502 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1402,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75}
I20260709 13:14:54.303120  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 536) took 1400 ms. Trace:
I20260709 13:14:54.315399  6330 rpcz_store.cc:276] 0709 13:14:52.903044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.776545 (+873501us) service_pool.cc:224] Handling call
0709 13:14:53.834530 (+ 57985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:54.302787 (+468257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.303051 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:54.316789  6330 raft_consensus.cc:1240] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:54.238397  8368 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:54.302197  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 185236us
I20260709 13:14:54.313930  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:54.321825  6251 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:54.314273  6295 leader_election.cc:336] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.524s (SENT)
I20260709 13:14:54.322742  6295 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:54.322196  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:54.327024  6397 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
W20260709 13:14:54.225449  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:54.323093  6219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.055s	sys 0.043s
W20260709 13:14:54.329461  6219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.055s	sys 0.043s
W20260709 13:14:54.330268  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 559851us
I20260709 13:14:54.330758  6905 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:54.331068  6219 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:54.309829  8375 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:54.249998  6328 rpcz_store.cc:276] 0709 13:14:53.154518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.511438 (+356920us) service_pool.cc:224] Handling call
0709 13:14:54.164802 (+653364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:54.338021  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:54.341357  6256 raft_consensus.cc:2368] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5.
W20260709 13:14:54.339707  6295 leader_election.cc:336] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.641s (SENT)
I20260709 13:14:54.301530  6933 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:54.342965  6295 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:54.360028  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:54.361538  6936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 450) took 1467 ms. Trace:
I20260709 13:14:54.363835  6397 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:54.364328  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:54.365480  6256 raft_consensus.cc:2393] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 4: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:54.366432  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:54.368028  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:14:54.368289  6295 leader_election.cc:336] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.018s (SENT)
I20260709 13:14:54.369019  6405 raft_consensus.cc:2393] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:54.369757  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:54.369894  6403 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:54.370824  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2010) took 1302 ms. Trace:
W20260709 13:14:54.371500  6295 leader_election.cc:336] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.028s (SENT)
I20260709 13:14:54.372198  6295 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:54.319391  8663 raft_consensus.cc:697] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:54.318899  8560 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:54.376240  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:54.380821  6399 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:54.362041  6936 rpcz_store.cc:276] 0709 13:14:52.894359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.769355 (+874996us) service_pool.cc:224] Handling call
0709 13:14:54.137675 (+368320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:54.137921 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:54.214526 (+ 76605us) log.cc:844] Serialized 14 byte log entry
0709 13:14:54.361108 (+146582us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:54.361195 (+    87us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:54.361253 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.361333 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:54.361469 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":75999,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"thread_start_us":124107,"threads_started":1}
I20260709 13:14:54.371289  6248 rpcz_store.cc:276] 0709 13:14:53.068260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.336327 (+1268067us) service_pool.cc:224] Handling call
0709 13:14:54.370750 (+ 34423us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:54.379546  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 254760us
I20260709 13:14:54.382007  6368 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:54.313678  8683 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:54.384114  6368 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:54.391453  6368 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:54.385228  6935 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.010s	sys 0.009s
I20260709 13:14:54.380928  6256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:14:54.392599  6256 raft_consensus.cc:606] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:54.393069  6256 raft_consensus.cc:614] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:54.384841  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.341313  8364 raft_consensus.cc:697] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:54.357427  8584 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:54.397001  6368 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:14:54.397684  6935 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.010s	sys 0.009s
I20260709 13:14:54.402557  6397 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:54.410024  6935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 443) took 2679 ms. Trace:
I20260709 13:14:54.410679  6935 rpcz_store.cc:276] 0709 13:14:51.730377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.640058 (+1909681us) service_pool.cc:224] Handling call
0709 13:14:53.673170 (+ 33112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.673380 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:53.737429 (+ 64049us) log.cc:844] Serialized 14 byte log entry
0709 13:14:54.409578 (+672149us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:54.409645 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:54.409707 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.409795 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:54.409950 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":64286,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":6531,"thread_start_us":671696,"threads_started":1}
W20260709 13:14:54.412758  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 482656us
I20260709 13:14:54.414880  6371 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:54.375890  8678 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:54.422262  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59284 (request call id 26) took 1235 ms. Trace:
W20260709 13:14:54.376339  6933 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 509) took 2170 ms (client timeout 1916 ms). Trace:
I20260709 13:14:54.419476  6405 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:54.379750  8589 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:54.423831  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:54.446244  6403 raft_consensus.cc:2393] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:54.389567  8563 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:54.423420  6251 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:14:54.441749  6256 rpcz_store.cc:276] 0709 13:14:53.161016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.380775 (+1219759us) service_pool.cc:224] Handling call
0709 13:14:54.393527 (+ 12752us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:54.447345  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 424) took 1195 ms. Trace:
I20260709 13:14:54.438989  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:54.394709  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:54.447852  6251 rpcz_store.cc:276] 0709 13:14:53.251879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.313630 (+1061751us) service_pool.cc:224] Handling call
0709 13:14:54.447267 (+133637us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:54.393952  8602 consensus_queue.cc:1059] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:14:54.390089  8660 consensus_queue.cc:1059] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:14:54.451004  6399 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:14:54.393368  8463 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:14:54.392393  8560 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:54.464012  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:54.472353  6255 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:54.466890  8663 consensus_queue.cc:237] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:54.468065  8564 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:54.468946  8602 raft_consensus.cc:3055] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:54.461851  8589 raft_consensus.cc:697] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:14:54.443710  6933 rpcz_store.cc:269] 0709 13:14:52.198800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.401962 (+1203162us) service_pool.cc:224] Handling call
0709 13:14:54.369576 (+967614us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:54.487533  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 156523us
I20260709 13:14:54.392028  8404 consensus_queue.cc:237] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:54.469518  8522 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:54.460068  8705 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:54.400631  8611 consensus_queue.cc:237] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:54.470738  8563 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:54.459273  6414 tablet_copy_service.cc:342] P b940f12ed61a49c4b3c11f13ef50fa92: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-4bc84db94ed44cf9bab11e4626d2ba6e received from {username='slave'} at 127.0.0.1:41486
I20260709 13:14:54.497452  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:54.501943  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:54.510228  6399 raft_consensus.cc:2393] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:54.403283  8617 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:54.514457  6397 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:54.475700  8602 raft_consensus.cc:740] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:54.509864  6403 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
W20260709 13:14:54.504911  6369 connection.cc:256] RPC call timeout handler was delayed by -1.0738454219999767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24460000000000004s for a response
I20260709 13:14:54.470587  6934 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
W20260709 13:14:54.474460  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 101104us
I20260709 13:14:54.492430  8626 raft_consensus.cc:697] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:14:54.522429  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 125520us
I20260709 13:14:54.498807  8708 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:54.521492  6907 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:14:54.516371  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 101284us
I20260709 13:14:54.542243  6371 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:14:54.549186  6295 leader_election.cc:336] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.100s (SENT)
I20260709 13:14:54.549630  6295 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:54.502470  8564 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:14:54.511973  8705 raft_consensus.cc:697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:54.561040  6399 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:54.515182  8710 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:54.572374  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:54.572718  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 84046.1us
I20260709 13:14:54.520890  8660 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:14:54.536620  6414 tablet_copy_service.cc:434] P b940f12ed61a49c4b3c11f13ef50fa92: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-4bc84db94ed44cf9bab11e4626d2ba6e on tablet 4bc84db94ed44cf9bab11e4626d2ba6e with peer 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:14:54.562252  6295 leader_election.cc:336] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.126s (SENT)
I20260709 13:14:54.580430  6295 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:54.533845  8563 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:54.579022  6401 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:54.516371  8377 consensus_queue.cc:1059] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:14:54.579829  6219 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:54.588229  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:54.530120  8464 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:14:54.623471  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2218) took 1761 ms. Trace:
W20260709 13:14:54.624142  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 61932.5us
W20260709 13:14:54.627158  6295 leader_election.cc:336] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.227s (SENT)
I20260709 13:14:54.627549  6295 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:54.537592  8583 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:14:54.548300  8719 raft_consensus.cc:2764] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:14:54.630553  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 50829.9us
I20260709 13:14:54.628376  6331 rpcz_store.cc:276] 0709 13:14:52.862328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.682553 (+820225us) service_pool.cc:224] Handling call
0709 13:14:53.771963 (+ 89410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.772162 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:14:54.272631 (+500469us) log.cc:844] Serialized 14 byte log entry
0709 13:14:54.585574 (+312943us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:54.622527 (+ 36953us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:54.622659 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.622920 (+   261us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:54.623357 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19717,"prepare.queue_time_us":113413,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":57634,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":1984,"spinlock_wait_cycles":9285888,"thread_start_us":700070,"threads_started":3,"wal-append.queue_time_us":242349}
I20260709 13:14:54.632025  6219 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:54.629757  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:54.636466  6398 raft_consensus.cc:2410] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:54.632678  6399 raft_consensus.cc:2393] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:54.634800  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:54.635032  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2223) took 1699 ms. Trace:
I20260709 13:14:54.520244  8364 consensus_queue.cc:237] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:54.637461  6325 rpcz_store.cc:276] 0709 13:14:52.935512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.898616 (+963104us) service_pool.cc:224] Handling call
0709 13:14:53.898982 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.899276 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:14:54.152675 (+253399us) log.cc:844] Serialized 14 byte log entry
0709 13:14:54.634660 (+481985us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:54.634717 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:54.634767 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.634857 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:54.634974 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":303902,"prepare.queue_time_us":255902,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":113315,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9694,"thread_start_us":398550,"threads_started":2,"wal-append.queue_time_us":422362}
I20260709 13:14:54.640583  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:54.583132  8563 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:54.641196  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:54.648005  6398 raft_consensus.cc:2410] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:14:54.648407  6401 raft_consensus.cc:2393] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:54.582870  8710 raft_consensus.cc:697] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:54.651908  8678 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:54.582944  8589 consensus_queue.cc:237] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:54.654524  8713 log.cc:927] Time spent T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:14:54.654759  8720 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:14:54.655496  8715 log.cc:927] Time spent T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:14:54.630888  8368 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:54.649317  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:54.659317  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:54.660151  6401 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:54.638518  8476 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:54.636631  8709 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:54.635811  8706 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:54.653498  8622 consensus_meta.cc:287] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.886s	user 0.009s	sys 0.003s
I20260709 13:14:54.660338  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:54.649935  8563 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:54.664719  8432 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:14:54.666568  8583 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:54.667088  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:54.650260  8698 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:54.667780  8701 log.cc:927] Time spent T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:14:54.664719  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:54.687398  6398 raft_consensus.cc:2393] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:54.650666  8711 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:54.639075  8718 consensus_queue.cc:1059] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:14:54.693691  6399 raft_consensus.cc:1240] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:14:54.639691  8708 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:14:54.625662  8602 consensus_queue.cc:260] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:54.661389  8683 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:54.665818  8368 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:54.696671  8583 raft_consensus.cc:697] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:54.692636  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:54.705894  6405 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:54.656394  8705 consensus_queue.cc:237] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:54.687161  8622 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:54.678010  8709 raft_consensus.cc:697] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:54.689594  8698 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:14:54.720371  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 198945us
I20260709 13:14:54.692440  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 543) took 1030 ms. Trace:
I20260709 13:14:54.721941  6399 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:54.724653  6327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 530) took 1823 ms (client timeout 2017 ms). Trace:
W20260709 13:14:54.725072  6327 rpcz_store.cc:269] 0709 13:14:52.901640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.250496 (+348856us) service_pool.cc:224] Handling call
0709 13:14:54.724477 (+1473981us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54003930d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:54.724586 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360143616}
I20260709 13:14:54.727799  8463 raft_consensus.cc:3055] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:54.728201  8463 raft_consensus.cc:740] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:54.728993  8463 consensus_queue.cc:260] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:54.730283  8463 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:54.732596  8678 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:54.706090  8583 consensus_queue.cc:237] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:54.733249  8710 consensus_queue.cc:237] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:54.713071  8610 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:54.737450  6940 raft_consensus.cc:1240] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:54.737576  8585 raft_consensus.cc:3055] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:54.737296  8709 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:54.738036  8585 raft_consensus.cc:740] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:54.738126  6940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 512) took 1495 ms. Trace:
I20260709 13:14:54.738520  6940 rpcz_store.cc:276] 0709 13:14:53.242486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.720819 (+1478333us) service_pool.cc:224] Handling call
0709 13:14:54.737274 (+ 16455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:54.737890 (+   616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.738072 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:54.738914  8585 consensus_queue.cc:260] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:54.720161  8698 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:54.739991  8585 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:54.743225  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.743813  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 538) took 1238 ms. Trace:
I20260709 13:14:54.750248  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:54.749873  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:54.750811  6936 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:54.744946  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:54.744163  6324 rpcz_store.cc:276] 0709 13:14:53.505624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.265014 (+759390us) service_pool.cc:224] Handling call
0709 13:14:54.317809 (+ 52795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:54.364678 (+ 46869us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:54.386938 (+ 22260us) log.cc:844] Serialized 14 byte log entry
0709 13:14:54.547679 (+160741us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:54.549084 (+  1405us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:54.549227 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.743602 (+194375us) spinlock_profiling.cc:243] Waited 46.7 ms on lock 0x7b54002a4c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:54.743644 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:54.743762 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4343,"prepare.queue_time_us":24597,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":13336,"raft.queue_time_us":87217,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":2869,"spinlock_wait_cycles":107323648,"thread_start_us":155831,"threads_started":1,"wal-append.queue_time_us":143435}
I20260709 13:14:54.668622  8476 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:54.751202  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:54.759750  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.711572  8560 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:54.754539  6907 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:54.803222  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 48773.3us
I20260709 13:14:54.804380  6907 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:54.806489  8583 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:14:54.807134  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 179995us
I20260709 13:14:54.711390  8718 raft_consensus.cc:3055] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:54.783488  6255 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:14:54.662382  8626 consensus_queue.cc:237] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:54.800292  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:54.809091  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1294) took 1725 ms. Trace:
I20260709 13:14:54.809453  6255 rpcz_store.cc:276] 0709 13:14:53.083416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.682101 (+598685us) service_pool.cc:224] Handling call
0709 13:14:54.463877 (+781776us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b5800004e98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:14:54.809035 (+345158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15411968}
I20260709 13:14:54.812583  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:54.811375  8718 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:54.813418  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:54.814787  6331 raft_consensus.cc:3055] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:54.814350  8718 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:54.815157  6331 raft_consensus.cc:740] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:54.816009  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:54.817116  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:54.818008  8707 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:14:54.756892  8602 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:54.807713  8464 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:54.745209  8711 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.840152  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:54.840742  6327 raft_consensus.cc:2376] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5. Re-sending same reply.
I20260709 13:14:54.840934  6252 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:14:54.841445  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 438) took 1293 ms. Trace:
I20260709 13:14:54.841714  6252 rpcz_store.cc:276] 0709 13:14:53.548300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.790784 (+242484us) service_pool.cc:224] Handling call
0709 13:14:54.744755 (+953971us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b5800004e98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:14:54.841398 (+ 96643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15676544}
I20260709 13:14:54.842633  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:54.845280  6252 raft_consensus.cc:2368] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6.
I20260709 13:14:54.847283  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:54.744935  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:54.822474  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:54.749470  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:54.821784  6405 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:54.821624  6255 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:14:54.744477  8452 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:54.830682  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:54.807475  8583 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:14:54.833443  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:54.846179  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 209745us
W20260709 13:14:54.802114  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 255040us
I20260709 13:14:54.868850  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:54.824862  6935 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:54.867784  8711 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:54.839562  8464 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:54.848542  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:54.903961  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.937688  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:54.938143  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:54.821521  8727 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.938889  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:54.944551  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 191915us
I20260709 13:14:54.950078  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:54.955624  6326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 540) took 1447 ms (client timeout 1816 ms). Trace:
I20260709 13:14:54.957170  6941 raft_consensus.cc:2368] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5.
W20260709 13:14:54.960273  6322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 534) took 2057 ms (client timeout 2011 ms). Trace:
I20260709 13:14:54.960991  6323 raft_consensus.cc:1240] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:54.878594  6331 consensus_queue.cc:260] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:55.113849  6399 raft_consensus.cc:1240] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:55.114450  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:54.972643  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:55.098624  6296 leader_election.cc:336] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.519s (SENT)
I20260709 13:14:55.117985  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:55.118456  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:55.122743  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 272141us
I20260709 13:14:55.124878  6254 raft_consensus.cc:2393] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:14:55.125418  6254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 426) took 1786 ms (client timeout 2150 ms). Trace:
W20260709 13:14:55.125844  6254 rpcz_store.cc:269] 0709 13:14:53.339247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.673354 (+334107us) service_pool.cc:224] Handling call
0709 13:14:54.949935 (+1276581us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5800004e98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:14:55.125353 (+175418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881312000}
I20260709 13:14:54.991714  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 532) took 2089 ms. Trace:
I20260709 13:14:55.127526  6253 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
W20260709 13:14:55.129372  6247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 440) took 1580 ms (client timeout 2011 ms). Trace:
I20260709 13:14:55.129995  6331 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:55.131302  6326 rpcz_store.cc:269] 0709 13:14:53.508091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.532113 (+ 24022us) service_pool.cc:224] Handling call
0709 13:14:54.955369 (+1423256us) spinlock_profiling.cc:243] Waited 67.8 ms on lock 0x7b5400019354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:54.955551 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155842816}
I20260709 13:14:55.132447  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:55.130126  6322 rpcz_store.cc:269] 0709 13:14:52.902578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.245551 (+342973us) service_pool.cc:224] Handling call
0709 13:14:54.960046 (+1714495us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54002913d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:54.960187 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":983144320}
I20260709 13:14:55.136233  6249 raft_consensus.cc:2410] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:14:54.723627  6328 rpcz_store.cc:276] 0709 13:14:53.661711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.546372 (+884661us) service_pool.cc:224] Handling call
0709 13:14:54.641307 (+ 94935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:54.653170 (+ 11863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:54.659174 (+  6004us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:54.663619 (+  4445us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:54.669321 (+  5702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.679447 (+ 10126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:54.691595 (+ 12148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.137838  6325 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:55.138890  6936 raft_consensus.cc:2393] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 9: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:55.033519  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:55.140004  6937 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 510) took 1363 ms (client timeout 1724 ms). Trace:
W20260709 13:14:55.140408  6937 rpcz_store.cc:269] 0709 13:14:53.777025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.898293 (+1121268us) service_pool.cc:224] Handling call
0709 13:14:55.139940 (+241647us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:54.971975  6905 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:55.128450  6253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 427) took 1725 ms (client timeout 1953 ms). Trace:
W20260709 13:14:55.143745  6296 leader_election.cc:336] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.564s (SENT)
W20260709 13:14:55.147001  6221 connection.cc:256] RPC call timeout handler was delayed by -3.6037596950000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
I20260709 13:14:55.147764  6255 raft_consensus.cc:1240] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:55.148578  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:55.148705  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 429) took 1603 ms. Trace:
W20260709 13:14:55.147775  6221 connection.cc:256] RPC call timeout handler was delayed by -3.5929596949999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260709 13:14:55.149266  6221 connection.cc:256] RPC call timeout handler was delayed by -3.4957596950000607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
I20260709 13:14:55.149140  6255 rpcz_store.cc:276] 0709 13:14:53.545501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.147256 (+1601755us) service_pool.cc:224] Handling call
0709 13:14:55.147570 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.148459 (+   889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.148651 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:55.149602  6221 connection.cc:256] RPC call timeout handler was delayed by -3.47055969500002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
W20260709 13:14:55.149930  6221 connection.cc:256] RPC call timeout handler was delayed by -3.376959695000096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 13:14:55.150166  6221 connection.cc:256] RPC call timeout handler was delayed by -3.3418596950000392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 13:14:55.129765  6247 rpcz_store.cc:269] 0709 13:14:53.548961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.727329 (+178368us) service_pool.cc:224] Handling call
0709 13:14:54.900499 (+1173170us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b5800004e98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:14:55.129267 (+228768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887411584}
W20260709 13:14:55.150420  6221 connection.cc:256] RPC call timeout handler was delayed by -3.1897596950000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
W20260709 13:14:55.150724  6221 connection.cc:256] RPC call timeout handler was delayed by -3.029559694999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
W20260709 13:14:55.150961  6221 connection.cc:256] RPC call timeout handler was delayed by -2.14305969499992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3199s for a response
W20260709 13:14:55.143711  6253 rpcz_store.cc:269] 0709 13:14:53.402699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.656664 (+253965us) service_pool.cc:224] Handling call
0709 13:14:54.899043 (+1242379us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5800004e98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:14:55.128387 (+229344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884009216}
I20260709 13:14:55.157647  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 433) took 1610 ms. Trace:
I20260709 13:14:55.158358  6249 rpcz_store.cc:276] 0709 13:14:53.546778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.806623 (+259845us) service_pool.cc:224] Handling call
0709 13:14:54.899354 (+1092731us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b5800004e98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:14:55.157579 (+258225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27611392}
W20260709 13:14:55.066355  8730 log.cc:927] Time spent T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.335s	user 0.002s	sys 0.004s
I20260709 13:14:55.165781  6369 leader_election.cc:400] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6.
I20260709 13:14:55.167376  6369 leader_election.cc:403] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:14:55.167128  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:55.167021  6401 raft_consensus.cc:2393] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:55.168251  6369 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:55.127161  6329 rpcz_store.cc:276] 0709 13:14:52.902112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.771654 (+869542us) service_pool.cc:224] Handling call
0709 13:14:54.154025 (+382371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:54.154300 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:54.221987 (+ 67687us) log.cc:844] Serialized 14 byte log entry
0709 13:14:54.392810 (+170823us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:54.392886 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:54.392947 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.393037 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:54.726372 (+333335us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b48002526d8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457ab0eaa1 00007f457ab05b37 00007f457ab059ca 00007f457abfd26f 00007f457abfcf37 00007f457ac1155c 00007f457ac11508 00007f457ac11488 00007f457ac11443 00007f457ac106ec 00007f4579b3aa96
0709 13:14:54.991471 (+265099us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54001c0a50. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:54.991635 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22569,"prepare.queue_time_us":65984,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":102473,"raft.run_cpu_time_us":1297,"raft.run_wall_time_us":255746,"spinlock_wait_cycles":748931840,"thread_start_us":136947,"threads_started":1,"wal-append.queue_time_us":247767}
I20260709 13:14:55.171027  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:55.171576  6253 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:55.168458  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:55.118108  8718 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:55.171761  6219 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:55.171985  6369 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:14:55.174924  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 203048us
I20260709 13:14:55.176254  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:55.176689  6905 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:55.069518  8522 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.138252  6328 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:55.184736  6247 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:55.180279  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:55.128589  8676 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:55.138995  8464 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:55.187397  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.187245  6322 raft_consensus.cc:1275] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:55.168376  8716 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.937913  6250 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 1.
I20260709 13:14:55.203565  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:55.098171  8404 consensus_queue.cc:1059] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:14:55.190282  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 442) took 1640 ms. Trace:
W20260709 13:14:55.198000  6296 leader_election.cc:336] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.618s (SENT)
I20260709 13:14:55.228418  6296 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:55.228286  6247 rpcz_store.cc:276] 0709 13:14:53.549602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.150618 (+1601016us) service_pool.cc:224] Handling call
0709 13:14:55.184548 (+ 33930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.189963 (+  5415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.190211 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:55.203337  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.140595  8683 consensus_queue.cc:1059] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:14:55.055712  8563 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:55.182965  8622 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:55.179057  8710 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:55.235253  6296 leader_election.cc:336] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.641s (SENT)
I20260709 13:14:55.250099  6296 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:55.244148  6403 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:55.183303  8725 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:55.178622  8564 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:55.204137  8476 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:55.160230  8736 consensus_queue.cc:1059] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:14:55.248301  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:14:55.253108  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 65559.8us
I20260709 13:14:55.253328  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.262889  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.264032  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.264698  6249 raft_consensus.cc:2368] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5.
I20260709 13:14:55.265581  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:55.203562  8611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.019s	sys 0.035s
I20260709 13:14:55.256943  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:55.266278  8611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.020s	sys 0.035s
I20260709 13:14:55.270823  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:55.271579  6396 raft_consensus.cc:2368] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5.
I20260709 13:14:55.134327  8727 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:55.267197  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.269642  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:55.192203  8522 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:55.239773  8368 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:55.274098  6403 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:55.329643  6255 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:14:55.272836  8711 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:55.270320  8738 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 13:14:55.246856  6250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 428) took 1737 ms (client timeout 2121 ms). Trace:
I20260709 13:14:55.336505  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:55.334543  6400 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
W20260709 13:14:55.312508  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.313807  6295 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:55.239689  8745 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.318161  6326 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:55.318670  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.319536  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.248106  8622 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.301923  8735 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:55.257313  8710 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:55.350751  8710 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:55.351805  8735 raft_consensus.cc:697] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:55.352715  8735 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:55.317090  8583 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:14:55.354269  8585 consensus_meta.cc:287] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.614s	user 0.005s	sys 0.005s
I20260709 13:14:55.354581  8610 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:55.355170  8610 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:55.355405  8563 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:55.335897  8726 raft_consensus.cc:3055] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:55.356258  8726 raft_consensus.cc:740] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:55.340060  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:55.330610  8463 consensus_meta.cc:287] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.596s	user 0.007s	sys 0.004s
I20260709 13:14:55.318836  8611 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:55.342599  6295 leader_election.cc:336] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.563s (SENT)
W20260709 13:14:55.333551  8375 consensus_meta.cc:287] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.968s	user 0.012s	sys 0.000s
I20260709 13:14:55.347040  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:55.348050  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:55.354709  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2231) took 1717 ms. Trace:
I20260709 13:14:55.244691  8716 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:55.428412  6295 leader_election.cc:400] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5.
I20260709 13:14:55.431883  6295 leader_election.cc:403] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:55.431466  6330 rpcz_store.cc:276] 0709 13:14:53.637627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.324289 (+686662us) service_pool.cc:224] Handling call
0709 13:14:54.358003 (+ 33714us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:54.539220 (+181217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:54.539262 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:54.548623 (+  9361us) log.cc:844] Serialized 26 byte log entry
0709 13:14:55.109376 (+560753us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:55.109435 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.109536 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.354510 (+244974us) raft_consensus.cc:1685] finished
0709 13:14:55.354527 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.354654 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61013,"raft.queue_time_us":96445,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4516,"thread_start_us":565894,"threads_started":2,"wal-append.queue_time_us":646737}
I20260709 13:14:55.423610  6326 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
W20260709 13:14:55.435865  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 313574us
I20260709 13:14:55.343585  8711 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.450902  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.448398  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:55.346495  8622 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:55.456423  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 221178us
W20260709 13:14:55.366541  8731 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
W20260709 13:14:55.461875  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 83754.6us
W20260709 13:14:55.448031  6906 leader_election.cc:336] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.021s (SENT)
I20260709 13:14:55.470841  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1292) took 2394 ms. Trace:
I20260709 13:14:55.471184  6400 raft_consensus.cc:2410] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 13:14:55.473711  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:55.502506  6296 leader_election.cc:336] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.795s (SENT)
I20260709 13:14:55.503022  6296 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:55.477632  6251 rpcz_store.cc:276] 0709 13:14:53.076009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.452767 (+1376758us) service_pool.cc:224] Handling call
0709 13:14:54.453219 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:54.453506 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:54.453543 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:54.461579 (+  8036us) log.cc:844] Serialized 26 byte log entry
0709 13:14:54.578299 (+116720us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:54.578377 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.578521 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.470565 (+892044us) raft_consensus.cc:1685] finished
0709 13:14:55.470594 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.470767 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":65253,"threads_started":1,"wal-append.queue_time_us":199817}
I20260709 13:14:55.500702  6906 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:55.503027  6254 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:14:55.502544  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:55.527333  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.455442  6933 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:55.472604  8452 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:55.530835  6249 raft_consensus.cc:2393] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:55.448832  8611 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:55.500313  8368 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.537308  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:55.537408  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.562633  6251 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:14:55.542178  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:55.542650  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 94650.8us
I20260709 13:14:55.564011  6295 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:55.564026  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:55.565326  6906 leader_election.cc:336] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.240s (SENT)
W20260709 13:14:55.338272  6250 rpcz_store.cc:269] 0709 13:14:53.509442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.790745 (+281303us) service_pool.cc:224] Handling call
0709 13:14:54.744798 (+954053us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b5800004e98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:14:55.244115 (+499317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73725184}
I20260709 13:14:55.565752  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:55.566047  6400 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:55.566329  6251 raft_consensus.cc:2376] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5. Re-sending same reply.
I20260709 13:14:55.567626  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.567770  6369 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:55.568660  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.569355  6251 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 3: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:55.565079  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:55.570071  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:55.570851  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.572163  6249 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:55.572687  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 443) took 2022 ms. Trace:
I20260709 13:14:55.565752  6906 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:55.575474  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.576100  8463 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:55.553794  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 51312.2us
I20260709 13:14:55.503897  8734 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:14:55.577873  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:55.533942  8705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.024s	sys 0.044s
W20260709 13:14:55.584679  6906 connection.cc:256] RPC call timeout handler was delayed by -1.556713026000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3073s for a response
I20260709 13:14:55.572971  6249 rpcz_store.cc:276] 0709 13:14:53.549878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.571656 (+2021778us) service_pool.cc:224] Handling call
0709 13:14:55.571891 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.572463 (+   572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.572609 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.448293  8375 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:55.586110  6249 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:14:55.586890  8705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.024s	sys 0.045s
W20260709 13:14:55.593540  8741 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:14:55.594782  8375 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:55.566325  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.596874  6250 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
W20260709 13:14:55.597326  8739 log.cc:927] Time spent T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 13:14:55.597523  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 445) took 2047 ms. Trace:
I20260709 13:14:55.597887  6250 rpcz_store.cc:276] 0709 13:14:53.550442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.596388 (+2045946us) service_pool.cc:224] Handling call
0709 13:14:55.596694 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.597268 (+   574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.597463 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.599201  6256 raft_consensus.cc:1240] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:55.599270  8522 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:55.536231  8603 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:55.588234  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 444) took 2038 ms. Trace:
I20260709 13:14:55.612600  6249 rpcz_store.cc:276] 0709 13:14:53.550131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.585527 (+2035396us) service_pool.cc:224] Handling call
0709 13:14:55.585790 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.587947 (+  2157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.588171 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.613920  6249 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:55.615783  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1296) took 2517 ms. Trace:
I20260709 13:14:55.616183  6252 rpcz_store.cc:276] 0709 13:14:53.084030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.129265 (+2045235us) service_pool.cc:224] Handling call
0709 13:14:55.129570 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.129773 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.129801 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:55.139435 (+  9634us) log.cc:844] Serialized 26 byte log entry
0709 13:14:55.258090 (+118655us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:55.258134 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.258200 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.601288 (+343088us) raft_consensus.cc:1685] finished
0709 13:14:55.601307 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.601445 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":66043,"threads_started":1,"wal-append.queue_time_us":259794}
I20260709 13:14:55.620368  6252 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:14:55.622089  6252 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
W20260709 13:14:55.630220  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 453487us
I20260709 13:14:55.633543  6371 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:55.643555  8375 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.644150  8375 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:55.646377  8375 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:55.655242  6331 consensus_meta.cc:287] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
I20260709 13:14:55.656594  6906 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:55.659291  6906 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:55.659940  6331 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:14:55.662500  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 98599.9us
W20260709 13:14:55.662534  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 85101.3us
I20260709 13:14:55.586098  8563 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:55.675487  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:55.676564  8368 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:55.526326  8726 consensus_queue.cc:260] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:55.677341  8732 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:55.678766  8585 consensus_queue.cc:1059] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:14:55.652079  8740 log.cc:927] Time spent T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.395s	user 0.000s	sys 0.001s
I20260709 13:14:55.615621  8711 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:14:55.695248  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:55.757962  6937 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.697237  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:55.750962  6253 consensus_meta.cc:287] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.001s
I20260709 13:14:55.760257  6253 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
W20260709 13:14:55.762156  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 95652.3us
I20260709 13:14:55.680920  8377 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.773685  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:55.787874  6397 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:55.680699  8583 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:55.687841  8736 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:55.733704  8368 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:55.760427  8747 log.cc:927] Time spent T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
I20260709 13:14:55.818486  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.782289  6938 raft_consensus.cc:1240] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:55.828245  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.783869  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.681026  8452 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.601912  8734 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:55.785699  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:55.788968  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:55.791499  6405 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:55.694314  8589 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
W20260709 13:14:55.763860  8698 consensus_meta.cc:287] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.023s	user 0.006s	sys 0.004s
I20260709 13:14:55.733382  8603 consensus_queue.cc:1059] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:14:55.798475  8712 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:14:55.799497  8717 log.cc:927] Time spent T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.692s	user 0.000s	sys 0.007s
I20260709 13:14:55.800150  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:55.800765  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1297) took 2716 ms. Trace:
I20260709 13:14:55.763888  8610 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:55.804334  8718 consensus_meta.cc:287] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.621s	user 0.005s	sys 0.003s
I20260709 13:14:55.806183  8611 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:55.807261  8742 log.cc:927] Time spent T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:14:55.807639  8759 consensus_queue.cc:1059] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:14:55.707062  8752 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:14:55.706678  8749 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.179s
I20260709 13:14:55.796006  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1304) took 1289 ms. Trace:
I20260709 13:14:55.814630  8660 raft_consensus.cc:3055] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:55.883419  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:55.816169  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2012) took 2747 ms. Trace:
I20260709 13:14:55.885891  6256 rpcz_store.cc:276] 0709 13:14:53.068771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.449368 (+1380597us) service_pool.cc:224] Handling call
0709 13:14:54.449725 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.599695 (+1149970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.815892 (+216197us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400203854. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:55.816097 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2643141888}
I20260709 13:14:55.887558  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.819511  6937 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:55.825229  6403 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:14:55.890813  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:55.848591  8727 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:55.897396  6329 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:55.889010  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:55.899094  6256 raft_consensus.cc:2376] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4. Re-sending same reply.
I20260709 13:14:55.780236  6331 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:14:55.829741  8464 consensus_meta.cc:287] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.000s
I20260709 13:14:55.827193  8368 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:55.843628  6254 rpcz_store.cc:276] 0709 13:14:53.084291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.131366 (+2047075us) service_pool.cc:224] Handling call
0709 13:14:55.178087 (+ 46721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.521369 (+343282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.800556 (+279187us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54000e33d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:55.800709 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687900032}
W20260709 13:14:55.851683  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 218206us
I20260709 13:14:55.837548  8736 consensus_queue.cc:1059] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:14:55.854521  6251 raft_consensus.cc:2410] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:14:55.857563  6396 raft_consensus.cc:2410] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:55.858285  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:55.837932  8452 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:55.876068  8770 log.cc:927] Time spent T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:14:55.876236  8711 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5.
I20260709 13:14:55.843170  8712 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.936931  8712 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:55.916849  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.938544  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.939131  6249 raft_consensus.cc:2393] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:55.939337  6254 raft_consensus.cc:2376] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6. Re-sending same reply.
I20260709 13:14:55.940002  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:55.940614  6249 raft_consensus.cc:2376] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7. Re-sending same reply.
W20260709 13:14:55.940760  8762 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:14:55.905143  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:55.858474  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:55.878328  8563 raft_consensus.cc:697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:55.844134  8698 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:55.919320  6371 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:55.946799  8752 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:55.947351  8752 raft_consensus.cc:697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:55.947536  8698 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:55.948130  6247 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:55.948176  8752 consensus_queue.cc:237] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:55.951632  8712 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:55.945465  8563 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:55.900518  8735 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:14:55.932540  8723 consensus_queue.cc:1059] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:55.899597  8719 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:55.933604  8727 raft_consensus.cc:3055] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:55.936863  8759 raft_consensus.cc:3055] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:55.817451  8767 consensus_queue.cc:1059] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:14:55.830616  8764 consensus_queue.cc:1059] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:14:55.942380  8721 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.062s	user 0.004s	sys 0.002s
I20260709 13:14:55.942020  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:55.884004  8660 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:55.930557  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:55.944344  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:55.971692  6256 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 1.
I20260709 13:14:55.902283  8716 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:55.959467  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 231413us
I20260709 13:14:55.960346  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:55.961238  8602 consensus_meta.cc:287] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 1.121s	user 0.006s	sys 0.005s
I20260709 13:14:55.902765  8718 consensus_queue.cc:1048] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:14:56.033859  6940 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:55.902053  8522 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:14:55.928190  8585 consensus_queue.cc:1243] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 6.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:14:55.971738  6398 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:56.035737  8589 consensus_queue.cc:1059] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:56.036598  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:56.036732  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:56.037225  6935 raft_consensus.cc:2376] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5. Re-sending same reply.
I20260709 13:14:56.037573  6398 raft_consensus.cc:2393] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:56.037781  8757 raft_consensus.cc:3055] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:56.038160  8757 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:56.038463  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.038998  8757 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:56.039526  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.040217  8757 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:56.040525  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:55.955798  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 178173us
I20260709 13:14:56.042248  6296 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:55.962632  8727 raft_consensus.cc:740] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:55.972743  6330 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:14:56.043394  6296 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:55.973805  8660 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:55.975634  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:55.976421  8622 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:55.980526  8725 consensus_meta.cc:287] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.707s	user 0.001s	sys 0.008s
I20260709 13:14:55.981817  8734 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:56.046923  6219 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:55.987530  8723 raft_consensus.cc:1064] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:55.914469  8464 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:55.988510  8764 raft_consensus.cc:3055] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:14:55.990495  8702 log.cc:927] Time spent T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.808s	user 0.002s	sys 0.000s
I20260709 13:14:55.995996  8564 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:55.998371  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2214) took 4102 ms. Trace:
I20260709 13:14:56.085234  6323 rpcz_store.cc:276] 0709 13:14:51.903971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.650859 (+1746888us) service_pool.cc:224] Handling call
0709 13:14:54.960745 (+1309886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.130720 (+169975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.998158 (+867438us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002913d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:55.998308 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3011787648}
I20260709 13:14:56.000026  6402 raft_consensus.cc:1240] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:56.001067  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:56.087577  6324 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:56.002174  8584 consensus_queue.cc:1059] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:56.002396  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:56.014523  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.089195  6403 raft_consensus.cc:2368] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5.
I20260709 13:14:56.090010  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.015475  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 547) took 1274 ms. Trace:
I20260709 13:14:56.090019  6404 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:14:56.090667  6325 rpcz_store.cc:276] 0709 13:14:54.741032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.757927 (+ 16895us) service_pool.cc:224] Handling call
0709 13:14:54.758192 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.138182 (+379990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.015209 (+877027us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b5400038c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:56.015411 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872677760}
I20260709 13:14:56.016274  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 441) took 2467 ms. Trace:
I20260709 13:14:56.092170  6255 rpcz_store.cc:276] 0709 13:14:53.549309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.150104 (+1600795us) service_pool.cc:224] Handling call
0709 13:14:55.178950 (+ 28846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.330230 (+151280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.016039 (+685809us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54000f6c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:56.016214 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345851264}
I20260709 13:14:56.017459  8617 raft_consensus.cc:3055] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:56.018304  6329 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:56.018785  8776 raft_consensus.cc:3055] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:56.019135  8377 raft_consensus.cc:3055] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:55.962849  8759 raft_consensus.cc:740] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:55.880374  6250 rpcz_store.cc:276] 0709 13:14:54.506272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.598690 (+1092418us) service_pool.cc:224] Handling call
0709 13:14:55.667384 (+ 68694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.736235 (+ 68851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.744040 (+  7805us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:55.755358 (+ 11318us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:55.764979 (+  9621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.777792 (+ 12813us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.792797 (+ 15005us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:56.026787  8712 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:55.992774  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:56.115736  6941 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:56.031009  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.117165  6396 raft_consensus.cc:2393] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:56.032830  8368 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:56.035094  6940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 511) took 1288 ms. Trace:
I20260709 13:14:55.961030  6221 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:55.983913  8452 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:56.118031  6940 rpcz_store.cc:276] 0709 13:14:54.746236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.801571 (+ 55335us) service_pool.cc:224] Handling call
0709 13:14:56.034947 (+1233376us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540055cb54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:56.035042 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2779250944}
I20260709 13:14:56.052305  6249 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:56.054266  6251 raft_consensus.cc:1275] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:56.120391  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:56.055133  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:56.056955  8725 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6.
I20260709 13:14:56.077414  8764 raft_consensus.cc:740] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:56.052662  6219 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:56.074599  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.075007  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:56.081780  6906 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:56.083847  6254 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:14:56.013666  6154 catalog_manager.cc:5697] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 2 to 3, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 3 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:56.051918  8404 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:14:56.104202  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.059170  8767 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:56.113183  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:56.102160  8564 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:56.062743  8718 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:56.114708  6325 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:56.057034  8778 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:14:56.126621  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 165663us
I20260709 13:14:56.152525  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 1893) took 1488 ms. Trace:
W20260709 13:14:56.134739  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 82143.7us
I20260709 13:14:56.097573  6328 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:56.152551  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:56.142388  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 60668.3us
I20260709 13:14:56.152925  6401 rpcz_store.cc:276] 0709 13:14:54.663912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.664053 (+   141us) service_pool.cc:224] Handling call
0709 13:14:56.152358 (+1488305us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54003ad9d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:56.152473 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1091432704}
I20260709 13:14:56.158876  6906 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:56.159329  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.160429  6906 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:56.102890  8617 raft_consensus.cc:740] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:56.142974  6371 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:56.106323  8776 raft_consensus.cc:740] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:56.060302  8710 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:14:56.114789  8660 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:56.109411  8377 raft_consensus.cc:740] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:56.147303  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:56.174538  6906 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:56.144713  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:14:56.146834  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.143537  8745 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.156839  6221 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:56.162832  6941 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:14:56.161644  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 102264us
I20260709 13:14:56.141582  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:56.145270  8719 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:56.171348  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:56.173480  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.174574  6937 raft_consensus.cc:1240] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:56.175269  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:56.177011  6324 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:56.183370  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.170178  6397 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:14:56.144390  8781 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:56.206156  6936 raft_consensus.cc:2410] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:14:56.223981  6942 raft_consensus.cc:1240] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:14:56.210968  6906 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:56.208451  6396 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:56.213547  8463 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.227670  8463 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:56.227748  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.228068  8463 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:56.228489  8463 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:56.228912  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.230000  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:56.230473  6396 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.208946  6401 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:56.204089  8719 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.233604  8719 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:56.233824  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.234922  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:56.235411  6401 raft_consensus.cc:2376] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3. Re-sending same reply.
I20260709 13:14:56.236145  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.237654  6940 raft_consensus.cc:1240] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:56.237432  8583 consensus_queue.cc:1059] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:56.237074  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.240473  6401 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:56.244254  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:56.170622  8712 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:56.247920  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:56.206832  6297 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:56.245566  6941 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:14:56.251016  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 80138.3us
I20260709 13:14:56.247251  6907 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:56.248196  6254 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:56.257082  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:56.125749  8727 consensus_queue.cc:260] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:56.204932  8602 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:14:56.266547  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 59808.5us
I20260709 13:14:56.203608  8783 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:56.269452  6297 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:56.264281  6401 raft_consensus.cc:2393] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:14:56.278182  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 99548.1us
I20260709 13:14:56.280561  6254 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:14:56.251390  8712 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.284065  6324 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 13:14:56.282172  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 55724.5us
I20260709 13:14:56.285046  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.282663  6297 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:56.297569  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:56.298437  6936 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:56.301416  8795 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:56.302171  8795 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:56.271193  8706 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:56.259361  8418 consensus_queue.cc:1059] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:14:56.309942  6297 leader_election.cc:400] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5.
I20260709 13:14:56.308418  6396 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:14:56.310434  6297 leader_election.cc:403] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:56.311193  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.312122  6396 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:56.277915  8781 raft_consensus.cc:3055] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:56.289337  6401 raft_consensus.cc:2393] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:56.312050  6297 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:56.313395  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 1923) took 1046 ms. Trace:
I20260709 13:14:56.281193  8563 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:56.287186  8712 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.317392  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.317704  6396 rpcz_store.cc:276] 0709 13:14:55.267040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.310906 (+1043866us) service_pool.cc:224] Handling call
0709 13:14:56.313320 (+  2414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:56.242673  8759 consensus_queue.cc:260] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:56.288924  8727 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.322085  6297 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:56.172370  8778 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:56.292702  8404 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:56.327832  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.304692  8698 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.332355  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.323125  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:56.331754  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.322932  8779 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:14:56.339560  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.340330  6396 raft_consensus.cc:2393] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:14:56.350754  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:56.351337  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.250181  8764 consensus_queue.cc:260] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:56.351712  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:56.352144  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.312986  8795 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5.
I20260709 13:14:56.331527  8464 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:56.365283  8764 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:56.370771  8756 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:56.352133  8761 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:56.312718  8617 consensus_queue.cc:260] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:56.374539  8761 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.372685  8719 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:56.375115  8761 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:56.375244  8564 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:56.376192  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 435) took 1202 ms. Trace:
I20260709 13:14:56.377061  8778 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:56.377884  8791 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:56.378702  8784 log.cc:927] Time spent T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:14:56.372917  8418 raft_consensus.cc:3055] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:56.380194  8418 raft_consensus.cc:740] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:56.376610  6399 rpcz_store.cc:276] 0709 13:14:55.173696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.173852 (+   156us) service_pool.cc:224] Handling call
0709 13:14:55.174134 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.183749 (+  9615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.183795 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:56.058163 (+874368us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b2c000f15d8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f45744dea11 00007f45744ee372 00007f4575c20a01 00007f4575be543a 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2
0709 13:14:56.058476 (+   313us) log.cc:844] Serialized 26 byte log entry
0709 13:14:56.151012 (+ 92536us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:56.151049 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.151113 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:56.375836 (+224723us) raft_consensus.cc:1685] finished
0709 13:14:56.375856 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.376127 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53635,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":18649,"spinlock_wait_cycles":23777152,"thread_start_us":92194,"threads_started":1,"wal-append.queue_time_us":256969}
I20260709 13:14:56.266760  8776 consensus_queue.cc:260] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:56.315186  8781 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:56.381384  6938 raft_consensus.cc:2393] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 3: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:56.394160  6941 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:56.352994  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 1927) took 1084 ms. Trace:
I20260709 13:14:56.471179  6396 rpcz_store.cc:276] 0709 13:14:55.268171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.338518 (+1070347us) service_pool.cc:224] Handling call
0709 13:14:56.352935 (+ 14417us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:56.385954  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.376716  8719 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:56.362833  8759 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:56.361249  8622 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:56.331138  8563 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:56.475896  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:56.380983  8418 consensus_queue.cc:260] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:56.337641  8404 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:56.386730  8368 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:56.352548  8584 consensus_queue.cc:1175] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8600a3fead0e48a7aa813822ec44d0fe" responder_term: 6 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:56.414731  8725 consensus_queue.cc:1059] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.126s
I20260709 13:14:56.371801  8711 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 13:14:56.335647  6401 raft_consensus.cc:2393] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:56.339210  8698 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:56.804528  6251 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.005s	sys 0.015s
W20260709 13:14:56.612056  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:56.705986  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.481705  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:56.906088  6330 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:56.902380  6251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.005s	sys 0.019s
W20260709 13:14:56.578897  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 422099us
I20260709 13:14:56.903625  6396 raft_consensus.cc:2376] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6. Re-sending same reply.
I20260709 13:14:56.913929  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 1929) took 1645 ms. Trace:
I20260709 13:14:56.914417  6396 rpcz_store.cc:276] 0709 13:14:55.268742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.472133 (+1203391us) service_pool.cc:224] Handling call
0709 13:14:56.913848 (+441715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:56.903728  6252 raft_consensus.cc:1240] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:56.916855  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2045) took 1396 ms. Trace:
W20260709 13:14:56.843927  6222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.002s	sys 0.009s
W20260709 13:14:56.921384  6222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.004s	sys 0.009s
I20260709 13:14:56.922277  6252 rpcz_store.cc:276] 0709 13:14:55.520020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.656823 (+136803us) service_pool.cc:224] Handling call
0709 13:14:56.903270 (+1246447us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b5800004e98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abbefc0 00007f457aba9929 00007f457aba93d2 00007f4574120bd4
0709 13:14:56.903523 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.916533 (+ 13010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.916785 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4338944}
I20260709 13:14:56.827728  8794 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:56.927588  8794 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:56.929842  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:56.926362  8418 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.930691  6331 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:14:56.932040  8698 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:56.824381  8781 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:56.749440  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.416280  8464 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:56.935672  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.941421  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 1928) took 1673 ms. Trace:
I20260709 13:14:56.941771  6396 rpcz_store.cc:276] 0709 13:14:55.268451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.915265 (+1646814us) service_pool.cc:224] Handling call
0709 13:14:56.941358 (+ 26093us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:56.483259  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 1916) took 1218 ms. Trace:
I20260709 13:14:56.942696  6399 rpcz_store.cc:276] 0709 13:14:55.265036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.385647 (+1120611us) service_pool.cc:224] Handling call
0709 13:14:56.483177 (+ 97530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:56.943624  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:56.943943  6907 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.002s	sys 0.010s
I20260709 13:14:56.930024  8794 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:56.938259  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.945820  6399 raft_consensus.cc:2410] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:14:56.944393  6907 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.002s	sys 0.010s
I20260709 13:14:56.940352  6222 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:56.947280  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:56.951128  6396 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:14:56.951712  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 1910) took 1688 ms. Trace:
I20260709 13:14:56.952188  6396 rpcz_store.cc:276] 0709 13:14:55.263246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.942444 (+1679198us) service_pool.cc:224] Handling call
0709 13:14:56.951657 (+  9213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25984}
I20260709 13:14:56.947153  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:14:56.952854  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:56.523823  8790 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:14:56.500913  8788 log.cc:927] Time spent T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:14:56.950639  6222 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:56.954380  6297 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:56.964130  6222 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:56.834959  8777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.009s	sys 0.013s
W20260709 13:14:56.954385  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 707163us
I20260709 13:14:56.953012  6401 raft_consensus.cc:2376] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6. Re-sending same reply.
I20260709 13:14:56.959323  6396 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:56.960002  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2223) took 1313 ms. Trace:
W20260709 13:14:56.960235  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:56.948971  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.940876  8464 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.681967  8718 raft_consensus.cc:697] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:56.805315  8622 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:56.974326  6399 rpcz_store.cc:276] 0709 13:14:55.646799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.943377 (+1296578us) service_pool.cc:224] Handling call
0709 13:14:56.959934 (+ 16557us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:56.974579  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.963299  8781 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.522851  8463 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:56.998983  8809 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:56.999747  8809 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.972892  8708 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.013520  8708 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:56.968515  8698 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:56.985553  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:56.977007  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:56.978446  6296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.012s	sys 0.012s
W20260709 13:14:57.031733  6296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.013s	sys 0.012s
W20260709 13:14:56.971504  8777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.009s	sys 0.016s
W20260709 13:14:57.024006  6249 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.021s	sys 0.059s
W20260709 13:14:57.032537  6249 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.021s	sys 0.059s
I20260709 13:14:56.982163  8464 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:56.995471  6330 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
W20260709 13:14:56.975811  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.032094  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 988698us
I20260709 13:14:57.042780  6296 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:56.973958  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2232) took 1009 ms. Trace:
I20260709 13:14:57.043527  6401 rpcz_store.cc:276] 0709 13:14:55.964982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.946923 (+981941us) service_pool.cc:224] Handling call
0709 13:14:56.973894 (+ 26971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.044694  6401 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:57.045342  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 439) took 1610 ms. Trace:
I20260709 13:14:57.045733  6401 rpcz_store.cc:276] 0709 13:14:55.435418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.044243 (+1608825us) service_pool.cc:224] Handling call
0709 13:14:57.044530 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.045049 (+   519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.045273 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.047396  6401 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:57.048017  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2199) took 1517 ms. Trace:
I20260709 13:14:57.048404  6401 rpcz_store.cc:276] 0709 13:14:55.530995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.046651 (+1515656us) service_pool.cc:224] Handling call
0709 13:14:57.046987 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.047756 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.047955 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:56.975026  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 1909) took 1712 ms. Trace:
I20260709 13:14:57.049284  6396 rpcz_store.cc:276] 0709 13:14:55.262904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.953669 (+1690765us) service_pool.cc:224] Handling call
0709 13:14:56.959150 (+  5481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.974740 (+ 15590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.974972 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.052035  6401 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:57.052860  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2203) took 1521 ms. Trace:
I20260709 13:14:57.053355  6401 rpcz_store.cc:276] 0709 13:14:55.532527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.051218 (+1518691us) service_pool.cc:224] Handling call
0709 13:14:57.051624 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.052571 (+   947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.052798 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.057940  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:57.030292  8764 consensus_meta.cc:287] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.000s
I20260709 13:14:57.062171  6296 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:57.065912  6396 raft_consensus.cc:1240] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:57.070065  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2252) took 1022 ms. Trace:
I20260709 13:14:57.063654  6401 raft_consensus.cc:1240] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:56.977515  8368 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.071789  6326 rpcz_store.cc:276] 0709 13:14:56.047873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.049308 (+  1435us) service_pool.cc:224] Handling call
0709 13:14:56.049666 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:56.050045 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.050084 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:56.058407 (+  8323us) log.cc:844] Serialized 26 byte log entry
0709 13:14:56.162846 (+104439us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:56.162885 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.162946 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:57.069876 (+906930us) raft_consensus.cc:1685] finished
0709 13:14:57.069898 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.070011 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6233,"raft.queue_time_us":59685,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":14203,"thread_start_us":104051,"threads_started":1,"wal-append.queue_time_us":222954}
I20260709 13:14:56.995045  8622 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.077667  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2202) took 1546 ms. Trace:
I20260709 13:14:57.083833  6396 rpcz_store.cc:276] 0709 13:14:55.531686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.050254 (+1518568us) service_pool.cc:224] Handling call
0709 13:14:57.059013 (+  8759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.071041 (+ 12028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.077601 (+  6560us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.078583  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2204) took 1545 ms. Trace:
I20260709 13:14:57.085330  6401 rpcz_store.cc:276] 0709 13:14:55.532793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.060586 (+1527793us) service_pool.cc:224] Handling call
0709 13:14:57.060913 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.078349 (+ 17436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.078532 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.086516  6401 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:57.087266  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2214) took 1551 ms. Trace:
I20260709 13:14:57.087801  6401 rpcz_store.cc:276] 0709 13:14:55.535999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.086033 (+1550034us) service_pool.cc:224] Handling call
0709 13:14:57.086345 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.086963 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.087198 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.090833  6401 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:14:57.061794  8698 raft_consensus.cc:697] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:57.114794  8698 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.094388  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2215) took 1558 ms. Trace:
I20260709 13:14:57.066015  8794 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:57.100252  8806 log.cc:927] Time spent T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:14:57.067512  8708 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:57.107616  8791 consensus_meta.cc:287] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.729s	user 0.003s	sys 0.009s
W20260709 13:14:57.108836  8757 consensus_meta.cc:287] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 1.068s	user 0.007s	sys 0.004s
I20260709 13:14:57.092702  8718 consensus_queue.cc:237] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:57.120290  6401 rpcz_store.cc:276] 0709 13:14:55.536214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.090137 (+1553923us) service_pool.cc:224] Handling call
0709 13:14:57.090446 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.091360 (+   914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.094326 (+  2966us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:57.124460  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 212559us
I20260709 13:14:57.065598  8807 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:57.087595  8764 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:14:57.094216  6250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.026s	sys 0.070s
W20260709 13:14:57.118232  8761 consensus_meta.cc:287] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.741s	user 0.008s	sys 0.000s
I20260709 13:14:57.100279  8678 raft_consensus.cc:3055] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:57.170500  6937 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 13:14:57.170701  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 108590us
I20260709 13:14:57.117658  6934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 517) took 1748 ms. Trace:
I20260709 13:14:57.186064  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1321) took 1141 ms. Trace:
I20260709 13:14:57.093477  8811 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:14:57.160136  8791 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:57.170235  8764 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:57.223304  8622 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:57.242220  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 464) took 1086 ms. Trace:
W20260709 13:14:57.206218  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 242165us
I20260709 13:14:57.172469  8418 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.198652  6296 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:57.251742  8727 consensus_meta.cc:287] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.916s	user 0.010s	sys 0.001s
W20260709 13:14:57.250361  8660 consensus_meta.cc:287] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 1.046s	user 0.009s	sys 0.002s
I20260709 13:14:57.172791  8761 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.252647  8464 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.232884  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2048) took 1077 ms. Trace:
W20260709 13:14:57.170533  6250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.026s	sys 0.071s
I20260709 13:14:57.250890  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1317) took 1206 ms. Trace:
I20260709 13:14:57.246767  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 438) took 1811 ms. Trace:
I20260709 13:14:57.170156  8678 raft_consensus.cc:740] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:14:57.250960  8803 log.cc:927] Time spent T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:14:57.165450  8807 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:57.181233  8818 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.184391  8563 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:57.240083  8463 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:57.185226  8757 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.242653  8754 raft_consensus.cc:3055] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:57.241164  8783 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.224954  8708 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.319727  6254 rpcz_store.cc:276] 0709 13:14:56.155446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.281639 (+126193us) service_pool.cc:224] Handling call
0709 13:14:56.303801 (+ 22162us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:56.305228 (+  1427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.305262 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:56.306724 (+  1462us) log.cc:844] Serialized 26 byte log entry
0709 13:14:56.901624 (+594900us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:56.960651 (+ 59027us) log.cc:844] Serialized 14 byte log entry
0709 13:14:56.960854 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.960936 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:57.242006 (+281070us) raft_consensus.cc:1685] finished
0709 13:14:57.242027 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.242158 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1050,"prepare.queue_time_us":86780,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":99893,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":25458,"spinlock_wait_cycles":1983744,"thread_start_us":274870,"threads_started":1,"wal-append.queue_time_us":686445}
I20260709 13:14:57.244978  8819 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:57.333608  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 135060us
I20260709 13:14:57.356964  6296 leader_election.cc:400] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5.
I20260709 13:14:57.339670  8761 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:57.267910  8824 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:14:57.320930  8748 log.cc:927] Time spent T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 1.988s	user 0.006s	sys 0.006s
I20260709 13:14:57.311285  6249 rpcz_store.cc:276] 0709 13:14:56.045013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.126010 (+ 80997us) service_pool.cc:224] Handling call
0709 13:14:56.126292 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.126466 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:57.033041 (+906575us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.185677 (+152636us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.185729 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:57.185767 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.185902 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.186008 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11974,"prepare.queue_time_us":189278,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2912,"raft.queue_time_us":1576,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":18272,"thread_start_us":1040916,"threads_started":2,"wal-append.queue_time_us":216414}
I20260709 13:14:57.320849  6222 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:57.327797  8759 consensus_meta.cc:287] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.844s	user 0.008s	sys 0.001s
W20260709 13:14:57.339018  8733 log.cc:927] Time spent T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 2.457s	user 0.011s	sys 0.031s
W20260709 13:14:57.334759  8817 log.cc:927] Time spent T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:14:57.341598  8796 log.cc:927] Time spent T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.944s	user 0.000s	sys 0.005s
I20260709 13:14:57.392272  8698 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:57.320485  8820 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:14:57.394984  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 548) took 2653 ms. Trace:
I20260709 13:14:57.365595  8819 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.398756  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 459) took 1244 ms. Trace:
I20260709 13:14:57.353619  8818 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.373420  8727 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:57.407377  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:57.373016  8824 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:57.407712  8727 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.357295  8757 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:57.425033  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.332412  8764 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.438797  8818 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:57.417258  8727 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:57.448541  8819 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:57.213338  8794 consensus_queue.cc:1059] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 13:14:57.454450  8794 raft_consensus.cc:3055] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:57.410213  8824 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:57.455026  8794 raft_consensus.cc:740] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:57.341004  8522 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:57.459339  6331 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:57.459482  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:57.373677  8660 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.459403  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:57.461652  6324 raft_consensus.cc:2410] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:14:57.460119  8464 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:57.372325  8718 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:57.335898  6221 leader_election.cc:336] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.576s (SENT)
W20260709 13:14:57.462880  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 127010us
W20260709 13:14:57.463478  6221 leader_election.cc:336] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.588s (SENT)
I20260709 13:14:57.463819  6221 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:57.319833  8611 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:57.465724  6935 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:57.466426  6403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2218) took 1929 ms. Trace:
I20260709 13:14:57.323230  8610 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:57.467278  8610 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.359215  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:14:57.325445  6933 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 512) took 2578 ms (client timeout 1524 ms). Trace:
I20260709 13:14:57.335214  8791 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:57.468598  6933 rpcz_store.cc:269] 0709 13:14:54.746523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.749215 (+  2692us) service_pool.cc:224] Handling call
0709 13:14:57.325233 (+2576018us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54004f8154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:57.325380 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290580736}
W20260709 13:14:57.470058  8712 consensus_meta.cc:287] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 1.135s	user 0.010s	sys 0.001s
I20260709 13:14:57.470291  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:57.470659  8712 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.471622  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:57.472173  6933 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.361303  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:57.363530  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:57.408861  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:57.473634  6249 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:57.474326  8712 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:57.336619  8418 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:57.355616  8783 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.476212  8418 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:57.370275  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 437) took 2195 ms. Trace:
I20260709 13:14:57.341298  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 461) took 1186 ms. Trace:
W20260709 13:14:57.373744  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.476771  6404 rpcz_store.cc:276] 0709 13:14:55.174403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.174518 (+   115us) service_pool.cc:224] Handling call
0709 13:14:55.191841 (+ 17323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:56.102349 (+910508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.369941 (+1267592us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b540007d354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:57.370198 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2064821632}
I20260709 13:14:57.349371  8807 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.478777  6404 raft_consensus.cc:1275] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:57.479367  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2219) took 1935 ms. Trace:
I20260709 13:14:57.479656  6404 rpcz_store.cc:276] 0709 13:14:55.544137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.478193 (+1934056us) service_pool.cc:224] Handling call
0709 13:14:57.478482 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.479133 (+   651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.479310 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.352684  8754 raft_consensus.cc:740] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:14:57.481921  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.481742  8754 consensus_queue.cc:260] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:14:57.482999  8754 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:57.483687  8563 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:57.484445  8626 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:57.172427  6934 rpcz_store.cc:276] 0709 13:14:55.346640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.034627 (+687987us) service_pool.cc:224] Handling call
0709 13:14:56.034975 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:56.035355 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.035386 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:56.035870 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:14:56.221858 (+185988us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:56.246025 (+ 24167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.256464 (+ 10439us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:57.081342 (+824878us) raft_consensus.cc:1685] finished
0709 13:14:57.081370 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.094456 (+ 13086us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":255,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"thread_start_us":115007,"threads_started":1,"wal-append.queue_time_us":254437}
I20260709 13:14:57.485430  8816 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:57.485863  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:57.380396  8678 consensus_queue.cc:260] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.381182  6330 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:14:57.381415  8753 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 1.639s	user 0.005s	sys 0.007s
I20260709 13:14:57.487846  8610 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.382611  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1286) took 4344 ms. Trace:
I20260709 13:14:57.383213  8767 raft_consensus.cc:3055] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:57.488407  8610 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.489283  8767 raft_consensus.cc:740] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:57.489614  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 1899) took 2631 ms. Trace:
I20260709 13:14:57.490015  6405 rpcz_store.cc:276] 0709 13:14:54.858282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.872620 (+ 14338us) service_pool.cc:224] Handling call
0709 13:14:54.938432 (+ 65812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.835398 (+896966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.489397 (+1653999us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b54003ae3d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:57.489558 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961297280}
I20260709 13:14:57.490247  8767 consensus_queue.cc:260] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:57.491587  8767 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:57.491885  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 441) took 1447 ms. Trace:
I20260709 13:14:57.383805  6247 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:57.492236  6405 rpcz_store.cc:276] 0709 13:14:56.044302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.491051 (+1446749us) service_pool.cc:224] Handling call
0709 13:14:57.491343 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.491515 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:57.491594 (+    79us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.491638 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:57.491670 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.491727 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.491832 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.468729  6935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 524) took 1312 ms. Trace:
I20260709 13:14:57.494006  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2050) took 1337 ms. Trace:
I20260709 13:14:57.494454  6247 rpcz_store.cc:276] 0709 13:14:56.156336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.004173 (+847837us) service_pool.cc:224] Handling call
0709 13:14:57.004414 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.492907 (+488493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.493789 (+   882us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54001487d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:57.493948 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872092928}
I20260709 13:14:57.395381  6327 rpcz_store.cc:276] 0709 13:14:54.741323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.841456 (+100133us) service_pool.cc:224] Handling call
0709 13:14:54.841754 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:54.842086 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:54.842112 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:54.868717 (+ 26605us) log.cc:844] Serialized 26 byte log entry
0709 13:14:55.144456 (+275739us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:55.144494 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.144559 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:57.320392 (+2175833us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:14:57.394719 (+ 74327us) raft_consensus.cc:1685] finished
0709 13:14:57.394746 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.394931 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":499,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":20283,"spinlock_wait_cycles":9455488,"thread_start_us":101423,"threads_started":1,"wal-append.queue_time_us":269427}
I20260709 13:14:57.399277  6255 rpcz_store.cc:276] 0709 13:14:56.154092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.171371 (+ 17279us) service_pool.cc:224] Handling call
0709 13:14:56.213173 (+ 41802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:56.213381 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.213406 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:56.242690 (+ 29284us) log.cc:844] Serialized 26 byte log entry
0709 13:14:56.329548 (+ 86858us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:56.332873 (+  3325us) log.cc:844] Serialized 14 byte log entry
0709 13:14:56.333082 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.333174 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:57.398506 (+1065332us) raft_consensus.cc:1685] finished
0709 13:14:57.398533 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.398689 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136,"prepare.queue_time_us":35997,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":59,"raft.queue_time_us":69584,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":1888,"thread_start_us":50552,"threads_started":1,"wal-append.queue_time_us":766186}
I20260709 13:14:57.496084  6247 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:57.496486  6255 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:57.384174  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:57.499176  6938 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:57.499382  8418 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.500043  8418 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:57.441622  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.415184  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:57.501456  6398 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.461114  8660 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:57.502370  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.502736  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.357828  6296 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:57.488643  6248 rpcz_store.cc:276] 0709 13:14:53.038421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.393661 (+1355240us) service_pool.cc:224] Handling call
0709 13:14:54.421978 (+ 28317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:54.629780 (+207802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:54.629854 (+    74us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:54.638700 (+  8846us) log.cc:844] Serialized 26 byte log entry
0709 13:14:54.707974 (+ 69274us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:54.708025 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.708130 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:57.338314 (+2630184us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:14:57.382284 (+ 43970us) raft_consensus.cc:1685] finished
0709 13:14:57.382330 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.382551 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143555,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":52859,"spinlock_wait_cycles":25677696,"thread_start_us":179724,"threads_started":2,"wal-append.queue_time_us":166423}
I20260709 13:14:57.503767  8660 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:57.504699  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:57.465479  8611 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.474191  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:57.476882  6250 rpcz_store.cc:276] 0709 13:14:56.154659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.169215 (+ 14556us) service_pool.cc:224] Handling call
0709 13:14:56.247641 (+ 78426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:56.285690 (+ 38049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.287353 (+  1663us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:56.338143 (+ 50790us) log.cc:844] Serialized 26 byte log entry
0709 13:14:57.340746 (+1002603us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:57.340810 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.341028 (+   218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:57.341077 (+    49us) raft_consensus.cc:1685] finished
0709 13:14:57.341087 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.341240 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48480,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":3241,"thread_start_us":974091,"threads_started":1,"wal-append.queue_time_us":828437}
I20260709 13:14:57.505280  6248 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 1.
I20260709 13:14:57.506016  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:57.506319  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:57.506688  6250 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:57.506748  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:57.508111  6250 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:14:57.359930  8708 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:57.493587  6935 rpcz_store.cc:276] 0709 13:14:56.156170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.156704 (+   534us) service_pool.cc:224] Handling call
0709 13:14:57.325372 (+1168668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.466127 (+140755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.467649 (+  1522us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54004f8154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:57.468515 (+   866us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54004f8150. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:57.468663 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3008977408}
I20260709 13:14:57.510461  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:14:57.513320  6221 leader_election.cc:336] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.696s (SENT)
I20260709 13:14:57.513783  6221 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:57.484965  6369 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:57.466791  6403 rpcz_store.cc:276] 0709 13:14:55.538227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.465661 (+1927434us) service_pool.cc:224] Handling call
0709 13:14:57.465955 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.466125 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:57.466152 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.466192 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:57.466221 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.466272 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.466377 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.517630  6403 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:57.518172  6403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 443) took 1295 ms. Trace:
I20260709 13:14:57.518481  6403 rpcz_store.cc:276] 0709 13:14:56.223055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.517003 (+1293948us) service_pool.cc:224] Handling call
0709 13:14:57.517323 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.517939 (+   616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.518119 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:57.519989  6400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 1915) took 2255 ms (client timeout 1795 ms). Trace:
W20260709 13:14:57.520491  6400 rpcz_store.cc:269] 0709 13:14:55.264745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.519747 (+2255002us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:57.519908 (+   161us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:57.496837  6247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49990
W20260709 13:14:57.534169  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.514222  6935 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:57.561609  8617 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.563858  8676 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:57.564417  8757 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:57.567041  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 528) took 1232 ms. Trace:
I20260709 13:14:57.567533  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 1907) took 2314 ms. Trace:
I20260709 13:14:57.568378  6937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 529) took 1345 ms. Trace:
W20260709 13:14:57.569887  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 46561.7us
W20260709 13:14:57.570479  6256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2047) took 1414 ms (client timeout 1585 ms). Trace:
I20260709 13:14:57.608007  6937 rpcz_store.cc:276] 0709 13:14:56.223302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.224171 (+   869us) service_pool.cc:224] Handling call
0709 13:14:56.243336 (+ 19165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.170910 (+927574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.541916 (+371006us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54007a49d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:57.568310 (+ 26394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2110498560}
W20260709 13:14:57.585980  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 72698.6us
I20260709 13:14:57.474249  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:57.609283  6221 leader_election.cc:336] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.724s (SENT)
W20260709 13:14:57.608731  6256 rpcz_store.cc:269] 0709 13:14:56.155675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.204645 (+ 48970us) service_pool.cc:224] Handling call
0709 13:14:57.547090 (+1342445us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000e24d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:57.570423 (+ 23333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2492993920}
I20260709 13:14:57.607884  6402 rpcz_store.cc:276] 0709 13:14:55.253007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.253918 (+   911us) service_pool.cc:224] Handling call
0709 13:14:55.273252 (+ 19334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.999866 (+726614us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b54000ddca0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575b5cdc0 00007f4575be71c0 00007f4575be8231 00007f4575be4d8f 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c
0709 13:14:56.102169 (+102303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.531711 (+1429542us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54001f4354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:57.567480 (+ 35769us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417918464}
I20260709 13:14:57.609941  6221 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:57.570079  6154 catalog_manager.cc:5697] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 2 to 3, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 3 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:57.588553  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:57.588014  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 103124us
I20260709 13:14:57.341580  6399 rpcz_store.cc:276] 0709 13:14:55.435041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.986625 (+1551584us) service_pool.cc:224] Handling call
0709 13:14:56.986983 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:56.987318 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.987341 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:56.996399 (+  9058us) log.cc:844] Serialized 26 byte log entry
0709 13:14:57.158530 (+162131us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:57.158570 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.158641 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:57.246557 (+ 87916us) raft_consensus.cc:1685] finished
0709 13:14:57.246577 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.246707 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":166689,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":24465,"thread_start_us":115038,"threads_started":1,"wal-append.queue_time_us":221670}
I20260709 13:14:57.340233  6252 rpcz_store.cc:276] 0709 13:14:56.155903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.927495 (+771592us) service_pool.cc:224] Handling call
0709 13:14:56.927793 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.927996 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:14:56.987592 (+ 59596us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.232410 (+244818us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.232484 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:57.232545 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.232634 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.232807 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32735,"prepare.queue_time_us":60687,"prepare.run_cpu_time_us":21,"prepare.run_wall_time_us":21,"raft.queue_time_us":1435,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"thread_start_us":242255,"threads_started":1,"wal-append.queue_time_us":279282}
I20260709 13:14:57.341449  6251 rpcz_store.cc:276] 0709 13:14:56.044084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.122498 (+ 78414us) service_pool.cc:224] Handling call
0709 13:14:56.122863 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:56.134825 (+ 11962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.134855 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:56.141922 (+  7067us) log.cc:844] Serialized 26 byte log entry
0709 13:14:56.908237 (+766315us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:56.908294 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.908391 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:57.250644 (+342253us) raft_consensus.cc:1685] finished
0709 13:14:57.250663 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.250805 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11559,"raft.queue_time_us":11729,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4824,"thread_start_us":705501,"threads_started":1,"wal-append.queue_time_us":979007}
I20260709 13:14:57.613333  6935 raft_consensus.cc:1240] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:57.607831  6941 rpcz_store.cc:276] 0709 13:14:56.334392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.335393 (+  1001us) service_pool.cc:224] Handling call
0709 13:14:56.338947 (+  3554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.470998 (+132051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.543633 (+1072635us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b540069f354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:57.566981 (+ 23348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126315392}
I20260709 13:14:57.565945  6247 raft_consensus.cc:606] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership
W20260709 13:14:57.589244  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 231456us
I20260709 13:14:57.615379  6935 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:14:57.612763  6325 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:57.619720  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.621143  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.625396  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.626616  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.613998  6369 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:57.612200  6221 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:57.641149  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:57.642946  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.650175  6221 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:57.603513  8678 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:57.657644  8755 log.cc:927] Time spent T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 1.847s	user 0.009s	sys 0.012s
W20260709 13:14:57.660703  6397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2216) took 2124 ms (client timeout 1674 ms). Trace:
W20260709 13:14:57.602522  8723 raft_consensus.cc:1068] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Unable to promote non-voter 8600a3fead0e48a7aa813822ec44d0fe: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:57.662285  8723 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:57.662670  8723 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:14:57.663025  8723 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.655714  8610 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:57.647490  8719 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:57.603781  8676 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.610965  8774 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.680977  6322 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:57.614481  8705 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:14:57.669093  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 80903.7us
I20260709 13:14:57.671164  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.671864  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:57.694759  6324 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:57.671641  8377 consensus_queue.cc:260] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.456458  8794 consensus_queue.cc:260] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:57.669297  6397 rpcz_store.cc:269] 0709 13:14:55.536456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.788679 (+252223us) service_pool.cc:224] Handling call
0709 13:14:57.660508 (+1871829us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54002f4254. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:57.660631 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705298816}
I20260709 13:14:57.617841  8726 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.711151  8820 consensus_queue.cc:1059] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:14:57.711947  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.713277  8779 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.713701  8700 raft_consensus.cc:3055] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:57.713812  8779 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.714762  8797 raft_consensus.cc:1064] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:57.614735  8819 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.723778  6935 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:14:57.730223  6326 raft_consensus.cc:2410] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:14:57.730027  8723 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:57.719511  8783 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:57.731173  8791 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:57.711779  8805 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:14:57.732090  6329 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:14:57.674662  6221 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:57.635236  8718 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:57.682602  6398 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:57.684998  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:57.738099  6324 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:57.644816  8464 consensus_queue.cc:1059] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:14:57.689308  8404 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:57.649713  8776 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:57.690550  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 126492us
I20260709 13:14:57.678112  8603 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:14:57.763724  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:57.681945  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.764812  6322 raft_consensus.cc:2368] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7.
I20260709 13:14:57.716324  8779 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:57.672485  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.726183  8611 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:57.701908  6219 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:57.773275  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 71498.9us
W20260709 13:14:57.771596  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 75637.7us
I20260709 13:14:57.774255  6219 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:14:57.702975  6296 leader_election.cc:336] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.006s (SENT)
I20260709 13:14:57.703758  8719 raft_consensus.cc:1064] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:57.775851  6296 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:14:57.776081  8719 raft_consensus.cc:1068] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Unable to promote non-voter 8600a3fead0e48a7aa813822ec44d0fe: Service unavailable: leader transfer in progress
I20260709 13:14:57.776895  8719 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:57.776933  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 73981.4us
I20260709 13:14:57.777675  8719 raft_consensus.cc:697] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:14:57.778164  6296 connection.cc:256] RPC call timeout handler was delayed by -1.6944770229999904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2671s for a response
W20260709 13:14:57.778676  6296 connection.cc:256] RPC call timeout handler was delayed by -1.2502828290000707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3279s for a response
W20260709 13:14:57.779141  6296 connection.cc:256] RPC call timeout handler was delayed by -1.2128105720000804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32220000000000004s for a response
I20260709 13:14:57.703691  8698 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:57.695875  8676 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:57.780076  8698 raft_consensus.cc:697] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:57.697644  8774 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:57.714190  8700 raft_consensus.cc:740] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:57.781333  8698 consensus_queue.cc:237] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:57.781903  8700 consensus_queue.cc:260] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.782843  8774 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:57.783288  8700 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:57.783910  8676 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:57.729230  8708 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:57.617806  8736 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:57.785517  6327 raft_consensus.cc:2410] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:14:57.717569  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:57.722980  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:57.679251  6328 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:14:57.788185  6940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 525) took 1631 ms. Trace:
I20260709 13:14:57.788239  6296 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:57.712469  8820 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:57.687690  6933 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:14:57.758665  6248 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.765908  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.794020  6322 raft_consensus.cc:2368] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6.
I20260709 13:14:57.795015  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:57.796272  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.694844  6325 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:57.728332  8418 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:57.684896  6254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49990
I20260709 13:14:57.796903  6322 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:57.798667  6254 raft_consensus.cc:606] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership
I20260709 13:14:57.798413  6939 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:14:57.778889  8719 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:57.788677  6940 rpcz_store.cc:276] 0709 13:14:56.156403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.157083 (+   680us) service_pool.cc:224] Handling call
0709 13:14:56.212605 (+ 55522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.238035 (+ 25430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.787949 (+1549914us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b54007b8754. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:57.788130 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57157888}
I20260709 13:14:57.788628  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:57.766534  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2217) took 2229 ms. Trace:
I20260709 13:14:57.791066  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.802193  6328 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:57.802553  6296 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:57.803395  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.790040  6936 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
W20260709 13:14:57.815897  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 201951us
I20260709 13:14:57.806813  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:57.819028  6369 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:57.807456  8418 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:57.804494  8683 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:57.804489  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:57.769372  8617 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:14:57.818461  8404 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:57.805943  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:57.818501  8754 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:57.819218  6399 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:14:57.803701  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:57.819857  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:57.854406  6324 raft_consensus.cc:2410] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:14:57.820919  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:57.823275  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.718046  8802 consensus_queue.cc:1059] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:14:57.786298  8718 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:57.747255  8819 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.821772  6401 rpcz_store.cc:276] 0709 13:14:55.536683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.159409 (+1622726us) service_pool.cc:224] Handling call
0709 13:14:57.159799 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.160050 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:14:57.359985 (+199935us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.766121 (+406136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.766190 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:57.766251 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.766334 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.766469 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":265543,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":102,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":15572,"thread_start_us":580680,"threads_started":2}
I20260709 13:14:57.724007  8764 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:57.826089  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.792245  8791 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:57.785702  8736 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.798254  8767 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.852272  8563 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:14:57.889182  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 45178.6us
I20260709 13:14:57.889686  6330 raft_consensus.cc:2393] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 4: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:57.833171  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2213) took 2297 ms. Trace:
I20260709 13:14:57.834394  6369 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:57.840253  6322 raft_consensus.cc:2410] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:14:57.818699  8585 raft_consensus.cc:3055] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:57.798406  8726 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:57.817077  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:57.799163  8676 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:57.798027  8783 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:57.818974  8779 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:57.817598  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:57.850584  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.851454  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2253) took 1803 ms. Trace:
I20260709 13:14:57.857836  6248 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:57.728745  8797 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:57.859964  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 56323.6us
I20260709 13:14:57.896389  6402 raft_consensus.cc:2376] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6. Re-sending same reply.
I20260709 13:14:57.894344  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:57.901206  6296 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:57.854584  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2051) took 1698 ms. Trace:
I20260709 13:14:57.874387  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:57.891937  6396 rpcz_store.cc:276] 0709 13:14:55.535767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.084567 (+1548800us) service_pool.cc:224] Handling call
0709 13:14:57.089615 (+  5048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.094655 (+  5040us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:14:57.356995 (+262340us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.832879 (+475884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.832921 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:57.832957 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.833009 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.833095 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40827,"prepare.queue_time_us":330480,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":49061,"spinlock_wait_cycles":25640320,"thread_start_us":627574,"threads_started":2,"wal-append.queue_time_us":470401}
I20260709 13:14:57.902233  6398 raft_consensus.cc:2393] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 2: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:57.900003  6323 rpcz_store.cc:276] 0709 13:14:56.048157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.086501 (+ 38344us) service_pool.cc:224] Handling call
0709 13:14:56.086896 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:56.109802 (+ 22906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.109865 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:56.110413 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:14:57.478512 (+1368099us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b1800030d60. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:14:57.742754 (+264242us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:57.742810 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.742903 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:57.851139 (+108236us) raft_consensus.cc:1685] finished
0709 13:14:57.851165 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.851392 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22491,"raft.queue_time_us":64287,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":49734,"spinlock_wait_cycles":5294464,"thread_start_us":263904,"threads_started":1,"wal-append.queue_time_us":1680058}
I20260709 13:14:57.885596  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:57.903260  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:57.833171  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2221) took 2254 ms. Trace:
I20260709 13:14:57.858812  8483 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:57.890223  6905 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:57.862748  8795 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:14:57.892704  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 218098us
I20260709 13:14:57.845466  8683 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:57.900470  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.901918  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:57.908640  6221 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:57.903896  6404 rpcz_store.cc:276] 0709 13:14:55.578561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.480355 (+1901794us) service_pool.cc:224] Handling call
0709 13:14:57.480629 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.480826 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:14:57.481113 (+   287us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.832803 (+351690us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.832863 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:57.832906 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.832970 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.833089 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39873,"prepare.queue_time_us":163,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":40536,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":17290,"thread_start_us":202783,"threads_started":1}
I20260709 13:14:57.910291  6322 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:57.816134  6297 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:14:57.911098  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 95084.3us
I20260709 13:14:57.911161  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:57.911785  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.907176  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:57.859083  8603 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:14:57.910693  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 135436us
I20260709 13:14:57.852535  8749 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:14:57.895915  8585 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:57.896963  6325 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:57.875643  8404 raft_consensus.cc:697] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:57.907691  6296 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:57.853392  8807 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:57.889683  8563 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.911262  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:57.912055  6400 raft_consensus.cc:2368] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8.
I20260709 13:14:57.941371  8563 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:57.904083  6323 raft_consensus.cc:2410] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:14:57.912354  6398 raft_consensus.cc:1240] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 1. Current term is 3. Ops: []
I20260709 13:14:57.945909  8820 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:57.945493  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.951578  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:57.951573  6323 raft_consensus.cc:2393] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:57.953529  8820 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:14:57.955518  8833 log.cc:927] Time spent T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:14:57.956671  8404 consensus_queue.cc:237] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:57.956615  6219 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:57.965782  8404 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:57.966280  8404 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.966872  8404 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:57.970384  8710 raft_consensus.cc:1064] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
W20260709 13:14:57.970912  8710 raft_consensus.cc:1068] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Unable to promote non-voter 8600a3fead0e48a7aa813822ec44d0fe: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:57.975251  6219 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:57.912425  6297 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:57.911108  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:57.901849  6249 rpcz_store.cc:276] 0709 13:14:56.156558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.474194 (+1317636us) service_pool.cc:224] Handling call
0709 13:14:57.474474 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.474649 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:14:57.474935 (+   286us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.846814 (+371879us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.846866 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:57.846909 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.854418 (+  7509us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.854533 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50322,"prepare.queue_time_us":1923,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":83260,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":15094,"thread_start_us":321169,"threads_started":2,"wal-append.queue_time_us":179871}
I20260709 13:14:57.914134  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:57.981515  6402 raft_consensus.cc:2393] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:57.844424  8418 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:57.914860  6328 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 4: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:14:57.914915  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.990613  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.892655  8767 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:57.991258  6905 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:57.916317  8723 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:57.907449  8847 raft_consensus.cc:3055] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:57.916693  8718 raft_consensus.cc:697] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:57.926373  8464 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:57.917827  8754 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:57.926925  6296 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:58.020677  8589 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:57.927238  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:58.020470  8754 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.927629  8783 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:57.927819  8610 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:58.021106  8589 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:58.021425  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 94560.2us
I20260709 13:14:58.023314  8589 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:57.928236  8835 log.cc:927] Time spent T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:14:58.025858  8377 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.021807  8711 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:58.029660  8711 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:58.030077  8711 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:58.032725  8736 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:57.928158  8764 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:57.999049  8805 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:14:58.034013  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 106840us
I20260709 13:14:58.034494  8805 raft_consensus.cc:697] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:58.035508  8805 consensus_queue.cc:237] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:57.929800  8819 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:58.037350  8375 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:58.038851  8375 consensus_queue.cc:1059] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:58.038977  8718 consensus_queue.cc:237] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:58.039657  8375 consensus_queue.cc:1059] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:57.926406  8795 raft_consensus.cc:697] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:57.942068  6322 raft_consensus.cc:2410] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:14:58.041195  8795 consensus_queue.cc:237] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:58.041862  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:58.042747  6322 raft_consensus.cc:2410] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:58.043434  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:57.979924  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.948897  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:57.963572  6323 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:58.047178  6327 raft_consensus.cc:1240] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:14:58.047636  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:58.048606  6323 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:14:57.913777  8791 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:57.997262  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.998083  6326 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
W20260709 13:14:57.998852  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 86504.4us
I20260709 13:14:58.058568  6322 raft_consensus.cc:1275] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:57.907675  8726 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.008610  6219 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:57.910696  8676 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:58.059420  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.006470  6330 raft_consensus.cc:1240] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 8. Current term is 9. Ops: []
W20260709 13:14:58.066273  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.059888  6322 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:14:58.060453  6939 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:58.060678  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.060842  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 230885us
I20260709 13:14:58.068320  8563 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.071653  8563 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:58.073341  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:14:58.074059  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 340244us
I20260709 13:14:57.999292  8735 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:58.075719  6324 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:58.036720  8719 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:14:58.078708  6325 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:58.002075  8847 raft_consensus.cc:740] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:58.008714  8727 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:58.083288  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:58.084646  6329 raft_consensus.cc:2410] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:14:58.080497  6936 raft_consensus.cc:1240] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:58.034046  8522 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:58.022173  8754 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:58.022715  8464 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.090797  8726 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:58.091202  8464 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:58.022154  8767 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:58.089875  8727 raft_consensus.cc:697] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:58.089646  8585 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.090479  8769 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:58.093067  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 84540.4us
I20260709 13:14:58.086743  8610 raft_consensus.cc:3055] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:58.104012  8583 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.095657  8850 raft_consensus.cc:3055] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:58.085157  8735 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.119597  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:58.134433  6330 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
W20260709 13:14:58.130487  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 94369.1us
I20260709 13:14:58.110954  8585 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:58.107137  8610 raft_consensus.cc:740] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:58.114286  8522 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:58.137980  8757 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.133554  8850 raft_consensus.cc:740] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:58.112708  8769 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.111775  8583 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:58.170060  8846 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:14:58.176991  6330 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:58.166975  8522 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.179795  6330 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:58.181565  6330 raft_consensus.cc:1275] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:58.154850  8404 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:58.186545  6330 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:14:58.187824  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 49492.1us
I20260709 13:14:58.182631  8464 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.191282  8404 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:58.192173  8464 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:58.184893  8522 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:58.193116  8845 log.cc:927] Time spent T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:14:58.193334  8676 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:58.153817  8847 consensus_queue.cc:260] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.183475  8610 consensus_queue.cc:260] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.194438  8847 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.195056  8610 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:58.190496  8851 log.cc:927] Time spent T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:14:58.204885  6330 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:14:58.178864  8797 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.174854  8757 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.188241  8683 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:58.196923  8807 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:58.213328  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:58.173628  8727 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.217437  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:58.217716  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:58.218341  6251 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:58.225051  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:58.208981  8589 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.227536  8735 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:58.231014  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:58.231743  6254 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:58.232641  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:58.237800  6139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 155939us
I20260709 13:14:58.238489  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:58.239203  6252 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:58.240358  8589 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:58.244251  8711 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:58.248476  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:58.249709  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 415375us
I20260709 13:14:58.250003  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:58.251240  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:58.252753  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:58.253988  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:58.249727  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 442) took 2185 ms. Trace:
I20260709 13:14:58.265651  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:58.259982  6405 rpcz_store.cc:276] 0709 13:14:56.064608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.493119 (+1428511us) service_pool.cc:224] Handling call
0709 13:14:57.640973 (+147854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.641731 (+   758us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:57.670481 (+ 28750us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.891124 (+220643us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.953315 (+ 62191us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b18003f1b40. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572ac62a6 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1
0709 13:14:57.954712 (+  1397us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b18003f1b40. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:14:58.249262 (+294550us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b18003f1b40. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572a72c0a 00007f457c1b2219 00007f4572afaa40 00007f4572af54e4 00007f4572af5455 00007f4575bdd060 00007f4575bef716 00007f4575c00287 00007f4575c00208
0709 13:14:58.249403 (+   141us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:58.249471 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:58.249513 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.249572 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:58.249674 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":354770,"prepare.queue_time_us":31077,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":76,"raft.queue_time_us":361768,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":10279,"spinlock_wait_cycles":22002688,"thread_start_us":219959,"threads_started":1,"wal-append.queue_time_us":332959}
I20260709 13:14:58.210595  8797 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:58.271628  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.276103  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:58.277007  6295 leader_election.cc:336] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.768s (SENT)
I20260709 13:14:58.276955  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:58.267544  8708 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:58.228112  8719 consensus_queue.cc:1048] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:14:58.227579  8769 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:58.277441  6219 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:14:58.281553  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 208274us
I20260709 13:14:58.284173  6368 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:58.287184  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:58.288651  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:58.295944  6254 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
W20260709 13:14:58.298170  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.299611  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:58.307924  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:58.359016  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 108528us
I20260709 13:14:58.360136  6369 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:14:58.361451  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 63889.5us
I20260709 13:14:58.362668  6295 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:58.281057  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:58.274971  8710 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:14:58.304993  8563 raft_consensus.cc:1064] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:14:58.405666  6251 raft_consensus.cc:1240] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:14:58.279675  8776 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:14:58.406780  6295 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:14:58.410568  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 126449us
I20260709 13:14:58.411695  6368 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:58.290885  8622 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:58.415431  6368 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:58.364380  8863 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:58.358628  8807 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:14:58.441963  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.429378  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 130422us
W20260709 13:14:58.490181  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 74830.9us
I20260709 13:14:58.491458  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:58.492039  6403 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:58.493777  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 59973us
I20260709 13:14:58.495141  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:58.496464  8858 log.cc:927] Time spent T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:14:58.259660  8850 consensus_queue.cc:260] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:58.503597  6906 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:58.371443  8676 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:58.495790  6399 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:14:58.501937  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:58.505280  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:58.505460  6405 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:58.498188  8718 consensus_queue.cc:1059] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:14:58.513613  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:58.371148  8725 consensus_queue.cc:1059] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.124s
I20260709 13:14:58.508678  6401 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:14:58.507607  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:58.522774  6402 raft_consensus.cc:2410] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:14:58.428720  8708 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:58.514454  6400 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:58.508635  6906 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:58.507797  6907 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:58.524303  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:58.418318  8705 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:14:58.529369  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 229803us
I20260709 13:14:58.533842  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:58.538552  6403 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
W20260709 13:14:58.539237  8868 log.cc:927] Time spent T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:14:58.539856  8866 raft_consensus.cc:993] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
W20260709 13:14:58.538842  8865 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 13:14:58.540558  6403 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:58.544016  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:58.547932  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.525017  6404 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:14:58.417804  8854 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.314s
I20260709 13:14:58.504565  8863 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.552004  6400 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:14:58.511507  8660 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:58.506294  8841 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:58.497385  8769 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:14:58.556528  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:58.562100  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:58.571194  6221 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.629s (SENT) [suppressed 78 similar messages]
I20260709 13:14:58.530125  8708 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:58.506047  8589 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:14:58.497500  8807 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.574885  6252 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:58.569521  6906 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:58.552098  8464 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:58.505954  8816 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:14:58.557088  8757 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:58.551203  8611 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:14:58.591627  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 99542.5us
I20260709 13:14:58.554896  8819 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.555372  8705 raft_consensus.cc:697] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:58.594708  6400 raft_consensus.cc:1240] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:58.595404  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:58.596179  6403 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:58.555744  8723 consensus_queue.cc:1059] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:14:58.564675  8863 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:58.575951  8711 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:58.602159  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:58.603451  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:58.604163  6327 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:58.585397  8483 raft_consensus.cc:3055] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:58.584120  8708 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.615628  6403 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.616302  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:58.588580  8866 raft_consensus.cc:1081] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:14:58.617583  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:58.626628  6402 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:14:58.617977  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:58.589120  8464 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:58.622169  6400 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:14:58.631500  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:58.632055  6400 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.600669  8611 raft_consensus.cc:697] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:58.608244  8872 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:58.591101  8585 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:58.620175  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:14:58.614907  8860 log.cc:927] Time spent T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.384s	user 0.000s	sys 0.002s
I20260709 13:14:58.621516  8483 raft_consensus.cc:740] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:58.609019  8795 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:58.604667  8683 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:58.641666  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:58.637071  8710 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.610538  8819 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:58.633833  8857 log.cc:927] Time spent T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.205s	user 0.001s	sys 0.001s
I20260709 13:14:58.629060  6934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 473) took 1263 ms. Trace:
W20260709 13:14:58.644515  8864 log.cc:927] Time spent T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
I20260709 13:14:58.635735  8464 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:58.638499  8797 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:58.637540  8725 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:58.645388  8840 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:58.648451  8585 raft_consensus.cc:697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:58.688786  8819 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:14:58.677305  8867 log.cc:927] Time spent T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
W20260709 13:14:58.673557  8871 log.cc:927] Time spent T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 13:14:58.692063  8873 log.cc:927] Time spent T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:14:58.705226  8874 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:14:58.656077  8710 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.684085  8794 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.681247  8725 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:58.765333  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 234280us
W20260709 13:14:58.766187  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 481198us
I20260709 13:14:58.766696  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:14:58.771974  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.846253  6250 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:58.670248  8705 consensus_queue.cc:237] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.683629  8483 consensus_queue.cc:260] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:58.851575  8483 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:58.853590  8887 log.cc:927] Time spent T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:14:58.857645  8710 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:58.858803  8709 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:58.662009  8683 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:58.867190  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:58.867885  8683 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:58.868647  6256 raft_consensus.cc:2393] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 3: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:58.869927  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:58.870735  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1225) took 1205 ms. Trace:
I20260709 13:14:58.871013  6324 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:58.871320  6325 rpcz_store.cc:276] 0709 13:14:57.665415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.797610 (+132195us) service_pool.cc:224] Handling call
0709 13:14:58.870254 (+1072644us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b54004376d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:58.870499 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95344512}
I20260709 13:14:58.874198  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1233) took 1185 ms. Trace:
I20260709 13:14:58.874692  6326 rpcz_store.cc:276] 0709 13:14:57.688429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.951326 (+262897us) service_pool.cc:224] Handling call
0709 13:14:58.873738 (+922412us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b54002431d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:58.873997 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36791680}
I20260709 13:14:58.876027  8816 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:58.878461  8816 consensus_queue.cc:1059] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:14:58.778012  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 206896us
I20260709 13:14:58.879803  6329 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:14:58.881974  8840 raft_consensus.cc:3055] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:58.882591  8840 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:58.643154  6403 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
W20260709 13:14:58.885596  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.886824  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:58.887806  6403 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:58.889102  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.889698  8712 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:58.891283  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:58.649436  6404 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:58.894331  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:58.895869  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:14:58.634280  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:58.642298  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:58.802078  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:58.899608  6404 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:58.899871  6405 raft_consensus.cc:1240] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:14:58.902848  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 57532.7us
I20260709 13:14:58.904299  8725 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:14:58.811265  6248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.010s
I20260709 13:14:58.657498  8611 consensus_queue.cc:237] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:58.905422  6248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.000s	sys 0.010s
W20260709 13:14:58.905669  8890 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.002s
W20260709 13:14:58.733286  8754 consensus_meta.cc:287] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
I20260709 13:14:58.818778  8676 consensus_queue.cc:1059] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:58.908301  8754 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.909458  8676 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:58.910367  8676 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.911433  8754 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:58.912345  8754 raft_consensus.cc:3055] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.912699  8754 raft_consensus.cc:740] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:58.820046  8767 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.913515  8767 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:14:58.915158  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:58.915937  8767 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:14:58.821094  8819 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.821067  8797 consensus_queue.cc:1059] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:14:58.735877  8847 consensus_meta.cc:287] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.002s
I20260709 13:14:58.917682  6330 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:14:58.918718  8819 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.919407  6327 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: [6.9-6.9]
W20260709 13:14:58.919700  8563 raft_consensus.cc:1068] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Unable to promote non-voter 8600a3fead0e48a7aa813822ec44d0fe: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:58.917701  8797 raft_consensus.cc:3055] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:58.921656  8797 raft_consensus.cc:740] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:58.921978  6402 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:14:58.832355  8776 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:58.658468  6934 rpcz_store.cc:276] 0709 13:14:57.362333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.486788 (+124455us) service_pool.cc:224] Handling call
0709 13:14:57.487084 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.632367 (+145283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:57.640229 (+  7862us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.651450 (+ 11221us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:57.654875 (+  3425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.615074 (+960199us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b54007df5d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:58.618817 (+  3743us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:58.626054 (+  7237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87761792}
W20260709 13:14:58.662925  8377 consensus_meta.cc:287] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.000s
I20260709 13:14:58.837896  8585 consensus_queue.cc:237] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:58.840648  8522 consensus_meta.cc:287] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.647s	user 0.007s	sys 0.003s
I20260709 13:14:58.876078  8622 consensus_queue.cc:1059] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:58.772676  6296 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:14:58.892817  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:58.930588  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:58.931259  8364 raft_consensus.cc:3055] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:58.945611  8708 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.949769  8708 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:58.951262  6331 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:14:58.954924  8863 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:58.956748  6253 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:14:58.884235  8840 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:58.912997  8676 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:58.917055  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:58.879601  8816 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:14:58.973249  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.896891  8854 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:58.923162  8797 consensus_queue.cc:260] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:58.980437  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:14:58.935801  8364 raft_consensus.cc:740] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:14:58.989735  6404 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:14:58.973271  8603 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.980626  8819 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:59.012624  8840 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:59.013234  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:14:59.017494  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.021556  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:59.021941  6933 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Advancing to term 4
I20260709 13:14:59.020975  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:58.974258  8754 consensus_queue.cc:260] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:59.034130  6397 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:14:59.035485  8816 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:59.036597  8854 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.037458  8676 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:14:59.067768  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 47005.7us
I20260709 13:14:58.988691  8522 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:59.071038  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:59.059595  8797 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.059651  8676 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.033850  8603 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.089833  6939 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:14:59.089308  8364 consensus_queue.cc:260] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:59.094004  8583 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:59.096431  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.082664  8676 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.097277  6326 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:59.099315  6404 raft_consensus.cc:1275] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:14:59.123296  6256 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:59.131639  8364 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:59.141884  8522 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:59.143170  8863 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:14:59.165545  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.141790  8754 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.154345  6396 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:59.155901  6400 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:14:59.157434  8872 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:14:59.157939  6247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.026s	sys 0.056s
I20260709 13:14:59.158903  6255 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:14:59.159353  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 156668us
I20260709 13:14:59.161991  6404 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:14:59.097044  8464 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.176510  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2269) took 1075 ms. Trace:
W20260709 13:14:59.178090  6247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.027s	sys 0.057s
I20260709 13:14:59.171356  8872 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.182420  6405 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:14:59.181701  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 409422us
I20260709 13:14:59.186772  6397 raft_consensus.cc:1275] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:59.187498  6247 raft_consensus.cc:1240] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:59.184316  6221 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:59.217077  6248 raft_consensus.cc:2410] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:14:59.218003  6404 raft_consensus.cc:3055] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:59.218397  6404 raft_consensus.cc:740] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:14:59.188998  8891 log.cc:927] Time spent T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:14:59.181310  6324 rpcz_store.cc:276] 0709 13:14:58.100647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.872324 (+771677us) service_pool.cc:224] Handling call
0709 13:14:58.872805 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.963011 (+ 90206us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:14:59.057731 (+ 94720us) log.cc:844] Serialized 14 byte log entry
0709 13:14:59.176059 (+118328us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:59.176137 (+    78us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:59.176200 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.176299 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:59.176441 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4592,"prepare.queue_time_us":60370,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":4788,"raft.queue_time_us":21367,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":9126,"thread_start_us":101278,"threads_started":2}
I20260709 13:14:59.220214  6403 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:14:59.187332  8885 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:59.189924  8872 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:59.249763  8832 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:59.250195  8885 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.250655  8832 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.187810  8794 consensus_queue.cc:1059] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:14:59.186988  8719 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
W20260709 13:14:59.249763  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.252945  8885 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:59.188313  6255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49990
W20260709 13:14:59.265357  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.269444  6941 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:14:59.271196  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2268) took 1170 ms. Trace:
I20260709 13:14:59.271807  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:59.272949  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2267) took 1173 ms. Trace:
I20260709 13:14:59.273393  6327 rpcz_store.cc:276] 0709 13:14:58.100038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.617854 (+517816us) service_pool.cc:224] Handling call
0709 13:14:58.618139 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:58.919872 (+301733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.272688 (+352816us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400292cd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:59.272889 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691718016}
I20260709 13:14:59.274678  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.265421  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.275375  6327 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:59.276037  6324 raft_consensus.cc:2368] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7.
I20260709 13:14:59.276943  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.278236  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.283550  8875 raft_consensus.cc:1064] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
W20260709 13:14:59.284209  8875 raft_consensus.cc:1068] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Unable to promote non-voter 8600a3fead0e48a7aa813822ec44d0fe: Service unavailable: leader transfer in progress
I20260709 13:14:59.285777  6255 raft_consensus.cc:606] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Received request to transfer leadership
W20260709 13:14:59.286957  6331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1212) took 1669 ms (client timeout 1530 ms). Trace:
I20260709 13:14:59.262056  8840 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:14:59.287508  6331 rpcz_store.cc:269] 0709 13:14:57.617600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.625039 (+  7439us) service_pool.cc:224] Handling call
0709 13:14:59.286708 (+1661669us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400436cd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:59.286858 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3021599104}
I20260709 13:14:59.287961  8840 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.288707  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:59.289822  6323 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:59.290946  8840 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:59.293679  6324 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:59.271600  6330 rpcz_store.cc:276] 0709 13:14:58.100357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.782437 (+682080us) service_pool.cc:224] Handling call
0709 13:14:58.783374 (+   937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:58.918220 (+134846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.270951 (+352731us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b5400038c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:59.271134 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133323520}
W20260709 13:14:59.302423  8899 log.cc:927] Time spent T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:14:59.260445  6404 consensus_queue.cc:260] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:59.308871  6404 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.309065  8708 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.309655  8708 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:59.310202  8375 consensus_queue.cc:1059] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:59.311074  8847 raft_consensus.cc:3055] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:59.311463  8847 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:59.311936  8708 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:59.307794  8622 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.313365  8816 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:59.313616  8622 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.314302  8832 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:59.313982  6331 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:59.318580  6326 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:14:59.328064  6906 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:59.329286  6906 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:14:59.331787  8377 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:59.332206  8377 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.332545  8377 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:59.315981  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:59.312477  8847 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.357506  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.359563  6404 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:14:59.361768  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.339483  8854 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:59.371749  6940 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:59.373168  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:59.372759  8776 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:14:59.380012  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:59.372381  8832 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:59.382248  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 198032us
I20260709 13:14:59.382937  6326 raft_consensus.cc:2368] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6.
I20260709 13:14:59.390656  8622 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:59.391958  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:59.392400  8418 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:59.395767  8807 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:59.397272  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:59.397789  8711 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.398123  6938 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:14:59.398439  8711 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.376488  8866 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:59.384371  8832 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:59.415928  8832 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:59.383975  8847 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:59.422375  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.422657  6327 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
W20260709 13:14:59.423893  6328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1215) took 1805 ms (client timeout 1972 ms). Trace:
W20260709 13:14:59.424332  6328 rpcz_store.cc:269] 0709 13:14:57.618417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.803148 (+184731us) service_pool.cc:224] Handling call
0709 13:14:59.423481 (+1620333us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54002a5154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:14:59.423717 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254401408}
I20260709 13:14:59.424731  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.425525  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.426240  6328 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:59.426419  6327 raft_consensus.cc:2368] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7.
I20260709 13:14:59.427096  6219 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:59.428263  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.428323  8698 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:59.429540  8698 raft_consensus.cc:697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:59.429886  6327 raft_consensus.cc:2376] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6. Re-sending same reply.
I20260709 13:14:59.430757  8698 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:59.434022  6330 raft_consensus.cc:2410] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:14:59.435433  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.439002  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:14:59.449963  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.450846  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.452085  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:59.448640  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:59.454890  6324 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:14:59.456489  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:59.458492  6219 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:59.453454  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:59.467142  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:14:59.470654  8884 log.cc:927] Time spent T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.505s	user 0.004s	sys 0.000s
I20260709 13:14:59.473091  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:59.473219  8807 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.474164  8711 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:59.475157  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:59.463780  6325 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:59.479873  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.484520  6942 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEARNER]: Advancing to term 7
I20260709 13:14:59.482344  6222 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:59.486025  6327 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 4: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:14:59.488684  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.479756  8854 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:14:59.490774  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 60297.5us
I20260709 13:14:59.494383  8854 raft_consensus.cc:697] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:59.495064  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.496317  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.495738  8854 consensus_queue.cc:237] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:59.499046  8795 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:59.499719  8795 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.499927  8676 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:14:59.501003  8904 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:14:59.502473  6326 raft_consensus.cc:2368] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5.
I20260709 13:14:59.482013  8866 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:14:59.505038  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:59.510382  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:59.493336  6933 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:14:59.514456  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.515341  6327 raft_consensus.cc:2410] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:14:59.475868  8807 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:59.518518  6324 raft_consensus.cc:2376] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6. Re-sending same reply.
I20260709 13:14:59.499723  8464 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:59.519469  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:59.519511  6328 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:14:59.520736  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.514447  6933 pending_rounds.cc:85] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Aborting all ops after (but not including) 3
W20260709 13:14:59.536629  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 101545us
I20260709 13:14:59.535909  6905 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:59.540786  6329 raft_consensus.cc:1275] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:14:59.517220  8603 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:59.549525  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:59.555431  6325 raft_consensus.cc:2410] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:14:59.546595  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:14:59.555967  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 73719.2us
I20260709 13:14:59.556540  6222 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:59.558010  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:59.558507  6324 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:14:59.559213  6297 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:59.559715  8797 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:59.560298  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 52968.3us
W20260709 13:14:59.560868  8905 log.cc:927] Time spent T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:14:59.561120  8820 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.568403  6934 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:59.573405  8863 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:14:59.573859  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 450) took 1072 ms. Trace:
I20260709 13:14:59.574195  8863 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:14:59.577425  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.579073  6330 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:14:59.553304  8807 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:59.574311  6398 rpcz_store.cc:276] 0709 13:14:58.501004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.501175 (+   171us) service_pool.cc:224] Handling call
0709 13:14:58.505025 (+  3850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.523506 (+ 18481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:58.523545 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:58.523601 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:58.523645 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.573412 (+1049767us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b540002d0d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:14:59.573471 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:59.573684 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41970048}
I20260709 13:14:59.543010  6933 pending_rounds.cc:107] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 13:14:59.572544  8872 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.590797  6942 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:14:59.590438  8603 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.591121  6942 pending_rounds.cc:85] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Aborting all ops after (but not including) 5
I20260709 13:14:59.598973  6942 pending_rounds.cc:107] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:14:59.599349  6942 raft_consensus.cc:2889] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:59.583294  8754 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.587695  6933 raft_consensus.cc:2889] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:59.601855  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 76522.9us
I20260709 13:14:59.607915  6905 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:59.609216  6905 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:14:59.609769  8912 log.cc:927] Time spent T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:14:59.609969  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:59.611167  8872 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:59.611702  8797 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:59.614010  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.614121  8829 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:59.614282  6329 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:14:59.614636  8829 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:59.615085  8829 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:59.615360  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:59.615694  8683 raft_consensus.cc:3055] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:59.615996  6329 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:14:59.616150  8683 raft_consensus.cc:740] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:14:59.611070  8464 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:59.617581  8464 raft_consensus.cc:697] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:59.618052  6326 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:59.618543  8464 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.620236  6221 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:59.621244  6905 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:59.622118  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:14:59.622727  8749 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:59.623426  8749 raft_consensus.cc:697] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:14:59.624472  8749 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.625224  8700 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.625109  8364 consensus_queue.cc:1059] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:59.626085  8364 raft_consensus.cc:3055] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:59.626314  8774 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:14:59.627043  8774 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:59.629070  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:59.629369  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:59.630468  6254 raft_consensus.cc:2410] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:14:59.630719  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:59.626446  8364 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:14:59.632160  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.637224  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:59.632932  8364 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.638825  6371 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:14:59.639356  8364 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:59.629294  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:59.640215  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:14:59.647179  6940 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:14:59.602164  6324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57230
I20260709 13:14:59.648676  6324 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:59.648842  6154 catalog_manager.cc:5697] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 4 to 5, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 5 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:14:59.651016  6154 catalog_manager.cc:5697] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 1 to 2, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 2 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.649855  6942 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:59.653033  6324 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.764820  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:59.654472  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2255) took 1003 ms. Trace:
W20260709 13:14:59.659829  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.661849  8622 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:59.662380  8622 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.662760  8622 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:59.663129  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.664033  6369 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:14:59.665948  6221 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:59.666910  8829 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.667469  6221 leader_election.cc:400] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8.
I20260709 13:14:59.667759  6221 leader_election.cc:403] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:59.668946  8847 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:59.669723  8847 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:59.673345  8718 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:14:59.673732  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:59.674597  6329 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:14:59.675379  8705 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:59.675545  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:59.676784  8774 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:59.676467  6905 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:59.652742  6154 catalog_manager.cc:5697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 2 to 3, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 3 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.679493  6324 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:14:59.688738  6326 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:14:59.656580  6401 rpcz_store.cc:276] 0709 13:14:58.794268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.165939 (+371671us) service_pool.cc:224] Handling call
0709 13:14:59.232284 (+ 66345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:59.301541 (+ 69257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:59.301688 (+   147us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:59.356933 (+ 55245us) log.cc:844] Serialized 26 byte log entry
0709 13:14:59.460564 (+103631us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:59.584747 (+124183us) log.cc:844] Serialized 14 byte log entry
0709 13:14:59.584976 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.585173 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:59.635942 (+ 50769us) raft_consensus.cc:1685] finished
0709 13:14:59.635967 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:59.636116 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36242,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":3721,"thread_start_us":150863,"threads_started":2,"wal-append.queue_time_us":166634}
I20260709 13:14:59.700124  6221 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:59.700919  6324 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:59.702662  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:14:59.703926  6942 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:59.679102  8754 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.642613  8797 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:14:59.709821  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:14:59.718364  6324 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:59.684098  8804 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:59.691167  8872 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.713037  6329 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:14:59.699661  8676 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:59.721041  6369 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:14:59.729969  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:14:59.730911  8856 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.612s	user 0.003s	sys 0.000s
I20260709 13:14:59.718688  8754 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:59.736099  8754 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:59.640715  8683 consensus_queue.cc:260] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.737257  8683 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.739816  6325 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:59.744236  6905 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:14:59.733897  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:14:59.745460  6329 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:14:59.746830  6325 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:59.745887  6329 pending_rounds.cc:85] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 3
I20260709 13:14:59.769580  6329 pending_rounds.cc:107] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 13:14:59.769901  6329 raft_consensus.cc:2889] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:59.721179  8804 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.786916  6324 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:14:59.710459  8774 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 13:14:59.788793  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.790015  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 103163us
I20260709 13:14:59.747546  8847 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8.
I20260709 13:14:59.724790  8854 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:14:59.793912  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 47250.2us
W20260709 13:14:59.798363  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 86726.6us
W20260709 13:14:59.799253  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.757138  8749 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:59.776976  8804 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:59.725855  8872 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.775633  8840 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.804183  8749 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.782989  8807 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:14:59.770460  8866 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:14:59.819166  6324 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:59.810694  8754 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.824019  8807 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.824417  8754 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:59.825961  8610 consensus_queue.cc:1059] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:14:59.827199  8754 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:59.827490  8807 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:59.827621  6933 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:59.828099  8829 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:14:59.828207  8850 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:59.829324  8907 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.503s	user 0.001s	sys 0.003s
W20260709 13:14:59.830892  6202 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 13:14:59.831192  8700 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:59.831503  6202 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for f3c8c870200141efa8a5f7cc58ece4a6 already in progress
I20260709 13:14:59.831732  6151 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55326 (request call id 375) took 9808 ms. Trace:
W20260709 13:14:59.832034  6202 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for f3c8c870200141efa8a5f7cc58ece4a6 already in progress
I20260709 13:14:59.802634  8676 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.833652  8676 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:14:59.835847  8676 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:14:59.836666  8847 consensus_queue.cc:1059] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:59.837634  6325 raft_consensus.cc:1275] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:14:59.838105  6325 pending_rounds.cc:85] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 1
I20260709 13:14:59.838415  6325 pending_rounds.cc:107] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:14:59.838719  6325 raft_consensus.cc:2889] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:59.840531  6325 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:59.814168  8718 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.841924  8718 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.842621  6331 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:14:59.843892  6331 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:14:59.847376  8882 log.cc:927] Time spent T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 1.165s	user 0.001s	sys 0.001s
W20260709 13:14:59.847954  8377 consensus_meta.cc:287] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260709 13:14:59.848393  8377 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.818184  8795 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:14:59.851514  8795 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:59.852963  8716 raft_consensus.cc:1064] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
W20260709 13:14:59.853384  8716 raft_consensus.cc:1068] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Unable to promote non-voter 8600a3fead0e48a7aa813822ec44d0fe: Service unavailable: leader transfer in progress
I20260709 13:14:59.853809  8716 raft_consensus.cc:3055] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:59.853760  8872 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:14:59.813828  8749 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.813572  8708 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:14:59.871471  6324 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:14:59.873502  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 283829us
W20260709 13:14:59.875787  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 75613.9us
I20260709 13:14:59.881520  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:14:59.882277  6401 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:14:59.882781  8377 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:14:59.887791  8896 log.cc:927] Time spent T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.933s	user 0.000s	sys 0.005s
W20260709 13:14:59.976040  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.981778  8919 log.cc:927] Time spent T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:14:59.983319  6368 leader_election.cc:400] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7.
I20260709 13:14:59.983696  6368 leader_election.cc:403] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:14:59.984627  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 103479us
I20260709 13:14:59.860437  8716 raft_consensus.cc:740] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:14:59.986342  6325 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:14:59.991077  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.018098  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 212475us
I20260709 13:14:59.989519  6296 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:14:59.818411  8832 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.037078  8794 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:15:00.037487  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 172708us
I20260709 13:15:00.038707  6296 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:00.039825  8802 raft_consensus.cc:3055] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:00.040328  8802 raft_consensus.cc:740] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:00.040500  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:00.040747  8840 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.041139  6328 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.041582  8840 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.041996  8802 consensus_queue.cc:260] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.043205  8802 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:00.044445  8840 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:00.046833  8705 consensus_queue.cc:1059] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:00.048130  8776 raft_consensus.cc:3055] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:00.048513  8776 raft_consensus.cc:740] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:15:00.051924  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.859382  8622 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.059839  6368 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:00.056188  6328 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:15:00.061811  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:00.065575  6935 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:00.070379  6328 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:00.050364  8364 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7.
W20260709 13:14:59.746114  8711 consensus_queue.cc:1175] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8600a3fead0e48a7aa813822ec44d0fe" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:00.049371  8776 consensus_queue.cc:260] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.089521  8776 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:00.073308  8603 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:15:00.121177  6296 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:00.124986  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 106981us
I20260709 13:15:00.131938  6325 raft_consensus.cc:1240] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:00.132436  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2281) took 1046 ms. Trace:
I20260709 13:14:59.832271  6151 rpcz_store.cc:276] 0709 13:14:50.023638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.029227 (+  5589us) service_pool.cc:224] Handling call
0709 13:14:59.831422 (+9802195us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:53.046564 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:53.257462 (+210898us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:53.257519 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:14:53.257543 (+    24us) tablet.cc:662] Decoding operations
0709 13:14:53.258616 (+  1073us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:53.258711 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:53.258752 (+    41us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:14:53.259581 (+   829us) tablet.cc:701] Row locks acquired
0709 13:14:53.259633 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:14:53.259827 (+   194us) write_op.cc:270] Start()
0709 13:14:53.259993 (+   166us) write_op.cc:276] Timestamp: P: 1783602893259758 usec, L: 0
0709 13:14:53.260019 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:14:53.260804 (+   785us) log.cc:844] Serialized 3241 byte log entry
0709 13:14:54.231502 (+970698us) op_driver.cc:464] REPLICATION: finished
0709 13:14:54.515365 (+283863us) write_op.cc:301] APPLY: starting
0709 13:14:54.521439 (+  6074us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:54.571917 (+ 50478us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:54.635289 (+ 63372us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:54.892106 (+256817us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:55.110558 (+218452us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:14:55.117072 (+  6514us) write_op.cc:312] APPLY: finished
0709 13:14:55.193454 (+ 76382us) log.cc:844] Serialized 65 byte log entry
0709 13:14:55.764028 (+570574us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:55.787338 (+ 23310us) write_op.cc:454] Released schema lock
0709 13:14:55.796674 (+  9336us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:55.805075 (+  8401us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:55.805115 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43525,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":261236,"apply.run_cpu_time_us":91459,"apply.run_wall_time_us":1295133,"num_ops":8,"prepare.queue_time_us":769340,"prepare.run_cpu_time_us":30190,"prepare.run_wall_time_us":465170,"raft.queue_time_us":646848,"raft.run_cpu_time_us":13071,"raft.run_wall_time_us":104712,"replication_time_us":971294,"thread_start_us":1881108,"threads_started":5,"wal-append.queue_time_us":958187,"wal-append.run_cpu_time_us":44222,"wal-append.run_wall_time_us":2437131}]]}
I20260709 13:15:00.132896  6329 rpcz_store.cc:276] 0709 13:14:59.086859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.730944 (+644085us) service_pool.cc:224] Handling call
0709 13:14:59.744845 (+ 13901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:59.794176 (+ 49331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:00.132135 (+337959us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b54002936d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:00.132352 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31299456}
I20260709 13:15:00.114559  8377 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.164430  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1331) took 1244 ms. Trace:
I20260709 13:15:00.114331  8819 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:00.164909  6256 rpcz_store.cc:276] 0709 13:14:58.888452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.056596 (+168144us) service_pool.cc:224] Handling call
0709 13:14:59.080264 (+ 23668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:59.123881 (+ 43617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:00.132250 (+1008369us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b54000f6754. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:00.132440 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46187904}
I20260709 13:15:00.118309  8683 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:00.189570  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 139918us
I20260709 13:15:00.190130  6907 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:00.191327  6369 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:00.177400  8754 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:00.196731  6369 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:00.179426  8807 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:00.184882  8840 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:00.206575  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 137962us
I20260709 13:15:00.074338  8716 consensus_queue.cc:260] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:00.170846  8377 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.186688  8676 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:00.179489  8819 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.223081  6296 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:15:00.238173  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 48156.5us
I20260709 13:15:00.197268  8683 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:00.250177  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 53532.1us
W20260709 13:15:00.256343  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 220870us
I20260709 13:15:00.239990  8832 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:00.211349  8840 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.241254  8795 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:00.266292  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 153165us
I20260709 13:15:00.241562  8928 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:00.268543  6905 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:00.271248  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:00.271318  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:15:00.272372  8922 log.cc:927] Time spent T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.446s	user 0.004s	sys 0.000s
I20260709 13:15:00.273532  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1229) took 2607 ms. Trace:
I20260709 13:15:00.273983  6323 rpcz_store.cc:276] 0709 13:14:57.666429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.049158 (+382729us) service_pool.cc:224] Handling call
0709 13:14:59.289294 (+1240136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:59.293289 (+  3995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:00.273315 (+980026us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400436cd0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:00.273457 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2851090304}
W20260709 13:15:00.274595  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 58706.2us
I20260709 13:15:00.275336  6296 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:00.276158  8807 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:00.276697  6296 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:00.278846  8718 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:00.245195  8622 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:00.271485  6937 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:00.290537  6221 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:00.267691  8921 log.cc:927] Time spent T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:15:00.263056  8364 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:00.288719  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:00.296941  6368 leader_election.cc:400] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6.
I20260709 13:15:00.297439  8801 consensus_queue.cc:1059] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:15:00.298095  8927 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:15:00.243844  8676 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.303467  8928 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.268158  8795 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:00.298576  8723 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:00.317526  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:00.320103  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:00.322948  8941 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:15:00.323321  8945 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:00.323869  8945 raft_consensus.cc:697] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:00.310156  8807 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:00.324796  8945 consensus_queue.cc:237] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.309574  8795 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:00.355446  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 69828.7us
W20260709 13:15:00.358492  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 52860us
I20260709 13:15:00.318770  8718 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:00.360309  6296 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:15:00.361954  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 76054.7us
I20260709 13:15:00.366407  6369 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:00.308702  8940 consensus_queue.cc:1059] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:15:00.372150  6256 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:00.373740  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 578) took 1460 ms. Trace:
I20260709 13:15:00.374238  6327 rpcz_store.cc:276] 0709 13:14:58.913294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.524175 (+610881us) service_pool.cc:224] Handling call
0709 13:14:59.546944 (+ 22769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:59.591395 (+ 44451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:59.591415 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:59.621473 (+ 30058us) log.cc:844] Serialized 26 byte log entry
0709 13:14:59.706148 (+ 84675us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:59.706203 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.706304 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:00.373471 (+667167us) raft_consensus.cc:1685] finished
0709 13:15:00.373498 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:00.373665 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4002,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":12544,"thread_start_us":84264,"threads_started":1,"wal-append.queue_time_us":194686}
I20260709 13:15:00.350734  8610 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:00.379945  6404 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:00.386624  6324 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:00.361074  8944 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:00.389786  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:00.313598  8928 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:00.399029  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:00.400069  6250 raft_consensus.cc:2410] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:15:00.405757  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 46400.9us
W20260709 13:15:00.406563  8936 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
I20260709 13:15:00.393260  6937 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:00.409469  8953 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:00.409682  8683 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:00.410306  8683 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.410419  8953 consensus_queue.cc:1059] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:00.410848  8683 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.411650  8940 raft_consensus.cc:3055] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:00.412026  8940 raft_consensus.cc:740] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:00.412829  8940 consensus_queue.cc:260] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:00.414855  8916 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.627s	user 0.000s	sys 0.003s
I20260709 13:15:00.393232  6368 leader_election.cc:400] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7.
I20260709 13:15:00.417019  6368 leader_election.cc:403] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:15:00.418655  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:00.394929  8610 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.395949  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:00.396202  8949 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.396601  8463 raft_consensus.cc:3055] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:00.397538  8840 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:00.398054  8802 raft_consensus.cc:1064] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:15:00.425051  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:00.412957  8683 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:00.436512  6221 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:00.430646  6937 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
W20260709 13:15:00.439739  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 109065us
I20260709 13:15:00.391844  8807 raft_consensus.cc:697] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:00.440125  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:00.393065  8944 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.447029  6371 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:00.422613  8377 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:00.450588  6402 raft_consensus.cc:2393] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 10: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:15:00.432111  8802 raft_consensus.cc:1068] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: Unable to promote non-voter 8600a3fead0e48a7aa813822ec44d0fe: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:00.427668  8463 raft_consensus.cc:740] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:15:00.469638  8930 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:15:00.470893  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2290) took 1107 ms. Trace:
I20260709 13:15:00.471259  6326 rpcz_store.cc:276] 0709 13:14:59.363875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.839347 (+475472us) service_pool.cc:224] Handling call
0709 13:14:59.839681 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:59.840053 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:59.840078 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:59.840521 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:15:00.100103 (+259582us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:00.100142 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:00.100216 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:00.470664 (+370448us) raft_consensus.cc:1685] finished
0709 13:15:00.470687 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:00.470822 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6202,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":259224,"threads_started":1,"wal-append.queue_time_us":455868}
I20260709 13:15:00.424185  8854 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:15:00.429822  8949 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.451089  8723 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7.
I20260709 13:15:00.484844  8698 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:00.458755  6296 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:00.453423  8944 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:00.486212  6933 raft_consensus.cc:2410] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:00.440683  8866 consensus_queue.cc:1059] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:15:00.461918  8364 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:00.472158  8797 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:15:00.499607  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 48294.8us
I20260709 13:15:00.459744  8957 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.501194  6906 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:00.504547  8956 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.445837  8719 consensus_queue.cc:1048] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
W20260709 13:15:00.510938  8947 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:15:00.521917  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 128945us
I20260709 13:15:00.525117  6296 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:00.502769  8946 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.511572  8711 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:00.508031  8957 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.514362  8364 raft_consensus.cc:697] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:00.517468  8872 raft_consensus.cc:3055] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:00.536764  6295 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:00.533270  8797 raft_consensus.cc:697] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:00.510881  8807 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.537842  8928 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:00.538394  8797 consensus_queue.cc:237] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.539445  8610 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:00.540448  8950 raft_consensus.cc:3055] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:00.540832  8950 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:00.541885  8950 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.543125  8950 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:00.545953  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 49135.3us
I20260709 13:15:00.535187  8957 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:00.548491  8850 consensus_meta.cc:287] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.720s	user 0.014s	sys 0.001s
I20260709 13:15:00.554191  8958 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:00.556418  8749 consensus_meta.cc:287] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.000s
I20260709 13:15:00.557726  8949 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:00.558501  8804 consensus_meta.cc:287] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.742s	user 0.008s	sys 0.003s
W20260709 13:15:00.559067  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.559499  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:00.536147  8872 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:00.536280  8711 raft_consensus.cc:697] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:00.561183  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 46326.8us
I20260709 13:15:00.547513  8463 consensus_queue.cc:260] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.548864  8718 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:00.564955  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:00.548768  8959 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:00.584955  6331 raft_consensus.cc:2410] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:00.574249  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:00.569687  8749 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.586369  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:00.588025  8716 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.588541  8749 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:00.587893  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:00.545586  8946 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.590318  6297 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:00.594596  6296 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:15:00.602203  8960 log.cc:927] Time spent T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:15:00.593010  8942 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.601670  8794 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.620901  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:00.619187  8854 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.623092  8854 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.571657  8870 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.624114  8870 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.571878  8802 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:00.614519  8863 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:00.625303  8802 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.625681  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:00.627744  8802 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:00.579830  8683 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.627900  8795 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.621021  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:00.629300  6937 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:00.606910  8711 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.622385  8946 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:00.569643  8610 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.592749  8928 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:00.580005  8875 consensus_queue.cc:1059] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:15:00.643180  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:00.571700  8804 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:00.645710  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 67897.7us
W20260709 13:15:00.651536  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 46115.7us
I20260709 13:15:00.619299  8794 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:00.674618  6330 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:00.622414  8676 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:00.677881  8463 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:00.642124  8718 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:00.681188  6296 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:15:00.680385  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 71357.3us
I20260709 13:15:00.690827  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:00.691654  6937 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:00.648105  8959 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:15:00.696497  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 123425us
I20260709 13:15:00.628615  8683 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:00.650887  8863 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:00.678653  8854 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:00.679692  8794 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.678702  8610 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.711071  8807 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:00.711699  8719 consensus_queue.cc:1059] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:00.712350  8945 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.712925  8718 raft_consensus.cc:697] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:00.713433  8977 consensus_queue.cc:1048] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:00.713683  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:00.693322  8676 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:15:00.731775  6331 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:00.731982  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:00.732657  6327 raft_consensus.cc:2368] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5.
I20260709 13:15:00.735502  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:00.721961  8807 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:00.719317  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 111218us
I20260709 13:15:00.630138  8942 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.628857  8364 consensus_queue.cc:237] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:00.721020  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.680260  8958 raft_consensus.cc:697] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:00.685673  8875 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.761556  8875 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.763676  8875 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:00.695614  8959 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.764283  8959 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:00.717330  8863 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:00.736259  6248 raft_consensus.cc:2410] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:15:00.769162  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:00.736850  6323 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:00.717440  8698 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:00.738490  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:00.741218  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:00.773373  6248 raft_consensus.cc:2410] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:00.742252  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:00.742841  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:00.733669  8965 log.cc:927] Time spent T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:15:00.723408  8854 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:15:00.745761  8870 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:00.742858  8610 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:00.746660  8718 consensus_queue.cc:237] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.749512  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:00.751220  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.729404  8776 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.751255  8807 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.740350  8802 raft_consensus.cc:3055] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:00.783347  8802 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:00.755458  6249 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:00.753409  8944 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.797469  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:00.798002  6331 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.798956  8944 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:00.799270  6933 raft_consensus.cc:2393] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:00.799958  8589 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:00.800432  8589 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.801267  8958 consensus_queue.cc:237] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.802584  8589 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:00.805228  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:00.806025  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:00.807852  8683 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:00.760319  8872 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.760905  8942 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:00.773703  6256 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:15:00.773957  6907 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:00.773895  6254 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:00.780431  8749 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:15:00.781520  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:00.820544  6247 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.820436  6369 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:00.789484  8802 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.790123  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:00.790454  8795 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:00.790827  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:00.785287  8776 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:00.791313  8819 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:00.791671  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:00.793252  8917 log.cc:927] Time spent T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.005s	user 0.007s	sys 0.014s
I20260709 13:15:00.793114  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:00.794116  8955 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:00.794943  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:00.843963  6937 raft_consensus.cc:2410] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:15:00.844210  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.817569  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:00.844831  6326 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:00.782749  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:00.845960  6252 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:00.842088  6331 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:00.843004  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:00.844808  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:00.848701  6325 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:00.728034  8945 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.837759  8942 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:00.890061  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 113832us
I20260709 13:15:00.829715  8463 consensus_queue.cc:1059] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:15:00.890957  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:00.891070  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 117173us
I20260709 13:15:00.891477  8875 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:00.891649  8756 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:00.892164  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:00.893357  6253 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:00.894415  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 63484.1us
I20260709 13:15:00.907121  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:00.893788  8955 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.908396  6252 raft_consensus.cc:2410] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:15:00.904430  6256 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:00.906642  6249 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:15:00.893976  8863 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:00.915966  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:00.919039  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:00.920258  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:00.917747  6219 leader_election.cc:400] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5.
I20260709 13:15:00.921671  6219 leader_election.cc:403] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:00.829502  8944 consensus_queue.cc:1059] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:15:00.926805  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:00.838560  8946 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:15:00.928202  6252 raft_consensus.cc:2410] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:00.930824  8974 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:00.933290  8732 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:15:00.935465  6219 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:00.936825  8975 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.942251  8863 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:00.942484  6905 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:00.944379  8805 raft_consensus.cc:3055] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:00.944520  8944 raft_consensus.cc:3055] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:00.832437  8716 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:15:00.959050  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:00.960314  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:00.913221  8802 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.963819  6331 raft_consensus.cc:1275] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:00.971978  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:00.972790  6253 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:15:00.987018  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:01.015460  6327 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:00.935359  8942 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.026346  6330 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:01.047168  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:01.028843  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 215106us
I20260709 13:15:00.952443  8804 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:01.028329  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:01.061245  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:01.072834  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:01.073268  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:01.073876  6401 raft_consensus.cc:2393] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:01.074005  6405 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:00.964766  8872 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:01.072932  6326 raft_consensus.cc:2393] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:01.069114  6398 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:00.919809  8875 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.994645  8944 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:00.984115  8854 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:01.078039  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:01.024827  6371 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:00.996021  8756 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:00.984726  8805 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:01.048998  8850 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.091598  6396 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:01.102005  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 188373us
I20260709 13:15:01.098343  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:00.964540  8974 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:01.110255  8974 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:01.111114  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:01.111383  8776 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:01.111805  6326 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:15:01.090091  8804 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:15:01.118309  6254 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:01.120545  6252 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:01.120726  6248 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
W20260709 13:15:01.121726  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 97022.9us
I20260709 13:15:01.048604  8794 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:01.024396  8977 consensus_queue.cc:1059] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:15:01.126613  8977 raft_consensus.cc:3055] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:01.127004  8977 raft_consensus.cc:740] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:00.960729  8959 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:00.966066  8957 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:01.129093  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:01.089234  8854 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.135986  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:01.137059  6368 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:01.101218  8756 raft_consensus.cc:697] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:01.143404  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:01.148263  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:01.152374  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.133389  8776 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:01.139704  8854 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:01.153215  6328 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:15:01.138814  8950 consensus_meta.cc:287] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.595s	user 0.007s	sys 0.005s
I20260709 13:15:01.103163  8850 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:01.143585  8364 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.178432  6399 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:15:01.213380  6399 pending_rounds.cc:85] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 7
I20260709 13:15:01.213665  6399 pending_rounds.cc:107] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:15:01.213505  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:01.213914  6399 raft_consensus.cc:2889] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:01.214192  8955 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:01.183506  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:01.187863  8978 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:15:01.172305  6907 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:01.219614  6256 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:01.220000  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 47787.4us
W20260709 13:15:01.188486  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 51531.1us
I20260709 13:15:01.147063  8944 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:01.191514  8819 raft_consensus.cc:3055] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:01.224736  8819 raft_consensus.cc:740] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:01.225582  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:01.197763  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:01.196799  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 119969us
I20260709 13:15:01.195317  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:01.198436  8805 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:01.206032  6403 raft_consensus.cc:1240] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:01.208921  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:01.234965  6330 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 2.
I20260709 13:15:01.211948  6324 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 13:15:01.220885  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:01.233035  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 159124us
I20260709 13:15:01.238135  6222 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:01.224315  8944 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:01.224794  6250 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:01.199016  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:01.241641  6325 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
W20260709 13:15:01.228147  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 365780us
I20260709 13:15:01.227556  6219 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:01.242954  6251 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:15:01.243351  6251 pending_rounds.cc:85] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 6
I20260709 13:15:01.243670  6251 pending_rounds.cc:107] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:15:01.244012  6251 raft_consensus.cc:2889] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:01.245581  6219 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:01.246003  6295 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:01.244894  6396 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:01.262449  8940 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:01.248888  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:01.266582  6331 raft_consensus.cc:2393] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:01.272207  8950 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.272975  8950 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:01.276836  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:01.276146  8950 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:01.268133  6331 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:01.295468  6905 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:01.296525  8589 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:01.297369  8589 raft_consensus.cc:697] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:15:01.303584  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 61383.8us
I20260709 13:15:01.174633  8945 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:01.305846  6254 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:01.308468  6906 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:01.226238  8955 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:01.344758  6368 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:01.222134  8870 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.329383  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:01.353410  6330 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
W20260709 13:15:01.334518  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 88593.2us
I20260709 13:15:01.144728  8756 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:01.127847  8977 consensus_queue.cc:260] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:01.224964  8718 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:15:01.364498  6295 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:01.365447  8805 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:01.369827  8676 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:01.370585  6401 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:01.310209  8610 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:01.329492  8749 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:01.374205  6396 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:01.225735  8819 consensus_queue.cc:260] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:01.392576  6295 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:01.341639  8955 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.408970  6295 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:01.370991  8795 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:01.373054  8946 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:01.471199  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 62348.3us
W20260709 13:15:01.479072  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.386983  8610 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:01.483060  8990 consensus_queue.cc:1059] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:15:01.484566  8794 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:01.371181  8464 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 13:15:01.490341  8611 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.167s
I20260709 13:15:01.492070  8850 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:01.504563  8875 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:01.510218  8795 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:01.510807  8683 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:01.513810  8854 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:01.534472  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 291553us
W20260709 13:15:01.573606  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 329733us
I20260709 13:15:01.466892  8955 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:01.539731  6905 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:01.464705  8958 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.395653  8949 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.154s
I20260709 13:15:01.381608  8870 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:01.480563  8711 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:01.574640  6222 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:01.536195  8610 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:01.406603  8676 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:01.572358  8794 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.612692  6253 raft_consensus.cc:2393] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:15:01.584785  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:01.578269  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 332740us
W20260709 13:15:01.610157  6247 consensus_meta.cc:287] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.778s	user 0.010s	sys 0.001s
I20260709 13:15:01.610354  6368 leader_election.cc:400] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5.
I20260709 13:15:01.616602  6368 leader_election.cc:403] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:15:01.617375  6247 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:01.565644  8377 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:15:01.629191  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.631458  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:01.631558  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:01.632908  6325 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:01.587941  8945 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:01.634033  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:01.640269  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:01.643476  8870 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:01.645197  8957 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:01.581795  8683 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:01.646159  8820 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:01.646466  8848 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.574362  8589 consensus_queue.cc:237] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:01.619545  8711 raft_consensus.cc:697] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:01.619861  8866 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:01.626714  8794 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:01.651048  8863 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:15:01.653472  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 69203.3us
I20260709 13:15:01.667735  8977 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:01.672631  6940 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:01.696137  8945 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.680580  8676 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:01.686379  8975 consensus_meta.cc:287] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.703s	user 0.007s	sys 0.003s
I20260709 13:15:01.686775  8854 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:01.610888  8875 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:01.688462  8807 consensus_meta.cc:287] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.898s	user 0.006s	sys 0.004s
I20260709 13:15:01.689584  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:01.690788  8872 consensus_meta.cc:287] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.000s
I20260709 13:15:01.692289  8946 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:01.706321  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 365043us
I20260709 13:15:01.675088  8974 raft_consensus.cc:1064] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:15:01.715507  6368 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:01.710000  8718 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:01.712591  8945 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:01.715011  8875 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:01.742648  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:01.745613  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 404386us
I20260709 13:15:01.751461  6906 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:01.717401  8975 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5.
I20260709 13:15:01.706113  8848 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:01.722891  8974 raft_consensus.cc:1068] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b: Unable to promote non-voter 8600a3fead0e48a7aa813822ec44d0fe: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:01.722662  8942 raft_consensus.cc:2764] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:15:01.768533  8875 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:01.708313  8820 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:01.727416  6250 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:01.717676  8863 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:01.785599  6368 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:01.717928  8807 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:01.727954  8464 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:15:01.778231  8949 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:01.809424  8863 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:01.814004  8683 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:01.814911  8364 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.807484  8949 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:01.816715  8949 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:01.775470  6906 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:01.733417  8944 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:15:01.819689  6247 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
W20260709 13:15:01.796175  8940 consensus_meta.cc:287] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.004s
W20260709 13:15:01.822640  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 47265.2us
I20260709 13:15:01.826429  6906 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:01.822999  8984 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.028s	sys 0.019s
W20260709 13:15:01.822578  8802 consensus_meta.cc:287] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.771s	user 0.012s	sys 0.000s
I20260709 13:15:01.786811  8705 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:15:01.835537  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 69962.8us
I20260709 13:15:01.826849  8611 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.840324  6906 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:01.839969  8940 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:01.837843  8984 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.029s	sys 0.019s
I20260709 13:15:01.859582  6404 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:15:01.839322  8683 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:01.878494  6403 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.014s
W20260709 13:15:01.881263  6403 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.008s	sys 0.014s
I20260709 13:15:01.883549  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:01.883870  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:01.866132  8956 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:01.851994  8804 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:01.853554  6251 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:15:01.821676  8711 consensus_queue.cc:237] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
W20260709 13:15:01.885303  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.904067  6251 pending_rounds.cc:85] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 3
I20260709 13:15:01.904222  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:01.883953  8364 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:01.907639  6219 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:01.862426  8940 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:01.913316  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:01.907714  6251 pending_rounds.cc:107] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:15:01.909461  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:01.920363  6251 raft_consensus.cc:2889] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:01.920549  6937 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:01.881505  8683 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:01.914217  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:01.914693  6906 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:01.922972  6222 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:01.923920  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:01.924661  6937 raft_consensus.cc:2393] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:01.927727  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:01.929054  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:01.930133  6253 raft_consensus.cc:2410] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:01.903362  8950 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:01.928481  6249 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:01.936117  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:01.939510  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 96309.2us
I20260709 13:15:01.908411  8794 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:01.946743  8464 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:01.948251  6250 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:15:01.949885  9004 log.cc:927] Time spent T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:15:01.950670  8683 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:01.951068  9002 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:15:01.958993  6295 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:01.925819  8364 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:01.918973  8956 raft_consensus.cc:697] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:01.922245  8802 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:01.962658  6295 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:01.944815  6219 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:01.970499  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:01.921646  8804 raft_consensus.cc:697] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:15:01.970443  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.965601  6368 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:01.933529  8863 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:01.927215  8944 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:01.971894  9001 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:01.976332  8950 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:01.977281  8683 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:01.977973  8804 consensus_queue.cc:237] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:01.973186  6368 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:01.975204  9007 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:01.975562  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:01.990439  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:01.975746  8794 consensus_queue.cc:1059] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:15:01.974035  6906 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:01.988098  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.989297  6368 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:01.970566  6255 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:01.967020  8848 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:01.968099  8802 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:01.981760  8863 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.997159  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:01.997465  6368 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:01.988104  8805 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:01.992055  8705 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.981906  8820 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:01.982096  8807 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:01.984493  8950 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.990140  9007 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.006726  6249 raft_consensus.cc:2393] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:02.000244  8939 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:01.987798  8872 consensus_queue.cc:1059] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:15:02.000226  8756 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:02.003567  8802 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.010880  8794 consensus_queue.cc:1243] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:02.004936  8805 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.005306  8863 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:02.025280  6938 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:02.025660  8959 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:02.025970  8705 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:02.019001  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:02.050808  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:02.068341  6941 raft_consensus.cc:2393] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:02.055047  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:02.056348  6330 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:02.059448  6328 raft_consensus.cc:3055] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:02.069970  6328 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:02.017757  8950 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:02.075973  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:02.077142  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:02.078591  8956 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.065165  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:02.079706  6325 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:02.019083  9007 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:02.069061  6329 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:02.065791  9014 raft_consensus.cc:3055] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:02.062765  6326 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:02.087715  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:02.088352  6328 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:02.036844  8756 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:02.058041  8805 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:02.345755  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 348374us
I20260709 13:15:02.129944  6252 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:15:02.349186  6330 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:02.102718  6325 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
W20260709 13:15:02.349690  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.109265  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:02.374603  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:02.199137  8610 consensus_meta.cc:287] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.000s
I20260709 13:15:02.387305  6368 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:02.113823  9006 log.cc:927] Time spent T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:15:02.299994  9000 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.122735  8946 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5.
I20260709 13:15:02.422070  8946 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:02.349702  9014 raft_consensus.cc:740] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:02.423911  9014 consensus_queue.cc:260] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:02.424852  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:02.425197  9014 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.425523  6253 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:15:02.426532  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:02.427520  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:02.428025  6253 raft_consensus.cc:2376] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5. Re-sending same reply.
I20260709 13:15:02.406172  8610 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:02.382520  8939 raft_consensus.cc:697] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:02.429883  6249 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:02.335632  8705 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.258841  8698 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:02.352900  8732 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:02.258237  8820 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:02.286335  8718 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:02.352628  8756 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:02.230966  8959 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.307516  8807 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:02.196972  8854 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.216s
I20260709 13:15:02.112035  8949 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.121596  8950 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:02.410071  8872 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:02.449473  8872 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.436681  8732 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.452011  8732 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:02.452109  8872 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:02.453246  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:02.453699  8819 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.453913  6937 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:02.455240  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:02.417290  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2082) took 1494 ms. Trace:
I20260709 13:15:02.417637  9000 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:02.457531  6255 rpcz_store.cc:276] 0709 13:15:00.922922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.951778 (+ 28856us) service_pool.cc:224] Handling call
0709 13:15:02.417082 (+1465304us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54003d0754. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:02.417211 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679425408}
I20260709 13:15:02.442252  8820 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:02.459095  9000 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:02.459152  6255 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:15:02.419482  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:02.459995  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.460294  8820 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:02.460685  6255 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:02.419984  8866 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.110821  8955 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.353072  9008 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:02.430583  8875 consensus_meta.cc:287] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.619s	user 0.006s	sys 0.000s
I20260709 13:15:02.108780  8945 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:02.441152  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 62128.1us
I20260709 13:15:02.442008  8959 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:02.441205  8939 consensus_queue.cc:237] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.446465  8949 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:02.438238  8718 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.471040  9013 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:02.494329  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 612) took 1200 ms. Trace:
I20260709 13:15:02.432976  8719 consensus_queue.cc:1059] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:15:02.472111  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:02.502619  6396 raft_consensus.cc:2393] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:02.437326  8705 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:02.438381  8698 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.481688  6368 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:02.494923  6324 rpcz_store.cc:276] 0709 13:15:01.279777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.282887 (+  3110us) service_pool.cc:224] Handling call
0709 13:15:01.293695 (+ 10808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:01.349265 (+ 55570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:01.349298 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:01.349769 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:15:01.840398 (+490629us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:01.840454 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:01.840544 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:02.480106 (+639562us) raft_consensus.cc:1685] finished
0709 13:15:02.480128 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:02.480240 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32896,"raft.queue_time_us":48982,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"thread_start_us":376329,"threads_started":1,"wal-append.queue_time_us":551499}
I20260709 13:15:02.470494  8866 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.481801  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:02.483472  8955 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:02.483681  8959 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:02.484076  8610 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:02.485633  8945 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:02.486215  6933 raft_consensus.cc:2368] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3.
W20260709 13:15:02.527678  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 312629us
I20260709 13:15:02.443481  8807 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.536900  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:02.466740  8802 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.484699  8756 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.542136  6295 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:02.544870  6398 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:02.545585  6906 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:02.502516  9027 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.479327  8875 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.550359  6295 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:02.562570  6295 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:02.502367  9013 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:02.478552  9008 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.579062  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2092) took 1335 ms. Trace:
I20260709 13:15:02.588408  6251 rpcz_store.cc:276] 0709 13:15:01.243560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.337082 (+ 93522us) service_pool.cc:224] Handling call
0709 13:15:01.348312 (+ 11230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:01.920835 (+572523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.578769 (+657934us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54000f5d54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:02.578985 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137632512}
I20260709 13:15:02.575744  6328 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:02.594081  6256 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:15:02.561534  8955 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:02.608364  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 128526us
W20260709 13:15:02.613196  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.613330  6368 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:02.561717  8959 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:02.617698  8990 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.618223  8990 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.620330  8990 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:02.615630  6369 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:02.563108  8945 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.561393  9031 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:02.605769  8994 log.cc:927] Time spent T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:15:02.587522  9013 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:02.622998  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.627605  6935 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:02.629302  6369 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:02.632982  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:02.587713  8958 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:02.595970  8719 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.631844  8975 raft_consensus.cc:1064] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:15:02.593874  8683 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:02.680162  6251 raft_consensus.cc:2368] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7.
I20260709 13:15:02.684780  6328 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:02.676880  8820 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:02.607182  8804 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:15:02.673851  8946 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:02.639029  8942 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:02.697448  6906 leader_election.cc:400] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7.
I20260709 13:15:02.697872  6906 leader_election.cc:403] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:15:02.681430  9007 consensus_meta.cc:287] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.562s	user 0.022s	sys 0.005s
I20260709 13:15:02.680465  8958 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.718211  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:02.718672  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.719920  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:02.635917  8939 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:15:02.606202  9027 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:02.691737  8959 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:02.724989  6247 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:02.727085  6404 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 469) took 2277 ms (client timeout 2051 ms). Trace:
I20260709 13:15:02.639158  8945 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:02.695995  9001 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:15:02.638842  8977 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:15:02.728092  8958 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.736282  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:02.717212  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:02.707122  8942 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:02.724462  8956 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:02.740397  6404 rpcz_store.cc:269] 0709 13:15:00.418028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.418201 (+   173us) service_pool.cc:224] Handling call
0709 13:15:02.695546 (+2277345us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54001f3454. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:02.695642 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3230033152}
I20260709 13:15:02.718984  8683 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:02.734927  6940 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:02.706442  8820 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.738813  8950 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:02.693949  8719 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.746590  8939 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:02.775616  6324 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:15:02.764062  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 126987us
I20260709 13:15:02.721830  9007 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:02.779124  6247 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
W20260709 13:15:02.782729  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 158601us
I20260709 13:15:02.754638  8942 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:02.790004  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 227509us
I20260709 13:15:02.793484  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:02.794206  6295 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:02.794368  6331 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.783685  6368 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:02.744402  8959 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:02.756985  8819 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:02.851914  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 165988us
I20260709 13:15:02.880673  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:02.886462  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:02.887005  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 103454us
I20260709 13:15:02.887383  6326 raft_consensus.cc:2410] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 11 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:02.894649  6331 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:15:02.776038  8939 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:02.879350  9026 log.cc:927] Time spent T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:15:02.898816  6396 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:02.916785  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:02.900745  6329 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:02.776615  8705 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:02.903609  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:02.807662  8802 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:02.919521  6322 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:02.920555  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:02.807400  8950 consensus_queue.cc:1059] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
W20260709 13:15:02.907578  9047 log.cc:927] Time spent T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:15:02.909339  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:02.909499  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:02.843639  8807 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:02.910890  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:02.760785  8683 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:02.911319  9029 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.887344  8875 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:02.915459  8711 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:02.918298  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:02.915769  6250 raft_consensus.cc:2410] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:15:02.906919  9037 log.cc:927] Time spent T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:15:02.942256  6402 raft_consensus.cc:2393] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:02.931732  6400 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
W20260709 13:15:02.942523  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 147427us
I20260709 13:15:02.929845  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:02.918157  8939 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:02.900497  8946 raft_consensus.cc:697] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:02.959666  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:02.896462  8819 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:03.134512  6396 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.959743  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:02.981267  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 489) took 1075 ms. Trace:
I20260709 13:15:03.138713  6331 raft_consensus.cc:2393] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:15:03.108140  6398 consensus_meta.cc:287] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 13:15:03.146503  6398 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:03.163779  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:03.164495  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:03.160290  6326 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
W20260709 13:15:02.956440  9036 log.cc:927] Time spent T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:15:03.137810  6405 rpcz_store.cc:276] 0709 13:15:01.905502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.905650 (+   148us) service_pool.cc:224] Handling call
0709 13:15:01.921858 (+ 16208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:01.922179 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:01.922211 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:01.934280 (+ 12069us) log.cc:844] Serialized 26 byte log entry
0709 13:15:02.224708 (+290428us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:02.224772 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.224863 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:02.981007 (+756144us) raft_consensus.cc:1685] finished
0709 13:15:02.981028 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:02.981195 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":322,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":6615,"thread_start_us":237074,"threads_started":1,"wal-append.queue_time_us":554324}
W20260709 13:15:02.980876  9038 log.cc:927] Time spent T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:15:03.165032  6331 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
W20260709 13:15:02.980299  9044 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
W20260709 13:15:02.970278  8863 consensus_meta.cc:287] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.903s	user 0.009s	sys 0.001s
W20260709 13:15:02.996538  8805 consensus_meta.cc:287] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.004s
I20260709 13:15:03.165041  6398 raft_consensus.cc:2376] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4. Re-sending same reply.
I20260709 13:15:03.184561  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.184767  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.172472  6326 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:03.173197  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:03.173265  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:03.186975  6397 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.174096  6396 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
W20260709 13:15:03.010722  9014 consensus_meta.cc:287] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.001s
I20260709 13:15:02.985785  9027 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:03.009763  8945 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:03.133638  8719 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:02.958974  8866 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:02.989272  8705 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.185978  6404 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:03.186015  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.210037  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:02.997460  9007 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:03.195010  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:03.176568  8718 consensus_meta.cc:287] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.656s	user 0.003s	sys 0.007s
I20260709 13:15:03.158412  9067 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:15:03.219633  6404 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:03.220916  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:03.221519  6404 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.221858  6405 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:03.210690  6398 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:03.224643  6398 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:03.228621  6397 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:15:03.211095  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:02.930747  9056 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.263s
I20260709 13:15:03.213668  8705 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:03.216830  6396 raft_consensus.cc:3055] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:03.217537  8718 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:03.233289  6396 raft_consensus.cc:740] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:15:03.234117  9040 log.cc:927] Time spent T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.473s	user 0.003s	sys 0.000s
W20260709 13:15:03.234290  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.234941  8718 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:03.236114  9046 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.444s	user 0.000s	sys 0.001s
W20260709 13:15:03.237952  9041 log.cc:927] Time spent T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
W20260709 13:15:03.241806  9043 log.cc:927] Time spent T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
I20260709 13:15:03.210114  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.243116  6398 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:03.243518  6400 raft_consensus.cc:2410] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:15:03.241313  8946 consensus_queue.cc:237] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:03.230978  6404 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:03.234149  6396 consensus_queue.cc:260] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:03.227636  8956 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7.
I20260709 13:15:03.246088  8940 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:03.310123  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.311666  6396 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.192727  8863 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:03.319095  8863 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:03.193169  8805 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:03.320228  8942 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:03.321159  8805 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:03.322832  8958 consensus_meta.cc:287] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.565s	user 0.004s	sys 0.004s
W20260709 13:15:03.323154  9038 log.cc:927] Time spent T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:15:03.324167  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.324512  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.329551  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 505) took 1415 ms. Trace:
I20260709 13:15:03.330137  6254 raft_consensus.cc:2368] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8.
I20260709 13:15:03.337177  8683 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:03.347988  8705 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:03.453625  6253 rpcz_store.cc:276] 0709 13:15:01.914053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.428618 (+514565us) service_pool.cc:224] Handling call
0709 13:15:02.428896 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.432748 (+  3852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.432782 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:02.439228 (+  6446us) log.cc:844] Serialized 26 byte log entry
0709 13:15:02.534483 (+ 95255us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:02.534540 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.534628 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:03.329331 (+794703us) raft_consensus.cc:1685] finished
0709 13:15:03.329350 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:03.329491 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3562,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":3687,"thread_start_us":56023,"threads_started":1,"wal-append.queue_time_us":232911}
I20260709 13:15:03.390486  6396 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:03.459754  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:03.453655  6404 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:03.453603  6400 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:03.457074  8958 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:03.248416  8959 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:03.461982  6396 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:03.451958  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.466089  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.464500  9058 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.329011  8939 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:03.466432  9013 consensus_meta.cc:287] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.785s	user 0.003s	sys 0.006s
I20260709 13:15:03.477506  9060 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.478833  8950 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:03.490374  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:03.491232  6400 raft_consensus.cc:2410] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:03.492029  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.492563  6400 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:03.493745  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:03.494153  8942 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:03.494546  6397 raft_consensus.cc:2410] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:03.495399  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:03.495954  6397 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:03.501119  8950 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:03.503588  8819 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:03.504153  8819 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:03.504741  8819 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:03.478845  9058 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:03.507084  8939 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:03.488613  9060 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:03.489583  9013 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:03.509917  9013 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:03.536931  6397 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:03.546403  8872 raft_consensus.cc:3055] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:03.546864  8872 raft_consensus.cc:740] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:03.547176  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:03.547981  6397 raft_consensus.cc:2410] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:03.547662  8872 consensus_queue.cc:260] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:03.548782  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.552017  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.553011  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.554008  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.555133  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:03.555938  6397 raft_consensus.cc:2410] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:03.556627  6405 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:03.556697  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.557727  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:03.557792  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.558266  6405 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:03.558431  6397 raft_consensus.cc:2368] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8.
I20260709 13:15:03.559188  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.560292  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.561255  6397 raft_consensus.cc:2393] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:03.562134  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.563234  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.563876  6400 raft_consensus.cc:2376] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7. Re-sending same reply.
I20260709 13:15:03.564671  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.565856  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.566919  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.568064  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.569825  6396 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:03.570917  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.572854  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.563205  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.574306  6397 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:03.574481  6402 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:03.573499  6400 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:03.581429  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:03.582086  6328 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:03.582963  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:03.583851  6402 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:03.548785  8872 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:03.587863  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 111544us
W20260709 13:15:03.589195  6249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2097) took 1674 ms (client timeout 1962 ms). Trace:
W20260709 13:15:03.589623  6249 rpcz_store.cc:269] 0709 13:15:01.915048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.076901 (+161853us) service_pool.cc:224] Handling call
0709 13:15:03.589010 (+1512109us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b540036ae54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:03.589113 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809811200}
W20260709 13:15:03.594558  6252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2090) took 2637 ms (client timeout 2247 ms). Trace:
I20260709 13:15:03.594496  8946 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:03.595326  6252 rpcz_store.cc:269] 0709 13:15:00.955374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.128861 (+173487us) service_pool.cc:224] Handling call
0709 13:15:03.592158 (+2463297us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54000e3dd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:03.592290 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2196043008}
I20260709 13:15:03.606503  6906 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
W20260709 13:15:03.606782  6256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 501) took 1693 ms (client timeout 1664 ms). Trace:
W20260709 13:15:03.607198  6256 rpcz_store.cc:269] 0709 13:15:01.912952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.913071 (+   119us) service_pool.cc:224] Handling call
0709 13:15:03.606645 (+1693574us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54003b24d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:03.606728 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550813056}
I20260709 13:15:03.594834  8958 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:03.610212  9029 consensus_meta.cc:287] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.649s	user 0.006s	sys 0.003s
I20260709 13:15:03.617713  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:03.613703  8950 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:03.608438  9060 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:03.663201  9029 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:03.669909  6404 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:03.616854  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:03.620663  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:03.630728  6328 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.734041  6405 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:03.739502  6405 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:15:03.739986  6405 pending_rounds.cc:85] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 5
I20260709 13:15:03.740278  6405 pending_rounds.cc:107] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:15:03.740574  6405 raft_consensus.cc:2889] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:03.745760  6328 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:15:03.609849  9058 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:03.606282  8946 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:03.750639  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:03.616289  8945 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:03.647550  8698 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:03.755410  8364 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:03.762141  6405 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:03.772927  6405 raft_consensus.cc:1240] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:15:03.779498  8946 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:03.771189  6906 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.664s (SENT) [suppressed 16 similar messages]
W20260709 13:15:03.785643  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 1.10431e+06us
W20260709 13:15:03.788906  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:03.789806  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.789882  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 511) took 1114 ms. Trace:
I20260709 13:15:03.790475  6251 rpcz_store.cc:276] 0709 13:15:02.675150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.755713 (+ 80563us) service_pool.cc:224] Handling call
0709 13:15:02.756000 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.789396 (+1033396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:03.789441 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:03.789502 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:03.789554 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.789641 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:03.789809 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1033017}
I20260709 13:15:03.792407  6907 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:03.792793  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:03.793453  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.802177  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:03.804071  6328 raft_consensus.cc:2368] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3.
I20260709 13:15:03.791953  8870 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:03.806048  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:03.814005  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.807711  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:03.817524  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:03.821645  6328 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:03.823240  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:03.823987  6325 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.816243  9042 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.829815  9042 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:03.830113  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:03.830423  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:03.831117  6331 raft_consensus.cc:2393] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:03.832247  9042 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:03.833340  9079 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:03.833523  9057 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:03.833979  9057 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:03.836421  9057 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:03.837525  9012 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.838266  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:03.838848  6938 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:03.824685  8974 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.840284  8974 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:03.842528  9077 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.843027  9077 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:03.843535  8866 raft_consensus.cc:1064] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:15:03.838063  9012 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:03.833921  9079 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:03.847060  9049 log.cc:927] Time spent T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.935s	user 0.009s	sys 0.006s
I20260709 13:15:03.808595  9074 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:03.849284  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2104) took 1218 ms. Trace:
I20260709 13:15:03.849505  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:03.849707  6250 rpcz_store.cc:276] 0709 13:15:02.630894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.635354 (+  4460us) service_pool.cc:224] Handling call
0709 13:15:03.848997 (+1213643us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b54000f5854. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:03.849226 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122124672}
I20260709 13:15:03.850307  9077 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:03.812546  8870 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:03.850937  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:03.851541  6331 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:15:03.854115  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:03.854842  6328 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:03.854815  6325 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:03.855549  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:03.856122  6936 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:03.859566  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:03.860136  8866 consensus_queue.cc:237] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:03.864866  9079 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:03.865325  6402 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:03.865828  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:03.894450  6936 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:03.895429  6402 raft_consensus.cc:1275] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 13:15:03.895483  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 90499.5us
I20260709 13:15:03.881803  8870 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:03.895777  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:03.887835  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:03.892571  6328 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:03.896885  6907 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:03.893273  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:03.885694  6942 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:03.898528  6331 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:15:03.895936  6402 pending_rounds.cc:85] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 3
I20260709 13:15:03.899972  6402 pending_rounds.cc:107] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:15:03.900388  6402 raft_consensus.cc:2889] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:03.902849  6907 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:03.903050  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:03.904456  9080 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:03.905180  9080 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.906216  9080 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:03.904465  6402 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:03.909216  6402 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:03.912030  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:03.910538  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:03.913030  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:03.913522  9057 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:03.914088  6250 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 4: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:03.914192  9057 raft_consensus.cc:697] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:03.915266  9057 consensus_queue.cc:237] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:03.910825  6222 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:03.917544  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:03.918478  6252 raft_consensus.cc:2410] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:03.918648  6222 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:03.919179  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:03.919811  6251 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:03.920493  6405 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:15:03.920884  6405 pending_rounds.cc:85] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 3
I20260709 13:15:03.921145  6405 pending_rounds.cc:107] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:15:03.921362  6405 raft_consensus.cc:2889] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:03.922421  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:03.923123  6397 raft_consensus.cc:2368] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5.
I20260709 13:15:03.924111  6397 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:15:03.985352  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 164510us
I20260709 13:15:04.098127  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2331) took 1213 ms. Trace:
I20260709 13:15:04.093369  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2335) took 1174 ms. Trace:
I20260709 13:15:04.106313  6219 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:04.047760  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 1963) took 1132 ms. Trace:
I20260709 13:15:04.040355  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:04.131573  6256 raft_consensus.cc:1240] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:04.136988  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:04.082614  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:04.141284  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.138921  6398 rpcz_store.cc:276] 0709 13:15:02.916101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.225723 (+309622us) service_pool.cc:224] Handling call
0709 13:15:03.226064 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.243641 (+ 17577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.047441 (+803800us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b54003769d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:04.047673 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37804928}
I20260709 13:15:03.924289  6402 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:04.140892  6400 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:03.938086  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:04.137109  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:04.146238  6404 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
W20260709 13:15:04.147514  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.981231  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:04.150194  6253 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:03.969743  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:03.991950  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:04.152588  6396 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:04.136821  6329 rpcz_store.cc:276] 0709 13:15:02.884808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.918201 (+ 33393us) service_pool.cc:224] Handling call
0709 13:15:02.949427 (+ 31226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:02.949692 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:03.162108 (+212416us) log.cc:844] Serialized 14 byte log entry
0709 13:15:03.852078 (+689970us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b1800196420. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f457578523a 00007f4575befa2a
0709 13:15:04.097696 (+245618us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:04.097775 (+    79us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:04.097838 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.097925 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.098063 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178353,"prepare.queue_time_us":212429,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":175776,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":89,"spinlock_wait_cycles":12131712,"thread_start_us":70795,"threads_started":1,"wal-append.queue_time_us":745957}
I20260709 13:15:04.137081  6324 rpcz_store.cc:276] 0709 13:15:02.918504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.959225 (+ 40721us) service_pool.cc:224] Handling call
0709 13:15:03.133061 (+173836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.133365 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:03.173628 (+ 40263us) log.cc:844] Serialized 14 byte log entry
0709 13:15:04.092930 (+919302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:04.092996 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:04.093057 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.093157 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.093297 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":894986,"prepare.queue_time_us":40310,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":862837,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"thread_start_us":56923,"threads_started":1,"wal-append.queue_time_us":295826}
I20260709 13:15:04.056665  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2320) took 2018 ms. Trace:
I20260709 13:15:03.892207  8999 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.891984  9042 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:04.155035  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 48820.2us
I20260709 13:15:04.156391  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:04.152837  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:04.127146  6296 connection.cc:256] RPC call timeout handler was delayed by -1.3374562490000699s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260709 13:15:03.918651  9023 log.cc:927] Time spent T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 1.378s	user 0.006s	sys 0.019s
I20260709 13:15:04.168742  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:04.170449  6328 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:15:04.127579  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:04.173636  6247 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:04.174067  6251 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:04.176033  6942 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:04.154709  6323 rpcz_store.cc:276] 0709 13:15:02.038136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.053223 (+ 15087us) service_pool.cc:224] Handling call
0709 13:15:02.053617 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:02.345364 (+291747us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:02.463657 (+118293us) log.cc:844] Serialized 14 byte log entry
0709 13:15:03.162144 (+698487us) log.cc:844] Serialized 14 byte log entry
0709 13:15:04.056058 (+893914us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b18003012a0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572a72c0a 00007f457c1b2219 00007f4572afaa40 00007f4572af54e4 00007f4572af5455 00007f4575bdd060 00007f4575bef716 00007f4575c00287 00007f4575c00208
0709 13:15:04.056254 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:04.056315 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:04.056358 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.056448 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.056598 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":218722,"prepare.queue_time_us":422280,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":85,"raft.queue_time_us":1192386,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":12742,"spinlock_wait_cycles":4050304,"thread_start_us":607049,"threads_started":3,"wal-append.queue_time_us":254869}
W20260709 13:15:03.978152  9017 log.cc:927] Time spent T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.897s	user 0.003s	sys 0.018s
W20260709 13:15:03.968360  9085 log.cc:927] Time spent T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:15:04.119693  9053 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 1.223s	user 0.000s	sys 0.018s
I20260709 13:15:04.178838  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:04.041986  8464 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:04.128077  9020 log.cc:927] Time spent T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 2.051s	user 0.006s	sys 0.027s
I20260709 13:15:04.181851  6219 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:04.093477  8974 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:04.057727  8711 raft_consensus.cc:697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:04.159245  8718 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:03.902601  8945 raft_consensus.cc:697] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:03.930648  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:04.186686  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:04.188253  6295 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:04.227316  6250 raft_consensus.cc:2393] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:04.052351  9054 raft_consensus.cc:3055] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:15:04.230795  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:04.231485  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:04.231876  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.190654  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:03.937668  9079 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:04.241991  9079 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.940023  8870 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:04.242420  9079 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:04.242843  8870 raft_consensus.cc:697] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:04.243713  8870 consensus_queue.cc:237] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:04.245492  6940 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 552) took 2275 ms (client timeout 2425 ms). Trace:
W20260709 13:15:04.245687  9018 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 2.180s	user 0.010s	sys 0.010s
I20260709 13:15:04.245736  6941 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:04.204190  9013 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
W20260709 13:15:04.246425  6254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 504) took 2332 ms (client timeout 1683 ms). Trace:
I20260709 13:15:04.246773  9013 consensus_queue.cc:1243] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer a13ffe92eb374309a5c8476d9fbbb2b8 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:15:04.246799  6254 rpcz_store.cc:269] 0709 13:15:01.913770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.913891 (+   121us) service_pool.cc:224] Handling call
0709 13:15:04.246224 (+2332333us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400356e54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:04.246358 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3203810048}
I20260709 13:15:04.247471  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 487) took 2488 ms. Trace:
I20260709 13:15:04.248066  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 511) took 1066 ms. Trace:
I20260709 13:15:03.934342  8756 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:04.249902  6154 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55342 (request call id 348) took 13632 ms (client timeout 15000 ms). Trace:
I20260709 13:15:04.250005  6150 catalog_manager.cc:5697] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 6, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 6 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.251653  6150 catalog_manager.cc:5697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 4, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 4 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.097460  9007 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.057958  8794 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:03.973305  8820 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:04.082362  9051 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.978721  9029 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:04.098666  9001 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:04.043972  6934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 509) took 1458 ms. Trace:
I20260709 13:15:04.207280  6219 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:04.231140  6933 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 569) took 2583 ms (client timeout 1501 ms). Trace:
I20260709 13:15:04.182657  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:04.093638  9012 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:03.932955  8819 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:04.024210  9031 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:04.183559  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:04.323936  6402 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:15:04.228794  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:04.189994  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:04.324620  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:04.233767  6249 raft_consensus.cc:1240] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:04.234054  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:04.325469  6396 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:04.325855  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:04.326208  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:04.326992  6251 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:04.328063  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:04.329664  6251 raft_consensus.cc:1240] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:15:04.330411  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:04.330910  6251 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:04.178349  8999 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:04.309944  6933 rpcz_store.cc:269] 0709 13:15:01.623800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.625206 (+  1406us) service_pool.cc:224] Handling call
0709 13:15:04.177831 (+2552625us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54005627d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:04.205063 (+ 27232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1816928128}
I20260709 13:15:04.342938  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:04.343101  8999 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:04.236171  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:04.344105  6936 raft_consensus.cc:2368] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3.
I20260709 13:15:04.344182  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:04.231001  9054 raft_consensus.cc:740] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:04.233506  9067 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:04.345240  9031 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.345825  9067 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:04.346065  6938 consensus_meta.cc:287] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.002s
I20260709 13:15:04.346271  9067 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:04.346432  6938 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:04.347494  9031 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:04.237252  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 488) took 2348 ms. Trace:
I20260709 13:15:04.347797  6938 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:04.237991  9008 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:04.348913  9076 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:04.222923  8464 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.238446  9080 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.239419  6221 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:04.350881  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 111536us
I20260709 13:15:04.351864  8464 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:04.293988  9007 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:04.352763  6221 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:04.354534  9007 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:04.354774  6221 leader_election.cc:400] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8.
I20260709 13:15:04.311468  8820 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:04.355083  6221 leader_election.cc:403] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:04.355306  8820 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:04.355688  9013 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:04.355902  6221 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:04.356242  9013 raft_consensus.cc:697] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:04.239621  6252 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:04.357298  8718 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:04.240959  6939 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 550) took 2357 ms (client timeout 1815 ms). Trace:
W20260709 13:15:04.357802  6939 rpcz_store.cc:269] 0709 13:15:01.883139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.891705 (+  8566us) service_pool.cc:224] Handling call
0709 13:15:04.240762 (+2349057us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b540069f354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:04.240891 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1841445632}
I20260709 13:15:04.358350  9077 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:04.241031  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 617) took 2563 ms. Trace:
I20260709 13:15:04.359031  6327 rpcz_store.cc:276] 0709 13:15:01.677483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.713739 (+ 36256us) service_pool.cc:224] Handling call
0709 13:15:01.721068 (+  7329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:01.730661 (+  9593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:01.730710 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:01.771030 (+ 40320us) log.cc:844] Serialized 26 byte log entry
0709 13:15:01.996444 (+225414us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:01.996485 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:01.996550 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:04.127486 (+2130936us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:04.240774 (+113288us) raft_consensus.cc:1685] finished
0709 13:15:04.240792 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.240975 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45964,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":6855,"spinlock_wait_cycles":14334720,"thread_start_us":185347,"threads_started":1,"wal-append.queue_time_us":293860}
I20260709 13:15:04.248047  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:04.360970  6254 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 2.
I20260709 13:15:04.361399  6250 raft_consensus.cc:2368] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8.
W20260709 13:15:04.180003  6296 connection.cc:256] RPC call timeout handler was delayed by -1.3086562490000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 13:15:04.362031  6296 connection.cc:256] RPC call timeout handler was delayed by -1.1467588749999322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
I20260709 13:15:03.933691  9084 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.290s
I20260709 13:15:04.247843  6401 rpcz_store.cc:276] 0709 13:15:01.758747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.760047 (+  1300us) service_pool.cc:224] Handling call
0709 13:15:01.760427 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:01.760847 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:01.760884 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:01.771582 (+ 10698us) log.cc:844] Serialized 52 byte log entry
0709 13:15:02.014381 (+242799us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:02.019167 (+  4786us) log.cc:844] Serialized 14 byte log entry
0709 13:15:02.232997 (+213830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.233099 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:04.169392 (+1936293us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:04.247214 (+ 77822us) raft_consensus.cc:1685] finished
0709 13:15:04.247301 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.247420 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3994,"prepare.queue_time_us":9862,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":70226,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":7271,"spinlock_wait_cycles":5507840,"thread_start_us":423732,"threads_started":2,"wal-append.queue_time_us":277419}
I20260709 13:15:04.255127  6941 rpcz_store.cc:276] 0709 13:15:03.181366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.181536 (+   170us) service_pool.cc:224] Handling call
0709 13:15:04.245430 (+1063894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:04.246281 (+   851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.247891 (+  1610us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003f6950. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:04.248012 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2446020992}
W20260709 13:15:04.253144  6940 rpcz_store.cc:269] 0709 13:15:01.970091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.970243 (+   152us) service_pool.cc:224] Handling call
0709 13:15:04.245294 (+2275051us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b54003f6954. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:04.245433 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1756105088}
I20260709 13:15:04.255872  6150 catalog_manager.cc:5697] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 4 to 5, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 5 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:04.264106  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 169091us
W20260709 13:15:04.271363  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.224939  8863 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:04.232276  8974 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.304335  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:04.231647  8705 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:04.207834  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:04.250360  6154 rpcz_store.cc:269] 0709 13:14:50.617580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.653420 (+ 35840us) service_pool.cc:224] Handling call
0709 13:15:04.249840 (+13596420us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:00.281970 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:00.300717 (+ 18747us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:00.300765 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:15:00.300793 (+    28us) tablet.cc:662] Decoding operations
0709 13:15:00.301503 (+   710us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:00.301594 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:00.301634 (+    40us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:15:00.302364 (+   730us) tablet.cc:701] Row locks acquired
0709 13:15:00.302416 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:15:00.302570 (+   154us) write_op.cc:270] Start()
0709 13:15:00.302703 (+   133us) write_op.cc:276] Timestamp: P: 1783602900302505 usec, L: 0
0709 13:15:00.302725 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:15:00.303470 (+   745us) log.cc:844] Serialized 2050 byte log entry
0709 13:15:00.628522 (+325052us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f4572adb0ac 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b
0709 13:15:01.209540 (+581018us) op_driver.cc:464] REPLICATION: finished
0709 13:15:01.507110 (+297570us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f4572adb0ac 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457961bef0
0709 13:15:01.925523 (+418413us) write_op.cc:301] APPLY: starting
0709 13:15:01.937818 (+ 12295us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:01.989952 (+ 52134us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:01.993450 (+  3498us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:02.084205 (+ 90755us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:02.084502 (+   297us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:15:02.084545 (+    43us) write_op.cc:312] APPLY: finished
0709 13:15:02.084827 (+   282us) log.cc:844] Serialized 47 byte log entry
0709 13:15:02.084998 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:02.085091 (+    93us) write_op.cc:454] Released schema lock
0709 13:15:02.085168 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:02.085564 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:02.085590 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3623640,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":676639,"apply.run_cpu_time_us":3282,"apply.run_wall_time_us":181745,"num_ops":5,"prepare.queue_time_us":259022,"prepare.run_cpu_time_us":64622,"prepare.run_wall_time_us":497082,"raft.queue_time_us":271817,"raft.run_cpu_time_us":48621,"raft.run_wall_time_us":692842,"replication_time_us":906595,"spinlock_wait_cycles":29319168,"thread_start_us":1481982,"threads_started":4,"wal-append.queue_time_us":505675,"wal-append.run_cpu_time_us":55894,"wal-append.run_wall_time_us":2299302}]]}
W20260709 13:15:04.307260  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 100045us
I20260709 13:15:04.458562  6219 leader_election.cc:400] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3.
I20260709 13:15:04.458972  6219 leader_election.cc:403] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:04.326923  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:04.452769  6150 catalog_manager.cc:5697] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.352322  9080 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:04.239674  8711 consensus_queue.cc:237] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:04.188244  9042 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:04.361954  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:04.333964  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:04.501456  6396 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:04.502447  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:04.503166  6396 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
W20260709 13:15:04.362473  6296 connection.cc:256] RPC call timeout handler was delayed by -1.0323562490000313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2472s for a response
W20260709 13:15:04.504578  6296 connection.cc:256] RPC call timeout handler was delayed by -1.0300634440000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
I20260709 13:15:04.057880  9063 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.165s
I20260709 13:15:04.364106  6221 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:04.559283  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 195262us
I20260709 13:15:04.532593  9007 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.365566  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:04.306952  9088 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:04.454849  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.455833  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:04.457561  6404 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:04.537142  9065 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.564826  6401 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:04.566265  6400 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:04.460282  6247 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
W20260709 13:15:04.461205  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 291956us
I20260709 13:15:04.475474  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1356) took 2828 ms. Trace:
I20260709 13:15:04.355722  8820 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:04.330355  9074 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:04.348179  6399 rpcz_store.cc:276] 0709 13:15:01.888399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.888576 (+   177us) service_pool.cc:224] Handling call
0709 13:15:01.888965 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:01.897625 (+  8660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:01.897671 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:01.909957 (+ 12286us) log.cc:844] Serialized 26 byte log entry
0709 13:15:02.343608 (+433651us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:02.343656 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.346602 (+  2946us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:03.918062 (+1571460us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:04.236928 (+318866us) raft_consensus.cc:1685] finished
0709 13:15:04.236949 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.237176 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5453,"spinlock_wait_cycles":4338432,"thread_start_us":281428,"threads_started":1,"wal-append.queue_time_us":544646}
I20260709 13:15:04.309067  9029 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.479195  8805 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:04.484714  9031 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:04.587659  6905 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:04.589826  6905 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:04.461256  6150 catalog_manager.cc:5697] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 4, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 4 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:04.506384  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:04.461663  8863 raft_consensus.cc:697] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:04.514997  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:04.516043  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:04.318771  8794 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:04.522924  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:04.596112  6323 raft_consensus.cc:2410] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:04.596940  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:04.505383  9090 log.cc:927] Time spent T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:15:04.311779  9001 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:04.530260  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:04.569653  8718 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8.
I20260709 13:15:04.532884  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:04.602672  6327 raft_consensus.cc:2393] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:04.462224  8974 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:04.307578  9051 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:04.536564  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:04.460440  8705 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.518464  9027 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:04.541414  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 77528us
I20260709 13:15:04.518716  8959 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.518877  8683 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:04.373152  9013 consensus_queue.cc:237] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:04.592986  6150 catalog_manager.cc:5697] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 2 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:04.307137  8975 consensus_queue.cc:237] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.612830  6219 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:04.605867  8863 consensus_queue.cc:237] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:04.613708  9098 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:04.613336  6150 catalog_manager.cc:5697] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 4 to 5, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 5 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:04.614167  9098 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.614594  9098 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:04.522406  8958 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:04.616935  8958 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:04.530882  9056 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:04.529452  8807 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:04.619223  9077 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:04.619387  9056 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.619509  8807 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.560230  6221 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:04.452077  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.614887  6150 catalog_manager.cc:5697] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 4 to 6, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 6 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.479302  8945 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.623772  6219 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:04.639917  6219 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:04.539600  9071 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:04.567564  6248 rpcz_store.cc:276] 0709 13:15:01.633020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.633147 (+   127us) service_pool.cc:224] Handling call
0709 13:15:01.663237 (+ 30090us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:01.663569 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:01.663593 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:01.664082 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:15:01.916221 (+252139us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:02.059699 (+143478us) log.cc:844] Serialized 14 byte log entry
0709 13:15:02.066332 (+  6633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.066411 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:03.977546 (+1911135us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:04.366221 (+388675us) raft_consensus.cc:1685] finished
0709 13:15:04.460762 (+ 94541us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.460950 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15959,"prepare.queue_time_us":446622,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":47,"raft.queue_time_us":17562,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":172,"spinlock_wait_cycles":21348608,"thread_start_us":366746,"threads_started":2,"wal-append.queue_time_us":346610}
I20260709 13:15:04.573371  6253 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:04.573524  9100 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:04.575196  9091 log.cc:927] Time spent T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:15:04.308854  6934 rpcz_store.cc:276] 0709 13:15:02.585196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.587657 (+  2461us) service_pool.cc:224] Handling call
0709 13:15:02.679573 (+ 91916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:02.696540 (+ 16967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.717351 (+ 20811us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:02.722238 (+  4887us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:02.729357 (+  7119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.043615 (+1314258us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b54005d52d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:04.043682 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.043871 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6120832}
I20260709 13:15:04.582671  6400 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:04.564810  8999 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:04.599701  6329 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:04.531226  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:04.670189  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 74599.5us
I20260709 13:15:04.671296  6326 raft_consensus.cc:2410] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:04.583323  9065 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:04.624881  6331 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:15:04.631145  6323 raft_consensus.cc:2410] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:15:04.638176  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 78065.9us
W20260709 13:15:04.655664  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 53133.3us
I20260709 13:15:04.608436  9080 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:04.638494  6150 catalog_manager.cc:5697] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.660097  6296 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:04.571167  9007 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.671953  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2283) took 1180 ms. Trace:
I20260709 13:15:04.684984  6150 catalog_manager.cc:5697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 5, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 5 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.664742  9077 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:04.600484  9064 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:04.678408  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:04.695690  6326 raft_consensus.cc:2393] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:04.585727  9074 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.697120  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:04.697916  6326 raft_consensus.cc:2410] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:04.681735  6905 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:04.699095  6905 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:04.661159  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:04.672120  6369 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:04.702179  6369 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:04.703631  6253 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:04.706581  6328 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:04.664803  8872 raft_consensus.cc:1027] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: attempt to promote peer 8600a3fead0e48a7aa813822ec44d0fe: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:15:04.693271  6405 rpcz_store.cc:276] 0709 13:15:03.491836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.922070 (+430234us) service_pool.cc:224] Handling call
0709 13:15:04.671289 (+749219us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b5800102f98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abbefc0 00007f457aba9929 00007f457aba93d2 00007f4574120bd4
0709 13:15:04.671473 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:04.671643 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:04.671670 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:04.671713 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:04.671751 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.671802 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.671902 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11332992}
I20260709 13:15:04.621088  8805 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3.
I20260709 13:15:04.681160  6330 raft_consensus.cc:1240] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:15:04.694139  6150 catalog_manager.cc:5697] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 6, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 6 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.576128  9088 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.664963  8610 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:04.708086  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:04.601373  9031 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.698320  9077 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.608174  9094 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:15:04.718240  6150 catalog_manager.cc:5697] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 4 to 6, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 6 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.719337  9112 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:04.719496  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 59509.2us
I20260709 13:15:04.664919  8683 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.655849  9027 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.669327  9084 consensus_queue.cc:1059] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:15:04.744441  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:04.745234  6405 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:04.727600  6326 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:15:04.709271  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:04.708410  9064 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:04.754803  9048 log.cc:927] Time spent T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 2.020s	user 0.006s	sys 0.018s
I20260709 13:15:04.755174  9027 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:04.755576  9088 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:04.755757  9027 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:04.756199  9027 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.756446  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2103) took 2731 ms. Trace:
I20260709 13:15:04.717867  9056 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:04.699196  8999 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:04.695518  9080 raft_consensus.cc:697] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:04.728571  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:04.683257  9071 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.713212  8848 raft_consensus.cc:1027] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: attempt to promote peer 8600a3fead0e48a7aa813822ec44d0fe: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:15:04.713689  8464 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:04.686118  8819 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:15:04.738525  6150 catalog_manager.cc:5697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 3, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.807687  6150 catalog_manager.cc:5697] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 2 to 3, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.738786  6296 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:04.809813  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 71092.8us
I20260709 13:15:04.810796  6296 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:04.812117  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:04.678072  9079 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.726792  9076 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:04.728389  8610 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.748688  6327 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
W20260709 13:15:04.821696  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 49555.9us
I20260709 13:15:04.822117  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:04.728562  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 88747.7us
I20260709 13:15:04.822650  6905 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:04.823304  6219 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:04.756856  6255 rpcz_store.cc:276] 0709 13:15:02.025502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.461747 (+436245us) service_pool.cc:224] Handling call
0709 13:15:02.473326 (+ 11579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.473899 (+   573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.473945 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:02.474462 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:15:02.600891 (+126429us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:02.675436 (+ 74545us) log.cc:844] Serialized 14 byte log entry
0709 13:15:03.780208 (+1104772us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b18000b0260. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572a72c0a 00007f457c1b2219 00007f4572afaa40 00007f4572af54e4 00007f4572af5455 00007f4575bdd060 00007f4575bef716 00007f4575c00287 00007f4575c00208
0709 13:15:03.780417 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.780519 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:04.754195 (+973676us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:04.756233 (+  2038us) raft_consensus.cc:1685] finished
0709 13:15:04.756254 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.756385 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49127,"prepare.queue_time_us":74389,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2589,"raft.queue_time_us":1111860,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":32751,"spinlock_wait_cycles":15537792,"thread_start_us":77081,"threads_started":1,"wal-append.queue_time_us":191242}
I20260709 13:15:04.736488  9077 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:04.670711  9100 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.756554  9027 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:04.656515  8959 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.725518  9008 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:15:04.776616  6941 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:04.709887  9106 consensus_queue.cc:1059] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:15:04.780148  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:04.780378  9007 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:04.725790  8863 consensus_queue.cc:1059] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:15:04.792762  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:04.804425  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:04.736277  8805 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:15:04.826283  6296 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:04.820176  9076 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:04.824110  6219 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:04.833835  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:04.839293  6405 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:04.843019  6256 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:04.803766  8999 raft_consensus.cc:697] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:04.818181  9042 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:04.820418  9056 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:04.829648  8610 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:04.892810  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:04.853958  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 131014us
I20260709 13:15:04.829936  9112 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:15:04.897405  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 72253us
I20260709 13:15:04.899974  6221 leader_election.cc:400] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5.
I20260709 13:15:04.834617  9088 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:15:04.855695  9094 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:04.857918  9029 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:04.872996  9007 raft_consensus.cc:2764] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:15:04.871372  9076 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:04.922603  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 218866us
W20260709 13:15:04.926021  9097 log.cc:927] Time spent T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:15:04.927106  9107 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:04.927659  9107 raft_consensus.cc:697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:04.927829  9075 raft_consensus.cc:3055] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:04.928265  9075 raft_consensus.cc:740] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:04.928547  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2333) took 2039 ms. Trace:
I20260709 13:15:04.929076  9075 consensus_queue.cc:260] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.928969  6322 rpcz_store.cc:276] 0709 13:15:02.888808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.921519 (+ 32711us) service_pool.cc:224] Handling call
0709 13:15:02.921789 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.941916 (+ 20127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.941946 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:02.965785 (+ 23839us) log.cc:844] Serialized 26 byte log entry
0709 13:15:04.128045 (+1162260us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b1800366940. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:15:04.597960 (+469915us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:04.598027 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.598147 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:04.928267 (+330120us) raft_consensus.cc:1685] finished
0709 13:15:04.928286 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.928488 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1890,"raft.queue_time_us":31945,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":158932,"spinlock_wait_cycles":17984256,"thread_start_us":469695,"threads_started":1,"wal-append.queue_time_us":1604301}
I20260709 13:15:04.930248  9100 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:04.930572  9075 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:04.900959  8974 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:04.931380  6322 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:04.932451  6322 raft_consensus.cc:1240] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:04.935047  9076 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.938671  9076 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:04.939671  9065 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:04.940457  9105 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:04.899967  8705 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:04.941222  9093 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.941746  9093 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.941866  8705 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:04.903102  9080 consensus_queue.cc:237] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:04.943857  9093 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:04.951879  6329 raft_consensus.cc:2410] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:04.959088  6221 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:04.971531  6326 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:15:04.972611  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 47997.7us
I20260709 13:15:04.976327  6401 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:04.981808  6221 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:04.905622  9042 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:04.982913  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 160359us
I20260709 13:15:04.983129  6907 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:04.904779  9094 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:05.000201  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:04.921770  9001 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:05.011289  6221 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:04.990878  8974 raft_consensus.cc:3055] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:05.036293  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:05.014782  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 112923us
I20260709 13:15:05.003137  9094 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.008648  9031 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:04.922012  9112 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:15:04.996068  9100 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:05.008700  9008 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:05.013080  9126 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:04.928561  9107 consensus_queue.cc:237] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:05.127120  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:05.015993  9042 raft_consensus.cc:697] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:05.026168  8974 raft_consensus.cc:740] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:05.139007  6327 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
W20260709 13:15:05.124109  9098 consensus_meta.cc:287] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.012s
I20260709 13:15:05.016239  9013 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:15:05.015730  8863 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 13:15:05.136983  8683 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:05.131282  9126 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:05.136161  9100 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:05.125366  8805 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:05.119498  9074 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:05.136668  9067 consensus_meta.cc:287] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.785s	user 0.008s	sys 0.004s
W20260709 13:15:05.155287  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 117221us
W20260709 13:15:05.178205  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.147509  9027 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:05.016641  8999 consensus_queue.cc:237] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:05.191028  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 504) took 1252 ms. Trace:
I20260709 13:15:05.155647  9008 raft_consensus.cc:697] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:05.195322  6905 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:05.157346  9079 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:05.196276  6397 rpcz_store.cc:276] 0709 13:15:03.938288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.160108 (+221820us) service_pool.cc:224] Handling call
0709 13:15:04.160492 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:04.160904 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:04.190608 (+ 29704us) log.cc:844] Serialized 14 byte log entry
0709 13:15:05.190343 (+999735us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b18004b5800. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f457578d4bc 00007f4572adb48b 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f457578523a
0709 13:15:05.190564 (+   221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:05.190632 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:05.190698 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.190800 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.190955 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43440,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1004,"spinlock_wait_cycles":4222848,"thread_start_us":70679,"threads_started":1,"wal-append.queue_time_us":121940}
W20260709 13:15:05.201308  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 357568us
I20260709 13:15:05.153950  9130 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:05.185228  9071 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:05.213918  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.185664  9126 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.216418  6403 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 6. Ops: []
I20260709 13:15:05.217971  6403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2263) took 1737 ms. Trace:
I20260709 13:15:05.218369  6403 rpcz_store.cc:276] 0709 13:15:03.480697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.480825 (+   128us) service_pool.cc:224] Handling call
0709 13:15:05.215187 (+1734362us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b5800102f98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abbefc0 00007f457aba9929 00007f457aba93d2 00007f4574120bd4
0709 13:15:05.215392 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.217674 (+  2282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.217902 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18084480}
I20260709 13:15:05.220834  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:05.216925  9042 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:05.165809  9098 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:05.211709  9130 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.214501  9074 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:05.194711  9067 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
W20260709 13:15:05.259316  8820 consensus_meta.cc:287] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.001s
I20260709 13:15:05.267563  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:05.272246  9115 log.cc:927] Time spent T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:15:05.213043  8974 consensus_queue.cc:260] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:05.272661  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:05.834210  6936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 583) took 2016 ms. Trace:
I20260709 13:15:05.681252  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2105) took 1525 ms. Trace:
I20260709 13:15:06.192027  6253 rpcz_store.cc:276] 0709 13:15:04.155915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.186141 (+ 30226us) service_pool.cc:224] Handling call
0709 13:15:05.681031 (+1494890us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400147dd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:05.681182 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795254016}
I20260709 13:15:05.384779  6934 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:05.258590  9074 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.672580  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1281) took 1135 ms. Trace:
I20260709 13:15:06.195292  9074 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:05.463106  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:05.675127  8807 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:06.196472  6938 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:15:05.678169  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:05.831372  9108 raft_consensus.cc:3055] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:06.197826  6325 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:06.198103  9108 raft_consensus.cc:740] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:06.199397  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:06.200342  6325 raft_consensus.cc:2393] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:15:05.330075  8464 consensus_meta.cc:287] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.509s	user 0.002s	sys 0.007s
I20260709 13:15:06.218936  8464 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:06.219774  9122 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.220257  9122 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:06.200421  9108 consensus_queue.cc:260] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:06.221406  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2359) took 1016 ms. Trace:
I20260709 13:15:06.221746  6325 rpcz_store.cc:276] 0709 13:15:05.205066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.199068 (+994002us) service_pool.cc:224] Handling call
0709 13:15:06.221344 (+ 22276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.222641  9122 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:06.222800  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:06.223377  6325 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:05.680084  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1274) took 1166 ms. Trace:
W20260709 13:15:06.207005  6329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.192s	user 0.003s	sys 0.015s
W20260709 13:15:06.202028  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 1.19072e+06us
I20260709 13:15:05.666257  9051 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:06.224591  9100 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:05.676853  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 513) took 1367 ms. Trace:
I20260709 13:15:05.323916  9123 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:06.225788  6221 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:06.225798  6404 rpcz_store.cc:276] 0709 13:15:04.309480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.589035 (+279555us) service_pool.cc:224] Handling call
0709 13:15:04.603562 (+ 14527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:04.833619 (+230057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:04.833648 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:04.833687 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:04.833716 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.676590 (+842874us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400184054. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:05.676641 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.676780 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528668928}
I20260709 13:15:06.227416  8870 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:06.227566  9014 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:06.191766  6936 rpcz_store.cc:276] 0709 13:15:03.818120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.344698 (+526578us) service_pool.cc:224] Handling call
0709 13:15:04.344997 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:04.367299 (+ 22302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:04.367340 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:04.460145 (+ 92805us) log.cc:844] Serialized 26 byte log entry
0709 13:15:04.566574 (+106429us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:04.566631 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.833681 (+1267050us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b5400663ad4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:05.833751 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:05.833813 (+    62us) raft_consensus.cc:1685] finished
0709 13:15:05.833833 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.834131 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14664,"raft.queue_time_us":5181,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":9707,"spinlock_wait_cycles":41424256,"thread_start_us":38521,"threads_started":1,"wal-append.queue_time_us":109936,"wal-append.run_cpu_time_us":1633,"wal-append.run_wall_time_us":1032537}
W20260709 13:15:06.228343  9076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.010s	sys 0.014s
W20260709 13:15:06.228734  9076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.010s	sys 0.014s
W20260709 13:15:05.328577  9110 log.cc:927] Time spent T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
W20260709 13:15:05.785102  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.648566  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:05.657428  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:06.204303  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1279) took 1687 ms. Trace:
I20260709 13:15:05.633802  8958 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:06.231078  6330 rpcz_store.cc:276] 0709 13:15:04.517283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.517423 (+   140us) service_pool.cc:224] Handling call
0709 13:15:04.524044 (+  6621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:04.710300 (+186256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.675620 (+965320us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400436cd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:06.204241 (+528621us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360743296}
I20260709 13:15:06.232690  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:06.233196  6371 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:06.233464  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2357) took 1029 ms. Trace:
I20260709 13:15:06.233626  9122 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.233901  6330 rpcz_store.cc:276] 0709 13:15:05.204504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.232446 (+1027942us) service_pool.cc:224] Handling call
0709 13:15:06.233414 (+   968us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.231130  6327 raft_consensus.cc:2376] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7. Re-sending same reply.
I20260709 13:15:06.234794  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2353) took 1031 ms. Trace:
I20260709 13:15:06.234920  8942 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:05.326906  6906 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.157s	user 0.017s	sys 0.006s
I20260709 13:15:06.235751  8942 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:05.826337  6933 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.016s	sys 0.052s
I20260709 13:15:05.300657  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:05.258939  9130 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:06.195492  6324 rpcz_store.cc:276] 0709 13:15:04.537561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.855896 (+318335us) service_pool.cc:224] Handling call
0709 13:15:04.856174 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:04.922378 (+ 66204us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:05.020827 (+ 98449us) log.cc:844] Serialized 14 byte log entry
0709 13:15:05.182891 (+162064us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:05.182946 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:05.182993 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.672255 (+489262us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b54001c0f54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:05.672318 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.672501 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":85946,"prepare.run_cpu_time_us":9647,"prepare.run_wall_time_us":73242,"raft.queue_time_us":2671,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":5212,"spinlock_wait_cycles":113939328,"thread_start_us":185956,"threads_started":2,"wal-append.queue_time_us":187075}
I20260709 13:15:06.251900  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 646) took 1103 ms. Trace:
I20260709 13:15:06.257455  6324 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:06.245100  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:06.256865  6330 rpcz_store.cc:276] 0709 13:15:05.149004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.251054 (+1102050us) service_pool.cc:224] Handling call
0709 13:15:06.251372 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.251551 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.251586 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.251641 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:06.251675 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.251731 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.251842 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:05.300053  9008 consensus_queue.cc:237] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:06.260447  6330 raft_consensus.cc:1240] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:06.258075  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2352) took 1056 ms. Trace:
I20260709 13:15:06.261106  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2355) took 1057 ms. Trace:
I20260709 13:15:06.261806  6330 rpcz_store.cc:276] 0709 13:15:05.203909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.258994 (+1055085us) service_pool.cc:224] Handling call
0709 13:15:06.259246 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.260898 (+  1652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.261058 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.263800  6330 pending_rounds.cc:85] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 3
W20260709 13:15:06.207015  6295 connection.cc:256] RPC call timeout handler was delayed by -1.1839021219998358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
I20260709 13:15:06.209503  9027 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:05.630573  9126 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:05.649292  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 509) took 1458 ms. Trace:
I20260709 13:15:06.261363  6324 rpcz_store.cc:276] 0709 13:15:05.201388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.256874 (+1055486us) service_pool.cc:224] Handling call
0709 13:15:06.257158 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.257855 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.258025 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:05.264289  9106 consensus_queue.cc:1059] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.947s
I20260709 13:15:06.265636  9051 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:06.278949  9051 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:06.280731  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:06.281533  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:06.282615  6248 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:15:06.281775  6404 raft_consensus.cc:2376] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7. Re-sending same reply.
I20260709 13:15:06.283756  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:06.284024  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:06.195240  9098 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:05.470175  6296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.006s	sys 0.007s
W20260709 13:15:06.289207  6296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.429s	user 0.010s	sys 0.011s
W20260709 13:15:06.265658  9142 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.988s	user 0.000s	sys 0.015s
I20260709 13:15:06.242663  9123 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.243157  9100 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.765435  9139 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.393687  9067 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:15:05.835203  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 518) took 1598 ms. Trace:
W20260709 13:15:05.748540  9042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.007s	sys 0.020s
W20260709 13:15:05.560968  8610 consensus_meta.cc:287] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.003s
I20260709 13:15:05.327639  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:06.216588  9064 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:06.217805  8974 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:06.219398  9143 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.200881  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 512) took 1905 ms. Trace:
I20260709 13:15:06.305866  6399 rpcz_store.cc:276] 0709 13:15:04.295386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.577043 (+281657us) service_pool.cc:224] Handling call
0709 13:15:04.577333 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:04.728078 (+150745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:04.728116 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:04.728155 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:04.728188 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.560826 (+832638us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54001f4854. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:06.200658 (+639832us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.200812 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346268032}
I20260709 13:15:06.265727  8705 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:06.223975  9108 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:05.391517  9077 consensus_meta.cc:287] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.000s
I20260709 13:15:06.224620  6331 rpcz_store.cc:276] 0709 13:15:04.513701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.514779 (+  1078us) service_pool.cc:224] Handling call
0709 13:15:05.679868 (+1165089us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b54004362d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:05.680001 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68550016}
I20260709 13:15:06.227855  8870 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.234280  9122 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:06.235147  6327 rpcz_store.cc:276] 0709 13:15:05.203276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.657088 (+453812us) service_pool.cc:224] Handling call
0709 13:15:06.234746 (+577658us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:05.561648  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1277) took 1047 ms. Trace:
I20260709 13:15:06.318220  6328 rpcz_store.cc:276] 0709 13:15:04.514657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.515739 (+  1082us) service_pool.cc:224] Handling call
0709 13:15:05.561419 (+1045680us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54001c1954. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:05.561563 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255864192}
W20260709 13:15:06.235936  6906 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.066s	user 0.026s	sys 0.024s
W20260709 13:15:06.319543  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 2.15812e+06us
I20260709 13:15:06.320076  6939 raft_consensus.cc:3055] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:06.297432  9093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.179s	user 0.004s	sys 0.017s
I20260709 13:15:06.320515  6939 raft_consensus.cc:740] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:06.323256  6331 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:06.325182  6331 raft_consensus.cc:1240] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:05.324118  9101 log.cc:927] Time spent T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
I20260709 13:15:05.381202  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:05.659416  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 505) took 1718 ms. Trace:
W20260709 13:15:06.238323  6329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.224s	user 0.003s	sys 0.016s
I20260709 13:15:05.664414  9063 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:05.461781  9135 log.cc:927] Time spent T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:15:06.238813  6325 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:06.242749  6253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:06.331800  6253 raft_consensus.cc:606] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:06.332170  6253 raft_consensus.cc:614] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:06.298568  9123 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:06.243958  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:06.242115  6933 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.019s	sys 0.055s
I20260709 13:15:06.264125  6330 pending_rounds.cc:107] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:15:06.270998  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2358) took 1066 ms. Trace:
I20260709 13:15:06.236279  8942 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.284541  6397 raft_consensus.cc:2410] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:06.284650  6401 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:06.334677  6324 rpcz_store.cc:276] 0709 13:15:05.204776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.270260 (+1065484us) service_pool.cc:224] Handling call
0709 13:15:06.270540 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.270702 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.270737 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.270778 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:06.270807 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.270856 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.270948 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.335548  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:06.338505  6222 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.009s	sys 0.021s
W20260709 13:15:06.338824  6222 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.009s	sys 0.021s
W20260709 13:15:06.339066  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 930816us
W20260709 13:15:05.326530  9131 log.cc:927] Time spent T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:15:06.260507  9114 log.cc:927] Time spent T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 1.113s	user 0.016s	sys 0.000s
I20260709 13:15:06.317772  8870 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:06.254730  9095 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.212177  8820 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:06.289551  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 1.42886e+06us
I20260709 13:15:06.309877  9098 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:15:06.357110  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 642) took 1363 ms. Trace:
I20260709 13:15:06.293382  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:05.655534  8794 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:06.294309  6295 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:06.295358  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:06.364802  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:06.317600  9077 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:06.365662  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 71435.8us
I20260709 13:15:06.296785  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:06.367352  6405 raft_consensus.cc:2393] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:06.266089  9117 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.297818  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:06.299183  6256 rpcz_store.cc:276] 0709 13:15:04.236960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.326724 (+ 89764us) service_pool.cc:224] Handling call
0709 13:15:05.834967 (+1508243us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400202e54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:05.835133 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881257856}
I20260709 13:15:06.302960  6250 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:06.265766  8958 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:05.535787  9094 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:06.281097  9051 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:06.312391  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:06.380432  6399 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
W20260709 13:15:06.302241  9042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.010s	sys 0.023s
I20260709 13:15:06.301856  8959 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:06.328996  6906 connection.cc:256] RPC call timeout handler was delayed by -1.2831935429999248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 13:15:06.385116  6906 connection.cc:256] RPC call timeout handler was delayed by -1.1427935429999252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 13:15:06.385574  6906 connection.cc:256] RPC call timeout handler was delayed by -1.0010969610000302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
I20260709 13:15:06.306551  9139 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:06.309110  9054 consensus_queue.cc:260] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:06.331327  6323 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:06.333847  6325 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:15:06.396927  6323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2360) took 1191 ms (client timeout 1529 ms). Trace:
W20260709 13:15:06.322962  9093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.206s	user 0.004s	sys 0.017s
I20260709 13:15:06.334376  6330 raft_consensus.cc:2889] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:06.399326  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:06.341766  6401 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:06.352077  9122 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:06.409365  6937 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEARNER]: Advancing to term 4
I20260709 13:15:06.411052  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:06.337694  9063 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:06.442961  9027 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.437772  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:06.437036  9074 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:06.454660  9027 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:06.455302  6940 raft_consensus.cc:1240] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:06.455473  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:06.434571  9139 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:06.413044  6906 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:06.458263  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 45336.3us
I20260709 13:15:06.460239  6906 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:06.307358  8610 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:06.307543  9100 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:06.357583  6322 rpcz_store.cc:276] 0709 13:15:04.993417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.993527 (+   110us) service_pool.cc:224] Handling call
0709 13:15:04.996513 (+  2986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:04.996860 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:04.996895 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:05.009964 (+ 13069us) log.cc:844] Serialized 26 byte log entry
0709 13:15:05.194298 (+184334us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:05.194356 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.194441 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:05.766908 (+572467us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:06.343946 (+577038us) raft_consensus.cc:1685] finished
0709 13:15:06.343966 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.357043 (+ 13077us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4961,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":33966,"spinlock_wait_cycles":3558784,"thread_start_us":75829,"threads_started":1,"wal-append.queue_time_us":239042}
I20260709 13:15:06.296089  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:06.369863  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:06.315891  8705 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:06.329840  6398 rpcz_store.cc:276] 0709 13:15:03.941062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.159055 (+217993us) service_pool.cc:224] Handling call
0709 13:15:04.159588 (+   533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:04.601703 (+442115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:04.601732 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:04.601777 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:04.601809 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.659121 (+1057312us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b54000262d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:05.659180 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.659341 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016294656}
I20260709 13:15:06.308552  9143 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
W20260709 13:15:06.397207  6369 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.013s	sys 0.053s
W20260709 13:15:06.480139  6369 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.013s	sys 0.054s
W20260709 13:15:06.480451  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 916943us
I20260709 13:15:06.323766  6939 consensus_queue.cc:260] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:06.397352  6323 rpcz_store.cc:269] 0709 13:15:05.205334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.380762 (+175428us) service_pool.cc:224] Handling call
0709 13:15:06.396872 (+1016110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.376607  9067 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:06.401674  6942 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:06.403276  6325 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:06.406319  6401 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:06.406981  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:06.365955  9095 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:06.458825  8464 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:06.443300  6328 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:06.268206  6396 rpcz_store.cc:276] 0709 13:15:04.191247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.503733 (+312486us) service_pool.cc:224] Handling call
0709 13:15:04.503983 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:04.672536 (+168553us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:04.683655 (+ 11119us) log.cc:844] Serialized 14 byte log entry
0709 13:15:04.819827 (+136172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:04.823763 (+  3936us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:04.823803 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.649033 (+825230us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400322654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:05.649075 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.649228 (+   153us) inbound_call.cc:177] Queueing success response
0709 13:15:05.847514 (+198286us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
Metrics: {"prepare.queue_time_us":11365,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":4253,"raft.queue_time_us":121745,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":396654336,"thread_start_us":133133,"threads_started":1,"wal-append.queue_time_us":325148}
I20260709 13:15:06.456737  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:06.462030  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 641) took 1469 ms. Trace:
I20260709 13:15:06.489267  6941 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:06.489110  6329 rpcz_store.cc:276] 0709 13:15:04.992669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.004433 (+ 11764us) service_pool.cc:224] Handling call
0709 13:15:05.006541 (+  2108us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:05.007016 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.007057 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:05.007623 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:15:06.330141 (+1322518us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:06.330196 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.330283 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.461783 (+131500us) raft_consensus.cc:1685] finished
0709 13:15:06.461811 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.461964 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7116,"thread_start_us":1315521,"threads_started":1,"wal-append.queue_time_us":1385222}
I20260709 13:15:06.483217  9067 raft_consensus.cc:697] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:06.493343  9122 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:06.477097  6936 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:06.430821  9077 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:06.440214  9134 log.cc:927] Time spent T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 1.047s	user 0.011s	sys 0.008s
I20260709 13:15:06.491868  6396 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:06.379226  9117 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:06.426587  9054 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:06.461273  9042 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.477558  6403 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:06.495783  6397 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:06.519203  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:06.445700  8820 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:06.466993  9075 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:06.503386  6297 leader_election.cc:336] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.815s (SENT)
I20260709 13:15:06.381760  8958 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:06.503464  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:06.528452  6941 raft_consensus.cc:2393] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 4: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:06.434055  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:06.506963  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:06.529848  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:06.507171  6937 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:06.355433  6296 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:06.530903  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 175545us
I20260709 13:15:06.531523  6296 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:06.508315  6399 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:06.534581  6296 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:06.535727  6296 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:06.509486  6369 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:06.537303  6255 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:06.537688  6296 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:06.487617  9074 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:06.524428  6297 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:06.493914  9122 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:06.508463  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:06.534320  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 516) took 1801 ms. Trace:
I20260709 13:15:06.515566  9126 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:06.551266  6296 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:06.555274  6402 rpcz_store.cc:276] 0709 13:15:04.732989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.733116 (+   127us) service_pool.cc:224] Handling call
0709 13:15:04.733440 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:04.898912 (+165472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:04.898942 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:04.911655 (+ 12713us) log.cc:844] Serialized 26 byte log entry
0709 13:15:05.165445 (+253790us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:05.165484 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.673264 (+507780us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54003ad4d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:05.673326 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.439563 (+766237us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:06.534071 (+ 94508us) raft_consensus.cc:1685] finished
0709 13:15:06.534098 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.534251 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151937,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9464,"spinlock_wait_cycles":400437376,"thread_start_us":221608,"threads_started":2,"wal-append.queue_time_us":410102}
I20260709 13:15:06.564095  6296 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:15:06.557451  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 54096.4us
I20260709 13:15:06.516017  6938 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:06.567726  8807 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:06.565653  6296 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:06.559913  9147 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:06.493997  9067 consensus_queue.cc:237] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:06.536820  9112 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:06.550097  9065 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:06.584529  6397 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:06.549506  8794 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:06.526911  8464 consensus_queue.cc:1059] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:15:06.553578  8959 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:06.586912  6296 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:06.563414  9051 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:06.566079  9104 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:06.568053  8711 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:06.589653  9147 raft_consensus.cc:2764] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:15:06.529516  8942 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:06.567747  9064 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:15:06.586460  6934 raft_consensus.cc:2393] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 5: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:06.524403  9042 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:06.554343  9075 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:15:06.523653  9027 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:06.583101  9074 consensus_queue.cc:1059] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:15:06.613807  6370 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.025s	sys 0.035s
W20260709 13:15:06.639290  6370 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.025s	sys 0.035s
I20260709 13:15:06.594233  9051 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:06.643821  9117 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:06.605353  8711 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:06.640547  9147 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:06.641623  8959 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:06.647255  9051 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:06.653614  9094 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:06.659402  8711 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:06.622427  8464 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:15:06.646096  9112 raft_consensus.cc:697] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:06.654609  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.667285  9100 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:15:06.739063  6399 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:06.668368  8958 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:06.684448  9147 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:06.683077  8610 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:06.755180  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.743870  9143 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:06.772614  6936 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:06.705884  9095 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:06.739403  9063 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:06.777861  6939 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:06.779264  9140 log.cc:927] Time spent T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:15:06.694116  8959 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:06.745275  9094 raft_consensus.cc:3055] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:06.756040  8870 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:06.792629  8705 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:06.792896  9154 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:15:06.709254  6397 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:06.799367  9094 raft_consensus.cc:740] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:06.797078  9122 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:06.846743  8942 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:06.787948  9147 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:06.956456  6219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.010s	sys 0.021s
W20260709 13:15:06.959250  6219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.010s	sys 0.021s
W20260709 13:15:06.934763  9123 consensus_meta.cc:287] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.005s
W20260709 13:15:06.934499  9108 consensus_meta.cc:287] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.620s	user 0.006s	sys 0.004s
W20260709 13:15:06.928229  9121 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.352s	user 0.047s	sys 0.107s
W20260709 13:15:06.975404  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 705559us
I20260709 13:15:06.957336  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 645) took 1962 ms. Trace:
I20260709 13:15:06.993192  6326 rpcz_store.cc:276] 0709 13:15:04.995302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.188971 (+193669us) service_pool.cc:224] Handling call
0709 13:15:05.206136 (+ 17165us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:05.206582 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:05.206636 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:05.208723 (+  2087us) log.cc:844] Serialized 26 byte log entry
0709 13:15:05.851025 (+642302us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b180013e640. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:15:06.331604 (+480579us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:06.331642 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.331709 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.931436 (+599727us) raft_consensus.cc:1685] finished
0709 13:15:06.931459 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.957260 (+ 25801us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1490,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":2035,"spinlock_wait_cycles":5712256,"thread_start_us":480411,"threads_started":1,"wal-append.queue_time_us":1469491}
W20260709 13:15:06.966014  6220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.007s	sys 0.027s
I20260709 13:15:06.806579  9112 consensus_queue.cc:237] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:06.995034  6400 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
W20260709 13:15:06.995447  6220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.007s	sys 0.027s
W20260709 13:15:07.012494  6221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.000s	sys 0.038s
W20260709 13:15:06.957180  9107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.570s	user 0.014s	sys 0.041s
W20260709 13:15:07.013253  6221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.000s	sys 0.038s
W20260709 13:15:07.014806  6330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.020s	sys 0.067s
I20260709 13:15:06.967743  9042 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:07.018323  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:07.026069  6256 raft_consensus.cc:2393] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 4: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:15:07.027062  6330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.020s	sys 0.067s
W20260709 13:15:06.992024  9121 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.663s	user 0.047s	sys 0.108s
W20260709 13:15:07.029343  6331 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.033s	sys 0.035s
I20260709 13:15:06.992681  9063 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:07.031267  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:07.032099  6253 raft_consensus.cc:2393] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:15:07.034132  6222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.000s	sys 0.012s
W20260709 13:15:07.034456  6222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.000s	sys 0.012s
W20260709 13:15:07.029875  6331 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.033s	sys 0.035s
W20260709 13:15:07.015717  9107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.628s	user 0.014s	sys 0.041s
W20260709 13:15:07.040987  6906 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.028s	sys 0.043s
W20260709 13:15:07.046213  6906 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.029s	sys 0.043s
I20260709 13:15:07.046607  6255 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:07.046530  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 565568us
I20260709 13:15:07.047899  6250 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:07.048179  6906 leader_election.cc:400] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8.
I20260709 13:15:07.048578  6906 leader_election.cc:403] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:07.048758  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:07.049324  6907 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.017s	sys 0.057s
W20260709 13:15:07.050447  6907 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.017s	sys 0.057s
I20260709 13:15:07.050036  6248 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
W20260709 13:15:07.050823  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 566589us
I20260709 13:15:07.015326  8974 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:07.015590  6933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.021s	sys 0.016s
I20260709 13:15:07.014513  9126 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.114244  6222 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:07.055398  6297 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:06.995426  9123 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:07.016484  9077 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:07.040725  9042 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:07.025120  8610 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:07.125780  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 70488.5us
W20260709 13:15:07.045231  9008 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.008s	sys 0.005s
W20260709 13:15:07.045300  9076 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.002s	sys 0.009s
W20260709 13:15:07.035408  9144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.002s	sys 0.010s
W20260709 13:15:07.133450  6401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.003s	sys 0.011s
W20260709 13:15:07.142371  6401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.003s	sys 0.012s
W20260709 13:15:07.133950  6396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.000s	sys 0.014s
W20260709 13:15:07.126081  6933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.021s	sys 0.016s
W20260709 13:15:07.134305  6402 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.008s	sys 0.006s
W20260709 13:15:07.174314  6402 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.008s	sys 0.006s
I20260709 13:15:07.136605  6297 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:07.175470  6297 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:07.112567  9093 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8.
W20260709 13:15:07.134546  9003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.001s	sys 0.013s
I20260709 13:15:06.997469  9094 consensus_queue.cc:260] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:07.133725  6369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.005s	sys 0.009s
W20260709 13:15:07.142922  6405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.004s	sys 0.012s
W20260709 13:15:07.190721  6405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.005s	sys 0.012s
W20260709 13:15:07.143335  6398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.008s	sys 0.007s
W20260709 13:15:07.191375  6398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.008s	sys 0.007s
W20260709 13:15:07.145051  9144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.003s	sys 0.010s
W20260709 13:15:07.145246  6296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.007s	sys 0.008s
I20260709 13:15:07.145809  6252 raft_consensus.cc:2393] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:15:07.132076  9054 consensus_meta.cc:287] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.608s	user 0.005s	sys 0.005s
W20260709 13:15:07.146123  6396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.000s	sys 0.015s
W20260709 13:15:07.153609  6295 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.017s	sys 0.082s
W20260709 13:15:07.221797  6295 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.018s	sys 0.082s
W20260709 13:15:07.134778  9008 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.008s	sys 0.005s
W20260709 13:15:07.134681  9104 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.003s	sys 0.011s
W20260709 13:15:07.137593  9076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.003s	sys 0.009s
W20260709 13:15:07.180590  6905 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.008s	sys 0.020s
W20260709 13:15:07.170598  9065 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.011s	sys 0.003s
W20260709 13:15:07.125245  6204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 71526.5us
W20260709 13:15:07.143729  6294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.003s	sys 0.012s
W20260709 13:15:07.145177  8999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.017s	sys 0.003s
I20260709 13:15:07.050395  9063 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:07.145447  8807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.007s	sys 0.008s
W20260709 13:15:07.260447  6294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.003s	sys 0.012s
I20260709 13:15:07.249068  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:07.261788  6255 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:07.125974  8974 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:07.213227  9161 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.127574  9126 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:07.188248  9003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.001s	sys 0.014s
I20260709 13:15:07.178632  9107 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.280514  9107 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:07.281733  9126 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:07.282578  9107 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:07.188113  9064 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:07.283100  9117 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:07.214598  6296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.008s	sys 0.008s
I20260709 13:15:07.288942  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2356) took 2084 ms. Trace:
I20260709 13:15:07.218708  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:07.219835  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:07.289444  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 702561us
I20260709 13:15:07.290366  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:07.220908  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:07.291195  6249 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:15:07.291975  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:07.222157  6256 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:15:07.222188  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 855622us
I20260709 13:15:07.192281  8870 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:07.137517  8794 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:15:07.221403  9096 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:07.264400  8999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.017s	sys 0.003s
I20260709 13:15:07.193837  9157 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.138350  8610 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:07.330035  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:07.241379  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 183210us
W20260709 13:15:07.246564  6905 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.008s	sys 0.020s
W20260709 13:15:07.331332  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 995400us
I20260709 13:15:07.139109  9042 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:07.199709  8959 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:07.249157  6254 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:07.259582  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:07.336935  6250 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:07.265625  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:07.266366  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:07.190472  6369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.005s	sys 0.009s
W20260709 13:15:07.338002  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 774290us
I20260709 13:15:07.271035  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:07.271220  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 157095us
I20260709 13:15:07.272840  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:07.213162  9121 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:07.277769  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:07.245162  9104 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.004s	sys 0.011s
W20260709 13:15:07.264091  8807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.007s	sys 0.008s
I20260709 13:15:07.283200  9064 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.230644  9094 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.297657  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:07.213651  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 187046us
I20260709 13:15:07.229535  6404 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:07.289381  6330 rpcz_store.cc:276] 0709 13:15:05.204219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.263347 (+1059128us) service_pool.cc:224] Handling call
0709 13:15:06.263620 (+   273us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:06.403399 (+139779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.403443 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:06.404082 (+   639us) log.cc:844] Serialized 52 byte log entry
0709 13:15:07.027621 (+623539us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:07.027678 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.027768 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:07.288722 (+260954us) raft_consensus.cc:1685] finished
0709 13:15:07.288742 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.288881 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3645,"raft.queue_time_us":4751,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":113,"thread_start_us":622556,"threads_started":1,"wal-append.queue_time_us":882374}
I20260709 13:15:07.134402  9077 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:07.355950  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:07.325373  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.323707  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1381) took 1079 ms. Trace:
I20260709 13:15:07.245568  9182 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:07.325745  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.362550  6368 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:07.306521  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:07.307410  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:07.308104  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:07.324869  6328 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:15:07.314500  9067 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:07.331655  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:07.308234  6296 connection.cc:256] RPC call timeout handler was delayed by -3.177140437999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:15:07.260358  6933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 515) took 3418 ms. Trace:
I20260709 13:15:07.377794  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:07.341378  6222 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:07.338617  6369 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:07.345182  6322 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.274916  9178 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.350751  6327 raft_consensus.cc:2393] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:15:07.396039  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 57500.5us
I20260709 13:15:07.356938  6252 rpcz_store.cc:276] 0709 13:15:06.244651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.244834 (+   183us) service_pool.cc:224] Handling call
0709 13:15:07.323508 (+1078674us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54000f5d54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:07.323636 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2040815488}
I20260709 13:15:07.397583  6252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:07.365283  6248 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:07.248951  9065 raft_consensus.cc:697] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:07.368640  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:07.369885  6249 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:15:07.376178  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:07.376935  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:07.388769  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:07.391225  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:07.391705  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:07.391878  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:07.392948  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:07.351290  9104 raft_consensus.cc:697] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:07.467749  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:07.469704  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 72726.9us
I20260709 13:15:07.471902  6369 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:07.398159  6252 raft_consensus.cc:606] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:07.399338  6248 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:07.473469  6252 raft_consensus.cc:614] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:07.474069  6251 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:07.400422  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:07.357414  8807 raft_consensus.cc:697] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:07.358688  9106 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.305274  9161 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:07.464646  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:07.410740  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:07.476670  6255 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:07.366696  9173 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:07.487983  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 146748us
I20260709 13:15:07.493016  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:07.493456  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:07.532056  6222 leader_election.cc:400] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 2. Current term is 3.
I20260709 13:15:07.496057  8807 consensus_queue.cc:237] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:07.497653  9077 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:07.498410  9156 log.cc:927] Time spent T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.272s	user 0.000s	sys 0.000s
I20260709 13:15:07.512624  6254 raft_consensus.cc:2368] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4.
I20260709 13:15:07.359242  9064 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:07.510038  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:07.510773  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:07.511749  6397 raft_consensus.cc:2376] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4. Re-sending same reply.
I20260709 13:15:07.566212  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:07.566784  6397 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:07.567548  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:07.568033  6397 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:07.495162  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:07.539114  6250 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:15:07.536689  6322 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:07.383702  9076 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
I20260709 13:15:07.549587  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2366) took 1702 ms. Trace:
W20260709 13:15:07.554669  6295 leader_election.cc:336] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.247s (SENT)
W20260709 13:15:07.555406  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 159462us
I20260709 13:15:07.573945  6331 rpcz_store.cc:276] 0709 13:15:05.846866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.325996 (+479130us) service_pool.cc:224] Handling call
0709 13:15:06.339015 (+ 13019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.339268 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:07.041175 (+701907us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.547337 (+506162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:07.547404 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:07.549268 (+  1864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.549387 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.549525 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1178979,"thread_start_us":1186674,"threads_started":3}
I20260709 13:15:07.556471  6222 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:07.557402  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:07.345162  9157 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:07.559001  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:07.561659  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:07.580255  6403 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.568717  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:07.500388  8711 consensus_meta.cc:287] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.756s	user 0.006s	sys 0.001s
I20260709 13:15:07.379943  9180 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.353070  9121 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:07.379179  9107 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.169s
I20260709 13:15:07.384320  9067 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:07.513811  9027 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:07.510943  8870 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:07.575357  6219 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:07.371608  8820 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.151s
I20260709 13:15:07.581349  6397 raft_consensus.cc:2410] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:07.517462  8794 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.373234  9054 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.193s
I20260709 13:15:07.589614  6222 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:07.584805  6255 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:07.592736  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:07.594115  9190 log.cc:927] Time spent T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:15:07.594580  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:07.595192  9063 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:07.398979  9184 consensus_queue.cc:1059] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.201s
I20260709 13:15:07.596467  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:07.596577  6250 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:07.385532  9188 consensus_queue.cc:1059] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.199s
I20260709 13:15:07.561456  8958 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:07.550472  9123 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:07.552660  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:07.631758  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 56477.8us
I20260709 13:15:07.631908  6256 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:07.641644  6323 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:07.643270  6254 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:07.641692  6400 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:07.644838  6249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:07.630558  9155 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:07.655658  6403 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:07.666709  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:07.666633  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 194779us
I20260709 13:15:07.667040  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:07.666774  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:07.669425  6403 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:07.635599  9095 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.597158  8999 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:07.584772  9122 consensus_queue.cc:1059] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:15:07.688249  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:07.548417  9106 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:07.465085  9178 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:07.634600  9027 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.585421  9077 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:15:07.680490  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:07.694883  6400 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.665680  9155 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.641570  9054 consensus_queue.cc:1243] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer a13ffe92eb374309a5c8476d9fbbb2b8 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:15:07.683358  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:07.683543  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:07.684000  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:07.684105  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 296480us
I20260709 13:15:07.647482  9126 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:07.682857  8974 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:07.728418  6326 raft_consensus.cc:2393] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 4: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:07.689366  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:07.665783  8870 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:07.585650  9158 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:15:07.605265  9108 consensus_queue.cc:1059] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:15:07.678957  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:07.604498  9159 consensus_queue.cc:1059] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:15:07.679222  9161 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:07.604732  9098 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:15:07.605706  8711 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:07.684859  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:07.731303  6322 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:07.732038  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:07.646628  8794 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:07.689890  9095 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:07.662340  9065 consensus_queue.cc:237] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:07.610338  9180 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:07.697428  9027 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.732045  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:07.929934  6400 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
W20260709 13:15:07.914340  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 324800us
W20260709 13:15:07.944085  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 280643us
I20260709 13:15:07.712059  9189 raft_consensus.cc:3055] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:07.944283  6396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.001s	sys 0.014s
W20260709 13:15:07.824182  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 155946us
I20260709 13:15:07.712788  9173 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.290s
I20260709 13:15:07.639207  9104 consensus_queue.cc:237] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:08.013263  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 46781us
W20260709 13:15:08.143396  9130 consensus_meta.cc:287] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.874s	user 0.007s	sys 0.007s
I20260709 13:15:08.062033  9027 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:07.377413  6933 rpcz_store.cc:276] 0709 13:15:03.827735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.452589 (+624854us) service_pool.cc:224] Handling call
0709 13:15:04.534983 (+ 82394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:04.548951 (+ 13968us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:04.586479 (+ 37528us) log.cc:844] Serialized 14 byte log entry
0709 13:15:05.223905 (+637426us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b180039a660. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572a72c0a 00007f457c1b2219 00007f4572afaa40 00007f4572af54e4 00007f4572af5455 00007f45795dd3c7 00007f4575bef9a7 00007f4575bff0bf 00007f4575bff038
0709 13:15:05.225739 (+  1834us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b180039a660. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af8522 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:15:06.369832 (+1144093us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.190694 (+820862us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:07.194127 (+  3433us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:07.204153 (+ 10026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.213494 (+  9341us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.232365 (+ 18871us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4944,"prepare.queue_time_us":410935,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":80338,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":9876,"spinlock_wait_cycles":24853248,"thread_start_us":2116072,"threads_started":3,"wal-append.queue_time_us":296618,"wal-append.run_cpu_time_us":58991,"wal-append.run_wall_time_us":2572203}
I20260709 13:15:07.994472  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:08.014547  9198 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:08.059449  9202 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:07.956440  9051 consensus_meta.cc:287] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.250s	user 0.011s	sys 0.000s
I20260709 13:15:08.054252  9178 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:08.053020  6934 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:15:07.710500  9155 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:07.922487  9107 consensus_queue.cc:1059] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.317s
I20260709 13:15:07.957248  6328 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:08.127188  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.014379  6296 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:07.744792  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:08.128547  6221 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:08.259407  6327 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:07.963701  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:08.173318  9205 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:15:08.180092  6323 consensus_meta.cc:287] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.000s
I20260709 13:15:08.243717  6371 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:08.260807  6400 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:08.235677  9095 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:08.235842  8794 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:08.245235  6396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.003s	sys 0.016s
I20260709 13:15:08.235850  9121 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:08.236289  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:07.953020  9168 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.391s	user 0.000s	sys 0.000s
I20260709 13:15:08.242125  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.243347  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:08.253701  6369 connection.cc:256] RPC call timeout handler was delayed by -1.5552002979998178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 13:15:08.229383  9182 consensus_meta.cc:287] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.852s	user 0.003s	sys 0.007s
I20260709 13:15:07.922542  9184 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.335s
W20260709 13:15:08.131508  9147 consensus_meta.cc:287] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.166s	user 0.010s	sys 0.000s
W20260709 13:15:08.259472  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 245157us
I20260709 13:15:07.995106  9192 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.280s
I20260709 13:15:08.260931  6323 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:08.081354  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:07.954051  9194 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
W20260709 13:15:08.269258  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 140791us
I20260709 13:15:08.324203  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.324395  6221 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:08.325723  6221 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:08.210775  9064 consensus_meta.cc:287] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.000s
I20260709 13:15:08.302881  6255 raft_consensus.cc:2410] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:08.316676  6296 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:08.329015  6296 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:08.308048  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:08.026342  8820 raft_consensus.cc:3055] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:15:08.303885  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 68923us
I20260709 13:15:08.318921  6400 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:07.720185  9126 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:07.733008  9163 log.cc:927] Time spent T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.379s	user 0.001s	sys 0.001s
I20260709 13:15:08.336449  8794 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:08.337018  8794 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:08.337579  8794 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:08.183902  9003 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:08.338304  9003 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.321105  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:08.340719  9003 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:08.341202  9201 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:08.341403  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2316) took 2056 ms. Trace:
I20260709 13:15:08.341653  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:08.342995  9126 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.343214  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:08.343936  6327 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:08.065757  9157 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:08.242117  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:08.302740  6403 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:07.732733  9042 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:08.330885  6296 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:08.322235  6331 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:08.258833  9027 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:08.240715  8711 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:08.047830  9093 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.332362  6221 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:08.237287  9130 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:08.298122  9094 consensus_meta.cc:287] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.931s	user 0.011s	sys 0.001s
I20260709 13:15:08.334986  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:08.334995  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.335561  9064 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.335069  9139 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:08.335047  9121 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:08.342029  6369 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:08.349237  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2107) took 1134 ms. Trace:
I20260709 13:15:08.326921  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:08.300191  9178 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:08.242374  9189 raft_consensus.cc:740] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:08.386382  9126 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:08.301961  8999 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:08.352072  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:08.394347  6400 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.394836  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:08.320405  9211 raft_consensus.cc:3055] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:08.265599  9207 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:15:08.341792  6405 rpcz_store.cc:276] 0709 13:15:06.289201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.396448 (+107247us) service_pool.cc:224] Handling call
0709 13:15:06.421630 (+ 25182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.422053 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.422088 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:06.422609 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:15:07.191117 (+768508us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:07.304592 (+113475us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.327663 (+ 23071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.327730 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:08.341201 (+1013471us) raft_consensus.cc:1685] finished
0709 13:15:08.341219 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:08.341347 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103951,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":45805,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":15162,"spinlock_wait_cycles":14044928,"thread_start_us":833058,"threads_started":2,"wal-append.queue_time_us":841178}
I20260709 13:15:08.322722  9182 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:08.394070  8999 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:08.407779  8999 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.312252  8870 raft_consensus.cc:697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:08.333968  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2324) took 2042 ms. Trace:
I20260709 13:15:08.378819  6221 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:08.415889  8958 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:08.416368  8958 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:08.418170  9159 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:08.418782  9159 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:08.418954  9199 log.cc:927] Time spent T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.731s	user 0.000s	sys 0.000s
I20260709 13:15:08.419216  9159 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.422117  8610 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:08.422904  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2120) took 1161 ms. Trace:
I20260709 13:15:08.411676  8870 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.423281  6256 rpcz_store.cc:276] 0709 13:15:07.261959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.400211 (+138252us) service_pool.cc:224] Handling call
0709 13:15:08.422739 (+1022528us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54000f6c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:08.422849 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358861568}
I20260709 13:15:08.424427  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:08.427999  6325 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:08.380667  6253 rpcz_store.cc:276] 0709 13:15:07.215623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.215852 (+   229us) service_pool.cc:224] Handling call
0709 13:15:07.216166 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:07.355100 (+138934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:07.355132 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:07.366406 (+ 11274us) log.cc:844] Serialized 26 byte log entry
0709 13:15:07.673586 (+307180us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:07.673632 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.348833 (+675201us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54001b8fd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:08.348881 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:08.348931 (+    50us) raft_consensus.cc:1685] finished
0709 13:15:08.348944 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:08.349177 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117316,"raft.queue_time_us":24692,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":13687,"spinlock_wait_cycles":262554368,"thread_start_us":186929,"threads_started":1,"wal-append.queue_time_us":661533}
I20260709 13:15:08.424950  6256 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.429348  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.332062  9208 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:08.341626  9201 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:08.437304  9201 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.238493  9198 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.439754  9198 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:08.384143  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:08.441082  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:08.366321  8794 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.402915  9211 raft_consensus.cc:740] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:08.385252  9117 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:08.443181  9211 consensus_queue.cc:260] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.386454  9189 consensus_queue.cc:260] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:08.444486  9211 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.444907  9189 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.446115  6405 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:08.446768  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 1991) took 1027 ms. Trace:
I20260709 13:15:08.447104  6405 rpcz_store.cc:276] 0709 13:15:07.419743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.445447 (+1025704us) service_pool.cc:224] Handling call
0709 13:15:08.445800 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:08.446510 (+   710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.446714 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:08.448390  6405 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: [6.5-7.6]
I20260709 13:15:08.345000  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:08.387789  6329 raft_consensus.cc:2393] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 6: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:08.384941  6397 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:08.380388  9093 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.388552  9064 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:08.388718  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.389211  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:08.388976  9139 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.389874  9180 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:08.325525  9147 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.391752  9027 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:08.332762  8820 raft_consensus.cc:740] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:08.392266  9157 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:15:08.365947  9063 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:08.358227  9003 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:08.387822  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2312) took 2103 ms. Trace:
I20260709 13:15:08.499625  6330 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:08.499522  6404 rpcz_store.cc:276] 0709 13:15:06.283991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.284087 (+    96us) service_pool.cc:224] Handling call
0709 13:15:08.387667 (+2103580us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b5400376ed4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:08.387762 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1973703552}
I20260709 13:15:08.401669  6247 raft_consensus.cc:2393] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:08.239867  9051 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:08.405097  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:08.411273  6396 rpcz_store.cc:276] 0709 13:15:06.291102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.552030 (+260928us) service_pool.cc:224] Handling call
0709 13:15:06.552719 (+   689us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:07.231310 (+678591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:07.231342 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:07.232461 (+  1119us) log.cc:844] Serialized 574 byte log entry
0709 13:15:08.300506 (+1068045us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:08.326257 (+ 25751us) log.cc:844] Serialized 14 byte log entry
0709 13:15:08.333545 (+  7288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.333655 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:08.333712 (+    57us) raft_consensus.cc:1685] finished
0709 13:15:08.333731 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:08.333898 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9159,"prepare.queue_time_us":25542,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":154341,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":16750,"thread_start_us":1629362,"threads_started":2,"wal-append.queue_time_us":758122}
W20260709 13:15:08.503773  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 161811us
W20260709 13:15:08.377250  9169 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.023s	sys 0.034s
W20260709 13:15:08.505491  9169 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.023s	sys 0.035s
I20260709 13:15:08.431737  6906 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:08.448953  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 1994) took 1028 ms. Trace:
I20260709 13:15:08.506561  6405 rpcz_store.cc:276] 0709 13:15:07.420417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.447809 (+1027392us) service_pool.cc:224] Handling call
0709 13:15:08.448144 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:08.448716 (+   572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.448903 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:08.457178  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:08.508168  6327 raft_consensus.cc:2410] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:08.457734  6249 raft_consensus.cc:606] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:08.509353  6249 raft_consensus.cc:614] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:08.458084  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 1989) took 1038 ms. Trace:
I20260709 13:15:08.509979  6397 rpcz_store.cc:276] 0709 13:15:07.419313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.381168 (+961855us) service_pool.cc:224] Handling call
0709 13:15:08.384726 (+  3558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:08.457814 (+ 73088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.458019 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:08.459816  6400 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:08.461699  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:08.462626  6403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 1985) took 1044 ms. Trace:
I20260709 13:15:08.464082  6256 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
W20260709 13:15:08.460561  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 216889us
I20260709 13:15:08.511868  6322 raft_consensus.cc:2393] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:08.511672  6403 rpcz_store.cc:276] 0709 13:15:07.418388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.376471 (+958083us) service_pool.cc:224] Handling call
0709 13:15:08.462541 (+ 86070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:08.487206  6295 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:08.512329  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:08.512771  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:08.513388  6322 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:08.239415  9202 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.513659  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.514124  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:08.514454  6256 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:08.443181  8794 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:08.501327  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.516268  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.504051  6396 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:08.378875  9042 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:08.464004  9208 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:08.486244  9198 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:08.515522  9108 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:08.526031  9180 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:08.526505  9065 consensus_queue.cc:1059] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:08.527865  9126 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:08.521930  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:08.530298  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:08.530834  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 99202.7us
I20260709 13:15:08.542177  9198 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.548183  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:08.550767  6331 raft_consensus.cc:2410] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:15:08.550913  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.515694  6328 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:15:08.538003  6369 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:15:08.457656  9121 consensus_queue.cc:1175] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" responder_term: 4 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:08.493031  8711 consensus_queue.cc:1059] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:15:08.498627  9027 raft_consensus.cc:697] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:08.515347  9202 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:08.533409  9075 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:08.562642  9171 log.cc:927] Time spent T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.609s	user 0.000s	sys 0.002s
I20260709 13:15:08.561977  9147 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:08.555923  6256 raft_consensus.cc:2393] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:08.515947  9003 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.590953  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.591730  6256 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 4: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:08.561518  9183 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:08.492817  9064 consensus_queue.cc:1059] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:15:08.560281  9093 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:08.549963  9094 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:15:08.548821  9198 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:08.540401  9112 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.021s	sys 0.023s
I20260709 13:15:08.565258  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2374) took 1300 ms. Trace:
I20260709 13:15:08.540143  9213 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.584960  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:08.587056  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 49146.4us
I20260709 13:15:08.561039  9130 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:08.545220  8820 consensus_queue.cc:260] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.539651  9208 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.794322  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 663) took 1044 ms. Trace:
I20260709 13:15:08.787909  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:08.786931  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:08.798926  6936 raft_consensus.cc:2376] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5. Re-sending same reply.
I20260709 13:15:08.794699  6905 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:08.594620  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.799654  6324 rpcz_store.cc:276] 0709 13:15:07.750160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.793239 (+1043079us) service_pool.cc:224] Handling call
0709 13:15:08.793670 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:08.793890 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:08.793931 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:08.793991 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:08.794036 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.794112 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:08.794256 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:08.732277  6253 raft_consensus.cc:2410] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:08.786079  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:08.801092  6256 raft_consensus.cc:2393] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:15:08.631239  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 50814.9us
I20260709 13:15:08.786360  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:08.802026  6323 rpcz_store.cc:276] 0709 13:15:07.264606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.266120 (+  1514us) service_pool.cc:224] Handling call
0709 13:15:08.555808 (+1289688us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400039154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:08.565191 (+  9383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698640256}
I20260709 13:15:08.729312  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:08.805070  6323 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:08.805450  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 76267.4us
I20260709 13:15:08.732827  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2320) took 2442 ms. Trace:
W20260709 13:15:08.809640  6368 connection.cc:256] RPC call timeout handler was delayed by -1.0491154400001506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260709 13:15:08.807116  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:08.810277  6368 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.988s (SENT) [suppressed 56 similar messages]
I20260709 13:15:08.801411  6939 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:15:08.785746  6941 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:15:08.813057  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:08.813385  6323 raft_consensus.cc:1240] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 13:15:08.813604  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.818082  6221 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:08.821492  6369 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:08.809826  6401 rpcz_store.cc:276] 0709 13:15:06.290206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.486650 (+196444us) service_pool.cc:224] Handling call
0709 13:15:06.486940 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.495847 (+  8907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.495879 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:06.496355 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:15:06.752873 (+256518us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b48001d01d8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457ab0eaa1 00007f457ab05b37 00007f457ab059ca 00007f457abfd26f 00007f457abfcf37 00007f457ac1155c 00007f457ac11508 00007f457ac11488 00007f457ac11443 00007f457ac106ec 00007f4579b3aa96
0709 13:15:07.145787 (+392914us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:07.269368 (+123581us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.269772 (+   404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.269900 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:08.533367 (+1263467us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:08.732560 (+199193us) raft_consensus.cc:1685] finished
0709 13:15:08.732590 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:08.732752 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17785,"prepare.queue_time_us":113762,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":19543,"raft.run_cpu_time_us":3412,"raft.run_wall_time_us":243798,"spinlock_wait_cycles":85625856,"thread_start_us":695259,"threads_started":2,"wal-append.queue_time_us":1178407}
I20260709 13:15:08.741117  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59284 (request call id 29) took 1110 ms. Trace:
W20260709 13:15:08.844329  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.802186  6935 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:08.846529  6249 rpcz_store.cc:276] 0709 13:15:07.630473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.630697 (+   224us) service_pool.cc:224] Handling call
0709 13:15:08.740832 (+1110135us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b54001725d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575bdf853 00007f457abad60a 00007f45741337d4 00007f4574133762 00007f4574133691 00007f457413360c 00007f45741328c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:08.741005 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1823958784}
I20260709 13:15:08.843714  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:08.846835  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:08.854204  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 44601.3us
I20260709 13:15:08.859856  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.860664  6295 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:08.861425  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:08.706550  9212 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 13:15:08.847685  9112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.027s	sys 0.025s
I20260709 13:15:08.787407  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:08.594772  8958 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.867612  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:08.632030  9223 log.cc:927] Time spent T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:15:08.879465  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:08.842370  9170 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:08.856151  6221 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:08.878369  9178 raft_consensus.cc:2764] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:15:08.906392  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 50325.4us
I20260709 13:15:08.907344  6221 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:08.908380  9077 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:08.873317  6295 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:08.909080  9077 raft_consensus.cc:697] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:08.784881  6934 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:08.734288  9107 raft_consensus.cc:3055] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:08.910018  9107 raft_consensus.cc:740] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:08.865823  9130 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:08.910315  9077 consensus_queue.cc:237] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:08.910975  9130 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.610140  9226 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:08.843228  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:08.580694  9095 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.284s
I20260709 13:15:08.912258  8870 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:08.581719  9155 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:08.912358  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 69199.4us
I20260709 13:15:08.912580  9226 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:08.913829  9226 raft_consensus.cc:697] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:08.913733  6222 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:08.912864  8870 raft_consensus.cc:697] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:08.914402  9155 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:08.914915  9226 consensus_queue.cc:237] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.906200  9123 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:08.916013  6222 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:08.897238  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:08.903777  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:08.917111  9123 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:08.917464  6249 raft_consensus.cc:2376] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3. Re-sending same reply.
I20260709 13:15:08.918566  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.919166  6249 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:15:08.909009  6221 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:08.915961  9207 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:08.916332  9126 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:15:08.955129  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 81898us
I20260709 13:15:08.955991  6295 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:08.917593  9123 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:08.918287  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:08.713948  9003 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:08.958918  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 662) took 1209 ms. Trace:
I20260709 13:15:08.911474  9130 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:08.723546  9051 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:08.872256  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 252256us
I20260709 13:15:08.728215  9201 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.985028  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.959338  6326 rpcz_store.cc:276] 0709 13:15:07.749873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.563321 (+813448us) service_pool.cc:224] Handling call
0709 13:15:08.563693 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:08.563934 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:08.688195 (+124261us) log.cc:844] Serialized 14 byte log entry
0709 13:15:08.958571 (+270376us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:08.958635 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:08.958680 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.958747 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:08.958859 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19672,"prepare.queue_time_us":268008,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":336683,"threads_started":2}
I20260709 13:15:08.986536  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:08.960603  6907 connection.cc:256] RPC call timeout handler was delayed by -1.2001721550000184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
I20260709 13:15:08.987355  6249 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:15:08.962882  9202 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:08.958225  6295 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:08.915266  8870 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.954314  8610 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:15:08.988322  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:08.960276  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:08.877523  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:09.143268  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 155530us
I20260709 13:15:09.762384  6256 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:15:09.511559  6295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.004s	sys 0.006s
W20260709 13:15:09.762894  6295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.004s	sys 0.027s
I20260709 13:15:09.763051  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 549) took 1035 ms. Trace:
I20260709 13:15:09.763566  6256 rpcz_store.cc:276] 0709 13:15:08.727663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.959289 (+231626us) service_pool.cc:224] Handling call
0709 13:15:09.762953 (+803664us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:09.528059  6324 raft_consensus.cc:1240] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:09.559872  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:09.569876  6401 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:09.767570  6397 raft_consensus.cc:2393] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:09.768785  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:09.508126  6221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.001s	sys 0.005s
W20260709 13:15:09.769791  6221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.018s	sys 0.009s
W20260709 13:15:09.771950  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 862944us
I20260709 13:15:09.529713  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 661) took 1780 ms. Trace:
I20260709 13:15:09.561266  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:09.773722  6396 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:09.773294  6327 rpcz_store.cc:276] 0709 13:15:07.749535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.549109 (+799574us) service_pool.cc:224] Handling call
0709 13:15:08.549439 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:08.549661 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:08.868997 (+319336us) log.cc:844] Serialized 14 byte log entry
0709 13:15:09.528846 (+659849us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:09.528984 (+   138us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:09.529098 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.529243 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:09.529474 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":281916,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":457916,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":306,"thread_start_us":623736,"threads_started":2}
W20260709 13:15:09.775316  9232 log.cc:927] Time spent T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:15:09.518962  6219 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:09.777577  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 1997) took 2187 ms. Trace:
W20260709 13:15:09.777750  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 259166us
W20260709 13:15:09.310034  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 322339us
I20260709 13:15:09.778854  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:09.780470  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:09.780962  9201 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:09.778029  6404 rpcz_store.cc:276] 0709 13:15:07.590448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.516069 (+925621us) service_pool.cc:224] Handling call
0709 13:15:08.534838 (+ 18769us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:08.578482 (+ 43644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:08.578534 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:08.579272 (+   738us) log.cc:844] Serialized 52 byte log entry
0709 13:15:08.863182 (+283910us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:09.041332 (+178150us) log.cc:844] Serialized 14 byte log entry
0709 13:15:09.582652 (+541320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.582800 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:09.777179 (+194379us) raft_consensus.cc:1685] finished
0709 13:15:09.777204 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:09.777375 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10585,"raft.queue_time_us":44466,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":10657,"thread_start_us":443818,"threads_started":3,"wal-append.queue_time_us":394515}
I20260709 13:15:09.783012  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:09.764866  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 806636us
I20260709 13:15:09.787998  6219 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:09.788250  9183 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:09.789537  9126 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:09.559530  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:09.508143  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:09.548940  6369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.000s	sys 0.008s
I20260709 13:15:09.630967  8705 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.716252  8999 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.713809  9027 consensus_queue.cc:237] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:09.640321  9051 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:09.087404  9093 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.918215  9093 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:08.978873  9112 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:08.978605  9123 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:09.676540  9147 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:09.693354  6251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2116) took 2465 ms (client timeout 2668 ms). Trace:
W20260709 13:15:09.925678  6251 rpcz_store.cc:269] 0709 13:15:07.227995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.375859 (+147864us) service_pool.cc:224] Handling call
0709 13:15:09.692855 (+2316996us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b54001739d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:09.693078 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19167104}
I20260709 13:15:09.704802  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2387) took 1324 ms. Trace:
I20260709 13:15:09.706429  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2392) took 1296 ms. Trace:
I20260709 13:15:09.709754  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 655) took 2322 ms. Trace:
W20260709 13:15:09.470629  9169 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.019s	sys 0.034s
I20260709 13:15:09.547995  6368 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:08.983992  9189 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:08.937985  9207 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:09.995187  9207 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:08.874090  9213 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:10.002583  9051 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:10.004738  9213 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:09.727095  9208 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:09.754980  9198 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:09.757462  9170 consensus_queue.cc:1059] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:09.769747  6401 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:09.511796  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 449487us
I20260709 13:15:09.778086  9157 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:09.568941  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:09.800920  6397 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:09.583748  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:09.799623  9098 consensus_queue.cc:1059] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:09.793977  9063 raft_consensus.cc:3055] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:15:09.845347  6369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.005s	sys 0.013s
I20260709 13:15:09.814416  9106 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:09.872139  9249 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.872882  9237 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:15:09.881655  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:09.882843  9067 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:09.823184  8705 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:09.883921  6255 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
W20260709 13:15:09.854507  9232 log.cc:927] Time spent T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:15:09.881742  6942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 610) took 1069 ms. Trace:
W20260709 13:15:10.007659  9169 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.019s	sys 0.035s
I20260709 13:15:10.011551  9157 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:09.896193  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 102603us
I20260709 13:15:09.904313  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2385) took 1527 ms. Trace:
I20260709 13:15:09.863348  9126 raft_consensus.cc:697] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:09.952927  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:09.927834  6330 rpcz_store.cc:276] 0709 13:15:07.386996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.387123 (+   127us) service_pool.cc:224] Handling call
0709 13:15:07.387391 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:08.502600 (+1115209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.708990 (+1206390us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002a5154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:09.709476 (+   486us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2557505408}
I20260709 13:15:09.927204  6331 rpcz_store.cc:276] 0709 13:15:08.380238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.404809 (+ 24571us) service_pool.cc:224] Handling call
0709 13:15:09.704223 (+1299414us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b54001680d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:09.704543 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108257536}
I20260709 13:15:09.957347  9246 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:15:09.958402  8870 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.954914  9077 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:09.971427  6247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1378) took 3727 ms (client timeout 1945 ms). Trace:
I20260709 13:15:09.971702  6250 raft_consensus.cc:1240] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:15:09.973009  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1390) took 1727 ms. Trace:
I20260709 13:15:09.976029  8999 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:09.979135  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:09.927541  6328 rpcz_store.cc:276] 0709 13:15:08.409656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.440801 (+ 31145us) service_pool.cc:224] Handling call
0709 13:15:09.705967 (+1265166us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b54002418d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:09.706231 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170140416}
I20260709 13:15:10.005694  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:09.726550  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 543) took 1599 ms. Trace:
I20260709 13:15:09.995221  9189 raft_consensus.cc:697] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:09.889539  6396 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:09.693572  9096 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.018345  6942 rpcz_store.cc:276] 0709 13:15:08.812620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.814171 (+  1551us) service_pool.cc:224] Handling call
0709 13:15:08.814749 (+   578us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:08.815218 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:08.815258 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:08.864077 (+ 48819us) log.cc:844] Serialized 548 byte log entry
0709 13:15:09.272021 (+407944us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:09.272076 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.272158 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:09.881047 (+608889us) raft_consensus.cc:1685] finished
0709 13:15:09.881097 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:09.881475 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":407260,"threads_started":1,"wal-append.queue_time_us":1012497}
I20260709 13:15:10.025216  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:10.025424  6221 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:10.050468  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2147) took 1354 ms. Trace:
I20260709 13:15:10.025949  9249 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:10.089252  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 541) took 2089 ms. Trace:
I20260709 13:15:10.089690  6250 rpcz_store.cc:276] 0709 13:15:07.999448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.047540 (+ 48092us) service_pool.cc:224] Handling call
0709 13:15:09.971150 (+1923610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:10.087419 (+116269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.089012 (+  1593us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400410ad0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:10.089169 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3837725056}
I20260709 13:15:10.090179  9126 consensus_queue.cc:237] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:10.090757  9249 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:10.029299  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 481678us
I20260709 13:15:10.091271  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:10.092118  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2148) took 1366 ms. Trace:
I20260709 13:15:10.092486  6250 rpcz_store.cc:276] 0709 13:15:08.725553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.090946 (+1365393us) service_pool.cc:224] Handling call
0709 13:15:10.092036 (+  1090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.070545  6253 rpcz_store.cc:276] 0709 13:15:08.245002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.429022 (+184020us) service_pool.cc:224] Handling call
0709 13:15:09.972526 (+1543504us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b540036ae54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:09.972779 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693908736}
I20260709 13:15:10.093410  6368 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:10.064989  8711 raft_consensus.cc:3055] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:10.031793  6939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 614) took 1163 ms. Trace:
I20260709 13:15:10.013253  9063 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:10.094216  8711 raft_consensus.cc:740] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:10.095417  9063 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:10.095533  8711 consensus_queue.cc:260] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:10.097067  9063 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.055840  8705 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:10.024147  6323 rpcz_store.cc:276] 0709 13:15:08.366449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.843362 (+476913us) service_pool.cc:224] Handling call
0709 13:15:08.843678 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:08.853733 (+ 10055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:08.853794 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:08.867108 (+ 13314us) log.cc:844] Serialized 26 byte log entry
0709 13:15:09.223833 (+356725us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:09.223894 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.224007 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:09.885017 (+661010us) raft_consensus.cc:1685] finished
0709 13:15:09.887378 (+  2361us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:09.893971 (+  6593us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9657,"raft.queue_time_us":22831,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3971,"thread_start_us":265347,"threads_started":1,"wal-append.queue_time_us":983133}
I20260709 13:15:10.057552  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2138) took 1562 ms. Trace:
W20260709 13:15:10.070300  6247 rpcz_store.cc:269] 0709 13:15:06.243622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.243733 (+   111us) service_pool.cc:224] Handling call
0709 13:15:09.970900 (+3727167us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b5400410ad4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:09.971195 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4756922240}
I20260709 13:15:10.061911  9175 raft_consensus.cc:3055] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:10.063697  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:10.064786  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 1.24327e+06us
I20260709 13:15:10.050928  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 545) took 1316 ms. Trace:
I20260709 13:15:10.139295  6256 rpcz_store.cc:276] 0709 13:15:08.726319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.821355 (+1095036us) service_pool.cc:224] Handling call
0709 13:15:10.042815 (+221460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.080092  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:10.041203  9157 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:10.082360  9098 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:10.082470  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 57246.9us
I20260709 13:15:10.083648  9189 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:10.084642  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:10.072786  6248 rpcz_store.cc:276] 0709 13:15:08.127134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.128797 (+  1663us) service_pool.cc:224] Handling call
0709 13:15:08.130668 (+  1871us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:08.130936 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:08.130973 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:08.131577 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:15:08.361554 (+229977us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:08.361604 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.361690 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:09.725987 (+1364297us) raft_consensus.cc:1685] finished
0709 13:15:09.726022 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:09.726279 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":229637,"threads_started":1,"wal-append.queue_time_us":367914}
I20260709 13:15:10.085239  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:10.087029  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2391) took 1702 ms. Trace:
W20260709 13:15:10.087323  9219 log.cc:927] Time spent T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 1.528s	user 0.004s	sys 0.000s
I20260709 13:15:10.163502  6328 rpcz_store.cc:276] 0709 13:15:08.384869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.085769 (+1700900us) service_pool.cc:224] Handling call
0709 13:15:10.086231 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:10.086614 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:10.086643 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:10.086705 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:10.086738 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.086809 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.086936 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.079134  6255 rpcz_store.cc:276] 0709 13:15:08.696305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.047902 (+351597us) service_pool.cc:224] Handling call
0709 13:15:10.041058 (+993156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.094380  6939 rpcz_store.cc:276] 0709 13:15:08.867874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.953930 (+ 86056us) service_pool.cc:224] Handling call
0709 13:15:08.954545 (+   615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:08.954916 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:08.954941 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:08.956048 (+  1107us) log.cc:844] Serialized 548 byte log entry
0709 13:15:09.272911 (+316863us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:09.272961 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.273053 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:10.031386 (+758333us) raft_consensus.cc:1685] finished
0709 13:15:10.031428 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.031621 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":316551,"threads_started":1,"wal-append.queue_time_us":917115}
I20260709 13:15:10.100409  6397 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:10.105757  6405 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:10.106230  6396 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:10.106268  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 664) took 1923 ms. Trace:
I20260709 13:15:10.170635  9218 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:10.171046  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:10.170866  6324 rpcz_store.cc:276] 0709 13:15:08.182732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.801258 (+618526us) service_pool.cc:224] Handling call
0709 13:15:08.864085 (+ 62827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:09.766254 (+902169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.105920 (+339666us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54001c1e54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:10.106192 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456397696}
I20260709 13:15:10.172111  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2143) took 1626 ms. Trace:
I20260709 13:15:10.172506  6250 rpcz_store.cc:276] 0709 13:15:08.546190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.170680 (+1624490us) service_pool.cc:224] Handling call
0709 13:15:10.172038 (+  1358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.173048  6221 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:10.107877  6251 rpcz_store.cc:276] 0709 13:15:08.494890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.926985 (+1432095us) service_pool.cc:224] Handling call
0709 13:15:10.057455 (+130470us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:10.061465  9159 consensus_meta.cc:287] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.642s	user 0.036s	sys 0.030s
I20260709 13:15:10.096932  8711 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.182317  6937 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:10.185513  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 666) took 1383 ms. Trace:
I20260709 13:15:10.190937  6324 rpcz_store.cc:276] 0709 13:15:08.791627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.172156 (+1380529us) service_pool.cc:224] Handling call
0709 13:15:10.172642 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:10.173012 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:10.173040 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:10.173086 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:10.174385 (+  1299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.174461 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.174598 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.024538  9051 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:10.072839  9211 consensus_meta.cc:287] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 1.616s	user 0.010s	sys 0.019s
I20260709 13:15:10.024802  9093 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:10.173272  6253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:10.173632  6933 raft_consensus.cc:2393] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 4: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:10.211745  9249 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:10.213871  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 116849us
I20260709 13:15:10.138792  9175 raft_consensus.cc:740] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:10.163434  9098 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:10.181913  9159 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:10.241430  9180 consensus_meta.cc:287] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.651s	user 0.019s	sys 0.010s
I20260709 13:15:10.242180  6250 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:10.242627  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:10.243435  6401 raft_consensus.cc:2410] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:10.246309  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:10.244127  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:10.185709  8870 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:10.381338  6397 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:15:10.539464  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 44323us
W20260709 13:15:10.884378  6295 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.007s	sys 0.009s
I20260709 13:15:10.345595  6248 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:10.576545  6222 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:11.043403  9027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.007s	sys 0.008s
W20260709 13:15:10.390123  6325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 657) took 3001 ms (client timeout 2152 ms). Trace:
W20260709 13:15:11.046088  6295 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.008s	sys 0.013s
W20260709 13:15:10.549144  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.884518  6323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.000s	sys 0.015s
I20260709 13:15:10.343446  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:10.671474  6329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 659) took 3280 ms (client timeout 1668 ms). Trace:
I20260709 13:15:11.058318  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2004) took 1497 ms. Trace:
I20260709 13:15:10.253991  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:11.059078  6323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.003s	sys 0.018s
W20260709 13:15:11.059824  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 1.05365e+06us
W20260709 13:15:10.884183  6252 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.002s	sys 0.009s
I20260709 13:15:10.253031  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:15:11.061836  6252 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.010s	sys 0.012s
I20260709 13:15:10.319481  6219 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:10.319280  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 226072us
I20260709 13:15:10.937657  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 520) took 4445 ms. Trace:
I20260709 13:15:11.063911  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2135) took 2551 ms. Trace:
W20260709 13:15:10.386593  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.064353  6250 rpcz_store.cc:276] 0709 13:15:08.493977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.183368 (+1689391us) service_pool.cc:224] Handling call
0709 13:15:10.241921 (+ 58553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.045249 (+803328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.045430 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.342522  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2396) took 1356 ms. Trace:
I20260709 13:15:10.424309  6369 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:11.045538  6247 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
W20260709 13:15:11.059098  6329 rpcz_store.cc:269] 0709 13:15:07.390897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.391679 (+   782us) service_pool.cc:224] Handling call
0709 13:15:10.670878 (+3279199us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b5400039654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:10.671220 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2014021888}
I20260709 13:15:10.292879  6253 raft_consensus.cc:606] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:10.253713  6331 raft_consensus.cc:2376] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4. Re-sending same reply.
I20260709 13:15:11.059828  6397 rpcz_store.cc:276] 0709 13:15:09.546250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.182625 (+636375us) service_pool.cc:224] Handling call
0709 13:15:10.249652 (+ 67027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.043786 (+794134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.043989 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:11.062631  6942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 580) took 1045 ms. Trace:
I20260709 13:15:11.092384  6942 rpcz_store.cc:276] 0709 13:15:10.019248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.219190 (+199942us) service_pool.cc:224] Handling call
0709 13:15:11.062556 (+843366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.580531  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2386) took 2202 ms. Trace:
I20260709 13:15:11.065521  6324 rpcz_store.cc:276] 0709 13:15:08.985889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.244399 (+1258510us) service_pool.cc:224] Handling call
0709 13:15:10.341746 (+ 97347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:10.342082 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:10.342110 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:10.342182 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:10.342221 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.342301 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.342442 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:11.052892  9027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.007s	sys 0.008s
W20260709 13:15:10.899560  9248 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.994s	user 0.001s	sys 0.001s
W20260709 13:15:11.061278  6325 rpcz_store.cc:269] 0709 13:15:07.388352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.388475 (+   123us) service_pool.cc:224] Handling call
0709 13:15:10.389608 (+3001133us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54003944d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:10.389863 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2175782784}
W20260709 13:15:11.074542  6401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2343) took 1508 ms (client timeout 1954 ms). Trace:
I20260709 13:15:10.319633  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:10.319133  9249 raft_consensus.cc:697] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:11.036057  9207 consensus_meta.cc:287] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.040s	user 0.013s	sys 0.000s
W20260709 13:15:10.376544  9255 log.cc:927] Time spent T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 13:15:11.097708  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2398) took 1169 ms. Trace:
I20260709 13:15:11.052273  9147 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:10.897878  9259 raft_consensus.cc:3055] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:10.549377  9261 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
W20260709 13:15:10.341818  9254 log.cc:927] Time spent T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:15:10.575047  9225 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.609s	user 0.000s	sys 0.003s
W20260709 13:15:11.035066  9157 consensus_meta.cc:287] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.813s	user 0.007s	sys 0.005s
I20260709 13:15:11.093710  6326 rpcz_store.cc:276] 0709 13:15:08.377657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.986598 (+608941us) service_pool.cc:224] Handling call
0709 13:15:08.986911 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:09.759195 (+772284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:09.759253 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:09.759300 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:09.759336 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.580158 (+820822us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b5400167bd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:10.580203 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.580369 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1774594816}
W20260709 13:15:11.036976  9222 log.cc:927] Time spent T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 2.493s	user 0.000s	sys 0.004s
W20260709 13:15:10.570315  9185 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 2.985s	user 0.003s	sys 0.000s
I20260709 13:15:10.704181  8794 raft_consensus.cc:3055] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:11.103037  9149 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.291956  9175 consensus_queue.cc:260] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:11.101924  6933 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:11.104027  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 527576us
I20260709 13:15:11.104687  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2397) took 1181 ms. Trace:
I20260709 13:15:11.136439  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:11.136405  6329 rpcz_store.cc:276] 0709 13:15:09.922889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.103590 (+1180701us) service_pool.cc:224] Handling call
0709 13:15:11.104001 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.104300 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:11.104334 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:11.104395 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:11.104424 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.104495 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.104613 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:11.100116  6401 rpcz_store.cc:269] 0709 13:15:09.543582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.768042 (+224460us) service_pool.cc:224] Handling call
0709 13:15:11.051616 (+1283574us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.570165  9213 raft_consensus.cc:3055] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:11.106052  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:10.252054  9098 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.697821  9204 raft_consensus.cc:3055] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:15:11.090276  6404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.000s	sys 0.027s
I20260709 13:15:10.356747  8611 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:11.119011  9260 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.112030  6331 rpcz_store.cc:276] 0709 13:15:09.923218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.063328 (+140110us) service_pool.cc:224] Handling call
0709 13:15:11.092087 (+1028759us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.711813  8958 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:11.111480  9147 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.115782  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59284 (request call id 30) took 1598 ms. Trace:
I20260709 13:15:11.133577  8794 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:11.118875  6368 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:11.173445  6253 rpcz_store.cc:276] 0709 13:15:09.513757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.137917 (+624160us) service_pool.cc:224] Handling call
0709 13:15:11.111549 (+973632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:11.101522  9180 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:10.514678  9123 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.131309  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:11.133249  6400 raft_consensus.cc:2393] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:11.113231  9207 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.127571  9157 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:11.064221  6402 rpcz_store.cc:276] 0709 13:15:06.491946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.564543 (+ 72597us) service_pool.cc:224] Handling call
0709 13:15:06.564814 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.581787 (+ 16973us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:07.179997 (+598210us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.345085 (+165088us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:07.345151 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:07.345204 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.513424 (+3168220us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b1800340120. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572ac62a6 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419
0709 13:15:10.937164 (+423740us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b54001f3e54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:10.937238 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.937440 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24061,"prepare.queue_time_us":643025,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":16971,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":4398,"spinlock_wait_cycles":50249856,"thread_start_us":733185,"threads_started":2,"wal-append.queue_time_us":875744,"wal-append.run_cpu_time_us":45202,"wal-append.run_wall_time_us":1676360}
I20260709 13:15:11.114588  9259 raft_consensus.cc:740] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:11.144428  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 668) took 1217 ms. Trace:
W20260709 13:15:11.146106  6404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.000s	sys 0.028s
I20260709 13:15:10.291630  9096 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:10.384392  9107 consensus_queue.cc:260] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:11.152083  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 667) took 1228 ms. Trace:
I20260709 13:15:11.144404  9192 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:11.113978  9051 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:10.291603  9238 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:11.172940  6942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 584) took 1054 ms. Trace:
W20260709 13:15:11.175731  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 992880us
W20260709 13:15:11.155429  6295 connection.cc:256] RPC call timeout handler was delayed by -1.0432801850001852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:15:11.177907  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 77128.7us
I20260709 13:15:11.143524  9213 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:15:11.202718  9269 log.cc:927] Time spent T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 13:15:11.181464  6400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2336) took 1640 ms (client timeout 2159 ms). Trace:
I20260709 13:15:10.252463  9077 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.185015  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 660) took 3408 ms. Trace:
I20260709 13:15:11.185230  9104 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:11.185065  6936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 581) took 1091 ms. Trace:
W20260709 13:15:11.217783  6400 rpcz_store.cc:269] 0709 13:15:09.540962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.568324 (+ 27362us) service_pool.cc:224] Handling call
0709 13:15:10.343084 (+774760us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800102f98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:15:11.181377 (+838293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454784}
I20260709 13:15:11.151530  8611 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.186880  9123 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:11.187273  8794 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:11.190268  6253 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:15:11.224702  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 555) took 1012 ms. Trace:
I20260709 13:15:11.225054  6253 rpcz_store.cc:276] 0709 13:15:10.211907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.189538 (+977631us) service_pool.cc:224] Handling call
0709 13:15:11.189958 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:11.224446 (+ 34488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.224643 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:11.222815  6936 rpcz_store.cc:276] 0709 13:15:10.093511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.113341 (+1019830us) service_pool.cc:224] Handling call
0709 13:15:11.185007 (+ 71666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:11.145850  9204 raft_consensus.cc:740] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:11.193336  6324 rpcz_store.cc:276] 0709 13:15:09.923809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.118409 (+1194600us) service_pool.cc:224] Handling call
0709 13:15:11.131510 (+ 13101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.135665 (+  4155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:11.135688 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:11.141238 (+  5550us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:11.141278 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.141343 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.141494 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:10.384765  9130 consensus_meta.cc:287] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.393s	user 0.015s	sys 0.007s
I20260709 13:15:11.203756  6256 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:11.204788  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 856505us
I20260709 13:15:11.206429  6325 rpcz_store.cc:276] 0709 13:15:09.923530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.106566 (+1183036us) service_pool.cc:224] Handling call
0709 13:15:11.135797 (+ 29231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.151601 (+ 15804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:11.151643 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:11.151709 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:11.151755 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.151836 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.151982 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:11.208040  9139 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:11.208890  9106 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:11.208994  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 98473.6us
I20260709 13:15:11.176136  9149 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.212397  6326 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:11.331449  6940 raft_consensus.cc:1240] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:11.332231  6940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 612) took 2489 ms. Trace:
I20260709 13:15:11.332916  9149 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:11.332525  6940 rpcz_store.cc:276] 0709 13:15:08.842918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.871381 (+ 28463us) service_pool.cc:224] Handling call
0709 13:15:11.228431 (+2357050us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b580006e498. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abbefc0 00007f457aba9929 00007f457aba93d2 00007f4574120bd4
0709 13:15:11.331037 (+102606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.331939 (+   902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.332150 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14386944}
I20260709 13:15:11.335978  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 669) took 1411 ms. Trace:
I20260709 13:15:11.338824  6326 rpcz_store.cc:276] 0709 13:15:09.924084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.122489 (+1198405us) service_pool.cc:224] Handling call
0709 13:15:11.171816 (+ 49327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.335732 (+163916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.335923 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:11.336133  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:11.340809  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.342561  6249 raft_consensus.cc:2393] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 4: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:11.343432  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:11.344084  6253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:11.214685  6942 rpcz_store.cc:276] 0709 13:15:10.094558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.115607 (+1021049us) service_pool.cc:224] Handling call
0709 13:15:11.149160 (+ 33553us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:11.216996  6295 leader_election.cc:336] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.673s (SENT)
I20260709 13:15:11.228816  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:11.224190  8794 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:11.229635  6328 raft_consensus.cc:1240] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:11.336361  6297 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:11.335464  6939 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
W20260709 13:15:11.369607  9224 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 2.616s	user 0.013s	sys 0.000s
W20260709 13:15:11.369621  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 46848.6us
I20260709 13:15:11.219576  6322 rpcz_store.cc:276] 0709 13:15:07.688914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.514960 (+826046us) service_pool.cc:224] Handling call
0709 13:15:09.707482 (+1192522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:09.708411 (+   929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:09.708452 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:09.709226 (+   774us) log.cc:844] Serialized 26 byte log entry
0709 13:15:09.890325 (+181099us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:09.890366 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.895969 (+  5603us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:10.055947 (+159978us) raft_consensus.cc:1685] finished
0709 13:15:10.055966 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.932436 (+876470us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002418d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:11.097003 (+164567us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5422,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":285,"spinlock_wait_cycles":2741555584,"thread_start_us":180560,"threads_started":1,"wal-append.queue_time_us":307447,"wal-append.run_cpu_time_us":2142,"wal-append.run_wall_time_us":1040758}
I20260709 13:15:11.228964  9107 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:11.370862  6219 connection.cc:256] RPC call timeout handler was delayed by -1.0279348730002766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
I20260709 13:15:11.380702  6936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 582) took 1286 ms. Trace:
W20260709 13:15:11.413549  6937 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 576) took 1397 ms (client timeout 1804 ms). Trace:
W20260709 13:15:11.414050  6937 rpcz_store.cc:269] 0709 13:15:09.980217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.244476 (+264259us) service_pool.cc:224] Handling call
0709 13:15:11.228676 (+984200us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b580006e498. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:15:11.377832 (+149156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62893312}
W20260709 13:15:11.414712  9275 log.cc:927] Time spent T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:15:11.415263  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:11.332957  9077 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:11.416291  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.381155  6936 rpcz_store.cc:276] 0709 13:15:10.093876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.231885 (+1138009us) service_pool.cc:224] Handling call
0709 13:15:11.380614 (+148729us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:11.415608  9249 consensus_queue.cc:237] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:11.421656  6937 raft_consensus.cc:2410] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:15:11.334601  8958 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:11.418763  6369 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:11.374222  9149 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:11.454514  6937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 578) took 1473 ms. Trace:
I20260709 13:15:11.425323  8870 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:11.418665  9180 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.427872  9096 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:11.429483  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:11.428664  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:11.502287  8611 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:11.472057  9051 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.454847  9213 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:11.471549  9265 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.288s	user 0.000s	sys 0.000s
I20260709 13:15:11.487496  9259 consensus_queue.cc:260] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.471851  9149 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.337077  9130 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.503357  9147 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.528270  9207 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:11.528700  9051 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:11.529410  9051 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:11.529245  9180 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:11.530125  9051 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:11.493584  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 276618us
W20260709 13:15:11.531368  9164 log.cc:927] Time spent T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6: Append to log took a long time: real 3.835s	user 0.007s	sys 0.012s
W20260709 13:15:11.531662  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.531488  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2129) took 3038 ms. Trace:
W20260709 13:15:11.532173  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.532236  6256 rpcz_store.cc:276] 0709 13:15:08.492573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.176272 (+1683699us) service_pool.cc:224] Handling call
0709 13:15:11.089406 (+913134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.282152 (+192746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.531275 (+249123us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54001478d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:11.531435 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233948928}
I20260709 13:15:11.379005  9234 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:11.511157  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2389) took 3126 ms. Trace:
I20260709 13:15:11.513144  6940 raft_consensus.cc:2410] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:11.511324  6219 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:11.515318  9139 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.523066  9157 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:11.523702  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 145606us
I20260709 13:15:11.525517  8958 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.526418  9130 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:11.526569  9096 consensus_queue.cc:1059] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:11.527199  6255 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:15:11.527499  9267 log.cc:927] Time spent T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 13:15:11.333097  9094 consensus_queue.cc:1059] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.210s
W20260709 13:15:11.556488  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 51602.3us
I20260709 13:15:11.531792  9180 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:11.533689  6295 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:15:11.534889  6939 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 574) took 1555 ms (client timeout 1965 ms). Trace:
I20260709 13:15:11.535564  9207 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.536628  9149 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:11.545077  6933 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
W20260709 13:15:11.562891  6933 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 577) took 1582 ms (client timeout 2080 ms). Trace:
I20260709 13:15:11.562727  9207 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:11.563298  6933 rpcz_store.cc:269] 0709 13:15:09.980505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.242205 (+261700us) service_pool.cc:224] Handling call
0709 13:15:11.562827 (+1320622us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:11.564329  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:11.537657  6938 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 569) took 1560 ms. Trace:
W20260709 13:15:11.560412  6939 rpcz_store.cc:269] 0709 13:15:09.979554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.246894 (+267340us) service_pool.cc:224] Handling call
0709 13:15:11.534716 (+1287822us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400537fd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:11.534828 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540704640}
I20260709 13:15:11.454936  6937 rpcz_store.cc:276] 0709 13:15:09.980811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.414908 (+1434097us) service_pool.cc:224] Handling call
0709 13:15:11.454447 (+ 39539us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:11.547708  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 202659us
I20260709 13:15:11.547012  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:11.552155  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:11.545146  6327 rpcz_store.cc:276] 0709 13:15:08.384247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.775985 (+1391738us) service_pool.cc:224] Handling call
0709 13:15:09.776685 (+   700us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:09.796144 (+ 19459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:09.796218 (+    74us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:09.798579 (+  2361us) log.cc:844] Serialized 52 byte log entry
0709 13:15:09.848942 (+ 50363us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:10.292430 (+443488us) log.cc:844] Serialized 14 byte log entry
0709 13:15:10.292683 (+   253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.292770 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:11.510921 (+1218151us) raft_consensus.cc:1685] finished
0709 13:15:11.510945 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.511085 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1354452,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":7916,"raft.queue_time_us":357,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":18021,"thread_start_us":440906,"threads_started":2,"wal-append.queue_time_us":209092}
I20260709 13:15:11.555348  6368 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:11.561085  6256 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:11.549347  9234 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.543610  6942 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.564843  9207 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:11.569024  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.571966  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 557) took 1359 ms. Trace:
I20260709 13:15:11.572283  6256 rpcz_store.cc:276] 0709 13:15:10.212407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.539135 (+1326728us) service_pool.cc:224] Handling call
0709 13:15:11.560903 (+ 21768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.571720 (+ 10817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.571919 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:11.574677  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 575) took 1594 ms. Trace:
W20260709 13:15:11.581573  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 48008.8us
I20260709 13:15:11.575122  6941 rpcz_store.cc:276] 0709 13:15:09.979895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.418663 (+1438768us) service_pool.cc:224] Handling call
0709 13:15:11.574617 (+155954us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:11.583334  6369 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:11.565045  6933 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:11.582221  6940 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
W20260709 13:15:11.594213  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 174001us
I20260709 13:15:11.570647  9180 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.596773  6941 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:11.587925  8794 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:11.587468  9201 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:11.604610  6940 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:11.606669  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 558) took 1394 ms. Trace:
I20260709 13:15:11.607051  6256 rpcz_store.cc:276] 0709 13:15:10.212659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.572895 (+1360236us) service_pool.cc:224] Handling call
0709 13:15:11.593426 (+ 20531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.602968 (+  9542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:11.602985 (+    17us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:11.606390 (+  3405us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:11.606449 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.606516 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.606620 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:11.597304  9123 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.597259  9147 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:11.611490  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2393) took 3148 ms. Trace:
I20260709 13:15:11.611173  9139 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.618352  9180 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:11.601325  9207 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.622972  6371 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:11.605671  8794 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:11.620761  9180 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:11.628954  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 73712.6us
I20260709 13:15:11.571079  9204 consensus_queue.cc:260] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:11.612310  9203 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:11.612751  6323 rpcz_store.cc:276] 0709 13:15:08.463338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.141457 (+1678119us) service_pool.cc:224] Handling call
0709 13:15:10.141958 (+   501us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:10.142566 (+   608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:10.142592 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:10.143276 (+   684us) log.cc:844] Serialized 52 byte log entry
0709 13:15:11.060346 (+917070us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:11.609881 (+549535us) log.cc:844] Serialized 14 byte log entry
0709 13:15:11.611211 (+  1330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.611277 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:11.611316 (+    39us) raft_consensus.cc:1685] finished
0709 13:15:11.611326 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.611439 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":274208,"prepare.run_cpu_time_us":295,"prepare.run_wall_time_us":43069,"raft.queue_time_us":19891,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":13701,"thread_start_us":1416344,"threads_started":2,"wal-append.queue_time_us":1071865}
I20260709 13:15:11.641773  6295 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:11.628062  8794 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:11.647104  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 63826.6us
I20260709 13:15:11.655525  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 559) took 1442 ms. Trace:
I20260709 13:15:11.658116  6256 rpcz_store.cc:276] 0709 13:15:10.212975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.607701 (+1394726us) service_pool.cc:224] Handling call
0709 13:15:11.612510 (+  4809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.645554 (+ 33044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:11.645597 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:11.655236 (+  9639us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:11.655277 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.655351 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.655467 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:11.667027  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2339) took 2124 ms. Trace:
I20260709 13:15:11.643388  9203 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:11.625823  9123 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:11.652936  9098 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.669615  6404 rpcz_store.cc:276] 0709 13:15:09.542161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.784077 (+241916us) service_pool.cc:224] Handling call
0709 13:15:09.784559 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:09.802644 (+ 18085us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:10.190902 (+388258us) log.cc:844] Serialized 14 byte log entry
0709 13:15:11.657768 (+1466866us) log.cc:844] Serialized 14 byte log entry
0709 13:15:11.666591 (+  8823us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:11.666656 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:11.666729 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.666811 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.666957 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13253,"prepare.queue_time_us":882175,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":76,"raft.queue_time_us":13381,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":1799073,"threads_started":3,"wal-append.queue_time_us":935720}
W20260709 13:15:11.712478  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 531993us
W20260709 13:15:11.732406  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 114300us
I20260709 13:15:11.708758  6403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2344) took 2164 ms. Trace:
I20260709 13:15:11.697752  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 552) took 1486 ms. Trace:
I20260709 13:15:11.733845  6255 rpcz_store.cc:276] 0709 13:15:10.211013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.262154 (+ 51141us) service_pool.cc:224] Handling call
0709 13:15:10.360889 (+ 98735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:11.558534 (+1197645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.697431 (+138897us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400356954. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:11.697676 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2681472896}
I20260709 13:15:11.693338  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:11.701864  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2141) took 3199 ms. Trace:
W20260709 13:15:11.736276  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:11.737056  6330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.000s	sys 0.017s
W20260709 13:15:11.737387  6398 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.019s
W20260709 13:15:11.740227  6330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.000s	sys 0.017s
W20260709 13:15:11.740486  6398 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.000s	sys 0.020s
I20260709 13:15:11.657395  9192 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:11.737071  6248 rpcz_store.cc:276] 0709 13:15:08.503173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.173220 (+1670047us) service_pool.cc:224] Handling call
0709 13:15:10.173656 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.052441 (+878785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.701576 (+649135us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54003d0754. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:11.701798 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394937088}
I20260709 13:15:11.733618  6403 rpcz_store.cc:276] 0709 13:15:09.543936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.037696 (+493760us) service_pool.cc:224] Handling call
0709 13:15:10.038355 (+   659us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:10.039180 (+   825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:10.039218 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:10.040134 (+   916us) log.cc:844] Serialized 52 byte log entry
0709 13:15:11.050684 (+1010550us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:11.603777 (+553093us) log.cc:844] Serialized 14 byte log entry
0709 13:15:11.604046 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.604114 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:11.708477 (+104363us) raft_consensus.cc:1685] finished
0709 13:15:11.708504 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.708682 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":589598,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":256,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":3701,"thread_start_us":874068,"threads_started":2,"wal-append.queue_time_us":1091867}
W20260709 13:15:11.736718  9273 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 13:15:11.739310  6296 connection.cc:256] RPC call timeout handler was delayed by -2.4706034319999617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
I20260709 13:15:11.707183  8611 raft_consensus.cc:3055] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:11.713092  9180 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:11.752230  6296 connection.cc:256] RPC call timeout handler was delayed by -2.1025034319998213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 13:15:11.701305  9169 raft_consensus.cc:3055] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:11.746961  6251 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
W20260709 13:15:11.748118  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 106446us
I20260709 13:15:11.718341  9051 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:11.736146  9203 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:11.727561  8958 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:11.719843  9139 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:11.753672  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:11.740823  6933 raft_consensus.cc:3055] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:11.758448  9117 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:11.759336  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:11.759687  9098 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:11.757947  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2390) took 3373 ms. Trace:
I20260709 13:15:11.667547  9207 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:11.885399  6935 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.791514  6248 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:15:11.786770  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:11.762697  6296 connection.cc:256] RPC call timeout handler was delayed by -2.0467034319999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
W20260709 13:15:11.863700  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 638975us
I20260709 13:15:11.794339  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2395) took 3233 ms. Trace:
I20260709 13:15:11.762482  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:11.752899  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2341) took 2210 ms. Trace:
W20260709 13:15:11.887343  6296 connection.cc:256] RPC call timeout handler was delayed by -2.0359034319999409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
I20260709 13:15:11.852484  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:11.888706  6328 rpcz_store.cc:276] 0709 13:15:08.561043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.169005 (+1607962us) service_pool.cc:224] Handling call
0709 13:15:11.097717 (+928712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.374315 (+276598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.794083 (+419768us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540001a754. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:11.794277 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291481984}
W20260709 13:15:11.831869  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 43847.9us
W20260709 13:15:11.790617  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 136658us
W20260709 13:15:11.889056  6296 connection.cc:256] RPC call timeout handler was delayed by -2.0134034319999046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
I20260709 13:15:11.889961  6323 raft_consensus.cc:2393] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 6: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:11.851747  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:11.891825  6296 connection.cc:256] RPC call timeout handler was delayed by -1.8802034319999166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
I20260709 13:15:11.566824  6938 rpcz_store.cc:276] 0709 13:15:09.977770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.981225 (+  3455us) service_pool.cc:224] Handling call
0709 13:15:09.981613 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:09.982226 (+   613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:09.982261 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:09.982821 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:15:10.015653 (+ 32832us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:10.024230 (+  8577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.049494 (+ 25264us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:10.897360 (+847866us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b18004a27e0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af8522 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:15:11.537250 (+639890us) raft_consensus.cc:1685] finished
0709 13:15:11.537270 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.537480 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10744,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":19910,"spinlock_wait_cycles":4321536,"thread_start_us":29617,"threads_started":1,"wal-append.queue_time_us":1135961}
I20260709 13:15:11.891935  6322 raft_consensus.cc:2410] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
W20260709 13:15:11.894475  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 51694.5us
W20260709 13:15:11.892324  6296 connection.cc:256] RPC call timeout handler was delayed by -1.7362034319999111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23250000000000004s for a response
W20260709 13:15:11.896034  6296 connection.cc:256] RPC call timeout handler was delayed by -1.23940343199979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2877s for a response
I20260709 13:15:11.885012  9139 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:11.790830  9256 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.784s	user 0.005s	sys 0.015s
I20260709 13:15:11.888881  6398 rpcz_store.cc:276] 0709 13:15:09.542882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.871405 (+328523us) service_pool.cc:224] Handling call
0709 13:15:09.872134 (+   729us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:09.886727 (+ 14593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:09.886788 (+    61us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:10.901560 (+1014772us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b2c000f15d8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f45744dea11 00007f45744ee372 00007f4575c20a01 00007f4575be543a 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2
0709 13:15:10.902353 (+   793us) log.cc:844] Serialized 574 byte log entry
0709 13:15:11.197734 (+295381us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:11.742433 (+544699us) log.cc:844] Serialized 14 byte log entry
0709 13:15:11.744506 (+  2073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.744572 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:11.744609 (+    37us) raft_consensus.cc:1685] finished
0709 13:15:11.750703 (+  6094us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.752815 (+  2112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":456539,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":482,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":27329,"spinlock_wait_cycles":2486016,"thread_start_us":811864,"threads_started":2,"wal-append.queue_time_us":439160}
W20260709 13:15:11.773912  9178 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.005s	sys 0.019s
I20260709 13:15:11.746966  8870 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.899287  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:11.790920  9180 raft_consensus.cc:697] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:11.903064  6296 connection.cc:256] RPC call timeout handler was delayed by -1.1340070629998991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 13:15:11.817760  8820 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:11.754413  8611 raft_consensus.cc:740] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:11.885290  9169 raft_consensus.cc:740] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:11.768707  9238 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:11.941224  9278 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:11.886188  6933 raft_consensus.cc:740] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:11.831328  9234 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:11.942344  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 46868.2us
I20260709 13:15:11.799098  9159 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:11.937367  6219 leader_election.cc:336] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.627s (SENT)
I20260709 13:15:11.901393  9139 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.887753  6330 rpcz_store.cc:276] 0709 13:15:08.384590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.067895 (+1683305us) service_pool.cc:224] Handling call
0709 13:15:10.068339 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:10.068725 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:10.417436 (+348711us) log.cc:844] Serialized 14 byte log entry
0709 13:15:11.751414 (+1333978us) log.cc:844] Serialized 14 byte log entry
0709 13:15:11.757251 (+  5837us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:11.757381 (+   130us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:11.757503 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.757712 (+   209us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.757879 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5233,"prepare.queue_time_us":1146127,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":3983,"raft.queue_time_us":20036,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":12169,"spinlock_wait_cycles":88769664,"thread_start_us":1167452,"threads_started":2}
I20260709 13:15:11.946280  6368 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:11.967204  6939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 617) took 1937 ms. Trace:
I20260709 13:15:11.967641  6939 rpcz_store.cc:276] 0709 13:15:10.030061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.570824 (+1540763us) service_pool.cc:224] Handling call
0709 13:15:11.584619 (+ 13795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:11.612899 (+ 28280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:11.612927 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:11.628448 (+ 15521us) log.cc:844] Serialized 26 byte log entry
0709 13:15:11.743973 (+115525us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:11.744036 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.744134 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:11.966986 (+222852us) raft_consensus.cc:1685] finished
0709 13:15:11.967004 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.967129 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4687,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":13363,"thread_start_us":87026,"threads_started":1,"wal-append.queue_time_us":310795}
W20260709 13:15:11.904774  9178 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.006s	sys 0.027s
I20260709 13:15:11.949934  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:11.969399  9173 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.951263  8794 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.970865  6327 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:11.972386  8794 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:11.794559  9192 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.952896  9175 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.954039  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:11.953913  8611 consensus_queue.cc:260] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.954578  6326 raft_consensus.cc:2376] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5. Re-sending same reply.
I20260709 13:15:11.954447  9169 consensus_queue.cc:260] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:11.955744  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:15:11.956121  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.983182  6941 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:11.958638  9117 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:11.960282  6249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 546) took 3233 ms (client timeout 2109 ms). Trace:
I20260709 13:15:11.975342  6935 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
W20260709 13:15:11.980186  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:11.982231  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.982007  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:11.989755  6935 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 585) took 1894 ms (client timeout 2066 ms). Trace:
W20260709 13:15:11.988273  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.990029  6219 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:11.816133  9296 consensus_queue.cc:1059] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
W20260709 13:15:11.990145  6935 rpcz_store.cc:269] 0709 13:15:10.094892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.609969 (+1515077us) service_pool.cc:224] Handling call
0709 13:15:11.989680 (+379711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:11.995071  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:11.998889  6255 raft_consensus.cc:2393] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:15:11.988798  6249 rpcz_store.cc:269] 0709 13:15:08.726687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.988000 (+261313us) service_pool.cc:224] Handling call
0709 13:15:11.960041 (+2972041us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54003d04d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:11.960214 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3372759936}
I20260709 13:15:12.000448  6323 raft_consensus.cc:1240] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:15:12.000658  6368 connection.cc:256] RPC call timeout handler was delayed by -1.6426738479999585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
W20260709 13:15:12.001436  6368 connection.cc:256] RPC call timeout handler was delayed by -1.6300738479999382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
W20260709 13:15:12.001960  6368 connection.cc:256] RPC call timeout handler was delayed by -1.6156738479999149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260709 13:15:12.002386  6368 connection.cc:256] RPC call timeout handler was delayed by -1.5661738479998348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 13:15:12.002817  6368 connection.cc:256] RPC call timeout handler was delayed by -1.5661738479998348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 13:15:12.004236  6368 connection.cc:256] RPC call timeout handler was delayed by -1.5283738480000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:15:12.004931  6368 connection.cc:256] RPC call timeout handler was delayed by -1.4617738479998934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 13:15:12.005357  6368 connection.cc:256] RPC call timeout handler was delayed by -1.4401738479998585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
I20260709 13:15:11.981073  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:12.005682  6368 connection.cc:256] RPC call timeout handler was delayed by -1.4311738479998439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 13:15:12.006381  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.006805  6325 pending_rounds.cc:85] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 7
W20260709 13:15:12.018899  6368 connection.cc:256] RPC call timeout handler was delayed by -1.3843738479999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
I20260709 13:15:12.007150  8959 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:12.019418  6368 connection.cc:256] RPC call timeout handler was delayed by -1.3024738479998632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
I20260709 13:15:12.008575  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.009846  9296 raft_consensus.cc:3055] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:12.006846  6933 consensus_queue.cc:260] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:12.012770  9107 consensus_meta.cc:287] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 13:15:12.012895  6941 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:12.013514  6936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 615) took 1984 ms. Trace:
I20260709 13:15:11.991530  9117 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:12.019855  6368 connection.cc:256] RPC call timeout handler was delayed by -1.2529738480000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260709 13:15:12.049328  6368 connection.cc:256] RPC call timeout handler was delayed by -1.2025738479999291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 13:15:12.020426  6326 raft_consensus.cc:2393] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:12.021963  6935 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:12.024423  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:12.052742  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:12.053576  9286 log.cc:927] Time spent T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:15:12.054273  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:12.052824  6254 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:12.055040  6255 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.987669  9173 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:12.019275  6325 pending_rounds.cc:107] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:15:12.059314  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:12.060590  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:12.048497  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 49065.1us
I20260709 13:15:12.060873  6297 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:12.059672  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:12.056203  6222 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:12.062495  6325 raft_consensus.cc:2889] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:12.048508  6936 rpcz_store.cc:276] 0709 13:15:10.029394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.421106 (+1391712us) service_pool.cc:224] Handling call
0709 13:15:11.514191 (+ 93085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:11.551687 (+ 37496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:11.551775 (+    88us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:11.562050 (+ 10275us) log.cc:844] Serialized 26 byte log entry
0709 13:15:11.732228 (+170178us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:11.732270 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.732336 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:12.013284 (+280948us) raft_consensus.cc:1685] finished
0709 13:15:12.013303 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:12.013455 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13230,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":123207,"threads_started":1,"wal-append.queue_time_us":257817}
W20260709 13:15:12.059569  6254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2146) took 3423 ms (client timeout 1564 ms). Trace:
I20260709 13:15:12.055060  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 553) took 1843 ms. Trace:
I20260709 13:15:12.005643  9238 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.072263  6933 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.072726  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:12.073534  9173 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.074862  6398 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:12.075794  6938 raft_consensus.cc:2410] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:12.075994  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:12.076377  9173 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:12.076553  6398 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.077286  8794 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:12.077931  8794 raft_consensus.cc:697] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:12.078152  6906 leader_election.cc:336] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.908s (SENT)
I20260709 13:15:12.078616  6906 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:12.079313  6399 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:12.080380  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:12.072862  6397 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:12.073943  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:12.050024  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:12.021636  9296 raft_consensus.cc:740] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:12.061079  9289 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:12.089376  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:12.087123  6295 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:12.116896  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:12.080981  6399 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:12.094165  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:12.070147  6254 rpcz_store.cc:269] 0709 13:15:08.635998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.738612 (+102614us) service_pool.cc:224] Handling call
0709 13:15:12.059394 (+3320782us) spinlock_profiling.cc:243] Waited 3.24 s on lock 0x7b54000f6254. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:12.059505 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7456056064}
W20260709 13:15:12.099684  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 43542.5us
I20260709 13:15:12.102949  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:12.120639  6221 connection.cc:256] RPC call timeout handler was delayed by -1.5872160250000888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
W20260709 13:15:12.014292  6934 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 618) took 1974 ms (client timeout 2171 ms). Trace:
I20260709 13:15:12.001519  8870 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.070307  6247 rpcz_store.cc:276] 0709 13:15:10.211350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.109865 (+898515us) service_pool.cc:224] Handling call
0709 13:15:11.121416 (+ 11551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:11.121853 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:11.121890 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:11.149239 (+ 27349us) log.cc:844] Serialized 26 byte log entry
0709 13:15:11.685701 (+536462us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:11.685761 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.686015 (+   254us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:12.054837 (+368822us) raft_consensus.cc:1685] finished
0709 13:15:12.054857 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:12.055000 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":518,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":19965,"thread_start_us":494494,"threads_started":1,"wal-append.queue_time_us":545164}
W20260709 13:15:12.120575  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 218384us
I20260709 13:15:12.121646  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:12.119628  6323 raft_consensus.cc:2410] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:12.130897  6941 raft_consensus.cc:2393] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 6: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:15:12.125581  6221 connection.cc:256] RPC call timeout handler was delayed by -1.4587137450000682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 13:15:12.060407  9249 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.080893  9108 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.055701  8999 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.127553  6401 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.011739  9297 consensus_queue.cc:1059] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.172s
I20260709 13:15:12.055701  9123 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:12.061254  9095 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.128068  6326 raft_consensus.cc:2410] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:15:12.119599  6942 consensus_meta.cc:287] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.001s
I20260709 13:15:12.067705  8705 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.118777  9207 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:12.154678  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 254214us
I20260709 13:15:12.131932  9277 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:12.132640  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:12.133198  6400 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
W20260709 13:15:12.149789  6368 leader_election.cc:336] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.700s (SENT)
I20260709 13:15:12.102383  8794 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.137924  9296 consensus_queue.cc:260] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.139030  9160 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.139356  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.162714  6324 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:15:12.142634  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:12.145834  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 85077.5us
W20260709 13:15:12.147809  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.116981  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:12.164448  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:12.164778  6938 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:12.168012  9117 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.154966  8999 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.173269  9277 raft_consensus.cc:697] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:12.174486  9277 consensus_queue.cc:237] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.177652  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.157071  9178 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:12.179026  9178 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:12.179404  9178 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:12.179280  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.180675  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.181519  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.182314  9213 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:12.182560  6329 raft_consensus.cc:2410] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:12.183606  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.184383  6329 raft_consensus.cc:2368] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5.
W20260709 13:15:12.127611  6934 rpcz_store.cc:269] 0709 13:15:10.030359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.953738 (+1923379us) service_pool.cc:224] Handling call
0709 13:15:12.004933 (+ 51195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:12.187259  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.152493  6942 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:12.156072  6403 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.188648  6401 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:12.158200  6368 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:12.159513  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:12.159786  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 81780.4us
I20260709 13:15:12.160182  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:12.081269  9173 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:12.173322  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 556) took 1961 ms. Trace:
I20260709 13:15:12.187410  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:12.083758  8959 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:12.155913  6369 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:12.160622  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.098417  9139 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.192481  6297 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:12.192655  6222 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:12.123234  9238 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.193003  6937 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:12.193162  6939 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:12.188134  6329 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:15:12.194021  6250 rpcz_store.cc:276] 0709 13:15:10.212173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.208640 (+996467us) service_pool.cc:224] Handling call
0709 13:15:11.209089 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:11.333374 (+124285us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:11.333402 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:11.336004 (+  2602us) log.cc:844] Serialized 26 byte log entry
0709 13:15:11.739852 (+403848us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:11.739888 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.739952 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:12.173082 (+433130us) raft_consensus.cc:1685] finished
0709 13:15:12.173105 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:12.173268 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":391686,"threads_started":1,"wal-append.queue_time_us":560533}
I20260709 13:15:12.202792  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:12.198738  6323 raft_consensus.cc:2410] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:15:12.199822  6398 raft_consensus.cc:2410] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:12.200345  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:12.204005  6255 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:12.204605  6401 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:12.207049  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:12.203338  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:12.140314  9077 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
W20260709 13:15:12.217643  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 54006.6us
I20260709 13:15:12.217796  6295 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:12.217924  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:12.218557  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:12.219424  6331 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:12.160924  8705 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:12.221648  6906 leader_election.cc:336] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.956s (SENT)
I20260709 13:15:12.223802  6906 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:12.224772  6330 raft_consensus.cc:2410] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:12.220465  6324 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:12.226176  6400 raft_consensus.cc:2393] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:12.227342  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:12.151793  9108 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:12.230993  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:12.227388  6250 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:15:12.161010  9095 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.206072  9104 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.228559  9098 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:12.258714  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:12.262066  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:12.262432  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:12.274403  6405 raft_consensus.cc:2410] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:12.218573  9218 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:12.263063  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 118827us
I20260709 13:15:12.202920  9173 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.262668  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:12.230238  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 89925.2us
I20260709 13:15:12.267825  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.281633  6329 raft_consensus.cc:2393] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:12.268472  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:12.267886  6247 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:12.268847  6402 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:12.220803  9107 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:12.279069  6399 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:12.187819  9180 consensus_queue.cc:237] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:12.280474  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 126471us
I20260709 13:15:12.262146  9160 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:12.277055  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 55422.6us
W20260709 13:15:12.284852  6221 connection.cc:256] RPC call timeout handler was delayed by -1.2238137449999158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
I20260709 13:15:12.284807  6398 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.268301  9051 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:12.286760  6295 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:12.287560  6250 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:12.288877  6399 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:12.289939  6401 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:12.290036  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:12.290907  6396 raft_consensus.cc:2410] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:15:12.291985  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:12.292790  6405 raft_consensus.cc:2410] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:12.279250  9296 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.293283  6399 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:12.293768  6297 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:12.315933  6247 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:12.295048  6404 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.317265  6323 raft_consensus.cc:2393] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:12.321620  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:12.322494  6250 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:12.281837  9098 raft_consensus.cc:697] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:12.294231  6368 leader_election.cc:336] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.714s (SENT)
I20260709 13:15:12.328007  6368 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:12.331020  6295 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:12.288152  9051 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.337379  6401 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:12.338526  6405 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:12.292135  8958 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:12.323776  9117 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:12.341470  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:12.343885  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:12.342078  6906 leader_election.cc:336] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.049s (SENT)
I20260709 13:15:12.347813  6401 raft_consensus.cc:1240] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:12.281416  9104 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.339442  9051 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.353221  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:12.355513  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 61863.7us
I20260709 13:15:12.357712  6323 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:12.342571  8958 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:12.358848  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.360488  6247 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:12.360867  9306 log.cc:927] Time spent T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:15:12.364540  6250 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:12.349866  6933 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:15:12.366007  6401 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:15:12.349313  9175 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:12.355221  8794 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:12.373852  6324 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:12.439735  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.378165  6403 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
W20260709 13:15:12.428294  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 100788us
W20260709 13:15:12.497151  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 85251.7us
W20260709 13:15:12.404439  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.802225  6396 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:12.798979  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 464373us
W20260709 13:15:12.443415  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.428076  6398 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:12.446600  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:12.804495  6399 raft_consensus.cc:1240] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:12.805362  6404 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:12.439281  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 539) took 4746 ms. Trace:
W20260709 13:15:12.799772  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 505522us
W20260709 13:15:12.796626  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.809003  6329 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:12.406483  6296 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:12.811244  6400 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:15:12.821197  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.824681  6323 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:12.801535  6933 pending_rounds.cc:85] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Aborting all ops after (but not including) 6
W20260709 13:15:12.435328  9309 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:15:12.831393  6324 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
I20260709 13:15:12.795873  8705 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:12.375547  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:12.795648  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:12.440519  9238 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:12.835246  6933 pending_rounds.cc:107] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:15:12.843865  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:12.840381  6250 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:12.754849  9314 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:12.841064  6368 leader_election.cc:336] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.730s (SENT)
I20260709 13:15:12.434012  9095 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:12.841410  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:12.840523  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:12.826725  8958 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.439987  9173 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:12.440793  8959 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:12.806046  6252 rpcz_store.cc:276] 0709 13:15:07.696615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.709927 (+ 13312us) service_pool.cc:224] Handling call
0709 13:15:08.425216 (+715289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:08.425636 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:08.425669 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:08.426222 (+   553us) log.cc:844] Serialized 52 byte log entry
0709 13:15:09.696880 (+1270658us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b180035d040. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:15:09.900896 (+204016us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:11.068656 (+1167760us) log.cc:844] Serialized 14 byte log entry
0709 13:15:11.099039 (+ 30383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.112344 (+ 13305us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:11.596566 (+484222us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:12.152764 (+556198us) raft_consensus.cc:1685] finished
0709 13:15:12.152786 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:12.439057 (+286271us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54000f6c50. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:12.439191 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":210,"prepare.queue_time_us":1134363,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":7478,"raft.queue_time_us":9865,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":3681,"spinlock_wait_cycles":1732270208,"thread_start_us":1100351,"threads_started":2,"wal-append.queue_time_us":1524505}
I20260709 13:15:12.857908  9042 raft_consensus.cc:993] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:15:12.847503  6933 raft_consensus.cc:2889] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:12.858103  8959 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.858651  6252 raft_consensus.cc:1240] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:12.858837  6933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 543) took 1237 ms. Trace:
I20260709 13:15:12.859284  6933 rpcz_store.cc:276] 0709 13:15:11.621694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.628747 (+  7053us) service_pool.cc:224] Handling call
0709 13:15:11.693493 (+ 64746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.858575 (+1165082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.858776 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:12.846915  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.861574  6324 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:12.861719  6250 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:12.647837  9178 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.847095  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:12.572952  9098 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.438213  9203 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.850529  9051 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:12.852591  9117 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:12.833827  9315 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:12.846004  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.854549  6398 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:12.855444  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:12.846457  6934 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:12.866014  9095 consensus_queue.cc:1059] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:15:12.867728  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.873564  6324 raft_consensus.cc:2410] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:12.873847  9314 consensus_queue.cc:1059] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:12.874483  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.874557  9314 consensus_queue.cc:1243] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:15:12.873502  6935 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:12.875180  6324 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:12.877620  9203 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:12.877774  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 671) took 1138 ms. Trace:
I20260709 13:15:12.873873  9315 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:12.878132  6327 rpcz_store.cc:276] 0709 13:15:11.739255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.743842 (+  4587us) service_pool.cc:224] Handling call
0709 13:15:12.877614 (+1133772us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b54002913d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:12.877712 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188408704}
I20260709 13:15:12.880249  9315 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:12.880452  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.880975  6405 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:12.856472  6938 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:12.866793  9296 raft_consensus.cc:1081] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:15:12.888120  6322 raft_consensus.cc:2393] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:12.888583  6327 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:12.890268  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.890573  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:12.891422  6323 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:12.889950  9095 raft_consensus.cc:3055] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:12.889938  9173 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:12.931309  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 61670us
I20260709 13:15:12.932924  6331 raft_consensus.cc:1240] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:15:12.937687  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 102213us
I20260709 13:15:12.917441  9095 raft_consensus.cc:740] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:12.947788  8794 raft_consensus.cc:697] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:12.950330  6368 leader_election.cc:336] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.785s (SENT)
I20260709 13:15:12.953184  6368 leader_election.cc:304] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:12.929579  9314 consensus_queue.cc:1059] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:15:12.955235  9324 consensus_queue.cc:1059] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:15:12.947237  9042 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.941388  9315 consensus_queue.cc:1059] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:15:12.965278  9322 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:12.962468  9098 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:15:12.973850  9051 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:12.977955  6368 leader_election.cc:336] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.785s (SENT)
I20260709 13:15:12.983989  6368 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:12.980214  9259 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:12.986496  6368 leader_election.cc:336] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.827s (SENT)
I20260709 13:15:12.986996  9203 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:12.987581  9321 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:12.989903  9178 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:12.991132  9098 raft_consensus.cc:2955] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:12.963120  9173 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:12.993781  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:12.956110  9180 consensus_queue.cc:1059] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:15:13.019673  6403 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:13.011394  6940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 628) took 1053 ms. Trace:
I20260709 13:15:13.034591  6940 rpcz_store.cc:276] 0709 13:15:11.957755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.969908 (+ 12153us) service_pool.cc:224] Handling call
0709 13:15:13.010346 (+1040438us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b580006e498. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abbefc0 00007f457aba9929 00007f457aba93d2 00007f4574120bd4
0709 13:15:13.010633 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.010931 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:13.010981 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:13.011047 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:13.011104 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.011187 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:13.011322 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25343360}
W20260709 13:15:13.003573  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 597203us
I20260709 13:15:12.999950  9320 raft_consensus.cc:3055] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:13.038825  9320 raft_consensus.cc:740] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:13.039849  9320 consensus_queue.cc:260] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.005002  9095 consensus_queue.cc:260] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.042310  9095 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:13.041033  9320 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.046957  8870 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:13.051113  8959 raft_consensus.cc:3055] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:13.051712  8959 raft_consensus.cc:740] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:12.983743  9042 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:13.054737  9042 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:13.061903  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 105320us
I20260709 13:15:13.062778  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:13.019203  9204 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.074641  6221 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:13.081985  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.081076  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:13.083006  6221 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:13.071527  9180 consensus_queue.cc:1243] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:13.090260  6253 raft_consensus.cc:606] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:13.090745  6253 raft_consensus.cc:614] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:13.091288  6254 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:13.093218  9277 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.093782  9277 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.052847  8959 consensus_queue.cc:260] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:13.098416  8959 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.101415  9330 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:13.103197  9330 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:13.103689  9330 raft_consensus.cc:697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:13.106014  6296 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:13.072665  8870 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:13.080677  9203 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:13.112424  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 125978us
I20260709 13:15:13.106966  9178 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:13.004669  9321 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:13.110417  9315 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:13.133306  9315 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:13.133818  9315 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:13.136198  9189 raft_consensus.cc:3055] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:13.136301  9108 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:13.136826  9189 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:13.137799  9189 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.138973  9189 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.140985  6400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 542) took 1050 ms. Trace:
I20260709 13:15:13.141407  6400 rpcz_store.cc:276] 0709 13:15:12.090144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.838941 (+748797us) service_pool.cc:224] Handling call
0709 13:15:12.846154 (+  7213us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:12.868227 (+ 22073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:12.868261 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:12.889211 (+ 20950us) log.cc:844] Serialized 52 byte log entry
0709 13:15:12.983342 (+ 94131us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:12.983422 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.984290 (+   868us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:13.140757 (+156467us) raft_consensus.cc:1685] finished
0709 13:15:13.140778 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:13.140925 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7,"raft.queue_time_us":11827,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":3982,"thread_start_us":29647,"threads_started":1,"wal-append.queue_time_us":169341}
I20260709 13:15:13.143019  9324 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:13.143263  6368 leader_election.cc:336] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.901s (SENT)
W20260709 13:15:13.126227  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:13.144887  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:13.145249  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.129518  6296 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:13.127888  6937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 586) took 2858 ms. Trace:
I20260709 13:15:13.147166  6937 rpcz_store.cc:276] 0709 13:15:10.269171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.570550 (+1301379us) service_pool.cc:224] Handling call
0709 13:15:12.189171 (+618621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.205795 (+ 16624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.127690 (+921895us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b54005375d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:13.127824 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393875200}
I20260709 13:15:13.129484  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:13.079653  8794 consensus_queue.cc:237] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.151525  9324 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.154361  6941 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:13.155049  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:13.156638  9324 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:13.157848  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:13.158653  6942 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:13.161212  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:13.163688  6222 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:13.164664  9333 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:13.166046  6371 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:13.166625  6368 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:13.104633  9330 consensus_queue.cc:237] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:13.114266  9259 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:13.177637  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 48290.9us
I20260709 13:15:13.116040  6934 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:13.177909  6937 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEARNER]: Advancing to term 5
I20260709 13:15:13.181705  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:13.185735  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:13.186353  6942 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:13.183964  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:13.152421  8999 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:13.190303  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:13.178013  9042 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:13.191478  6249 raft_consensus.cc:2393] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:13.177374  9178 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:13.196806  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 196365us
I20260709 13:15:13.191915  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:13.191910  6371 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:13.200014  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2150) took 1447 ms. Trace:
I20260709 13:15:13.201879  6248 rpcz_store.cc:276] 0709 13:15:11.752960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.768687 (+ 15727us) service_pool.cc:224] Handling call
0709 13:15:11.791279 (+ 22592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:11.891311 (+100032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.199768 (+1308457us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5400428ea0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575b5cdc0 00007f4575be8a02 00007f4575be4dd6 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2
0709 13:15:13.199953 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30568832}
I20260709 13:15:13.165243  8870 consensus_queue.cc:1059] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:15:13.201493  6256 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
W20260709 13:15:13.204526  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 121623us
I20260709 13:15:13.184329  9175 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:13.203349  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2349) took 1145 ms. Trace:
I20260709 13:15:13.202415  6222 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:13.205989  6402 rpcz_store.cc:276] 0709 13:15:12.058030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.059756 (+  1726us) service_pool.cc:224] Handling call
0709 13:15:12.060070 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.283232 (+223162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.199477 (+916245us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54003ae3d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:13.203287 (+  3810us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465045760}
I20260709 13:15:13.207274  6296 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:13.187297  9108 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:13.180802  9203 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:15:13.223083  9201 consensus_queue.cc:1059] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:13.223440  9333 raft_consensus.cc:3055] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:13.223299  6933 raft_consensus.cc:2955] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:13.229336  9292 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:13.230676  9318 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:13.233783  6937 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:15:13.235224  9326 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:13.238466  8611 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:13.240098  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1403) took 1157 ms. Trace:
I20260709 13:15:13.324484  6254 rpcz_store.cc:276] 0709 13:15:12.082829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.127258 (+ 44429us) service_pool.cc:224] Handling call
0709 13:15:13.239911 (+1112653us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b5400203854. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:13.240028 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2147575552}
I20260709 13:15:13.242363  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1328) took 1066 ms. Trace:
I20260709 13:15:13.325697  6331 rpcz_store.cc:276] 0709 13:15:12.176269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.225446 (+ 49177us) service_pool.cc:224] Handling call
0709 13:15:12.269944 (+ 44498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:12.937294 (+667350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.242097 (+304803us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54003f3254. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:13.242300 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1519528320}
I20260709 13:15:13.243242  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1314) took 1263 ms. Trace:
I20260709 13:15:13.326902  6330 rpcz_store.cc:276] 0709 13:15:11.980044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.980317 (+   273us) service_pool.cc:224] Handling call
0709 13:15:13.243042 (+1262725us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400167bd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:13.243183 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521209728}
I20260709 13:15:13.244179  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 531) took 1160 ms. Trace:
I20260709 13:15:13.244336  6403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 540) took 1154 ms. Trace:
I20260709 13:15:13.196650  9042 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:13.249881  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 131558us
I20260709 13:15:13.216971  9178 raft_consensus.cc:697] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:13.216612  9175 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:13.255903  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:13.304814  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.316443  9321 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:13.306217  6251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 550) took 3123 ms (client timeout 1841 ms). Trace:
W20260709 13:15:13.334309  6251 rpcz_store.cc:269] 0709 13:15:10.185309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.190475 (+  5166us) service_pool.cc:224] Handling call
0709 13:15:13.254748 (+3064273us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54000f7154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:13.306023 (+ 51275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1566244608}
W20260709 13:15:13.304970  6322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 678) took 1360 ms (client timeout 1701 ms). Trace:
W20260709 13:15:13.335141  6322 rpcz_store.cc:269] 0709 13:15:11.944593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.439473 (+494880us) service_pool.cc:224] Handling call
0709 13:15:13.254518 (+815045us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b54002427d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:13.304908 (+ 50390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200226560}
I20260709 13:15:13.222447  9217 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:13.254999  9169 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:13.315624  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 123749us
W20260709 13:15:13.317807  6905 leader_election.cc:336] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.668s (SENT)
I20260709 13:15:13.321295  6937 pending_rounds.cc:85] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Aborting all ops after (but not including) 4
I20260709 13:15:13.305760  9320 raft_consensus.cc:3055] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:13.328855  6403 rpcz_store.cc:276] 0709 13:15:12.089487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.803566 (+714079us) service_pool.cc:224] Handling call
0709 13:15:13.019430 (+215864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.033757 (+ 14327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.244117 (+210360us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54004380d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:13.244270 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495587712}
W20260709 13:15:13.336706  6368 leader_election.cc:336] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.925s (SENT)
I20260709 13:15:13.328016  6399 rpcz_store.cc:276] 0709 13:15:12.084178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.310988 (+226810us) service_pool.cc:224] Handling call
0709 13:15:12.804340 (+493352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.804909 (+   569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.243967 (+439058us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54000262d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:13.244111 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133783424}
W20260709 13:15:13.305018  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.317606  9333 raft_consensus.cc:740] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:13.336287  6937 pending_rounds.cc:107] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:15:13.321249  9318 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.342084  6937 raft_consensus.cc:2889] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:13.344022  6368 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:13.323843  9173 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.345841  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:13.346563  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:13.345155  6296 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:13.345674  6905 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:13.352751  9201 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:13.346102  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:13.333861  9042 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.361310  6322 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:13.317870  9338 consensus_queue.cc:1059] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:15:13.333632  9175 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.336872  9320 raft_consensus.cc:740] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:13.345860  9318 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:13.324097  8958 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.337759  9098 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:13.375479  6330 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:15:13.375937  6330 pending_rounds.cc:85] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 2
I20260709 13:15:13.376195  6330 pending_rounds.cc:107] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:15:13.376462  6330 raft_consensus.cc:2889] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:13.370147  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:13.363358  9292 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.363006  9217 raft_consensus.cc:697] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:15:13.383695  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 47016.6us
I20260709 13:15:13.384694  6296 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:13.395464  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:13.365084  9201 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:13.397563  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 91882.6us
I20260709 13:15:13.365586  9204 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:13.405520  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:13.406080  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.405917  6906 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:13.406291  6323 raft_consensus.cc:2410] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:13.407218  6327 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:13.409977  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:13.413283  6368 leader_election.cc:336] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.935s (SENT)
I20260709 13:15:13.414242  6368 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:13.415318  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:13.333439  9326 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.356600  9173 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:13.419266  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 54514.4us
I20260709 13:15:13.416085  6331 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
W20260709 13:15:13.422151  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:13.430001  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 86674.3us
I20260709 13:15:13.430346  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:13.431099  6323 raft_consensus.cc:2393] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 4: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:13.405172  9332 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:13.391525  9098 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.436851  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:13.410764  9201 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:13.434854  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.427666  9160 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:13.449303  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:13.434619  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.440205  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:13.450780  6327 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:13.448050  6297 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:13.417177  8999 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:15:13.453289  6330 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:13.452718  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:13.467096  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 67175us
I20260709 13:15:13.479270  6323 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:15:13.484701  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:13.442466  9203 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:13.405167  9292 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:13.452405  9201 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:13.476590  9332 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:13.444284  9051 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:15:13.503759  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:13.533504  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:13.534571  6327 raft_consensus.cc:2410] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
W20260709 13:15:13.514935  6368 leader_election.cc:336] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.987s (SENT)
I20260709 13:15:13.499735  9338 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:13.545423  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 62030.6us
I20260709 13:15:13.429811  9333 consensus_queue.cc:260] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.483745  9344 consensus_queue.cc:1059] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:15:13.444178  9178 consensus_queue.cc:237] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:13.451269  9320 consensus_queue.cc:260] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:13.552482  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 104492us
I20260709 13:15:13.543565  9332 raft_consensus.cc:697] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:13.584815  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:13.585094  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:15:13.586515  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 151542us
I20260709 13:15:13.587495  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:13.592540  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 49222.9us
I20260709 13:15:13.593819  6331 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:13.598812  6935 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:13.603149  9342 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:15:13.620534  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.641106  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:13.509732  9217 consensus_queue.cc:237] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.597838  9347 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:13.612602  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:13.639111  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.549515  9348 consensus_queue.cc:1059] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:15:13.591711  9338 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.641319  9350 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.600665  9192 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:13.650027  9104 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:13.601434  9292 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:13.594318  6934 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:13.596607  8958 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:13.663161  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 318259us
I20260709 13:15:13.663570  6326 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:13.647540  6369 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:13.675096  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.645465  9139 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:13.678134  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 65628.7us
I20260709 13:15:13.665288  9338 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.661926  9320 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:13.684572  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:13.690057  6935 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:13.691114  6331 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:15:13.692456  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 374656us
I20260709 13:15:13.666973  9203 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:13.701895  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 54456.1us
I20260709 13:15:13.706172  6296 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:15:13.707104  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 207778us
I20260709 13:15:13.670369  9344 consensus_queue.cc:1059] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:15:13.678947  9326 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:13.737936  6219 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:13.742722  6331 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:15:13.743064  6331 pending_rounds.cc:85] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 4
I20260709 13:15:13.743294  6331 pending_rounds.cc:107] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:15:13.743516  6331 raft_consensus.cc:2889] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:13.743891  6296 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:13.705824  9098 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:13.709921  9336 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.713341  9220 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:13.766701  6368 leader_election.cc:336] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 2.078s (SENT)
W20260709 13:15:13.771273  9356 log.cc:927] Time spent T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:15:13.777339  8958 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:13.777887  8958 raft_consensus.cc:697] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:13.778481  9336 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.779084  9339 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:13.782621  6296 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:13.713713  9139 consensus_queue.cc:1059] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:15:13.778862  8958 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.665501  9350 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:13.799921  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 145374us
I20260709 13:15:13.800588  9369 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:13.802161  9368 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:13.805279  6368 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:13.665625  9347 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.740996  9204 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:15:13.739145  9349 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:13.741178  9352 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:15:13.742492  9238 consensus_queue.cc:1059] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 13:15:13.825325  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 81431us
I20260709 13:15:13.814502  9220 raft_consensus.cc:697] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:13.766631  9201 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:13.827929  6297 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:13.832454  6936 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:13.744619  9360 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:15:13.811324  9345 consensus_queue.cc:1059] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:15:13.818397  9104 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.821008  9326 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:13.837262  9368 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:13.850163  6331 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:13.851094  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 86684.7us
I20260709 13:15:13.829341  9349 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.861537  9354 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:13.863193  9358 log.cc:927] Time spent T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:15:13.861670  9349 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:13.841671  9340 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.841528  9238 consensus_queue.cc:1243] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:13.745424  9332 consensus_queue.cc:237] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:13.887283  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.890249  6330 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:13.896697  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1330) took 1719 ms. Trace:
W20260709 13:15:13.896747  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 158888us
I20260709 13:15:13.897169  6329 rpcz_store.cc:276] 0709 13:15:12.176865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.287701 (+110836us) service_pool.cc:224] Handling call
0709 13:15:12.800349 (+512648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.809426 (+  9077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.892101 (+1082675us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54001c1950. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:13.896624 (+  4523us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096393600}
W20260709 13:15:13.898682  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 49256.5us
W20260709 13:15:13.899973  6368 leader_election.cc:336] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 2.133s (SENT)
I20260709 13:15:13.856215  9368 raft_consensus.cc:697] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:13.852241  9104 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:13.872859  9175 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.903470  9175 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:13.905397  6219 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:13.901059  6905 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:13.907145  6219 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:13.912290  6219 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:13.913151  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 130575us
I20260709 13:15:13.915817  6329 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
W20260709 13:15:13.910275  9315 consensus_meta.cc:287] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.776s	user 0.005s	sys 0.009s
W20260709 13:15:13.917878  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 121515us
W20260709 13:15:13.909554  9318 consensus_meta.cc:287] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.003s
I20260709 13:15:13.916325  6329 pending_rounds.cc:85] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 5
I20260709 13:15:13.919890  6329 pending_rounds.cc:107] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:15:13.920176  6329 raft_consensus.cc:2889] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:13.921136  6369 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:13.921774  6329 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:13.929881  9347 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:13.918823  9169 consensus_meta.cc:287] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.000s
I20260709 13:15:13.934279  9324 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.934793  9324 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:13.936654  9042 consensus_meta.cc:287] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.564s	user 0.002s	sys 0.007s
W20260709 13:15:13.937362  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 58855.6us
I20260709 13:15:13.937114  9042 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:13.938055  6368 leader_election.cc:336] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 2.189s (SENT)
I20260709 13:15:13.876765  9340 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.940212  9042 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:13.928064  9318 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.942022  9238 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:13.942318  6248 raft_consensus.cc:2368] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5.
I20260709 13:15:13.943159  9203 raft_consensus.cc:3055] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:13.912235  9220 consensus_queue.cc:237] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:13.943576  9203 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:13.943922  9318 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:13.940876  9340 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:13.939042  6368 leader_election.cc:336] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 2.711s (SENT)
I20260709 13:15:13.914772  9360 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:13.913856  9349 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:13.945372  6368 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:13.945276  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.945582  6369 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:13.912701  9377 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:13.959717  9201 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:13.956516  9377 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:13.961786  9377 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.962286  9326 raft_consensus.cc:3055] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:13.962693  9326 raft_consensus.cc:740] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:13.963485  9326 consensus_queue.cc:260] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:13.964527  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.956764  9338 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.965502  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:13.944393  9203 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:13.967990  6329 raft_consensus.cc:2393] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:13.968091  6369 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:13.964896  9326 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.967057  9160 raft_consensus.cc:3055] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:15:13.972563  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 71615.7us
I20260709 13:15:13.921787  9315 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.927842  9204 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.978454  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:13.991979  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:13.994656  6329 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:13.995217  6399 raft_consensus.cc:2410] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:13.978648  9076 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:13.975754  9349 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:15:13.953661  9360 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.000555  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:13.956202  9340 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:15:13.980808  9175 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:13.981267  9380 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:13.945050  9372 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:15:13.982599  9203 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:13.919263  9352 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:15:13.984017  9350 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:13.984395  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:14.030429  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.985743  9368 consensus_queue.cc:237] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:13.988226  6219 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:14.004232  9360 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:13.992057  6905 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:13.997781  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:14.000231  9217 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:14.039430  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 47454.9us
I20260709 13:15:14.039567  6254 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:14.040169  6905 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:14.001521  6401 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:13.995051  9355 consensus_queue.cc:1059] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:15:14.041181  9169 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:14.041630  6905 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:14.002386  6251 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:14.004155  6250 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:15:14.008677  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:14.044534  6249 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:14.040169  9329 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:14.045701  9329 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.046036  9329 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:14.049770  9315 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:14.050864  6369 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:14.051424  9324 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:14.051895  9380 consensus_queue.cc:1059] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:13.990272  9238 raft_consensus.cc:2764] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:15:14.007499  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:13.990238  9160 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:14.011932  9076 raft_consensus.cc:697] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:14.013705  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:13.995800  9369 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.990440  9379 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:14.000593  9204 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:14.036890  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 48807.4us
W20260709 13:15:13.989760  6296 connection.cc:256] RPC call timeout handler was delayed by -1.394527159000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:15:14.084726  6296 connection.cc:256] RPC call timeout handler was delayed by -1.2577271590000692s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260709 13:15:14.086756  6296 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.558s (SENT) [suppressed 24 similar messages]
I20260709 13:15:14.056730  6905 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:14.052906  9169 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:14.053069  9189 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:14.073475  6398 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:14.074061  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:14.034549  6329 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:14.010708  9175 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.107587  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:14.088804  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:14.111110  6397 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:14.108786  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:14.097880  9204 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:14.101307  6247 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:14.104382  9338 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:14.102702  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 46085us
I20260709 13:15:14.115374  6905 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:14.105583  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:14.074514  9139 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:14.070966  9348 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:14.102409  9169 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:14.082733  9369 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:14.102571  9315 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.105100  9324 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:14.089321  9320 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.118484  6905 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:14.059398  9217 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.111816  6329 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 6: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:14.129361  6905 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:14.129362  6939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 547) took 1803 ms. Trace:
I20260709 13:15:14.117960  9139 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:14.135207  9139 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:14.135478  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:14.136088  6330 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:14.121369  9355 consensus_queue.cc:1059] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:15:14.088135  9379 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:14.120397  9340 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:14.124966  9315 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.112337  9175 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:14.120814  9204 raft_consensus.cc:3055] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:14.133147  9343 raft_consensus.cc:3055] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:14.141494  6296 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:14.133288  9180 raft_consensus.cc:3055] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:14.133616  9344 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:14.134038  9361 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:14.134461  9370 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:14.134733  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:14.137990  6219 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:14.130398  6939 rpcz_store.cc:276] 0709 13:15:12.326049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.326199 (+   150us) service_pool.cc:224] Handling call
0709 13:15:12.338383 (+ 12184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.343278 (+  4895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:12.343307 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:12.343345 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:12.343373 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.129116 (+1785743us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b54005d52d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:14.129192 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.129301 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10842368}
I20260709 13:15:14.137012  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:14.120268  9348 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:14.121239  9357 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:14.142527  6400 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: [7.8-9.9]
W20260709 13:15:14.254355  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 112924us
I20260709 13:15:14.254783  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 677) took 2357 ms. Trace:
I20260709 13:15:14.272722  6296 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:14.274294  6322 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
W20260709 13:15:14.277909  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 139980us
I20260709 13:15:14.142041  9369 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:14.143496  9340 raft_consensus.cc:697] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:14.143788  9204 raft_consensus.cc:740] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:14.132122  9320 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.149781  9180 raft_consensus.cc:740] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:14.261476  9344 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.276497  9350 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:14.281401  9352 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:14.270419  6328 rpcz_store.cc:276] 0709 13:15:11.896891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.897217 (+   326us) service_pool.cc:224] Handling call
0709 13:15:11.937373 (+ 40156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.002725 (+ 65352us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:12.081292 (+ 78567us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.066657 (+1985365us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b1800189fa0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572a72c0a 00007f457c1b2219 00007f4572afaa40 00007f4572af54e4 00007f4572af5455 00007f45795dd3c7 00007f4575bef9a7 00007f4575bff0bf 00007f4575bff038
0709 13:15:14.079147 (+ 12490us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.254260 (+175113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:14.254335 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:14.254426 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.254530 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.254703 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89311,"prepare.queue_time_us":1918193,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":97743,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":4330,"spinlock_wait_cycles":58462080,"thread_start_us":238258,"threads_started":3,"wal-append.queue_time_us":234975,"wal-append.run_cpu_time_us":13270,"wal-append.run_wall_time_us":1522111}
I20260709 13:15:14.277040  9348 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:14.145915  9343 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:14.264463  9332 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:14.301600  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:14.306455  6330 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:14.309206  6329 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:14.280944  6296 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:14.296084  9344 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:14.315461  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:14.315995  9388 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:14.321578  9380 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:14.284250  9370 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.326040  9217 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:14.288394  9363 consensus_queue.cc:1059] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:15:14.329463  9290 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:14.330492  9387 log.cc:927] Time spent T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:15:14.330427  9320 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:14.331614  9384 log.cc:927] Time spent T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:15:14.363368  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:14.364172  6330 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:14.261476  9076 consensus_queue.cc:237] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.312160  8794 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:14.346160  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:14.373895  6328 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:14.361591  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:14.374583  9277 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:14.375983  9381 log.cc:927] Time spent T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:15:14.376441  9173 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:14.389827  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:14.390539  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 278869us
I20260709 13:15:14.151080  9160 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.395506  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:14.396919  9343 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.415318  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2411) took 1028 ms. Trace:
I20260709 13:15:14.400804  6397 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
W20260709 13:15:14.378548  9341 log.cc:927] Time spent T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.957s	user 0.008s	sys 0.008s
I20260709 13:15:14.350379  9352 raft_consensus.cc:697] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:14.415745  6326 rpcz_store.cc:276] 0709 13:15:13.386436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.673889 (+287453us) service_pool.cc:224] Handling call
0709 13:15:13.674167 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.674360 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:14.109758 (+435398us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.414970 (+305212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:14.415022 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:14.415082 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.415145 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.415266 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":462158,"prepare.queue_time_us":441058,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":1203,"thread_start_us":239033,"threads_started":1}
W20260709 13:15:14.439672  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 161118us
I20260709 13:15:14.441457  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:14.444350  6933 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:14.389065  9350 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:14.465456  9350 raft_consensus.cc:697] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:14.466442  9350 consensus_queue.cc:237] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.445569  9336 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:14.445712  9370 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:14.392565  9204 consensus_queue.cc:260] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.386608  9332 raft_consensus.cc:697] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:14.478153  9332 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.478710  9366 raft_consensus.cc:3055] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:14.447492  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:14.479446  9366 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:14.442914  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1313) took 2477 ms. Trace:
I20260709 13:15:14.447372  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:14.454461  9386 log.cc:927] Time spent T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:15:14.349323  9388 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.455101  9371 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:14.459242  6933 raft_consensus.cc:1240] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:14.377808  9380 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:14.461473  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:15:14.463281  9377 consensus_meta.cc:287] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260709 13:15:14.392084  9340 consensus_queue.cc:237] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.478734  8794 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:14.453981  9379 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:14.480736  6403 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:15:14.489336  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:14.490814  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:14.456602  9329 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:14.494557  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:14.515955  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.480746  6325 rpcz_store.cc:276] 0709 13:15:11.965900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.966141 (+   241us) service_pool.cc:224] Handling call
0709 13:15:11.987420 (+ 21279us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:12.097769 (+110349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:12.097801 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:12.098452 (+   651us) log.cc:844] Serialized 52 byte log entry
0709 13:15:12.200135 (+101683us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:12.224810 (+ 24675us) log.cc:844] Serialized 14 byte log entry
0709 13:15:13.131005 (+906195us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b18000e0980. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:15:14.066963 (+935958us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.310221 (+243258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.310298 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:14.345540 (+ 35242us) raft_consensus.cc:1685] finished
0709 13:15:14.345572 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.442841 (+ 97269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3649380,"prepare.queue_time_us":1871800,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":62,"raft.queue_time_us":13002,"raft.run_cpu_time_us":442,"raft.run_wall_time_us":44505,"spinlock_wait_cycles":27729408,"thread_start_us":344092,"threads_started":2,"wal-append.queue_time_us":436631,"wal-append.run_cpu_time_us":2382,"wal-append.run_wall_time_us":1092515}
I20260709 13:15:14.481304  9139 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.502094  8794 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:14.494001  9396 log.cc:927] Time spent T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:15:14.494397  9343 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:14.525303  9203 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.519433  9379 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:14.539331  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.531291  9189 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:14.539763  9203 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:14.540508  9366 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.548389  9366 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:14.548784  9203 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:14.549285  6941 raft_consensus.cc:3055] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:14.550462  9360 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:14.496253  9377 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.569938  9377 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:14.555120  6325 raft_consensus.cc:3055] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:14.556844  6941 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:14.472954  9352 consensus_queue.cc:237] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:14.571238  6325 raft_consensus.cc:740] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:14.571751  6941 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.571950  6325 consensus_queue.cc:260] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:14.572691  6941 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:14.572789  6325 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:14.559603  8794 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:14.577498  9331 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.578016  9331 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.580313  9331 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:14.582466  9399 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.583070  9399 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:14.560314  9175 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:14.585412  6369 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:14.565858  9398 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:14.567543  9139 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:14.535470  9169 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.584781  9388 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:14.594220  9203 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:14.540719  9344 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:14.599853  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 159157us
I20260709 13:15:14.494885  9371 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:14.599028  6941 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:14.583415  6322 raft_consensus.cc:2955] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:14.591001  9377 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.544193  9379 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:15.164333  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:14.992591  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.677142  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:15.087633  6325 consensus_meta.cc:287] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.001s
I20260709 13:15:15.175725  6399 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:14.737679  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.612138  6905 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:15.177587  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.815474  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:14.773382  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59284 (request call id 31) took 3549 ms. Trace:
I20260709 13:15:14.641289  6940 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:15:15.179456  6253 rpcz_store.cc:276] 0709 13:15:11.218175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.231955 (+ 13780us) service_pool.cc:224] Handling call
0709 13:15:14.766974 (+3535019us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b5400203854. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575bdf853 00007f457abad60a 00007f45741337d4 00007f4574133762 00007f4574133691 00007f457413360c 00007f45741328c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:14.767124 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4014595840}
I20260709 13:15:14.773828  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:15.163595  6906 leader_election.cc:336] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.729s (SENT)
W20260709 13:15:15.186818  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 448262us
I20260709 13:15:15.188031  6249 raft_consensus.cc:2410] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 11 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:15.188107  6906 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:15.016943  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.836098  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:15.192106  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:14.744375  6248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2159) took 1409 ms (client timeout 1564 ms). Trace:
W20260709 13:15:15.193375  6248 rpcz_store.cc:269] 0709 13:15:13.334678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.334807 (+   129us) service_pool.cc:224] Handling call
0709 13:15:14.744118 (+1409311us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54000f6254. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:14.744291 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345963776}
I20260709 13:15:15.198167  6325 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:15:15.189638  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2423) took 1266 ms. Trace:
I20260709 13:15:15.198869  6328 rpcz_store.cc:276] 0709 13:15:13.923462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.116640 (+1193178us) service_pool.cc:224] Handling call
0709 13:15:15.188961 (+ 72321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.189228 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.189264 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.189321 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:15.189377 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.189445 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.189573 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.198582  6325 pending_rounds.cc:85] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 3
I20260709 13:15:15.200940  6325 pending_rounds.cc:107] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:15:15.201375  6325 raft_consensus.cc:2889] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:14.601441  8999 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.671873  9139 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.673977  9104 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:15.202527  8999 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:15.203254  9104 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:15.202981  9139 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:15.203748  9104 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:15.204778  8999 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:14.603605  9203 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.215366  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2430) took 1246 ms. Trace:
I20260709 13:15:15.215762  6325 rpcz_store.cc:276] 0709 13:15:13.968900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.527695 (+558795us) service_pool.cc:224] Handling call
0709 13:15:14.538081 (+ 10386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.215113 (+677032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.215313 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.211182  6399 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:15.218647  6368 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:14.604804  9399 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:15:14.702764  9220 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.702718  9388 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.222959  9104 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:15.220746  6247 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:15.167532  9371 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:15.197369  9108 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:14.915925  9329 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:15.228591  6322 consensus_meta.cc:287] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.001s
I20260709 13:15:15.044786  9344 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:14.854545  9380 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:14.675654  9169 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:14.731377  9175 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:15.237156  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 73610.5us
I20260709 13:15:14.605187  9398 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:15.227944  9345 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:15.225373  9360 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:15.218293  9203 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:15.218526  9095 raft_consensus.cc:3055] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:14.609949  9348 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:15.240721  9104 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:15.253265  9348 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:15.233605  9399 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.250586  9379 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:15.213044  9377 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:15.243304  9371 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:15.242846  9343 consensus_meta.cc:287] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.001s
W20260709 13:15:15.256600  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 68097.6us
I20260709 13:15:15.247622  9345 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.267170  6368 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:15.249118  9366 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:15.253741  9095 raft_consensus.cc:740] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:15.238448  9388 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:15.270340  6252 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:15:15.239326  9220 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:15.255143  9108 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:15.265369  9345 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:15.274582  6906 leader_election.cc:336] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.841s (SENT)
I20260709 13:15:15.275799  6906 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:15.277490  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.278175  6247 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:15.278666  6368 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:15.279575  6368 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:15.265456  9399 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:15.280403  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.280544  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:15.281328  9388 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:15.281665  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.281883  9399 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:15.282733  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.283707  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:15.284241  6251 raft_consensus.cc:2393] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 4: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:15.284825  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.285400  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:15.285852  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.286056  6255 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:15.286437  6251 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:15.286994  9399 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:15.287322  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:15.287477  9399 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:15.287904  9399 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:15.288394  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.274101  9350 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.289948  6247 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:15:15.289677  9350 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:15.295212  6255 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
W20260709 13:15:15.300810  6255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2161) took 1956 ms (client timeout 2172 ms). Trace:
I20260709 13:15:15.297092  6254 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:15:15.298466  9220 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:15.301893  9139 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:15.302421  6251 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:15.302973  6254 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:15.303243  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:15.298902  6368 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:15.301172  6255 rpcz_store.cc:269] 0709 13:15:13.344824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.273959 (+1929135us) service_pool.cc:224] Handling call
0709 13:15:15.300765 (+ 26806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.305544  6368 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:15.307530  6221 connection.cc:256] RPC call timeout handler was delayed by -1.2506665050000265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 13:15:15.307878  6221 connection.cc:256] RPC call timeout handler was delayed by -1.2409617460000391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2332s for a response
W20260709 13:15:15.308111  6221 connection.cc:256] RPC call timeout handler was delayed by -1.0634665050001786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
I20260709 13:15:15.309935  6221 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:15.310189  6248 raft_consensus.cc:2393] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:15.304142  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.311821  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:15.312417  6941 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
W20260709 13:15:15.312551  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.314203  6368 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:15.315337  6221 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:15.326967  6933 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:15.274255  9409 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:15.268186  9371 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:15.359712  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 44448.9us
I20260709 13:15:15.328926  9104 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:15.360270  9108 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:15.364648  9104 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.360891  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.365041  9104 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:15.365520  6401 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:15:15.365790  9413 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:15:15.366489  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.361080  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.367324  6400 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:15.368127  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:15.368631  6400 raft_consensus.cc:2376] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5. Re-sending same reply.
I20260709 13:15:15.369004  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.369486  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.369625  6398 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:15.370143  6400 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:15.370533  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:15.371079  6398 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:15.371187  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.371961  6400 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:15.373459  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.373481  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2428) took 1447 ms. Trace:
I20260709 13:15:15.374049  6402 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:15.375010  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:15.374271  6326 rpcz_store.cc:276] 0709 13:15:13.925746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.509191 (+583445us) service_pool.cc:224] Handling call
0709 13:15:14.528294 (+ 19103us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:14.534774 (+  6480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.534818 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:14.585852 (+ 51034us) log.cc:844] Serialized 574 byte log entry
0709 13:15:14.997657 (+411805us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:14.997716 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.997817 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.373196 (+375379us) raft_consensus.cc:1685] finished
0709 13:15:15.373222 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.373396 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2060,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":6250,"thread_start_us":361232,"threads_started":1,"wal-append.queue_time_us":620874}
I20260709 13:15:15.375808  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.376147  6326 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:15.376387  6404 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:15.376751  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1339) took 1249 ms. Trace:
I20260709 13:15:15.377245  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.377065  6326 rpcz_store.cc:276] 0709 13:15:14.127303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.375693 (+1248390us) service_pool.cc:224] Handling call
0709 13:15:15.375988 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.376541 (+   553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.376704 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.378136  6404 raft_consensus.cc:2393] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:15.379192  6404 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:15:15.379488  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 689) took 1247 ms. Trace:
I20260709 13:15:15.379997  6326 rpcz_store.cc:276] 0709 13:15:14.131608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.378522 (+1246914us) service_pool.cc:224] Handling call
0709 13:15:15.378863 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.379072 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.379107 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.379155 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:15.379194 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.379246 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.379355 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.361469  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.361654  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.383790  6397 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:15.362823  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.302640  9379 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:15.385075  6405 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:15.382907  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.372911  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.300381  9388 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:15.395917  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:15.305991  9366 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:15.313840  9398 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:15.314172  9220 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:15.493518  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:15.316450  9360 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:15.319931  9139 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:15.517807  6397 raft_consensus.cc:1240] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:15:15.518082  6324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 682) took 3081 ms (client timeout 1964 ms). Trace:
I20260709 13:15:15.469625  6398 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:15.493484  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.518484  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.519387  6327 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:15.518515  6324 rpcz_store.cc:269] 0709 13:15:12.436626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.875948 (+439322us) service_pool.cc:224] Handling call
0709 13:15:15.517866 (+2641918us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b5400293bd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:15.518011 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1847141632}
I20260709 13:15:15.503679  9371 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:15.505101  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.506891  6326 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:15.523797  6405 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:15:15.504451  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.511935  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2415) took 2124 ms. Trace:
I20260709 13:15:15.525686  6331 rpcz_store.cc:276] 0709 13:15:13.387567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.766156 (+378589us) service_pool.cc:224] Handling call
0709 13:15:13.766451 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.854150 (+ 87699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.511736 (+1657586us) spinlock_profiling.cc:243] Waited 80.2 ms on lock 0x7b5400019854. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:15.511882 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184363264}
I20260709 13:15:15.524904  6251 raft_consensus.cc:2410] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:15.513669  6940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 556) took 1117 ms. Trace:
I20260709 13:15:15.527346  6940 rpcz_store.cc:276] 0709 13:15:14.395859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.395971 (+   112us) service_pool.cc:224] Handling call
0709 13:15:15.513467 (+1117496us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54008c0354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:15.513594 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307117824}
I20260709 13:15:15.320902  9415 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.521059  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:15.396790  9117 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:15:15.494473  9314 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:15:15.524663  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 690) took 1391 ms. Trace:
I20260709 13:15:15.536403  6326 rpcz_store.cc:276] 0709 13:15:14.133376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.382025 (+1248649us) service_pool.cc:224] Handling call
0709 13:15:15.506720 (+124695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.524425 (+ 17705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.524600 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.320210  8999 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.184s
W20260709 13:15:15.507627  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 895505us
I20260709 13:15:15.527030  6405 pending_rounds.cc:85] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 1
I20260709 13:15:15.539276  6405 pending_rounds.cc:107] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:15.539589  6405 raft_consensus.cc:2889] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:15.506178  6907 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:15.518949  6253 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:15.531893  6398 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:15.520157  6399 raft_consensus.cc:3055] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:15.541872  6402 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:15.542055  6399 raft_consensus.cc:740] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:15.541159  9415 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:15.308869  9095 consensus_queue.cc:260] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:15.545444  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.571722  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 693) took 1131 ms. Trace:
I20260709 13:15:15.572381  6331 rpcz_store.cc:276] 0709 13:15:14.440407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.528338 (+1087931us) service_pool.cc:224] Handling call
0709 13:15:15.571043 (+ 42705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.571289 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.571326 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.571383 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:15.571441 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.571511 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.571648 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.522341  9139 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.575018  6254 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:15.578167  6253 raft_consensus.cc:1240] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:15.580349  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 74219.1us
I20260709 13:15:15.402663  9352 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 13:15:15.580660  6399 consensus_queue.cc:260] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:15.508692  9388 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:15.586468  6396 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:15.601821  6933 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:15.601061  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:15.609794  6399 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:15.587596  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:15.611080  6936 raft_consensus.cc:2410] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:15.614373  6940 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:15.504253  9104 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:15.577011  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2434) took 1488 ms. Trace:
I20260709 13:15:15.546604  9117 raft_consensus.cc:697] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:15.612564  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:15.618836  6254 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:15.593330  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.615072  6323 rpcz_store.cc:276] 0709 13:15:14.088809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.675035 (+586226us) service_pool.cc:224] Handling call
0709 13:15:14.675370 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.113711 (+438341us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:15.228099 (+114388us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.576675 (+348576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.576726 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:15.576776 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.576835 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.576949 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":159390,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":5242,"thread_start_us":462005,"threads_started":2}
W20260709 13:15:15.608387  9408 log.cc:927] Time spent T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.361s	user 0.000s	sys 0.001s
I20260709 13:15:15.640501  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.636476  6398 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:15.637432  6399 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
W20260709 13:15:15.640204  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.643695  6399 pending_rounds.cc:85] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 6
I20260709 13:15:15.643957  6399 pending_rounds.cc:107] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:15:15.644199  6399 raft_consensus.cc:2889] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:15.628602  6405 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:15.648777  6400 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 2.
I20260709 13:15:15.586603  9139 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:15.656179  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:15.641400  6251 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:15:15.659637  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:15:15.660431  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 255109us
I20260709 13:15:15.617174  9095 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:15.666523  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:15.666489  6295 leader_election.cc:336] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.564s (SENT)
I20260709 13:15:15.667019  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.671233  6253 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:15:15.672186  6295 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:15.671125  6396 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:15.679598  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:15.682220  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.686017  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:15.686893  6935 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:15.690549  6254 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:15.678113  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:15.725157  6936 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:15.693536  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:15.726680  6937 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:15.567708  9332 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:15:15.714036  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.639853  9377 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:15.665323  9407 log.cc:927] Time spent T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.393s	user 0.001s	sys 0.001s
I20260709 13:15:15.568728  9314 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 13:15:15.701455  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:15.729310  9117 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:15.746827  6942 raft_consensus.cc:2393] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:15.719238  9344 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.750180  9344 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:15.751765  9180 consensus_queue.cc:260] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:15.752359  9344 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:15.742748  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:15.728231  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:15.722318  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:15.755880  6937 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:15.761344  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.622737  9419 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:15.734503  9416 log.cc:927] Time spent T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:15:15.760704  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.748839  9388 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:15.768324  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.761706  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:15.743454  9405 log.cc:927] Time spent T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.472s	user 0.000s	sys 0.001s
I20260709 13:15:15.773804  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:15.774762  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2425) took 1850 ms. Trace:
I20260709 13:15:15.753015  9180 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:15.753703  9415 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:15.697796  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:15.730043  6251 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:15.734771  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2436) took 1627 ms. Trace:
I20260709 13:15:15.737666  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:15.775242  6330 rpcz_store.cc:276] 0709 13:15:13.924517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.480069 (+555552us) service_pool.cc:224] Handling call
0709 13:15:14.480414 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:14.487207 (+  6793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.487251 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:14.487808 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:15:14.603947 (+116139us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:14.603986 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.604059 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.774519 (+1170460us) raft_consensus.cc:1685] finished
0709 13:15:15.774543 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.774694 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6394,"raft.queue_time_us":7272,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5834,"thread_start_us":89973,"threads_started":1,"wal-append.queue_time_us":727617}
I20260709 13:15:15.777670  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:15.784425  6325 rpcz_store.cc:276] 0709 13:15:14.106900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.216474 (+1109574us) service_pool.cc:224] Handling call
0709 13:15:15.216794 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.220681 (+  3887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.220729 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.221227 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:15:15.574142 (+352915us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:15.574186 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.574258 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.734549 (+160291us) raft_consensus.cc:1685] finished
0709 13:15:15.734568 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.734696 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3493,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"thread_start_us":327876,"threads_started":1,"wal-append.queue_time_us":488364}
I20260709 13:15:15.785372  6933 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
W20260709 13:15:15.770453  6221 leader_election.cc:336] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.500s (SENT)
I20260709 13:15:15.786055  6221 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:15.764348  9314 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:15.774504  6396 raft_consensus.cc:2376] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5. Re-sending same reply.
I20260709 13:15:15.780633  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:15.764971  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:15.802836  6399 raft_consensus.cc:2410] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:15.796239  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:15.802992  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:15.804845  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 292831us
I20260709 13:15:15.808327  6251 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:15.809352  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.810186  6396 raft_consensus.cc:2410] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:15:15.777038  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:15.812726  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.814193  6253 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:15.766685  9419 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.816900  6222 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:15.820416  6297 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:15.830695  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:15.832003  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 165524us
W20260709 13:15:15.832551  6907 leader_election.cc:336] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.109s (SENT)
I20260709 13:15:15.832612  6222 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:15.833360  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:15.835520  6939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 554) took 1440 ms. Trace:
I20260709 13:15:15.833982  6933 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:15.835366  6295 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:15.840699  6940 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:15.841650  6295 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:15.841735  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.843704  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.844331  6250 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:15.836057  6939 rpcz_store.cc:276] 0709 13:15:14.395238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.395971 (+   733us) service_pool.cc:224] Handling call
0709 13:15:14.396392 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:14.396811 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.396847 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:14.397410 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:15:15.114407 (+716997us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:15.114463 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.114570 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.835262 (+720692us) raft_consensus.cc:1685] finished
0709 13:15:15.835288 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.835446 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17982,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":15182,"thread_start_us":258097,"threads_started":1,"wal-append.queue_time_us":841251}
I20260709 13:15:15.817802  9340 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:15.849149  6295 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:15.811858  6399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36164
I20260709 13:15:15.854264  6399 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:15.854770  6399 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:15.852702  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:15.862044  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:15.863406  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.864419  6253 raft_consensus.cc:2410] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:15.819618  9419 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:15.840335  9314 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:15.841634  9335 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:15.844152  9352 raft_consensus.cc:2764] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:15:15.833935  6938 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:15.879283  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2432) took 1890 ms. Trace:
I20260709 13:15:15.879680  6322 rpcz_store.cc:276] 0709 13:15:13.988862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.582620 (+593758us) service_pool.cc:224] Handling call
0709 13:15:14.583032 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:14.583275 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:15.241305 (+658030us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.878953 (+637648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.879001 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:15.879042 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.879116 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.879230 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25811,"raft.queue_time_us":116581,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":57,"thread_start_us":611423,"threads_started":2,"wal-append.queue_time_us":520734}
I20260709 13:15:15.880487  6253 raft_consensus.cc:1240] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 2. Current term is 3. Ops: []
W20260709 13:15:15.881949  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 95885.6us
W20260709 13:15:15.882804  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:15.884795  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.887041  9388 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:15.887750  9388 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:15.890470  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:15.890529  9388 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:15.892019  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:15.865079  9204 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:15.891788  6371 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:15.852186  9104 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:15.899752  6399 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:15.849362  9350 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:15.903757  6371 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:15.829778  9415 consensus_queue.cc:1059] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:15:15.876165  9335 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.846313  9377 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:15:15.876340  9314 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:15.914808  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 144391us
W20260709 13:15:15.903138  9421 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 13:15:15.902246  9424 log.cc:927] Time spent T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:15:15.918668  6221 leader_election.cc:336] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.675s (SENT)
I20260709 13:15:15.920128  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:15.920683  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:15.922576  6371 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:15.914942  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:15.835906  9428 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:15:15.924073  6399 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:15.925434  6221 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:15.928594  6398 raft_consensus.cc:2393] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:15.921836  9175 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:15.910671  9388 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:15.933054  6221 leader_election.cc:336] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.954s (SENT)
I20260709 13:15:15.936427  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:15.922169  9352 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:15.937284  9352 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.937443  9438 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:15.937875  9352 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:15.937300  6938 raft_consensus.cc:2393] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:15.939076  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2437) took 1804 ms. Trace:
I20260709 13:15:15.936460  6221 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:15.939455  6324 rpcz_store.cc:276] 0709 13:15:14.134273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.520569 (+1386296us) service_pool.cc:224] Handling call
0709 13:15:15.541592 (+ 21023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.542513 (+   921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.542541 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.574428 (+ 31887us) log.cc:844] Serialized 26 byte log entry
0709 13:15:15.773859 (+199431us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:15.773898 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.773964 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.938894 (+164930us) raft_consensus.cc:1685] finished
0709 13:15:15.938913 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.939010 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":586,"raft.queue_time_us":217523,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":11625,"thread_start_us":187828,"threads_started":1,"wal-append.queue_time_us":281954}
I20260709 13:15:15.940793  9438 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:15.940371  6221 leader_election.cc:336] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.105s (SENT)
I20260709 13:15:15.941679  6221 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:15.942909  9438 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:15.947299  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.918453  9335 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:15.923633  9314 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:15.955086  6221 leader_election.cc:336] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.159s (SENT)
I20260709 13:15:15.968271  6221 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:15.969393  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 120361us
I20260709 13:15:15.970561  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:15.932055  9220 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:15.931630  9433 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:15.933637  9388 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:15.981330  6221 leader_election.cc:336] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.215s (SENT)
I20260709 13:15:15.982452  6221 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:15.972354  9180 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:15.988494  6933 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:15.974466  9415 raft_consensus.cc:3055] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:15:15.990623  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.999811  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:16.000567  6253 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:15.976980  9377 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:15.934075  9417 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:15:15.990147  6254 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:15:15.971438  9432 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:16.003839  6296 leader_election.cc:336] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.558s (SENT)
I20260709 13:15:15.976704  9220 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:15.985965  9388 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:16.010066  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2435) took 1906 ms. Trace:
I20260709 13:15:16.011235  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:16.029832  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:16.030557  6296 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:16.031862  6328 rpcz_store.cc:276] 0709 13:15:14.103252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.200686 (+1097434us) service_pool.cc:224] Handling call
0709 13:15:15.221156 (+ 20470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.268083 (+ 46927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.268113 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.268595 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:15:15.577882 (+309287us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:15.577915 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.577973 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.009862 (+431889us) raft_consensus.cc:1685] finished
0709 13:15:16.009880 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.010006 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":257,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"thread_start_us":320262,"threads_started":2,"wal-append.queue_time_us":344088}
I20260709 13:15:16.031123  9220 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:16.031100  9432 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.048002  9432 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:15.989670  9434 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:15.990509  9438 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:15.992419  9139 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.051934  6397 raft_consensus.cc:2368] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6.
W20260709 13:15:16.059082  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 55279.9us
I20260709 13:15:16.011245  9180 raft_consensus.cc:697] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:15.993000  9415 raft_consensus.cc:740] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:16.069538  9362 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:15:16.071440  9426 log.cc:927] Time spent T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:15:16.057731  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:16.083485  6253 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:16.084805  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:16.086560  9415 consensus_queue.cc:260] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:15.994685  9433 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
W20260709 13:15:16.094985  9345 consensus_meta.cc:287] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.000s
I20260709 13:15:16.103825  6937 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:16.099078  9352 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.107743  9440 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:16.123153  9345 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.156211  6253 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:15:16.126125  6329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1337) took 1999 ms (client timeout 1536 ms). Trace:
W20260709 13:15:16.157172  6329 rpcz_store.cc:269] 0709 13:15:14.126778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.134474 (+  7696us) service_pool.cc:224] Handling call
0709 13:15:16.125943 (+1991469us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b54003944d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:16.126052 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107721088}
I20260709 13:15:16.126399  9180 consensus_queue.cc:237] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.127658  9333 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.128378  9178 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:16.132519  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.159610  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.163300  6396 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:16.164052  6248 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:16.164230  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:16.177194  6396 raft_consensus.cc:2376] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5. Re-sending same reply.
I20260709 13:15:16.175998  9415 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.179378  6256 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:15:16.179749  6256 pending_rounds.cc:85] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 3
I20260709 13:15:16.179965  6256 pending_rounds.cc:107] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:15:16.180217  6256 raft_consensus.cc:2889] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:16.163723  9434 raft_consensus.cc:697] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:16.182921  9434 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.186337  9352 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.187026  6405 raft_consensus.cc:2410] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:16.188438  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:16.188989  6939 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:16.190857  9399 consensus_meta.cc:287] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.902s	user 0.011s	sys 0.000s
I20260709 13:15:16.191327  9399 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.192494  6404 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:16.193109  6933 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:16.195571  6404 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 6. Ops: []
I20260709 13:15:16.198241  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.219017  6405 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:16.201093  6939 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:16.185479  9335 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.128891  9314 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.225351  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:16.228477  6405 raft_consensus.cc:2410] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:15:16.199998  9203 consensus_meta.cc:287] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.934s	user 0.012s	sys 0.001s
I20260709 13:15:16.223476  9362 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.231855  6255 raft_consensus.cc:2393] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:16.220186  9433 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:16.239809  6405 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:16.233057  9379 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:16.245204  6967 heartbeater.cc:646] Failed to heartbeat to 127.4.254.62:46653 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.254.62:46653 timed out after 15.000s (SENT)
I20260709 13:15:16.245496  9379 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.246071  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:16.246675  6939 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.247476  9379 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.248853  9345 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:16.235044  9104 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.249642  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1421) took 1501 ms. Trace:
I20260709 13:15:16.249795  9104 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.250085  6252 rpcz_store.cc:276] 0709 13:15:14.748416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.769723 (+ 21307us) service_pool.cc:224] Handling call
0709 13:15:16.249481 (+1479758us) spinlock_profiling.cc:243] Waited 91.4 ms on lock 0x7b54001473d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:16.249586 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210174720}
I20260709 13:15:16.251212  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:16.199908  9178 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.244916  9335 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:16.239583  9095 consensus_meta.cc:287] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260709 13:15:16.253722  9104 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:16.255148  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.255229  9314 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.256130  9399 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.259816  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:16.234890  9175 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.262490  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.262647  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.271373  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.277269  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.277711  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.278501  6322 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:16.278586  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.279217  6324 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:16.279896  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:16.272910  6906 leader_election.cc:336] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.109s (SENT)
I20260709 13:15:16.273661  6404 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:16.280409  6324 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:16.280409  6906 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:16.279695  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.275437  6296 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:16.281561  6329 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:16.281487  6939 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:16.282711  6398 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:16.284503  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.235580  9220 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.285930  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.286520  6324 raft_consensus.cc:2410] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:16.200752  9419 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.287652  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.287923  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.288697  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.290771  6328 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:15:16.290644  6398 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:16.291917  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.235613  9203 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:16.291445  9314 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.293817  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.296259  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.294458  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.297605  6329 raft_consensus.cc:2410] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 7 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:16.288245  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.297969  6939 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:16.298059  6326 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:16.237056  9362 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.299393  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.301204  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:16.300565  6906 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:16.239987  9433 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.301429  6405 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:16.303082  6396 raft_consensus.cc:1240] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:16.305496  6401 raft_consensus.cc:2393] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:16.307586  6296 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:16.309499  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:16.310230  6937 raft_consensus.cc:2393] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:16.285754  9175 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:16.314844  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.315832  6404 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:16.283779  9321 consensus_queue.cc:1059] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:15:16.296911  9418 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:16.311348  6296 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:16.299484  9292 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:15:16.318621  9321 raft_consensus.cc:3055] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:16.319661  9175 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:16.329993  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.320511  9178 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.316594  9180 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:15:16.333810  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.316565  6398 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:16.313877  8611 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:16.324568  9343 consensus_queue.cc:1059] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:15:16.335423  9343 raft_consensus.cc:3055] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:16.335788  9343 raft_consensus.cc:740] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:16.326280  9433 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.336637  9343 consensus_queue.cc:260] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.337710  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.338472  9343 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:16.338755  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.338929  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.339380  6404 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:16.340116  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.340489  6404 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:15:16.340667  6331 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:16.341490  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.341898  6404 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:16.342060  6323 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.301257  9428 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:15:16.342576  9362 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:16.345453  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.346746  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.346818  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:16.347569  6325 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:16.348047  9180 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:16.348384  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.349853  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.350620  6324 raft_consensus.cc:2393] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:16.351337  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.352444  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.354446  9203 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:16.354722  6403 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 552) took 2364 ms (client timeout 2109 ms). Trace:
W20260709 13:15:16.355116  6403 rpcz_store.cc:269] 0709 13:15:13.991099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.994784 (+  3685us) service_pool.cc:224] Handling call
0709 13:15:16.354498 (+2359714us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b5400183b54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:16.354617 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968112384}
I20260709 13:15:16.356340  9220 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.333755  9432 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:16.357589  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.358323  6328 raft_consensus.cc:2393] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:16.358762  9432 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:16.359041  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.359651  6328 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:16.359889  6330 raft_consensus.cc:2393] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:16.360435  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.360893  6371 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:16.361480  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.361783  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2173) took 1078 ms. Trace:
I20260709 13:15:16.362028  6402 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:16.326373  9315 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.362802  6329 raft_consensus.cc:1240] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:16.326787  9451 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:16.363684  9451 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:16.364193  9451 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:16.364596  9419 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:16.361814  6400 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:15:16.367796  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.326894  9388 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.381975  6328 raft_consensus.cc:1275] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:15:16.382418  6328 pending_rounds.cc:85] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 3
I20260709 13:15:16.382681  6328 pending_rounds.cc:107] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:15:16.382961  6328 raft_consensus.cc:2889] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:16.383550  9388 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.384867  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2407) took 3006 ms. Trace:
I20260709 13:15:16.385352  6327 rpcz_store.cc:276] 0709 13:15:13.378514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.563245 (+184731us) service_pool.cc:224] Handling call
0709 13:15:15.519226 (+1955981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.521736 (+  2510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.384640 (+862904us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b5400293bd0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:16.384800 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4420657024}
W20260709 13:15:16.328027  9449 log.cc:927] Time spent T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:15:16.327903  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.328400  9321 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:16.302796  9367 consensus_queue.cc:1059] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:15:16.334678  6322 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:16.403860  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.404561  6322 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.322062  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.405668  6405 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:16.362032  6330 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.369974  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.371172  6296 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:16.362234  6247 rpcz_store.cc:276] 0709 13:15:15.283569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.290897 (+  7328us) service_pool.cc:224] Handling call
0709 13:15:15.291167 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.317421 (+1026254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:16.317450 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:16.317491 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:16.317530 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.361582 (+ 44052us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001b94d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:16.361621 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.361731 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":332,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":30826,"spinlock_wait_cycles":2359367424}
W20260709 13:15:16.374318  6150 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55346 (request call id 391) took 16523 ms (client timeout 15000 ms). Trace:
I20260709 13:15:16.381309  9220 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:16.380797  6323 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
W20260709 13:15:16.422006  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 50938.2us
W20260709 13:15:16.423542  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.387560  9315 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:16.397415  6905 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:16.397680  6331 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:16.387092  6326 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 2.
I20260709 13:15:16.398087  9180 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.434412  6322 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:16.435340  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.435840  6322 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:16.428246  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 114267us
I20260709 13:15:16.430641  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.436499  6325 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:16.437337  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.415063  9314 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:16.395288  9432 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:16.317963  9434 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:16.438797  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.418195  9220 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.437359  6296 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:16.451234  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.439914  6906 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:16.444113  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.442637  6905 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:16.452425  6326 raft_consensus.cc:2393] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:16.452389  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:16.448331  6330 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:16.413401  9362 consensus_queue.cc:1059] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:15:16.453812  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.454344  6330 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:16.454648  6907 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:16.455961  6324 raft_consensus.cc:1240] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:16.438519  9452 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:16.437187  8611 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:16.464923  6322 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:16.470188  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:16.466501  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:16.468155  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.468205  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:16.471802  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:16.472062  9457 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:16.472455  6251 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 3.
I20260709 13:15:16.468405  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:16.468205  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:16.474114  6937 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:15:16.474682  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:16.426960  9372 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:16.473436  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:16.481679  6369 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:16.495456  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:16.451897  9220 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.497174  9443 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:16.497830  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:16.498467  9464 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:16.498750  6369 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:16.499090  9464 raft_consensus.cc:697] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:16.499724  9238 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:16.500092  9464 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.500511  6369 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:16.438491  9418 consensus_queue.cc:1059] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:15:16.503165  6327 raft_consensus.cc:2393] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:16.503099  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:16.497398  9415 raft_consensus.cc:3055] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:16.478591  6296 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:16.413514  6150 rpcz_store.cc:269] 0709 13:14:59.850743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.851128 (+   385us) service_pool.cc:224] Handling call
0709 13:15:00.818463 (+967335us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b54002c15d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4f090 00007f4575bedf3a 00007f457b9a41cc 00007f457baa237e 00007f4579f632a4 00007f4579f63232 00007f4579f63161 00007f4579f630dc 00007f4579f62392 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:16.374059 (+15555596us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:06.350196 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:06.350734 (+   538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:06.350772 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:15:06.350788 (+    16us) tablet.cc:662] Decoding operations
0709 13:15:06.351900 (+  1112us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:06.351973 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:06.352000 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:15:06.353111 (+  1111us) tablet.cc:701] Row locks acquired
0709 13:15:06.354230 (+  1119us) write_op.cc:260] PREPARE: finished
0709 13:15:06.381856 (+ 27626us) write_op.cc:270] Start()
0709 13:15:06.386628 (+  4772us) write_op.cc:276] Timestamp: P: 1783602906377022 usec, L: 0
0709 13:15:06.396786 (+ 10158us) op_driver.cc:348] REPLICATION: starting
0709 13:15:06.444045 (+ 47259us) log.cc:844] Serialized 5523 byte log entry
0709 13:15:11.423607 (+4979562us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:11.691532 (+267925us) op_driver.cc:464] REPLICATION: finished
0709 13:15:12.053165 (+361633us) write_op.cc:301] APPLY: starting
0709 13:15:12.053330 (+   165us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:12.053736 (+   406us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:12.053780 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:12.058701 (+  4921us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:12.059059 (+   358us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:15:12.059107 (+    48us) write_op.cc:312] APPLY: finished
0709 13:15:12.059573 (+   466us) log.cc:844] Serialized 101 byte log entry
0709 13:15:12.059819 (+   246us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:12.060050 (+   231us) write_op.cc:454] Released schema lock
0709 13:15:12.060113 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:12.084673 (+ 24560us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:12.084715 (+    42us) write_op.cc:454] Released schema lock
0709 13:15:12.088950 (+  4235us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b54002c15d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be232a 00007f4575b67f14 00007f4575b67ec3 00007f4575b67e38 00007f4575b67df3 00007f4575b670dc 00007f4575b90e16 00007f4575b78cbb 00007f4575b6339d 00007f4575b66d75
Metrics: {"mutex_wait_us":145707,"reported_tablets":23,"spinlock_wait_cycles":8690688,"child_traces":[["op",{"apply.queue_time_us":269244,"apply.run_cpu_time_us":4924,"apply.run_wall_time_us":79832,"num_ops":14,"prepare.queue_time_us":1447555,"prepare.run_cpu_time_us":17289,"prepare.run_wall_time_us":864792,"raft.queue_time_us":73633,"raft.run_cpu_time_us":11562,"raft.run_wall_time_us":477035,"replication_time_us":5242653,"spinlock_wait_cycles":9656064,"thread_start_us":1293813,"threads_started":4,"wal-append.queue_time_us":1208301,"wal-append.run_cpu_time_us":39903,"wal-append.run_wall_time_us":5411021}]]}
I20260709 13:15:16.500123  9238 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:16.511078  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:16.511633  9238 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.511859  6250 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.463418  9189 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:15:16.443224  9321 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.514010  9321 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:16.517437  9374 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:16.517890  9374 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.518241  9374 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.519104  6250 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:16.520190  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:16.505743  9457 raft_consensus.cc:697] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:16.467898  9433 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:16.521622  9175 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.521574  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:16.522234  9175 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.522827  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:16.523352  6255 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:16.441830  9180 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:16.440471  9315 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.523340  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:16.530097  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:16.533769  6253 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.533881  6247 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:16.531023  6256 raft_consensus.cc:1275] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:16.531553  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:16.532721  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:16.531550  9175 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.473109  9367 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:16.449072  9432 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:16.543738  6405 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:16.543778  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:16.544471  6933 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.541788  6250 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.543068  6369 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:16.546795  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:16.547061  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:16.547430  6403 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.494917  9343 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:16.548708  6398 raft_consensus.cc:1240] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:16.549355  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 109492us
I20260709 13:15:16.553294  6906 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:16.554423  6906 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:16.550524  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:16.501777  9388 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:16.529477  9203 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:16.507691  9415 raft_consensus.cc:740] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:16.521487  9433 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.543960  9367 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.565618  6404 raft_consensus.cc:1240] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:16.562485  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 53288.2us
I20260709 13:15:16.504204  9335 consensus_queue.cc:1059] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:15:16.542927  9139 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.542546  9104 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:16.549892  9418 consensus_queue.cc:1243] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer a13ffe92eb374309a5c8476d9fbbb2b8 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:16.553066  9175 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:16.551976  9343 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:16.570631  6250 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:16.503895  9372 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.571549  6255 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:16.563930  6906 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:16.569464  6403 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:16.560400  9362 raft_consensus.cc:2764] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:15:16.580067  6933 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:16.575877  9175 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.621560  9175 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:16.621759  9459 log.cc:927] Time spent T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:15:16.622290  9180 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:16.580950  9349 raft_consensus.cc:2955] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:16.625762  6371 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:16.626685  9217 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:16.627234  9217 raft_consensus.cc:697] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:16.576092  9371 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:16.570691  9367 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.625492  9451 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:16.632822  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.633481  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:16.574175  9104 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:16.634594  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.575508  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:16.581871  9343 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.637809  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:16.636060  9104 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:16.642079  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 49841.7us
I20260709 13:15:16.643129  6935 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:16.587759  9418 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:16.646216  6371 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:16.650525  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:16.651069  9451 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.653255  9388 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.653656  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 565) took 1131 ms. Trace:
I20260709 13:15:16.628155  9217 consensus_queue.cc:237] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.654115  6397 rpcz_store.cc:276] 0709 13:15:15.522410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.522515 (+   105us) service_pool.cc:224] Handling call
0709 13:15:16.653457 (+1130942us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b5400401d54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:16.653576 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111511808}
I20260709 13:15:16.654011  9388 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:16.656147  6401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2029) took 1291 ms (client timeout 1540 ms). Trace:
W20260709 13:15:16.656558  6401 rpcz_store.cc:269] 0709 13:15:15.364217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.366258 (+  2041us) service_pool.cc:224] Handling call
0709 13:15:16.655969 (+1289711us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b5400183154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:16.656090 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2157869824}
I20260709 13:15:16.657236  9139 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:16.643172  9443 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.662333  9452 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:16.662196  9443 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:16.662842  9452 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.677541  8611 raft_consensus.cc:3055] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:16.677994  8611 raft_consensus.cc:740] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:16.678897  8611 consensus_queue.cc:260] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.680294  8611 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.683457  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:16.648901  6219 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:16.686954  6295 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:16.687595  6402 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:15:16.688216  6402 pending_rounds.cc:85] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 5
I20260709 13:15:16.688593  6402 pending_rounds.cc:107] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:15:16.688966  6402 raft_consensus.cc:2889] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:16.687526  6253 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:16.690879  6295 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:16.636191  6934 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:16.696601  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.697458  6400 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:16.697244  9321 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:16.721313  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.656949  9388 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.722007  6401 raft_consensus.cc:2376] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8. Re-sending same reply.
W20260709 13:15:16.722841  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 74021us
I20260709 13:15:16.728891  6935 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:16.738147  6327 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:16.743635  6331 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:16.694360  9432 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:16.750564  9175 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:16.751729  6221 leader_election.cc:336] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 3.078s (SENT)
I20260709 13:15:16.649294  9238 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:16.707629  9350 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:16.581269  9457 consensus_queue.cc:237] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.643520  9415 consensus_queue.cc:260] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:16.730146  9360 raft_consensus.cc:2764] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:15:16.779536  6221 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:16.793896  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 60309.3us
W20260709 13:15:16.796195  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 341602us
I20260709 13:15:16.710258  9461 consensus_queue.cc:1059] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:15:16.773993  9438 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:16.803851  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.784462  9419 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.804502  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:16.803818  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 577) took 1279 ms. Trace:
I20260709 13:15:16.805239  6254 rpcz_store.cc:276] 0709 13:15:15.524018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.786693 (+262675us) service_pool.cc:224] Handling call
0709 13:15:15.810149 (+ 23456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:16.029344 (+219195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.803584 (+774240us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400356954. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:16.803765 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413286144}
I20260709 13:15:16.804667  6907 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:16.779979  9371 raft_consensus.cc:697] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:16.797037  9042 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:16.777329  9321 consensus_queue.cc:1059] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:15:16.782902  9432 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:15:16.800401  9415 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:16.825433  6221 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:16.803189  9372 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.826956  6221 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:16.828703  9470 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:16.826310  9377 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:16.829413  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.829429  9461 consensus_queue.cc:1059] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:16.830101  6397 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:16.830475  9461 consensus_queue.cc:1243] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer b940f12ed61a49c4b3c11f13ef50fa92 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:16.830940  9461 raft_consensus.cc:3055] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:16.831178  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:16.831434  6368 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:16.828616  6907 leader_election.cc:400] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6.
I20260709 13:15:16.832057  6907 leader_election.cc:403] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:16.832350  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.832506  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.833081  6399 raft_consensus.cc:2393] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:16.833242  6405 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:16.833597  9471 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6.
I20260709 13:15:16.833874  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.835024  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.831286  9461 raft_consensus.cc:740] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:16.835602  6398 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:16.829516  9377 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:16.836685  9377 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:16.836153  9461 consensus_queue.cc:260] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.837368  9402 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:16.837564  9461 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:16.837798  9469 log.cc:927] Time spent T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:15:16.838413  9321 consensus_queue.cc:1243] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:16.838939  9321 raft_consensus.cc:3055] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:16.839247  9321 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:16.839963  9321 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.839896  6368 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:16.845635  9465 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:15:16.845824  9402 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:16.846784  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 645) took 1191 ms. Trace:
I20260709 13:15:16.847056  6368 leader_election.cc:304] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:16.847867  9402 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:16.848461  9402 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:16.847232  6941 rpcz_store.cc:276] 0709 13:15:15.655174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.656095 (+   921us) service_pool.cc:224] Handling call
0709 13:15:15.692194 (+ 36099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.692649 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.692689 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.696528 (+  3839us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.466033 (+769505us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b1800383f80. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:15:16.545464 (+ 79431us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:16.545507 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.545583 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.846489 (+300906us) raft_consensus.cc:1685] finished
0709 13:15:16.846508 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.846726 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":700,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":27641,"spinlock_wait_cycles":50109696,"thread_start_us":77176,"threads_started":1,"wal-append.queue_time_us":945879}
I20260709 13:15:16.848853  9402 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.849050  9371 consensus_queue.cc:237] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.850101  9175 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:16.854498  9104 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:16.856714  6368 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:15:16.861510  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:16.864392  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:16.864845  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.828595  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:16.831956  6403 raft_consensus.cc:2368] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6.
I20260709 13:15:16.795418  9343 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:16.882295  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 55399.4us
I20260709 13:15:16.864100  6368 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:16.848664  9220 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.896415  6368 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:16.867311  9321 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.815793  9419 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.899366  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:16.807220  9438 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.880530  9175 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:16.900527  6937 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:16.903893  6396 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:16.889847  9372 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:16.907562  6368 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:16.891954  9217 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:16.911571  6368 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:16.863507  9377 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:16.914783  6368 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:16.913970  9139 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.916584  9139 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:16.906635  9175 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:16.917493  9175 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:16.921773  9419 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:16.924137  9438 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.925165  9398 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:16.925792  9398 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:16.926278  9398 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.925318  9203 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:16.931183  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:16.942175  9238 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:16.940862  9042 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:16.908763  9326 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:16.951896  6368 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:16.890012  9360 consensus_queue.cc:1059] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:15:16.906728  9388 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:15:16.956073  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 369867us
I20260709 13:15:16.915351  9217 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.914713  9104 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:16.963867  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:16.965093  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:16.965845  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:15:16.967810  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 76463.4us
I20260709 13:15:16.965432  6935 raft_consensus.cc:1240] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:16.975795  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:16.976624  6941 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:16.956682  9326 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:16.987073  6368 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:16.975811  9315 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:16.958468  9238 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:16.907250  9478 consensus_queue.cc:1059] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:15:16.966957  9217 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.961961  9419 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.968842  9220 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:17.014925  9173 raft_consensus.cc:2764] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:15:17.037478  9374 consensus_meta.cc:287] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.004s
I20260709 13:15:17.016160  9238 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.037741  9104 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.042171  9438 raft_consensus.cc:3055] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:17.069868  9438 raft_consensus.cc:740] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:17.071142  9438 consensus_queue.cc:260] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.075304  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:17.075764  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:17.076370  6398 raft_consensus.cc:2376] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7. Re-sending same reply.
I20260709 13:15:17.076426  6942 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:17.077275  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:17.077445  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:17.077888  6399 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:15:17.078107  6397 raft_consensus.cc:2393] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:17.078876  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:17.079365  6369 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:17.080288  6907 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:17.081666  6907 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:17.083556  9452 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.085415  9345 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:17.085925  9345 raft_consensus.cc:697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:17.086455  9457 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:17.086740  9479 log.cc:927] Time spent T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 13:15:17.087023  9345 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.090337  9452 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:17.091022  9220 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:17.091439  9220 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.091765  9220 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.093711  9326 consensus_queue.cc:1048] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:17.055960  9238 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:17.095728  6369 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:17.097581  9104 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:17.098212  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:17.050756  9419 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.046873  9402 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:17.059615  9374 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:17.100833  9360 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:17.048745  9367 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:17.068053  9443 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:17.107040  6324 raft_consensus.cc:1240] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:17.047492  9433 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:17.111199  6222 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:17.079403  6401 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.086858  9457 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.088054  9175 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:17.112089  6369 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:17.123581  9160 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:17.113584  9326 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:17.169275  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:17.172235  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:17.115080  9402 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:17.113234  9419 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:17.115789  9478 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:15:17.120831  9438 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:17.109999  9377 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:17.121694  9344 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:17.178303  6399 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:17.159999  9457 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:17.188613  9340 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.189224  9340 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.190901  9478 raft_consensus.cc:1064] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
W20260709 13:15:17.191326  9478 raft_consensus.cc:1068] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Unable to promote non-voter 8600a3fead0e48a7aa813822ec44d0fe: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:17.191937  9340 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:17.197623  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:17.173486  9360 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:17.198495  9457 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.199172  9360 raft_consensus.cc:697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:17.198489  6933 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 3.
I20260709 13:15:17.204051  6222 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:17.205533  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:17.206351  6330 raft_consensus.cc:2393] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:17.207300  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:17.207931  6323 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.170982  9450 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:17.209578  9450 raft_consensus.cc:697] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:17.210986  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:17.210688  9450 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.211606  6331 raft_consensus.cc:2376] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8. Re-sending same reply.
I20260709 13:15:17.212694  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:17.213670  6322 raft_consensus.cc:2410] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:17.217677  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:17.220207  6252 raft_consensus.cc:3055] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:17.220374  9367 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:17.220722  6252 raft_consensus.cc:740] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:17.200309  9360 consensus_queue.cc:237] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.225943  9238 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:17.184767  6401 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:17.226853  9374 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:17.229741  6252 consensus_queue.cc:260] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:17.230679  9344 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.161459  9388 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:17.110404  9343 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:17.234439  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:17.258692  6325 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:17.245174  6323 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:17.247524  6252 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.206434  8999 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:17.260226  8999 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.260738  8999 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.278106  9343 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.282066  6329 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 6. Ops: []
I20260709 13:15:17.244549  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:17.285048  9217 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:17.286369  9175 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:17.286790  6907 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:17.287423  9217 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:17.165345  9398 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.287873  9348 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:17.288313  9348 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.288650  9348 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.289435  9463 raft_consensus.cc:3055] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:17.289300  8611 consensus_queue.cc:1059] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:17.289779  9398 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:17.240363  9478 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:17.290769  9371 raft_consensus.cc:3055] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:17.291169  9371 raft_consensus.cc:740] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:15:17.291781  9486 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:15:17.292192  9371 consensus_queue.cc:260] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.293323  6403 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:17.293464  6907 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:17.294291  9481 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:17.294821  9481 raft_consensus.cc:697] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:17.295835  9344 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:17.295693  9481 consensus_queue.cc:237] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.291143  9478 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.300127  9388 raft_consensus.cc:697] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:17.185820  9326 raft_consensus.cc:697] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:15:17.357234  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 381410us
I20260709 13:15:17.109184  9220 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:17.363495  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 59612.6us
I20260709 13:15:17.372879  6219 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:17.212970  6151 catalog_manager.cc:5697] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 2 to 4, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 4 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:17.358305  6221 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:17.360857  6252 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:17.376989  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:17.278918  9343 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.379696  8999 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.386027  6151 catalog_manager.cc:5697] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 2 to 4, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 4 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:17.388019  6151 catalog_manager.cc:5697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 3 to 6, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 6 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:17.390306  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:17.390859  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:17.391160  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.392561  6221 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:17.289928  9463 raft_consensus.cc:740] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:17.394649  6371 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:17.397573  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:17.397727  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:17.398222  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 411204us
I20260709 13:15:17.398363  6399 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:17.399314  6368 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:17.405010  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:17.406320  6368 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:17.389365  9333 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 6 is higher.
I20260709 13:15:17.443171  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:17.448968  6942 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:17.408372  6221 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:17.364660  9372 raft_consensus.cc:697] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:17.379568  9217 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:17.394505  9371 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.409428  9377 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.408581  9398 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.409917  9335 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.469353  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:17.408959  9173 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.439965  9402 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:17.450881  9467 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:17.479671  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:17.477293  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:17.460095  9139 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:17.382686  9388 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:17.439615  9175 consensus_queue.cc:1048] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:15:17.438907  9204 consensus_queue.cc:1059] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:15:17.445047  9095 consensus_queue.cc:1059] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:15:17.460843  9189 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:15:17.493832  6252 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:17.488680  6934 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:17.474697  9335 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.450552  9213 consensus_queue.cc:1059] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:15:17.492095  9398 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:17.518922  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:17.520211  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:17.496363  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:17.524226  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:17.537264  6254 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.462703  9415 consensus_queue.cc:1059] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:15:17.465837  9217 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:17.477975  9402 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:17.488929  6151 catalog_manager.cc:5697] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 4 to 5, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 5 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:17.533978  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:17.532986  9335 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.488706  9203 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:17.538051  6249 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:17.543105  9189 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:17.549336  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:17.477375  9326 consensus_queue.cc:237] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.544940  8999 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:17.546346  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:17.483561  9463 consensus_queue.cc:260] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.538610  9238 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:17.520990  9489 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:15:17.540360  9402 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.601747  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:17.565645  6151 catalog_manager.cc:5697] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 2 to 4, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 4 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:17.584404  6369 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:17.540834  9457 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:17.558128  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:17.555461  9419 raft_consensus.cc:3055] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:15:17.611856  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 235470us
I20260709 13:15:17.575039  9220 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:17.643122  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 200476us
I20260709 13:15:17.556281  6254 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
W20260709 13:15:17.645426  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 61131.3us
I20260709 13:15:17.666144  6296 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:17.573184  9217 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:17.668651  6400 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:17.668577  6151 catalog_manager.cc:5697] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 1 to 2, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 2 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:17.572656  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:17.673167  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.673806  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:17.674526  6396 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:17.553781  9203 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:17.677959  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:17.555505  9398 raft_consensus.cc:697] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:17.679657  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:17.681934  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:17.673844  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.685437  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:17.572324  9189 raft_consensus.cc:697] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:17.567495  9478 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:17.546121  9487 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:15:17.685667  6907 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:17.687673  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:17.698642  9160 consensus_meta.cc:287] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.003s
I20260709 13:15:17.657414  9238 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:17.685796  6369 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:17.699086  9398 consensus_queue.cc:237] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:17.676479  9175 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.690883  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:17.700958  9238 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:17.701828  9238 raft_consensus.cc:697] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:17.700901  9175 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.702729  9238 consensus_queue.cc:237] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:17.683394  9367 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:17.708135  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:17.566236  9204 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:15:17.709263  6938 raft_consensus.cc:2410] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:17.691919  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:17.547556  9372 consensus_queue.cc:237] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.710233  9175 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:17.699138  6323 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:17.677850  9220 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.713708  9220 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.715540  9371 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:17.716037  9220 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:17.716104  9371 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:17.716847  9371 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.718125  9345 raft_consensus.cc:3055] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:17.718559  9345 raft_consensus.cc:740] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:17.719467  9345 consensus_queue.cc:260] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.720707  9345 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.721222  9173 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:17.722383  6399 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:17.723675  9335 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:17.725718  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:17.726438  6399 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:17.726482  9203 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:17.564406  9348 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.728096  6399 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:17.728304  6398 raft_consensus.cc:1240] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:15:17.728355  6397 raft_consensus.cc:1240] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:17.729941  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:17.691542  6151 catalog_manager.cc:5697] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 5 to 6, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 6 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:17.662726  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:17.661099  9419 raft_consensus.cc:740] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:17.731981  6256 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:17.733542  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:17.731153  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:17.739976  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:17.740923  6296 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:17.730862  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:17.728999  9348 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:17.760239  6405 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:17.759891  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:17.760562  9160 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:17.761418  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:17.761421  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:17.762032  6397 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.729947  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:17.763203  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:17.763563  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:17.764160  6398 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.764319  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:17.765329  6327 raft_consensus.cc:2410] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:17.765856  6323 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:15:17.760043  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:17.767073  6399 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:17.768055  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:17.768996  6399 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 5: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:17.769304  6331 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:17.770848  6296 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:17.762809  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:17.773635  6296 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:17.738279  9360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.018s	sys 0.013s
W20260709 13:15:17.795173  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.738510  9338 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.749890  9367 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.807829  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:17.759778  6934 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.811039  6151 catalog_manager.cc:5697] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 2 to 3, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 3 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:17.800845  9360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.019s	sys 0.014s
I20260709 13:15:17.718567  9344 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:15:17.785964  9178 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:17.785702  9415 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.848706  6151 catalog_manager.cc:5697] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 3 to 5, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 5 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:15:17.850750  6326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.021s	sys 0.025s
W20260709 13:15:17.851104  6326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.021s	sys 0.025s
W20260709 13:15:17.854684  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.860064  6397 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:17.861027  6404 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:17.829391  9463 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.864500  6151 catalog_manager.cc:5697] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 2 to 3, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 3 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:15:17.874425  6151 catalog_manager.cc:5697] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:17.836206  6398 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:17.840553  6396 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
W20260709 13:15:17.846207  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:17.847222  6324 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.000s	sys 0.044s
W20260709 13:15:17.887035  6324 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.044s
I20260709 13:15:17.846861  9377 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:17.847584  9178 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:17.823907  9338 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.960741  9338 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:17.962312  6941 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:17.828677  9367 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:17.880858  9360 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:17.971778  6908 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.021s	sys 0.034s
I20260709 13:15:17.907260  9415 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:17.974020  6908 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.022s	sys 0.034s
I20260709 13:15:17.961642  9349 raft_consensus.cc:3055] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:17.980330  6221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.016s	sys 0.036s
I20260709 13:15:17.860152  9189 consensus_queue.cc:237] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:17.964051  9348 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.965698  9335 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:17.861651  9419 consensus_queue.cc:260] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.001719  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:18.003163  6370 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.016s	sys 0.022s
W20260709 13:15:18.003597  6370 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.016s	sys 0.022s
I20260709 13:15:18.006313  6331 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:15:17.962848  9178 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.010432  6935 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11. Ops: []
W20260709 13:15:17.978794  9104 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.015s	sys 0.033s
W20260709 13:15:17.980748  6221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.016s	sys 0.036s
I20260709 13:15:18.011247  6151 catalog_manager.cc:5697] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:18.019747  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 611383us
W20260709 13:15:18.012734  6906 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.000s	sys 0.018s
W20260709 13:15:18.021544  6906 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.000s	sys 0.018s
I20260709 13:15:18.021195  9335 consensus_queue.cc:1059] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:17.978231  9349 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:17.995179  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:18.029315  6942 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:18.037873  6221 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:17.973826  9360 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:18.024367  9104 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.016s	sys 0.033s
I20260709 13:15:18.055403  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.055604  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:18.056715  6250 raft_consensus.cc:1240] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:18.057215  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:18.057523  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:18.057806  6937 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:18.019856  9173 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:18.072844  6937 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:18.073060  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:18.074661  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:18.078338  6297 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:18.080153  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.081022  6250 raft_consensus.cc:2393] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:18.082244  6942 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:18.083372  6940 raft_consensus.cc:1240] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:18.084764  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.085273  6941 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:18.085968  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.089659  6250 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:15:18.084015  9443 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.010s	sys 0.028s
I20260709 13:15:18.097529  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.098424  6254 raft_consensus.cc:2393] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:18.099972  6222 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:18.051009  9419 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:18.084770  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.110556  6253 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:18.111696  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.083870  6248 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:18.097645  9443 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.010s	sys 0.029s
I20260709 13:15:18.104552  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:18.116611  6254 raft_consensus.cc:2393] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:18.116096  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.105510  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.061882  9335 raft_consensus.cc:3055] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:18.011390  9348 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.047338  9117 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 13:15:18.108055  6219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.003s	sys 0.032s
W20260709 13:15:18.119480  6219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.003s	sys 0.032s
I20260709 13:15:18.113070  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.118408  6250 raft_consensus.cc:1240] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:18.012359  9496 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.097s
W20260709 13:15:18.115797  6251 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.003s	sys 0.029s
I20260709 13:15:18.117724  6249 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
W20260709 13:15:18.121107  6251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.003s	sys 0.029s
I20260709 13:15:18.121313  6253 raft_consensus.cc:1240] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:18.121770  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:18.122541  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:18.122604  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:18.125064  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 675618us
I20260709 13:15:18.080392  9438 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:18.080178  9415 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.127333  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:18.079131  9457 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:18.130360  6248 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.130834  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.052876  9402 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.117486  9467 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:18.056000  9466 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:15:18.126844  9492 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:15:18.086982  9042 consensus_queue.cc:1059] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:15:18.124329  9335 raft_consensus.cc:740] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:18.098049  9488 consensus_queue.cc:1059] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:15:18.138943  9496 consensus_queue.cc:1243] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer 8600a3fead0e48a7aa813822ec44d0fe log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:15:18.161082  6250 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:18.177004  6936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 671) took 1012 ms. Trace:
I20260709 13:15:18.083886  9173 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:18.184520  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:18.197494  6252 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:18.130159  9438 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:18.140765  9388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.002s	sys 0.037s
I20260709 13:15:18.149644  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:18.189211  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:18.181838  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:18.195941  6936 rpcz_store.cc:276] 0709 13:15:17.164260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.164385 (+   125us) service_pool.cc:224] Handling call
0709 13:15:17.186797 (+ 22412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.187054 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:17.662871 (+475817us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.176656 (+513785us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.176712 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:18.176759 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.176829 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.176946 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27436,"prepare.queue_time_us":514360,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":32501,"thread_start_us":914082,"threads_started":2}
W20260709 13:15:18.199971  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 53932.3us
I20260709 13:15:18.201488  6396 raft_consensus.cc:2410] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:18.139462  9415 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:18.217715  6400 raft_consensus.cc:1240] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:18.143133  9457 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:18.203881  9481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.029s	sys 0.019s
W20260709 13:15:18.263031  9481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.029s	sys 0.019s
W20260709 13:15:18.263278  9501 log.cc:927] Time spent T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:15:18.199173  9478 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.007s	sys 0.025s
W20260709 13:15:18.201027  9388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.002s	sys 0.037s
I20260709 13:15:18.199394  9467 raft_consensus.cc:697] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:18.203483  9438 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.282859  9415 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:18.284534  9415 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:18.285419  9510 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.286113  9510 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:18.288144  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.288750  9510 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:18.286705  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2456) took 1082 ms. Trace:
W20260709 13:15:18.263932  9478 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.007s	sys 0.026s
W20260709 13:15:18.311079  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.312376  6907 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:18.264264  9367 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:18.296659  6326 rpcz_store.cc:276] 0709 13:15:17.203611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.230675 (+ 27064us) service_pool.cc:224] Handling call
0709 13:15:17.231002 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.231213 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:17.231522 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.691796 (+460274us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b180028b400. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af8522 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:15:18.281310 (+589514us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.282223 (+   913us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:18.283071 (+   848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.284184 (+  1113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.285819 (+  1635us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":209,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":188084,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4100,"spinlock_wait_cycles":3722496,"thread_start_us":1046815,"threads_started":2,"wal-append.queue_time_us":894802}
I20260709 13:15:18.295919  9488 consensus_queue.cc:1243] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer 8600a3fead0e48a7aa813822ec44d0fe log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:15:18.320574  6907 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:18.322423  6295 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:18.219496  9491 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 13:15:18.332515  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.333395  6252 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:18.325376  6295 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:18.217849  9506 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:15:18.355780  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.356690  6250 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
W20260709 13:15:18.358449  6247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.002s	sys 0.016s
W20260709 13:15:18.360343  6247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.002s	sys 0.017s
I20260709 13:15:18.274219  9335 consensus_queue.cc:260] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:18.369392  9467 consensus_queue.cc:237] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.325479  9503 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.373394  9503 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:18.374810  6934 consensus_meta.cc:287] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.001s
I20260709 13:15:18.323300  9481 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:18.323827  9367 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:18.369959  9335 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:18.332608  8611 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:15:18.375936  9512 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:15:18.390787  9343 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:18.414940  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 196416us
I20260709 13:15:18.375824  9360 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:18.375211  6934 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:18.332087  9415 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.403941  9481 raft_consensus.cc:697] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:18.375191  9178 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.383378  9367 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:18.401912  9490 raft_consensus.cc:3055] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:18.413112  9348 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:18.416064  9374 raft_consensus.cc:3055] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:18.426759  6219 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:18.418287  8611 raft_consensus.cc:697] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:18.423241  9402 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:18.460853  6248 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
W20260709 13:15:18.449026  9371 consensus_meta.cc:287] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.732s	user 0.006s	sys 0.013s
I20260709 13:15:18.433593  9503 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:18.449091  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 355208us
W20260709 13:15:18.478916  6296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.016s	sys 0.020s
W20260709 13:15:18.479315  6296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.016s	sys 0.020s
I20260709 13:15:18.464432  6219 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:18.449885  9367 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:18.479874  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 706272us
I20260709 13:15:18.450892  9490 raft_consensus.cc:740] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:18.481523  6296 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:15:18.486385  9433 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.010s	sys 0.011s
W20260709 13:15:18.492169  9433 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.010s	sys 0.011s
I20260709 13:15:18.479936  9371 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.492683  9433 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.466826  9173 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:18.468611  9333 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:18.457252  9523 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:18.461772  9374 raft_consensus.cc:740] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:18.493201  9360 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:18.436003  9525 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:15:18.481655  9499 log.cc:927] Time spent T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.377s	user 0.000s	sys 0.004s
W20260709 13:15:18.514525  9398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.004s	sys 0.012s
I20260709 13:15:18.493345  9433 consensus_queue.cc:1059] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:15:18.479213  9160 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:18.527256  9371 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:18.527791  9433 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:18.528406  9433 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.528795  9433 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:18.527184  9481 consensus_queue.cc:237] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.530521  9349 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.531855  9349 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.517151  9333 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:18.525457  9398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.005s	sys 0.012s
W20260709 13:15:18.535167  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 209854us
I20260709 13:15:18.549086  6295 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:18.530781  9433 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:18.568106  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2455) took 1364 ms. Trace:
I20260709 13:15:18.578549  6324 rpcz_store.cc:276] 0709 13:15:17.203225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.235308 (+ 32083us) service_pool.cc:224] Handling call
0709 13:15:17.235582 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.235782 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:17.887430 (+651648us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.566567 (+679137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.566639 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:18.566699 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.567866 (+  1167us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.568029 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":456058,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":200114,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":1284119,"threads_started":3,"wal-append.queue_time_us":563575}
I20260709 13:15:18.546221  9333 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:18.522226  9523 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:18.595171  6249 raft_consensus.cc:1240] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:18.595870  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:18.559115  9443 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:18.564049  9173 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.537388  9160 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.619774  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:18.619869  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 138405us
I20260709 13:15:18.620920  6296 leader_election.cc:400] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6.
I20260709 13:15:18.621227  6296 leader_election.cc:403] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:15:18.623991  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:18.590301  9433 raft_consensus.cc:3055] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:18.624089  9525 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:18.624820  6327 raft_consensus.cc:2393] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 6: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:18.537137  8611 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.600559  9443 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:18.632454  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.628939  9433 raft_consensus.cc:740] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:18.634179  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:18.634806  9497 log.cc:927] Time spent T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.528s	user 0.000s	sys 0.001s
I20260709 13:15:18.634985  6326 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:18.631929  9443 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.644750  6296 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:18.650440  6937 raft_consensus.cc:1240] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:18.653065  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:18.654824  9398 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.654762  6906 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:18.658417  6939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 672) took 1467 ms. Trace:
I20260709 13:15:18.573820  9374 consensus_queue.cc:260] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.662065  6906 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:18.662504  6327 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: [6.5-9.6]
I20260709 13:15:18.658859  6939 rpcz_store.cc:276] 0709 13:15:17.190649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.190812 (+   163us) service_pool.cc:224] Handling call
0709 13:15:17.191156 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:17.191512 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.191544 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:17.192039 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:15:17.633318 (+441279us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:17.633376 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.633442 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:18.634253 (+1000811us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:18.641055 (+  6802us) raft_consensus.cc:1685] finished
0709 13:15:18.641075 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.658346 (+ 17271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1093,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":7107840,"thread_start_us":440815,"threads_started":1,"wal-append.queue_time_us":827516}
I20260709 13:15:18.668032  6906 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:18.665915  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.668164  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:18.669833  6906 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:18.671025  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 122029us
I20260709 13:15:18.674166  6253 raft_consensus.cc:2393] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:18.633258  9525 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:18.671697  6295 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:18.606514  9173 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.577881  9490 consensus_queue.cc:260] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.702776  6219 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:18.656385  9178 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:18.708619  6327 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:15:18.711354  9345 consensus_meta.cc:287] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.975s	user 0.012s	sys 0.001s
I20260709 13:15:18.690526  9343 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.673727  9095 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:15:18.697480  9521 log.cc:927] Time spent T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:15:18.673911  9461 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.689525  9507 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:18.655433  9398 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.674131  9360 raft_consensus.cc:697] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:18.725863  9551 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.697088  9525 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:18.733285  9536 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:15:18.733815  9553 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.700289  9374 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:18.721993  9463 consensus_meta.cc:287] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.825s	user 0.011s	sys 0.000s
W20260709 13:15:18.719404  9529 log.cc:927] Time spent T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:15:18.751096  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 80191.3us
I20260709 13:15:18.707719  9549 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:18.634817  9433 consensus_queue.cc:260] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:18.718626  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:18.764814  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 105698us
W20260709 13:15:18.749588  9540 log.cc:927] Time spent T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:15:18.720494  9173 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:18.769515  9554 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:18.771245  6906 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
W20260709 13:15:18.693089  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 44743.9us
I20260709 13:15:18.749554  9530 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6.
I20260709 13:15:18.777717  6296 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:18.722579  9438 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:18.817312  9539 consensus_queue.cc:1059] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:18.818756  9438 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:18.819211  9539 consensus_queue.cc:1059] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:18.820202  9539 raft_consensus.cc:3055] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:18.820549  9539 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:18.825873  6253 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:18.762029  9178 consensus_queue.cc:1059] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:15:18.801456  9559 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.802124  9523 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:18.803026  9531 log.cc:927] Time spent T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:15:18.828670  6296 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:18.803735  9398 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:18.807780  9367 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.854934  9178 raft_consensus.cc:3055] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:18.855379  9178 raft_consensus.cc:740] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:18.856523  9367 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:18.856212  9178 consensus_queue.cc:260] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:18.804855  9547 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:18.857324  9547 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.857725  9547 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:18.857542  9539 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.858940  9539 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.860785  6322 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:18.807003  9457 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:18.863974  9546 raft_consensus.cc:3055] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:18.864408  9546 raft_consensus.cc:740] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:18.865208  9546 consensus_queue.cc:260] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.866361  9546 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.871716  9367 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:18.872203  9367 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:18.872608  9367 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.874349  9178 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.762534  9551 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:18.776324  9549 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:18.808985  9537 log.cc:927] Time spent T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:15:18.809496  9360 consensus_queue.cc:237] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:18.811048  9419 consensus_meta.cc:287] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.000s
I20260709 13:15:18.813625  9443 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:18.816032  9433 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:18.816797  9530 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:18.827756  6256 raft_consensus.cc:1240] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:18.828323  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:18.896627  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:18.830935  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 159262us
I20260709 13:15:18.843309  9343 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:18.843745  9463 consensus_queue.cc:1059] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:18.776785  9507 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:15:18.844587  9560 consensus_queue.cc:1059] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:18.844904  9525 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:18.845010  9559 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.847172  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:18.849272  9348 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:18.924958  9415 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:18.850682  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:18.927352  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 76736.8us
I20260709 13:15:18.928326  6296 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:18.850910  9333 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:18.931602  9516 log.cc:927] Time spent T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.576s	user 0.002s	sys 0.000s
I20260709 13:15:18.932546  9443 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:18.932874  9333 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:18.933467  9525 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.934365  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.935542  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.936098  6250 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:18.936859  6248 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:18.894235  6933 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:18.897490  6295 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:18.900578  9343 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:18.944837  9388 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.944988  9343 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.945427  9388 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:18.944898  9525 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:18.948235  9525 raft_consensus.cc:697] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:18.911983  6939 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:18.948696  9564 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:18.912652  6324 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:18.883955  9457 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.905311  9553 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.950222  9457 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:18.950897  9553 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:18.938020  6369 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:18.954159  9505 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:18.954541  9505 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.954869  9505 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.888490  9549 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.920521  9377 raft_consensus.cc:3055] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:18.922365  6400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2054) took 1196 ms. Trace:
I20260709 13:15:18.930058  6296 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:18.937485  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.967705  6400 rpcz_store.cc:276] 0709 13:15:17.725714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.751174 (+ 25460us) service_pool.cc:224] Handling call
0709 13:15:17.751598 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.274954 (+523356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.922088 (+647134us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54003750d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:18.922301 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1071165824}
W20260709 13:15:18.882633  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 126283us
I20260709 13:15:18.947533  9388 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:18.948599  9374 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:18.949411  9564 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:18.872596  9547 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:18.958209  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.958819  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:19.019119  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:19.019767  6250 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:18.940604  9415 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:18.972572  6322 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:15:18.975313  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 45323.6us
I20260709 13:15:18.978615  6328 raft_consensus.cc:3055] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:19.022255  6328 raft_consensus.cc:740] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:18.920984  9559 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:18.953020  9553 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:18.986611  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.992444  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:18.992524  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:18.993988  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:18.996776  9566 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:18.997267  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:18.998070  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:19.042814  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 222207us
I20260709 13:15:19.042819  6330 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:19.043985  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.044070  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:19.001480  9551 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:19.078682  6330 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:19.006925  9349 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:19.010574  9565 consensus_queue.cc:1059] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:18.910351  6935 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:18.954154  9457 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:19.020774  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:19.083016  6402 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:19.021018  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:19.022462  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:19.022491  6296 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:19.040443  6329 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:19.045239  6322 raft_consensus.cc:2410] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:19.023023  6328 consensus_queue.cc:260] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.049023  6297 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:15:19.050221  9543 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
I20260709 13:15:19.057170  9503 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.058600  9463 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.062203  9564 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:19.062691  9467 raft_consensus.cc:3055] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:19.064154  9553 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:19.064584  9340 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:19.064949  6400 raft_consensus.cc:1240] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:19.065786  6397 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:15:18.966455  9377 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:19.017948  9374 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.067246  9367 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:18.981647  9525 consensus_queue.cc:237] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:19.070363  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:19.070885  9547 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:19.071807  6331 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:15:19.269548  6331 pending_rounds.cc:85] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 8
I20260709 13:15:19.073223  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:19.073918  6371 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:19.269958  6331 pending_rounds.cc:107] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:15:19.270358  6331 raft_consensus.cc:2889] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:19.075197  9343 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.078589  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:18.987670  9530 consensus_queue.cc:1059] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:15:19.080418  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:19.082216  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:19.083747  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 62815us
I20260709 13:15:19.282195  6404 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:15:19.084803  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 62387.6us
W20260709 13:15:19.099301  9559 consensus_queue.cc:1175] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:19.185066  9340 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:19.284158  6296 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:19.080418  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:19.286351  6330 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:19.286453  9203 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:19.287144  9552 log.cc:927] Time spent T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:15:19.287330  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:19.092466  6933 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:19.107295  6396 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:15:19.289954  6396 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:19.084429  6328 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:19.130422  6401 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:19.110738  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:19.293067  6249 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:19.293174  6296 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:19.295646  9542 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:19.131251  6403 raft_consensus.cc:1240] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:19.133802  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:19.023850  6934 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:15:19.160073  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:19.134066  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:19.161165  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:19.174049  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 217758us
I20260709 13:15:19.298862  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:19.182803  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:19.287161  9203 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.176048  9553 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:19.181747  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 73554.2us
I20260709 13:15:19.301754  6219 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:19.302009  9203 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:19.302610  6219 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:19.161979  9556 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:18.987195  9443 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:19.131399  9467 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:19.134938  9562 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:19.272765  6325 raft_consensus.cc:2410] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:19.277155  6942 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:19.278932  6399 raft_consensus.cc:2393] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 6: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:19.277550  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:19.418505  6329 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:19.277256  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:19.280591  6938 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:19.287415  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:19.430343  6331 raft_consensus.cc:2393] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 9: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:19.430682  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:19.431530  6331 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:19.431936  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:19.432513  6328 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:15:19.299640  6934 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:19.299340  6369 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:19.183063  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:19.268946  9564 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.434487  9564 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.435487  6330 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:15:19.436520  9564 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:19.107889  9371 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:19.182176  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.409873  6323 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:19.437167  9371 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.437582  9371 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.440917  6905 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:19.416937  9438 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:19.110530  9503 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:19.286482  9555 log.cc:927] Time spent T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.261s	user 0.000s	sys 0.000s
I20260709 13:15:19.305217  9203 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:19.428287  6249 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:19.302627  9553 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:19.432906  6328 pending_rounds.cc:85] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 5
I20260709 13:15:19.443781  6331 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: [6.5-9.6]
I20260709 13:15:19.183382  6400 raft_consensus.cc:1275] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:19.423025  9340 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:19.458318  6297 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:19.424880  6325 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:15:19.543386  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 85180.5us
I20260709 13:15:19.544550  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:19.545161  6297 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:19.173301  9551 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.147s
W20260709 13:15:19.451203  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 377320us
I20260709 13:15:19.488638  9213 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:19.488852  9564 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.488687  9562 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:19.490159  9367 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:19.488883  9457 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:15:19.490763  9509 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:19.594686  9509 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.595147  9509 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:19.491079  6329 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:19.597560  6934 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:19.597368  9562 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:19.078329  9566 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:19.599210  9567 log.cc:927] Time spent T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
I20260709 13:15:19.599546  9367 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:19.452138  9438 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.600764  9438 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:19.452651  9539 consensus_meta.cc:287] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.000s
I20260709 13:15:19.406700  9443 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:19.492676  9433 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.497488  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:19.417237  9496 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:19.701444  9553 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:19.702049  9553 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:19.704185  9553 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:19.503393  9505 consensus_meta.cc:287] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.001s
W20260709 13:15:19.523270  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 223991us
I20260709 13:15:19.293378  9415 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:19.130450  9463 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.534967  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:19.531553  6328 pending_rounds.cc:107] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:15:19.716013  6328 raft_consensus.cc:2889] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:19.717770  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:19.718561  6328 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:19.715991  6331 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:19.719745  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:19.720144  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:19.720511  6328 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:19.720839  6331 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:19.721722  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:19.441754  9467 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:19.726681  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:19.726729  6402 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:19.731845  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:19.732913  6249 raft_consensus.cc:2393] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:15:19.564615  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 123765us
I20260709 13:15:19.566576  6325 raft_consensus.cc:2393] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 3: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:19.574685  6371 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:19.571895  9213 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.598088  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:19.736267  6905 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:19.451387  9360 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:19.675268  9374 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:19.543175  9220 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:19.695081  9433 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:19.696457  9503 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:19.543083  9203 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:19.565184  9530 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.532384  9377 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.698484  6938 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:19.679888  9457 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:19.830075  9457 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.572556  9546 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:19.575501  9551 consensus_queue.cc:1243] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer a13ffe92eb374309a5c8476d9fbbb2b8 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:19.833271  9546 raft_consensus.cc:697] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:19.712281  9367 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.834208  9367 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.834256  9546 consensus_queue.cc:237] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.835238  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:19.737807  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:19.836422  6221 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:19.738752  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:19.739550  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:19.839038  6251 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:19.839694  9349 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:19.840189  6251 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:15:19.739667  9213 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:19.842486  9509 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.844614  9509 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:19.455348  9549 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.845206  9503 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:19.846429  9549 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:19.847321  6399 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:19.681046  9443 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:19.796279  6905 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:19.603400  9564 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.828964  9377 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:19.802718  9095 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:19.776078  9338 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:19.832206  9457 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:19.837872  9372 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:19.836730  6403 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
W20260709 13:15:19.873052  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 76856.6us
I20260709 13:15:19.803529  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:19.911864  6325 raft_consensus.cc:2393] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:19.777211  9220 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.844825  9343 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:19.861593  9509 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:19.901337  6397 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:19.930465  9343 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:19.932126  9343 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.925882  9335 consensus_queue.cc:1059] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:15:19.741163  9496 raft_consensus.cc:697] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:19.933187  9335 consensus_queue.cc:1059] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:19.934001  9496 consensus_queue.cc:237] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.832172  9578 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:19.742062  9326 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.164s
W20260709 13:15:19.894744  9178 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.062s	sys 0.098s
W20260709 13:15:19.938669  9178 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.062s	sys 0.099s
I20260709 13:15:19.939519  9578 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:19.836437  9367 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:19.942956  9463 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:19.926524  9457 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:15:19.888213  9503 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:19.900422  9095 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.925818  6331 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:19.926708  6325 raft_consensus.cc:1240] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:19.934441  9450 raft_consensus.cc:3055] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:19.936631  9478 raft_consensus.cc:3055] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:19.738619  9575 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.923029  9220 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.718719  9505 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.957103  6325 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:15:19.971143  6325 pending_rounds.cc:85] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 6
I20260709 13:15:19.971485  6325 pending_rounds.cc:107] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:15:19.971786  6325 raft_consensus.cc:2889] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:19.847107  9530 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.932636  9343 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.957571  9450 raft_consensus.cc:740] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:19.803150  9360 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:19.962846  6907 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.652s (SENT) [suppressed 30 similar messages]
I20260709 13:15:19.914362  9338 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:19.956454  9095 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.965389  9575 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:19.966825  6397 raft_consensus.cc:2410] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:19.967546  9213 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:19.972925  6368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.078s	sys 0.152s
W20260709 13:15:19.750041  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 55548.7us
I20260709 13:15:19.940755  9438 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:19.989991  6325 raft_consensus.cc:1275] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:19.923178  9461 consensus_queue.cc:1059] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:15:20.005780  6404 raft_consensus.cc:2368] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7.
I20260709 13:15:20.005868  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:19.959239  9478 raft_consensus.cc:740] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:20.011979  6368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.078s	sys 0.152s
I20260709 13:15:19.982679  9564 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:19.983148  9509 raft_consensus.cc:697] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:19.990782  9580 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.679919  9371 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.051234  9450 consensus_queue.cc:260] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:20.052342  9343 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:20.052836  9585 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 13:15:20.030790  9553 consensus_queue.cc:1175] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" responder_term: 10 status { last_received { term: 4 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: [6.5-9.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:20.058746  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:20.065339  9580 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.066926  9433 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:20.081413  6251 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:20.083352  9457 raft_consensus.cc:3055] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:20.084023  9360 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:20.086303  9213 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:20.031927  9467 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:20.099727  9505 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:20.097993  9457 raft_consensus.cc:740] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:20.100526  9556 raft_consensus.cc:3055] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:20.105581  9457 consensus_queue.cc:260] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.106873  9457 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:20.111650  9160 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:20.100740  9580 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:20.098003  9564 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:20.118369  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 155555us
I20260709 13:15:20.117190  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:20.119426  6325 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:20.064831  9220 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.114269  9551 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.101027  9556 raft_consensus.cc:740] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:20.124150  6941 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:15:20.147346  6297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.038s	sys 0.051s
W20260709 13:15:20.147908  6297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.038s	sys 0.051s
W20260709 13:15:20.148612  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 603509us
I20260709 13:15:20.150118  6297 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:20.157648  6325 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:20.159438  6297 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:20.167212  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:20.170643  6325 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.147981  9338 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:20.143945  9433 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:20.122967  9564 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.177861  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:20.178994  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 604397us
W20260709 13:15:20.187381  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.124413  9551 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.160081  9547 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:20.168083  9415 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.189098  6371 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:20.173801  9539 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:20.172773  9374 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:20.202925  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.116254  9478 consensus_queue.cc:260] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:20.210431  6325 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:20.186911  9338 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:20.167193  9542 consensus_queue.cc:1059] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:15:20.186568  9549 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:20.167651  9556 consensus_queue.cc:260] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:20.188318  9160 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:20.221424  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:20.210599  9539 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.201889  9547 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.213316  9213 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.188330  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:20.213796  9178 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.182138  9433 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:20.236166  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:20.161824  9509 consensus_queue.cc:237] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.242084  6937 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:20.285146  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:20.285948  6937 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.213600  9415 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.230163  9547 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:20.232352  9539 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:20.247241  9587 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.067s	user 0.001s	sys 0.001s
I20260709 13:15:20.236123  9556 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.217621  9374 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.242905  9505 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:20.223428  9549 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:20.234884  9213 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.224174  9338 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.230765  9160 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.243800  9580 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:15:20.244350  9178 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:20.299751  9488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.567s	user 0.025s	sys 0.043s
I20260709 13:15:20.301954  9371 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:20.315922  9573 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:15:20.315058  9505 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:20.359519  9590 log.cc:927] Time spent T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:15:20.375103  9569 log.cc:927] Time spent T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 13:15:20.361068  9564 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:20.393388  9597 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:15:20.389791  9586 log.cc:927] Time spent T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:15:20.358023  9591 raft_consensus.cc:2955] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:20.405859  9562 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:20.407303  9551 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:20.408773  9549 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:20.360527  9505 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:20.418011  9505 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:20.549022  6221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.019s	sys 0.020s
W20260709 13:15:20.550086  6221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.019s	sys 0.020s
W20260709 13:15:20.550557  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 642551us
W20260709 13:15:20.552592  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.556071  6221 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:20.562327  6255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.002s	sys 0.018s
W20260709 13:15:20.562858  6255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.003s	sys 0.018s
I20260709 13:15:20.563357  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 603) took 1634 ms. Trace:
I20260709 13:15:20.563875  6247 rpcz_store.cc:276] 0709 13:15:18.929069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.929214 (+   145us) service_pool.cc:224] Handling call
0709 13:15:18.938682 (+  9468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.938993 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.939020 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.939463 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:15:19.083035 (+143572us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:19.083071 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.083129 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:20.562577 (+1479448us) raft_consensus.cc:1685] finished
0709 13:15:20.562666 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.563064 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9479,"raft.queue_time_us":1346,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":13125,"thread_start_us":143289,"threads_started":1,"wal-append.queue_time_us":1161729}
W20260709 13:15:20.589708  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:20.624363  6329 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.006s	sys 0.022s
W20260709 13:15:20.624935  6329 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.007s	sys 0.022s
I20260709 13:15:20.639564  9613 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.641052  9613 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.642933  9612 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:20.241878  6938 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
W20260709 13:15:20.680045  6368 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.007s	sys 0.017s
W20260709 13:15:20.689960  6368 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.007s	sys 0.017s
W20260709 13:15:20.690649  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 644664us
I20260709 13:15:20.692090  9415 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:20.302073  9220 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:20.713094  9117 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.740844  9612 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:20.742118  9372 consensus_queue.cc:1059] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:20.742491  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:20.743819  6405 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:20.744386  9372 consensus_queue.cc:1059] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:20.745651  9213 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:20.746094  9372 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:20.747363  9372 consensus_queue.cc:1059] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:20.756134  6297 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:20.757038  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:20.758198  6938 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:20.758378  6400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 588) took 1033 ms. Trace:
I20260709 13:15:20.759972  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:20.758914  6400 rpcz_store.cc:276] 0709 13:15:19.725033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.725183 (+   150us) service_pool.cc:224] Handling call
0709 13:15:19.725686 (+   503us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:19.726192 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:19.726219 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:19.738671 (+ 12452us) log.cc:844] Serialized 600 byte log entry
0709 13:15:20.047164 (+308493us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:20.047219 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.047308 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:20.757739 (+710431us) raft_consensus.cc:1685] finished
0709 13:15:20.757782 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.758177 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105533,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":142,"thread_start_us":308084,"threads_started":1,"wal-append.queue_time_us":418206}
I20260709 13:15:20.760944  6403 raft_consensus.cc:2393] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:20.761649  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:20.762588  6402 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:20.764003  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:20.764925  6405 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:20.765517  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:20.766121  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.766687  6940 raft_consensus.cc:2410] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:20.768167  6938 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:20.774405  9374 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:20.762200  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:20.829892  9374 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.830365  6401 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:20.830775  9374 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.831631  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:20.770301  9433 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:20.833614  9433 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.834331  9433 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:20.760353  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:20.836447  6398 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:20.837909  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:20.740899  9117 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:20.784226  9360 raft_consensus.cc:3055] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:20.789746  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:20.791676  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:20.793596  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:20.693534  9095 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.799791  9213 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:20.768397  9371 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.803985  9338 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:20.809260  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:20.810393  9457 consensus_meta.cc:287] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.703s	user 0.017s	sys 0.006s
W20260709 13:15:20.809336  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 249661us
I20260709 13:15:20.811447  9178 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:20.827996  6937 consensus_meta.cc:287] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.006s
I20260709 13:15:20.968015  6937 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:20.832973  6401 raft_consensus.cc:2393] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:20.692945  9415 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:20.961154  6396 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
W20260709 13:15:20.943660  6256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.007s	sys 0.021s
W20260709 13:15:20.945716  6249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.015s	sys 0.015s
I20260709 13:15:20.961074  6403 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.962520  9117 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:20.929697  9360 raft_consensus.cc:740] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:20.963361  6405 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
W20260709 13:15:20.321919  9488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.589s	user 0.026s	sys 0.044s
I20260709 13:15:20.959146  6402 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:20.784890  9160 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:20.964681  9584 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.975075  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:20.747285  9613 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:20.978791  6256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.008s	sys 0.022s
I20260709 13:15:20.980283  6401 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:20.981021  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1473) took 1251 ms. Trace:
I20260709 13:15:20.981878  9095 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:20.983239  9542 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:20.983816  9542 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:20.984429  9542 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.484197  9547 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.986240  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2491) took 1907 ms. Trace:
I20260709 13:15:20.986769  6329 rpcz_store.cc:276] 0709 13:15:19.078252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.740374 (+662122us) service_pool.cc:224] Handling call
0709 13:15:19.740662 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.740845 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:20.625676 (+884831us) log.cc:844] Serialized 14 byte log entry
0709 13:15:20.985493 (+359817us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:20.985602 (+   109us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:20.985786 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.985905 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.986122 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16232,"prepare.queue_time_us":318503,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":16464,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":228,"thread_start_us":1189106,"threads_started":2,"wal-append.queue_time_us":312392}
I20260709 13:15:20.989908  9117 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:20.990967  9117 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:20.991603  9611 log.cc:927] Time spent T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.469s	user 0.001s	sys 0.000s
I20260709 13:15:20.991153  9360 consensus_queue.cc:260] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:20.993813  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:20.995074  9503 consensus_meta.cc:287] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 1.049s	user 0.014s	sys 0.000s
I20260709 13:15:20.983937  9580 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:20.995752  9503 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:20.996071  9580 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:20.997481  9377 consensus_meta.cc:287] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.109s	user 0.010s	sys 0.011s
I20260709 13:15:20.983373  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1390) took 1237 ms. Trace:
I20260709 13:15:20.998461  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:20.982888  9213 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:20.978961  6249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.015s	sys 0.016s
I20260709 13:15:20.983901  9415 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:20.992893  9360 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.998863  6325 rpcz_store.cc:276] 0709 13:15:19.499428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.217362 (+717934us) service_pool.cc:224] Handling call
0709 13:15:20.596417 (+379055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:20.644929 (+ 48512us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:20.644962 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:20.645021 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:20.645075 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.729791 (+ 84716us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.736875 (+  7084us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":336824,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":31428,"thread_start_us":47643,"threads_started":1}
I20260709 13:15:20.994871  6221 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:21.008926  9433 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:21.009475  9505 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:21.010283  9505 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:21.012728  9213 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:21.022154  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:21.023197  9415 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:21.023422  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:21.024678  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:21.025385  6940 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:21.025615  6297 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:21.026223  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:21.026336  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:21.026979  6405 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:21.027050  6940 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:21.027187  9580 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:21.012862  9496 raft_consensus.cc:3055] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:15:21.013458  9604 log.cc:927] Time spent T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:15:21.014057  9549 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.013548  9584 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.981485  6256 rpcz_store.cc:276] 0709 13:15:19.729564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.730613 (+  1049us) service_pool.cc:224] Handling call
0709 13:15:19.740171 (+  9558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.740358 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:20.046666 (+306308us) log.cc:844] Serialized 14 byte log entry
0709 13:15:20.980592 (+933926us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:20.980670 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:20.980758 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.980828 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.980970 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":440768,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":8803,"raft.queue_time_us":2491,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":249,"thread_start_us":1239346,"threads_started":2,"wal-append.queue_time_us":897118}
I20260709 13:15:21.015600  6398 raft_consensus.cc:1275] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:15:20.998497  9371 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:20.988966  9547 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:21.016786  9539 consensus_meta.cc:287] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.718s	user 0.006s	sys 0.007s
W20260709 13:15:21.042542  9467 consensus_meta.cc:287] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.936s	user 0.010s	sys 0.010s
I20260709 13:15:21.042840  9539 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:21.043887  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 73199us
I20260709 13:15:21.044782  6221 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:21.045444  9539 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:21.045567  9467 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:20.989974  9374 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:21.046500  9467 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:21.017970  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1475) took 1287 ms. Trace:
W20260709 13:15:21.028170  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.047310  9488 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:21.047163  6249 rpcz_store.cc:276] 0709 13:15:19.730258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.875522 (+145264us) service_pool.cc:224] Handling call
0709 13:15:19.909543 (+ 34021us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.909790 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:20.162454 (+252664us) log.cc:844] Serialized 14 byte log entry
0709 13:15:21.017341 (+854887us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:21.017446 (+   105us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:21.017560 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.017695 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.017913 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":309255,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":534,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":192,"thread_start_us":1072806,"threads_started":2,"wal-append.queue_time_us":783329}
I20260709 13:15:21.018698  9508 raft_consensus.cc:3055] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:20.978180  9612 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:21.049899  9508 raft_consensus.cc:740] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:21.049860  9549 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.051618  9508 consensus_queue.cc:260] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:21.012738  6369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.223s	user 0.008s	sys 0.027s
I20260709 13:15:21.008783  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:21.053534  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:21.053792  6937 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:21.036854  6325 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:21.055019  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2495) took 1369 ms. Trace:
I20260709 13:15:21.055593  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1478) took 1324 ms. Trace:
I20260709 13:15:21.055760  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:21.030737  9496 raft_consensus.cc:740] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:21.056037  6251 rpcz_store.cc:276] 0709 13:15:19.731066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.841090 (+110024us) service_pool.cc:224] Handling call
0709 13:15:19.903400 (+ 62310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:20.096679 (+193279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.055187 (+958508us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54002107d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:21.055439 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408927488}
I20260709 13:15:21.031672  9415 consensus_queue.cc:1059] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:15:21.054288  6396 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:21.036160  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:21.057379  9443 consensus_meta.cc:287] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.156s	user 0.009s	sys 0.010s
I20260709 13:15:21.058035  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:21.057917  9443 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:21.059008  6396 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:21.060432  9443 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:21.047947  9596 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.056566  6401 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:21.046581  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2496) took 1359 ms. Trace:
I20260709 13:15:21.055367  6325 rpcz_store.cc:276] 0709 13:15:19.686107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.036107 (+1350000us) service_pool.cc:224] Handling call
0709 13:15:21.036581 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:21.054736 (+ 18155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.054942 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:21.061779  9596 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:21.064659  6938 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:21.065407  6325 raft_consensus.cc:1240] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:21.052822  9549 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:21.066067  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2497) took 1378 ms. Trace:
I20260709 13:15:21.066426  6325 rpcz_store.cc:276] 0709 13:15:19.687432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.064696 (+1377264us) service_pool.cc:224] Handling call
0709 13:15:21.065209 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:21.065818 (+   609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.065994 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:21.066828  9596 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:21.067090  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:21.068023  6325 raft_consensus.cc:1275] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:21.068373  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:21.068602  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1395) took 1021 ms. Trace:
I20260709 13:15:21.069191  6401 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:21.069499  9508 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:21.069751  9117 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:21.012745  9505 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:21.072382  9496 consensus_queue.cc:260] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.068969  6325 rpcz_store.cc:276] 0709 13:15:20.046978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.067275 (+1020297us) service_pool.cc:224] Handling call
0709 13:15:21.067665 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:21.068388 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.068548 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:21.073621  9189 raft_consensus.cc:3055] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:21.075099  9584 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:21.077907  6402 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:21.082228  8611 raft_consensus.cc:3055] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:21.083721  6940 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:21.055451  9371 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:21.062791  6297 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:21.062755  6328 rpcz_store.cc:276] 0709 13:15:19.686796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.045355 (+1358559us) service_pool.cc:224] Handling call
0709 13:15:21.045812 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:21.046070 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:21.046099 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:21.046161 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:21.046199 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.046264 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.046373 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:21.088829  6403 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:21.086241  9203 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:15:21.095687  9606 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:21.095901  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 53821.3us
I20260709 13:15:21.092535  9189 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:21.100348  6297 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:21.100529  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:21.086669  9542 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.095929  9496 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.100013  9433 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:21.103217  6940 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:21.103521  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:21.093986  8611 raft_consensus.cc:740] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:15:21.102722  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 229758us
W20260709 13:15:21.105792  6369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.316s	user 0.009s	sys 0.027s
W20260709 13:15:21.106206  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 197025us
I20260709 13:15:21.109310  6939 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 3.
I20260709 13:15:21.101321  9613 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:21.114691  8611 consensus_queue.cc:260] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:21.112452  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 1.32274e+06us
I20260709 13:15:21.105499  9433 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.114936  9189 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.121436  9433 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:21.121457  9203 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:21.122991  9367 raft_consensus.cc:3055] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:21.156839  9367 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:21.157998  9338 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:21.157938  9367 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.159209  9367 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.111893  9371 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.130403  6368 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:21.135216  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.140803  9549 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:21.141747  6397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2416) took 2062 ms (client timeout 1992 ms). Trace:
W20260709 13:15:21.142762  6371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.002s	sys 0.022s
I20260709 13:15:21.145244  6297 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:21.149427  6400 raft_consensus.cc:1240] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:21.149619  9612 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.153070  9584 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:21.167930  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2494) took 1478 ms. Trace:
I20260709 13:15:21.169533  9584 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.169804  6329 rpcz_store.cc:276] 0709 13:15:19.685396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.020077 (+1334681us) service_pool.cc:224] Handling call
0709 13:15:21.020519 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:21.021029 (+   510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:21.021057 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:21.021705 (+   648us) log.cc:844] Serialized 26 byte log entry
0709 13:15:21.099757 (+ 78052us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:21.099814 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.100074 (+   260us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:21.163585 (+ 63511us) raft_consensus.cc:1685] finished
0709 13:15:21.163614 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.163951 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2788,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":72422,"threads_started":1,"wal-append.queue_time_us":121403}
I20260709 13:15:21.171866  9584 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:21.153580  9578 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:21.153852  9213 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:21.173449  9213 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:21.175388  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.175752  9213 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:21.176023  9443 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:21.176394  9443 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.176791  9443 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:21.154464  9160 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.181834  9160 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.155606  9095 consensus_queue.cc:1059] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:15:21.156193  9577 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 1.447s	user 0.015s	sys 0.009s
W20260709 13:15:21.125067  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:21.162587  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.128247  9189 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:21.153862  6295 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:21.154901  9117 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:15:21.165868  6397 rpcz_store.cc:269] 0709 13:15:19.079038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.184429 (+105391us) service_pool.cc:224] Handling call
0709 13:15:21.141250 (+1956821us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400182c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:21.141510 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107993984}
W20260709 13:15:21.180871  6371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.003s	sys 0.022s
I20260709 13:15:21.182971  6937 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:21.189011  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:21.189702  6933 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:21.192276  9160 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:21.169560  9612 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:21.183313  9549 raft_consensus.cc:697] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:21.194175  9549 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.194814  9612 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:21.197085  9438 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:21.198185  9095 consensus_queue.cc:1243] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer a13ffe92eb374309a5c8476d9fbbb2b8 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:21.183444  9371 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.198773  9095 raft_consensus.cc:3055] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:21.199110  9095 raft_consensus.cc:740] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:21.199702  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 593) took 1473 ms. Trace:
I20260709 13:15:21.200039  9095 consensus_queue.cc:260] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.200292  6404 rpcz_store.cc:276] 0709 13:15:19.726364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.726475 (+   111us) service_pool.cc:224] Handling call
0709 13:15:21.199224 (+1472749us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54001f3454. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:21.199471 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383972736}
I20260709 13:15:21.201220  9371 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:21.202405  6399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 589) took 1476 ms (client timeout 1652 ms). Trace:
W20260709 13:15:21.202952  6399 rpcz_store.cc:269] 0709 13:15:19.725343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.726468 (+  1125us) service_pool.cc:224] Handling call
0709 13:15:21.201909 (+1475441us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400183654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:21.202174 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275553024}
I20260709 13:15:21.203181  9203 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.205646  9203 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:21.206359  6219 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:21.207943  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:21.208702  6322 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:21.172750  9478 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.239444  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2209) took 2281 ms. Trace:
I20260709 13:15:21.209425  6939 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:15:21.210656  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 80369.2us
I20260709 13:15:21.239851  6254 rpcz_store.cc:276] 0709 13:15:18.958115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.960278 (+  2163us) service_pool.cc:224] Handling call
0709 13:15:18.984581 (+ 24303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.995833 (+ 11252us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:18.996169 (+   336us) log.cc:844] Serialized 14 byte log entry
0709 13:15:19.268204 (+272035us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:19.268712 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:15:19.268868 (+   156us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:19.268903 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.268964 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:21.227839 (+1958875us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b180034f240. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:15:21.238986 (+ 11147us) raft_consensus.cc:1685] finished
0709 13:15:21.239084 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.239265 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135273,"prepare.queue_time_us":687,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":111982,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":9024,"spinlock_wait_cycles":43263104,"thread_start_us":176226,"threads_started":1,"wal-append.queue_time_us":429283}
I20260709 13:15:21.211278  9398 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:21.217010  9535 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:15:21.241835  6368 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:21.211575  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:21.243957  6368 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:21.244419  6326 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:21.212518  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:21.245280  9398 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:21.245609  6329 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:21.246034  9398 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:21.213912  9596 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:21.220053  9613 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:21.246687  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:21.247148  9613 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.247582  6329 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.248497  9213 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.213979  9349 consensus_queue.cc:1059] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:21.246755  9596 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:21.249341  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:21.249562  9349 raft_consensus.cc:3055] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:21.249706  9596 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.250056  6327 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.251040  6368 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:21.251217  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:21.252122  9203 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:21.231542  9450 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:21.224089  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2471) took 2621 ms. Trace:
I20260709 13:15:21.229068  9160 raft_consensus.cc:2955] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:15:21.236696  6252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 599) took 2571 ms (client timeout 2164 ms). Trace:
I20260709 13:15:21.227025  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:21.238188  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:21.253712  6324 rpcz_store.cc:276] 0709 13:15:18.604312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.604724 (+   412us) service_pool.cc:224] Handling call
0709 13:15:18.605240 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.949865 (+344625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.223464 (+2273599us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400038254. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:21.223818 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":706445184}
W20260709 13:15:21.245760  6935 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 612) took 3188 ms (client timeout 2190 ms). Trace:
W20260709 13:15:21.221239  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.249081  9213 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.250018  9349 raft_consensus.cc:740] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:21.221450  9117 consensus_queue.cc:1059] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:21.252367  6326 raft_consensus.cc:2393] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 5: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:21.233292  9578 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.252740  6368 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:21.233649  9095 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:21.237694  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 83984.4us
I20260709 13:15:21.257597  6940 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:21.238240  9612 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:15:21.254070  6252 rpcz_store.cc:269] 0709 13:15:18.665373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.665576 (+   203us) service_pool.cc:224] Handling call
0709 13:15:21.236198 (+2570622us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b5400172fd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:21.236440 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386126208}
I20260709 13:15:21.272049  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:21.259016  6935 rpcz_store.cc:269] 0709 13:15:18.057211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.057317 (+   106us) service_pool.cc:224] Handling call
0709 13:15:21.245426 (+3188109us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b5400538ed4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:21.245567 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917504768}
I20260709 13:15:21.259665  6933 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:21.263322  6371 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:21.282415  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:21.235221  9443 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.285584  6295 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:21.293614  9349 consensus_queue.cc:260] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:21.294377  6325 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:15:21.295010  9349 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.309263  9560 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.309813  6397 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:21.311800  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1389) took 1813 ms. Trace:
I20260709 13:15:21.312306  6331 rpcz_store.cc:276] 0709 13:15:19.498793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.721499 (+222706us) service_pool.cc:224] Handling call
0709 13:15:21.311353 (+1589854us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54004376d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:21.311565 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468065536}
I20260709 13:15:21.312952  9546 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:21.313592  9546 raft_consensus.cc:697] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:21.314210  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:21.315189  6399 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:21.314638  9546 consensus_queue.cc:237] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:21.316133  9213 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:21.316727  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:21.319463  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 86344.3us
I20260709 13:15:21.320001  6329 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:21.301879  9372 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:15:21.319314  9415 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:21.324909  9415 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.327101  9415 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:21.327696  9203 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:21.328261  9203 raft_consensus.cc:697] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:21.329208  9203 consensus_queue.cc:237] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.329818  6399 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:21.321750  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:21.330931  6940 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:21.336031  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:21.336421  6326 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:21.336663  6329 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:21.334183  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:21.321970  9578 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.338692  9542 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:21.339447  9388 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:21.309865  9560 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.340909  6327 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
W20260709 13:15:21.333335  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 80763us
I20260709 13:15:21.349895  9553 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.350219  9566 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:21.350611  9553 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.343595  6219 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:21.356295  6935 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:21.357306  9443 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:21.359237  9566 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:21.359961  9566 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:21.360958  6330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 722) took 2255 ms (client timeout 2164 ms). Trace:
I20260709 13:15:21.361100  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:21.361233  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:21.361883  6936 raft_consensus.cc:2393] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:21.362416  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:21.363154  6401 raft_consensus.cc:2393] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:21.361912  6398 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:15:21.361716  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:21.362948  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:21.359331  8611 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:21.369925  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:21.993744  9623 log.cc:927] Time spent T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:15:21.365422  6328 raft_consensus.cc:1240] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:21.532119  6399 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 2. Current term is 3. Ops: []
W20260709 13:15:21.985188  9367 consensus_meta.cc:287] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.825s	user 0.010s	sys 0.005s
I20260709 13:15:21.369319  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:22.042420  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:22.043395  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:21.364310  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:21.409689  9042 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.637s
I20260709 13:15:22.046514  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:21.582855  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:22.047897  6329 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:22.048781  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:22.049402  6323 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:22.049989  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:22.050695  6329 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:15:22.051673  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:22.052315  6329 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
W20260709 13:15:21.368419  9571 log.cc:927] Time spent T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.325s	user 0.005s	sys 0.026s
I20260709 13:15:21.384696  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:21.389415  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:22.055430  6939 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:21.385651  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:21.361452  6330 rpcz_store.cc:269] 0709 13:15:19.105415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.287079 (+181664us) service_pool.cc:224] Handling call
0709 13:15:21.360613 (+2073534us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54003935d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:21.360764 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338682240}
I20260709 13:15:22.057072  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:22.057164  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:22.057937  6330 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:21.381760  9535 raft_consensus.cc:3055] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:21.385809  6253 raft_consensus.cc:1275] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:15:21.540526  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:22.060091  6253 pending_rounds.cc:85] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 1
I20260709 13:15:22.060585  6253 pending_rounds.cc:107] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:15:21.386634  6251 raft_consensus.cc:1240] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:15:21.409237  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 49498.2us
I20260709 13:15:21.389961  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:22.063062  6247 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:21.383541  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:22.064702  6402 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:21.569228  6368 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:22.066628  6402 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:21.362983  6936 raft_consensus.cc:1240] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:22.069594  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:22.070649  6936 raft_consensus.cc:2376] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5. Re-sending same reply.
I20260709 13:15:21.403342  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:22.073211  6401 raft_consensus.cc:2393] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:21.415604  6905 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:21.404280  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.059504  9535 raft_consensus.cc:740] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:22.076488  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.429301  9433 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:21.366817  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:22.098328  6405 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:22.082046  9560 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:21.363940  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:22.109314  6396 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:21.531764  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:22.084194  6330 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:15:22.111151  6330 pending_rounds.cc:85] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 6
I20260709 13:15:22.037638  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:22.111299  6327 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:22.112855  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:22.091936  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:22.113890  6329 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:21.361460  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:22.115751  6403 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:22.111478  6330 pending_rounds.cc:107] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:15:22.117484  6330 raft_consensus.cc:2889] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:22.061100  6253 raft_consensus.cc:2889] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:22.121706  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:22.111460  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 596205us
I20260709 13:15:22.124318  6368 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:22.129575  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:22.130965  6256 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:22.131335  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:22.141470  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:21.406417  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 84661.3us
W20260709 13:15:22.109318  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.406548  9372 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:22.146800  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:22.147907  6936 raft_consensus.cc:2393] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:22.151713  6369 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:22.171819  6324 raft_consensus.cc:2368] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8.
I20260709 13:15:22.173600  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:22.174327  6939 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:21.372342  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:22.038038  9095 consensus_meta.cc:287] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.002s
W20260709 13:15:22.186575  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.186944  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:22.188772  6405 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:22.186120  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:22.202268  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 786686us
I20260709 13:15:22.202679  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:22.205693  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:22.210846  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:22.204509  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:22.239190  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 43497.8us
W20260709 13:15:22.240087  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.148728  9560 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.168404  9372 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:22.210253  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:22.203850  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:22.186172  9367 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:22.211222  9360 consensus_meta.cc:287] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.200s	user 0.012s	sys 0.000s
I20260709 13:15:22.256927  6400 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.765616  9613 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:22.284430  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:22.247979  9372 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:22.259357  9560 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:22.291461  6936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 608) took 1021 ms. Trace:
W20260709 13:15:22.876256  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 665927us
W20260709 13:15:22.876663  6369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.003s	sys 0.007s
W20260709 13:15:22.877204  6369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.003s	sys 0.007s
I20260709 13:15:22.298318  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:22.687954  6151 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49212 (request call id 202) took 21073 ms (client timeout 15000 ms). Trace:
I20260709 13:15:22.878409  6253 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
W20260709 13:15:22.596531  9160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.253s	user 0.012s	sys 0.008s
W20260709 13:15:22.579803  6371 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.005s	sys 0.017s
W20260709 13:15:22.434424  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 128207us
I20260709 13:15:22.454162  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:22.316807  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:22.881206  6256 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:22.884409  9638 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:22.323339  9367 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:22.886022  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:22.695235  9627 log.cc:927] Time spent T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 13:15:22.881374  6905 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:22.466506  6248 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.003s
I20260709 13:15:22.315567  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:22.462188  9443 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:22.888810  6940 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 700) took 1521 ms (client timeout 1954 ms). Trace:
W20260709 13:15:22.374207  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 49793.2us
W20260709 13:15:22.831167  6222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.006s	sys 0.004s
W20260709 13:15:22.890239  6248 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.251s	user 0.011s	sys 0.006s
W20260709 13:15:22.889472  6940 rpcz_store.cc:269] 0709 13:15:21.367400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.071922 (+704522us) service_pool.cc:224] Handling call
0709 13:15:22.315401 (+243479us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b580006e498. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:15:22.888745 (+573344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171671808}
I20260709 13:15:22.308073  9503 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.575s
W20260709 13:15:22.890321  6222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.006s	sys 0.005s
W20260709 13:15:22.892400  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:22.893746  6371 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.006s	sys 0.022s
W20260709 13:15:22.879302  9160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.536s	user 0.016s	sys 0.012s
I20260709 13:15:22.380285  9490 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:22.277607  9566 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:22.706408  9575 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:22.628742  6220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.029s	sys 0.048s
I20260709 13:15:22.261158  9095 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:22.876672  6936 rpcz_store.cc:276] 0709 13:15:21.270035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.265212 (+995177us) service_pool.cc:224] Handling call
0709 13:15:22.269491 (+  4279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.277098 (+  7607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.277636 (+   538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:22.291081 (+ 13445us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:22.291123 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.291197 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:22.291371 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:22.731487  8611 consensus_meta.cc:287] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.683s	user 0.008s	sys 0.000s
W20260709 13:15:22.874029  6296 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.007s	sys 0.005s
W20260709 13:15:22.915695  6296 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.007s	sys 0.005s
W20260709 13:15:22.916025  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 1.49435e+06us
I20260709 13:15:22.324515  9633 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:22.447491  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 140811us
W20260709 13:15:22.687582  9625 log.cc:927] Time spent T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.740s	user 0.000s	sys 0.002s
I20260709 13:15:22.878961  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:15:22.377041  9596 consensus_meta.cc:287] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.124s	user 0.005s	sys 0.007s
I20260709 13:15:22.887981  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:22.882593  9560 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:22.896656  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2230) took 1215 ms. Trace:
I20260709 13:15:22.882058  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:22.623952  6937 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.271s	user 0.024s	sys 0.049s
W20260709 13:15:22.932614  6937 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.595s	user 0.036s	sys 0.051s
W20260709 13:15:22.906916  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:22.933496  6295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.002s	sys 0.024s
W20260709 13:15:22.933862  6295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.002s	sys 0.024s
W20260709 13:15:22.909890  6400 consensus_meta.cc:287] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.000s
I20260709 13:15:22.934309  6400 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:22.749794  9630 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:22.934900  6400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 609) took 1565 ms (client timeout 1563 ms). Trace:
W20260709 13:15:22.935230  6400 rpcz_store.cc:269] 0709 13:15:21.369376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.372024 (+  2648us) service_pool.cc:224] Handling call
0709 13:15:22.934824 (+1562800us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:22.932365  6253 rpcz_store.cc:276] 0709 13:15:21.681231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.266996 (+585765us) service_pool.cc:224] Handling call
0709 13:15:22.896594 (+629598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:22.906713  6219 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:22.305445  9578 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:22.297442  6934 raft_consensus.cc:2410] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:15:22.863124  9349 consensus_meta.cc:287] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.568s	user 0.014s	sys 0.000s
I20260709 13:15:22.888885  9443 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:22.269367  9433 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:22.918939  6939 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:22.923074  9566 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.600759  9635 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:22.922109  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:22.946139  6940 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:15:22.909089  6220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.029s	sys 0.054s
W20260709 13:15:22.894088  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 1.37767e+06us
I20260709 13:15:22.946700  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:22.935626  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 604) took 3994 ms. Trace:
I20260709 13:15:22.938030  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:22.940681  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 811565us
I20260709 13:15:22.887389  9367 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:22.917939  9042 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:22.937543  6398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.011s	sys 0.015s
I20260709 13:15:22.934057  8611 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:22.934049  9596 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:23.011826  6398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.013s	sys 0.017s
I20260709 13:15:23.012645  6936 raft_consensus.cc:2393] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:15:22.949892  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:22.878684  6151 rpcz_store.cc:269] 0709 13:15:01.249666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.249911 (+   245us) service_pool.cc:224] Handling call
0709 13:15:02.570886 (+1320975us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54002c15d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4f090 00007f4575bedf3a 00007f457b9a41cc 00007f457baa237e 00007f4579f632a4 00007f4579f63232 00007f4579f63161 00007f4579f630dc 00007f4579f62392 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:22.305666 (+19734780us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:18.862115 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:18.862895 (+   780us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:18.862941 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:15:18.862958 (+    17us) tablet.cc:662] Decoding operations
0709 13:15:18.864142 (+  1184us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:18.864218 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:18.864249 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:15:18.878772 (+ 14523us) tablet.cc:701] Row locks acquired
0709 13:15:18.878805 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:15:18.878980 (+   175us) write_op.cc:270] Start()
0709 13:15:18.879116 (+   136us) write_op.cc:276] Timestamp: P: 1783602918878916 usec, L: 0
0709 13:15:18.879135 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:15:18.879821 (+   686us) log.cc:844] Serialized 4739 byte log entry
0709 13:15:20.144516 (+1264695us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b18002d8c20. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:15:20.498854 (+354338us) op_driver.cc:464] REPLICATION: finished
0709 13:15:20.507858 (+  9004us) write_op.cc:301] APPLY: starting
0709 13:15:20.507987 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:20.508355 (+   368us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:20.508389 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:20.516552 (+  8163us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:20.516984 (+   432us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:15:20.517063 (+    79us) write_op.cc:312] APPLY: finished
0709 13:15:20.517527 (+   464us) log.cc:844] Serialized 89 byte log entry
0709 13:15:20.518956 (+  1429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:20.519157 (+   201us) write_op.cc:454] Released schema lock
0709 13:15:20.519229 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:20.519716 (+   487us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:20.519758 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1654909,"reported_tablets":28,"spinlock_wait_cycles":1346005248,"child_traces":[["op",{"apply.queue_time_us":8723,"apply.run_cpu_time_us":4148,"apply.run_wall_time_us":11830,"num_ops":12,"prepare.queue_time_us":547025,"prepare.run_cpu_time_us":35502,"prepare.run_wall_time_us":126621,"raft.queue_time_us":79221,"raft.run_cpu_time_us":2276,"raft.run_wall_time_us":8946,"replication_time_us":1619574,"spinlock_wait_cycles":73658112,"thread_start_us":390150,"threads_started":4,"wal-append.queue_time_us":127213,"wal-append.run_cpu_time_us":16651,"wal-append.run_wall_time_us":1392102}]]}
I20260709 13:15:22.940006  9560 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:22.950510  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 826306us
W20260709 13:15:22.978619  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 71969.3us
I20260709 13:15:22.970171  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:22.968755  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:22.934405  9633 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:23.015184  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 76526.4us
I20260709 13:15:22.967027  6254 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
W20260709 13:15:23.001554  9372 consensus_meta.cc:287] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.000s
W20260709 13:15:23.014860  6296 connection.cc:256] RPC call timeout handler was delayed by -1.2911933789998784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
W20260709 13:15:23.027369  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 146056us
W20260709 13:15:23.027897  6296 connection.cc:256] RPC call timeout handler was delayed by -1.2448023439999361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
I20260709 13:15:23.030604  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:23.031075  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2241) took 1027 ms. Trace:
I20260709 13:15:23.031428  6253 rpcz_store.cc:276] 0709 13:15:22.003985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.969867 (+965882us) service_pool.cc:224] Handling call
0709 13:15:23.031015 (+ 61148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:23.041494  6219 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:23.029816  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2234) took 1028 ms. Trace:
I20260709 13:15:22.958370  9634 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.042711  6255 rpcz_store.cc:276] 0709 13:15:22.001742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.943801 (+942059us) service_pool.cc:224] Handling call
0709 13:15:23.029736 (+ 85935us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:22.945950  9635 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:23.015030  8611 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.005162  9575 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.020696  9367 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.045455  6905 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:22.957741  9360 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.015414  9546 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.020283  9640 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.048425  6368 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:23.011653  6248 rpcz_store.cc:276] 0709 13:15:18.941001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.941298 (+   297us) service_pool.cc:224] Handling call
0709 13:15:18.941678 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:18.942141 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.942176 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:18.957469 (+ 15293us) log.cc:844] Serialized 52 byte log entry
0709 13:15:21.234654 (+2277185us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b180042cdc0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:15:21.503957 (+269303us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:22.895284 (+1391327us) log.cc:844] Serialized 14 byte log entry
0709 13:15:22.910943 (+ 15659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.917425 (+  6482us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:22.917466 (+    41us) raft_consensus.cc:1685] finished
0709 13:15:22.920879 (+  3413us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:22.935572 (+ 14693us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33344,"prepare.queue_time_us":1144837,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":17537,"raft.run_cpu_time_us":1461,"raft.run_wall_time_us":44891,"spinlock_wait_cycles":63658240,"thread_start_us":1298041,"threads_started":2,"wal-append.queue_time_us":2367878}
I20260709 13:15:23.060649  6940 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:23.022039  9560 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:23.050431  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.052573  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 599) took 1690 ms. Trace:
I20260709 13:15:22.947865  9566 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:23.113611  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:23.060318  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.051407  8611 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:23.136907  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 70229.7us
W20260709 13:15:23.137624  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.043637  9372 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:23.133497  6404 rpcz_store.cc:276] 0709 13:15:21.359385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.359883 (+   498us) service_pool.cc:224] Handling call
0709 13:15:22.060633 (+700750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.106003 (+ 45370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.106048 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:22.106727 (+   679us) log.cc:844] Serialized 26 byte log entry
0709 13:15:22.502472 (+395745us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:22.502518 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.502586 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:23.049528 (+546942us) raft_consensus.cc:1685] finished
0709 13:15:23.049551 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.049700 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":314546,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":52265,"thread_start_us":440167,"threads_started":2,"wal-append.queue_time_us":885805}
I20260709 13:15:23.141539  9645 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:23.154233  6256 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:23.148973  6939 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:23.051522  9433 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:23.161048  6255 raft_consensus.cc:2410] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:15:23.161072  6253 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:23.051266  9635 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:23.155821  6939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 648) took 1014 ms. Trace:
I20260709 13:15:23.051450  9042 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:23.157655  9631 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:15:23.160228  9360 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:23.157253  9640 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:23.069777  9367 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:23.101811  9503 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:15:23.159178  9530 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:23.053758  9575 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:23.154152  9645 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:23.105860  9643 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.181088  9643 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:23.182713  6295 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:23.183131  9643 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:23.183624  9643 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:23.183941  9643 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.184274  9643 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:23.184443  9530 consensus_queue.cc:1048] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.185959  9530 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:23.186296  9530 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:23.186641  9530 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:23.165004  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2233) took 1163 ms. Trace:
I20260709 13:15:23.051752  9634 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:23.164714  6939 rpcz_store.cc:276] 0709 13:15:22.141012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.260674 (+119662us) service_pool.cc:224] Handling call
0709 13:15:23.155761 (+895087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:23.192183  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:23.168835  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.156620  9349 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:23.159471  9372 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:23.108523  9633 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:23.136169  9546 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:23.179391  9575 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:23.180330  9585 consensus_queue.cc:1059] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:15:23.287546  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 275563us
I20260709 13:15:23.190618  6255 rpcz_store.cc:276] 0709 13:15:22.001343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.049065 (+1047722us) service_pool.cc:224] Handling call
0709 13:15:23.164940 (+115875us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:23.194084  6248 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:23.168787  6936 raft_consensus.cc:2955] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:23.298962  6939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 612) took 1999 ms. Trace:
I20260709 13:15:23.299341  6939 rpcz_store.cc:276] 0709 13:15:21.299550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.197818 (+1898268us) service_pool.cc:224] Handling call
0709 13:15:23.274276 (+ 76458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:23.298649 (+ 24373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:23.298673 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:23.298712 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:23.298739 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.298795 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.298903 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:23.285910  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 612) took 1241 ms. Trace:
W20260709 13:15:23.281348  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 239948us
I20260709 13:15:23.189779  9645 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:23.163241  9433 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:23.310714  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.315364  6937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 688) took 2119 ms. Trace:
W20260709 13:15:23.317687  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 395951us
I20260709 13:15:23.290620  9634 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:23.315862  6937 rpcz_store.cc:276] 0709 13:15:21.187720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.188634 (+   914us) service_pool.cc:224] Handling call
0709 13:15:21.188975 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:21.189221 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:21.304359 (+115138us) log.cc:844] Serialized 14 byte log entry
0709 13:15:23.306905 (+2002546us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:23.306958 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:23.307012 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.307076 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.307185 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":134850,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":46,"raft.queue_time_us":208087,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":39040,"thread_start_us":2080684,"threads_started":3,"wal-append.queue_time_us":1655951}
I20260709 13:15:23.318854  6255 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:23.325858  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.326663  6255 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:23.327685  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.328851  6255 raft_consensus.cc:2410] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:15:23.301220  6398 rpcz_store.cc:276] 0709 13:15:22.044173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.044299 (+   126us) service_pool.cc:224] Handling call
0709 13:15:22.044602 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.045024 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:22.325356 (+280332us) log.cc:844] Serialized 14 byte log entry
0709 13:15:23.285589 (+960233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:23.285641 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:23.285685 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.285745 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.285858 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":846289,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"thread_start_us":1177500,"threads_started":3,"wal-append.queue_time_us":629885}
I20260709 13:15:23.333199  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:23.278577  9652 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.274022  9636 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.335358  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:23.338503  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.303545  9349 raft_consensus.cc:697] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:23.291384  9553 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:23.340277  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.287195  9660 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:23.317937  9585 consensus_queue.cc:1243] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer a13ffe92eb374309a5c8476d9fbbb2b8 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:23.358759  6939 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:15:23.384027  6939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 699) took 2016 ms. Trace:
I20260709 13:15:23.384630  6939 rpcz_store.cc:276] 0709 13:15:21.367137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.335797 (+1968660us) service_pool.cc:224] Handling call
0709 13:15:23.358434 (+ 22637us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:23.383382 (+ 24948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.383955 (+   573us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:23.360203  6219 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:23.379590  6255 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:23.323370  9095 raft_consensus.cc:697] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:23.298326  9633 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:15:23.342257  9642 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.396890  9560 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:23.398319  6934 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 632) took 3231 ms (client timeout 1708 ms). Trace:
I20260709 13:15:23.413987  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.402637  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:23.389256  6907 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:23.416730  6324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 736) took 2188 ms (client timeout 1928 ms). Trace:
W20260709 13:15:23.417315  6324 rpcz_store.cc:269] 0709 13:15:21.228014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.046244 (+818230us) service_pool.cc:224] Handling call
0709 13:15:23.403846 (+1357602us) spinlock_profiling.cc:243] Waited 97.4 ms on lock 0x7b54003930d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:23.416627 (+ 12781us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224062848}
I20260709 13:15:23.423998  9642 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:23.400607  9535 consensus_queue.cc:260] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:23.425961  9535 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:23.426298  9642 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:23.419337  6934 rpcz_store.cc:269] 0709 13:15:20.166404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.172471 (+  6067us) service_pool.cc:224] Handling call
0709 13:15:21.237875 (+1065404us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b580006e498. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:15:23.398088 (+2160213us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b54005906d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:23.398241 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2137482752}
I20260709 13:15:23.428841  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:23.429492  6934 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
W20260709 13:15:23.429620  6941 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 602) took 4269 ms (client timeout 2264 ms). Trace:
W20260709 13:15:23.430184  6941 rpcz_store.cc:269] 0709 13:15:19.160538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.160823 (+   285us) service_pool.cc:224] Handling call
0709 13:15:23.429172 (+4268349us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54004803d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:23.429394 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897288064}
I20260709 13:15:23.414932  6331 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
W20260709 13:15:23.434770  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 54921.2us
I20260709 13:15:23.436312  9643 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:23.437289  9042 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:23.437721  9443 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:23.436869  6907 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:23.438823  9360 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:23.441608  6907 connection.cc:256] RPC call timeout handler was delayed by -1.0405022659999759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 13:15:23.442127  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.446376  6248 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
W20260709 13:15:23.457659  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 103992us
W20260709 13:15:23.458540  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:23.458961  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.460752  6935 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:15:23.405921  9585 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:23.341431  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 292789us
I20260709 13:15:23.460809  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:23.469834  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.420065  9596 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:23.361029  9636 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:23.472465  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.593676  6248 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:23.594210  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 612) took 1219 ms. Trace:
I20260709 13:15:23.594152  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:23.390602  9660 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:23.594937  6326 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:23.595119  9645 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:23.596066  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:23.596697  6326 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:23.596215  6937 raft_consensus.cc:1240] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:23.594703  6248 rpcz_store.cc:276] 0709 13:15:22.374761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.456191 (+1081430us) service_pool.cc:224] Handling call
0709 13:15:23.594151 (+137960us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:23.589592  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 51225.8us
I20260709 13:15:23.361420  9652 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:23.601410  6219 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:23.560366  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.602021  6935 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:23.525110  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:23.599758  6905 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.008s	sys 0.016s
W20260709 13:15:23.617216  6905 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.010s	sys 0.016s
W20260709 13:15:23.617153  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 568723us
W20260709 13:15:23.617872  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 572462us
W20260709 13:15:23.602041  9490 consensus_meta.cc:287] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.684s	user 0.004s	sys 0.006s
I20260709 13:15:23.626258  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.454906  9503 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:23.622974  6219 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:23.617981  6222 leader_election.cc:336] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.804s (SENT)
W20260709 13:15:23.569082  6296 leader_election.cc:336] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.507s (SENT)
W20260709 13:15:23.629182  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 60157.4us
W20260709 13:15:23.629922  6296 leader_election.cc:336] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.511s (SENT)
I20260709 13:15:23.631937  6219 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:23.626875  6248 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:23.633509  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2231) took 1824 ms. Trace:
I20260709 13:15:23.633816  6248 rpcz_store.cc:276] 0709 13:15:21.842997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.605979 (+1762982us) service_pool.cc:224] Handling call
0709 13:15:23.633456 (+ 27477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:23.634346  9640 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:23.634768  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:23.635337  6248 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:23.636502  9619 log.cc:927] Time spent T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 2.003s	user 0.003s	sys 0.014s
I20260709 13:15:23.637177  9655 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:23.637754  9655 raft_consensus.cc:697] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:23.638420  9652 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:15:23.638703  9655 consensus_queue.cc:237] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:23.642889  9333 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:23.643307  9333 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.643625  9333 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:23.590132  9349 consensus_queue.cc:237] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:23.645227  9560 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.645895  9560 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:23.648265  9560 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:23.648391  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:23.649063  6322 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:23.650082  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:23.654022  6396 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:23.625876  9650 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.655061  9650 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:23.655463  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.656153  6250 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:23.656625  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2240) took 1653 ms. Trace:
I20260709 13:15:23.656934  6250 rpcz_store.cc:276] 0709 13:15:22.003692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.655209 (+1651517us) service_pool.cc:224] Handling call
0709 13:15:23.656568 (+  1359us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:23.638013  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.631261  9553 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:23.660650  6295 leader_election.cc:336] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.507s (SENT)
I20260709 13:15:23.671877  6219 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:23.672029  6295 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:23.661199  6905 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:23.674991  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2501) took 2471 ms. Trace:
I20260709 13:15:23.675443  6328 rpcz_store.cc:276] 0709 13:15:21.203600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.213875 (+ 10275us) service_pool.cc:224] Handling call
0709 13:15:21.365227 (+151352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.041286 (+676059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.671430 (+1630144us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003935d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:23.674922 (+  3492us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347200384}
I20260709 13:15:23.660775  6255 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:23.467010  9585 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.605566  9660 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:23.669327  9636 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:23.669428  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.679749  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:23.680452  6322 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:23.692755  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:23.464897  9647 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:23.470207  9566 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:23.689530  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.619153  9659 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:23.698550  6250 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:23.693730  6935 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
W20260709 13:15:23.699390  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 66327.4us
W20260709 13:15:23.675432  9631 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:23.671604  9606 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.731215  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:23.634040  9503 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:23.460621  9648 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.234s
I20260709 13:15:23.671919  9553 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:23.587630  9095 consensus_queue.cc:237] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:24.482633  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:24.485610  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:24.004252  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:24.597838  6322 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:24.237149  6934 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.027s	sys 0.035s
W20260709 13:15:24.002192  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 372274us
I20260709 13:15:24.479813  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.691632  9585 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:24.577361  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 99747.7us
W20260709 13:15:23.970881  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 310221us
W20260709 13:15:24.029824  6371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.113s	sys 0.233s
W20260709 13:15:24.612998  6371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.231s	sys 0.451s
I20260709 13:15:23.995951  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:24.613840  6297 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:24.095702  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:23.867789  6905 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:23.673771  9596 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:15:24.290337  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.579059  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:23.732858  6326 raft_consensus.cc:2393] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:15:24.617988  6295 leader_election.cc:336] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.681s (SENT)
I20260709 13:15:24.341197  6940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 610) took 3064 ms. Trace:
I20260709 13:15:24.625420  6940 rpcz_store.cc:276] 0709 13:15:21.276913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.137695 (+1860782us) service_pool.cc:224] Handling call
0709 13:15:23.137936 (+   241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:23.138237 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:23.138264 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:23.164459 (+ 26195us) log.cc:844] Serialized 26 byte log entry
0709 13:15:23.465110 (+300651us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:23.465181 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.465243 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.340883 (+875640us) raft_consensus.cc:1685] finished
0709 13:15:24.340909 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.341081 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":167633,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":266667,"threads_started":1,"wal-append.queue_time_us":761256}
W20260709 13:15:24.282060  6323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 728) took 3056 ms (client timeout 1516 ms). Trace:
I20260709 13:15:24.598263  6933 raft_consensus.cc:2376] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5. Re-sending same reply.
W20260709 13:15:24.459760  9635 consensus_meta.cc:287] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 1.184s	user 0.008s	sys 0.003s
W20260709 13:15:23.893265  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 202862us
I20260709 13:15:23.975761  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:24.635259  6251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1481) took 1677 ms (client timeout 2198 ms). Trace:
W20260709 13:15:24.635705  6251 rpcz_store.cc:269] 0709 13:15:22.958275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.732389 (+774114us) service_pool.cc:224] Handling call
0709 13:15:24.635196 (+902807us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.598126  6331 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:23.768947  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:23.987104  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:24.602896  6248 consensus_meta.cc:287] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.967s	user 0.010s	sys 0.000s
I20260709 13:15:24.637022  6939 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:24.637321  6248 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
W20260709 13:15:23.883615  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 283613us
W20260709 13:15:24.637840  6248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1483) took 1679 ms (client timeout 1937 ms). Trace:
W20260709 13:15:24.511173  6254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2219) took 3128 ms (client timeout 1507 ms). Trace:
W20260709 13:15:24.638192  6248 rpcz_store.cc:269] 0709 13:15:22.958797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.634522 (+675725us) service_pool.cc:224] Handling call
0709 13:15:24.637784 (+1003262us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:24.638485  6254 rpcz_store.cc:269] 0709 13:15:21.382457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.385318 (+  2861us) service_pool.cc:224] Handling call
0709 13:15:24.510921 (+3125603us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54003d0754. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:24.511074 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2031190912}
I20260709 13:15:24.639191  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.639554  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.640151  6254 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:24.640619  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 621) took 1680 ms. Trace:
W20260709 13:15:24.629238  6323 rpcz_store.cc:269] 0709 13:15:21.225512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.226534 (+  1022us) service_pool.cc:224] Handling call
0709 13:15:24.281833 (+3055299us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54002a4c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:24.281960 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812920576}
I20260709 13:15:24.641350  6939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 710) took 1054 ms. Trace:
I20260709 13:15:24.598709  6255 raft_consensus.cc:2376] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7. Re-sending same reply.
I20260709 13:15:24.480798  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:24.085430  9160 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:24.199170  9663 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.971275  9660 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:24.577803  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:24.614897  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1487) took 1655 ms. Trace:
W20260709 13:15:24.619705  6934 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.032s	sys 0.049s
W20260709 13:15:24.287416  6396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 616) took 2163 ms (client timeout 1778 ms). Trace:
W20260709 13:15:24.451601  6369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.000s	sys 0.007s
W20260709 13:15:24.434733  9530 consensus_meta.cc:287] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.248s	user 0.008s	sys 0.004s
W20260709 13:15:24.189038  8611 consensus_meta.cc:287] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 1.034s	user 0.005s	sys 0.001s
W20260709 13:15:24.303915  9638 consensus_meta.cc:287] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 1.419s	user 0.011s	sys 0.001s
W20260709 13:15:24.190161  9646 log.cc:927] Time spent T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.498s	user 0.000s	sys 0.000s
I20260709 13:15:24.622251  6935 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
W20260709 13:15:24.301546  9665 log.cc:927] Time spent T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
W20260709 13:15:24.225349  9535 consensus_meta.cc:287] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.799s	user 0.007s	sys 0.004s
W20260709 13:15:24.302851  9631 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:15:24.255048  9653 consensus_queue.cc:1059] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.392s
I20260709 13:15:24.518148  6937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 615) took 3180 ms. Trace:
W20260709 13:15:24.632090  6296 leader_election.cc:336] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.586s (SENT)
I20260709 13:15:24.647608  9160 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:24.633724  6936 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.006s	sys 0.014s
W20260709 13:15:24.671294  6936 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.007s	sys 0.014s
I20260709 13:15:24.581365  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 729) took 3355 ms. Trace:
I20260709 13:15:24.671363  6937 rpcz_store.cc:276] 0709 13:15:21.343960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.335015 (+1991055us) service_pool.cc:224] Handling call
0709 13:15:23.382732 (+ 47717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:23.598926 (+216194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.517789 (+918863us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b540049d9d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:24.518062 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490551040}
W20260709 13:15:23.971266  6941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.003s	sys 0.015s
W20260709 13:15:24.256099  6329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.026s	sys 0.041s
I20260709 13:15:24.672652  6368 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:15:24.465948  9333 consensus_meta.cc:287] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.822s	user 0.011s	sys 0.000s
W20260709 13:15:24.240451  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 205788us
I20260709 13:15:24.673969  6219 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:24.483675  9613 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:24.609756  9553 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.297461  9643 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:24.460844  9546 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:24.001410  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:24.645524  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2244) took 1015 ms. Trace:
I20260709 13:15:24.683526  6328 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.661073  9645 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:24.642762  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2243) took 1018 ms. Trace:
I20260709 13:15:24.617491  9606 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:24.643679  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:24.648397  6369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.200s	user 0.000s	sys 0.010s
I20260709 13:15:24.642230  6939 rpcz_store.cc:276] 0709 13:15:23.587090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.683594 (+ 96504us) service_pool.cc:224] Handling call
0709 13:15:24.637632 (+954038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.647652  6250 rpcz_store.cc:276] 0709 13:15:22.959903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.972385 (+1012482us) service_pool.cc:224] Handling call
0709 13:15:24.614826 (+642441us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.419018  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:24.616706  9503 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:24.694072  6322 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:15:24.650136  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:24.694916  6940 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:24.651073  6942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 708) took 1185 ms. Trace:
I20260709 13:15:23.710098  9667 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:23.931386  9433 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:24.488315  9650 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:24.685271  9349 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:24.624169  9596 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.655033  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.688339  9546 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:24.703039  6251 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:24.703378  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2246) took 1078 ms. Trace:
I20260709 13:15:24.657370  6935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 709) took 1070 ms. Trace:
W20260709 13:15:24.704077  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.704329  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 733) took 3477 ms. Trace:
I20260709 13:15:24.704144  6935 rpcz_store.cc:276] 0709 13:15:23.586677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.759465 (+172788us) service_pool.cc:224] Handling call
0709 13:15:24.657312 (+897847us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:24.705011  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.703558  6251 rpcz_store.cc:276] 0709 13:15:23.624928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.642009 (+1017081us) service_pool.cc:224] Handling call
0709 13:15:24.703338 (+ 61329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.706578  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2513) took 1313 ms. Trace:
I20260709 13:15:24.660250  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:24.661623  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:24.644670  9647 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:24.631733  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2527) took 1033 ms. Trace:
I20260709 13:15:24.191025  9659 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:24.705463  6938 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 656) took 1063 ms. Trace:
I20260709 13:15:24.710727  6938 rpcz_store.cc:276] 0709 13:15:23.641935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.418676 (+776741us) service_pool.cc:224] Handling call
0709 13:15:24.702584 (+283908us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:24.633045  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 900128us
I20260709 13:15:24.641980  9675 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.712155  9659 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:24.712013  9675 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:24.709482  9647 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:24.672824  6329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.034s	sys 0.049s
I20260709 13:15:24.184239  9491 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:24.672676  6941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.229s	user 0.011s	sys 0.072s
I20260709 13:15:24.704813  6330 rpcz_store.cc:276] 0709 13:15:21.227100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.119321 (+892221us) service_pool.cc:224] Handling call
0709 13:15:22.119987 (+   666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.120704 (+   717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.120769 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:23.147005 (+1026236us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b2c0002aad8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f45744dea11 00007f45744ee372 00007f4575c20a01 00007f4575be543a 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2
0709 13:15:23.147453 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:15:23.241404 (+ 93951us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:23.241443 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.241509 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.701693 (+1460184us) raft_consensus.cc:1685] finished
0709 13:15:24.701711 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.704269 (+  2558us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":782,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":150,"spinlock_wait_cycles":86605056,"thread_start_us":93572,"threads_started":1,"wal-append.queue_time_us":429973}
I20260709 13:15:24.717437  6933 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:24.717964  6933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 657) took 1075 ms. Trace:
I20260709 13:15:24.670819  6296 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:24.671931  6327 rpcz_store.cc:276] 0709 13:15:21.225830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.112955 (+887125us) service_pool.cc:224] Handling call
0709 13:15:22.113763 (+   808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.115127 (+  1364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.115195 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:23.653469 (+1538274us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b2c0002aad8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f45744dea11 00007f45744ee372 00007f4575c20a01 00007f4575be543a 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2
0709 13:15:23.653885 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:15:23.986521 (+332636us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:23.986561 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.986638 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.580962 (+594324us) raft_consensus.cc:1685] finished
0709 13:15:24.580991 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.581287 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":191,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":23130496,"thread_start_us":332270,"threads_started":1,"wal-append.queue_time_us":924964}
I20260709 13:15:24.675834  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.656883  9496 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:24.713042  9647 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:24.660375  9638 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:24.681399  6253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2235) took 2674 ms (client timeout 2042 ms). Trace:
I20260709 13:15:24.713342  9546 raft_consensus.cc:697] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:24.724822  6253 rpcz_store.cc:269] 0709 13:15:22.002088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.048934 (+1046846us) service_pool.cc:224] Handling call
0709 13:15:24.675878 (+1626944us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b54001b8fd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:24.675980 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58705152}
I20260709 13:15:24.725956  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.685454  6248 rpcz_store.cc:276] 0709 13:15:23.624633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.638943 (+1014310us) service_pool.cc:224] Handling call
0709 13:15:24.639870 (+   927us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.719853  6328 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:24.726771  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2525) took 1262 ms. Trace:
I20260709 13:15:24.726981  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.727092  6328 rpcz_store.cc:276] 0709 13:15:23.464257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.869801 (+405544us) service_pool.cc:224] Handling call
0709 13:15:24.726722 (+856921us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.728008  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.728459  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2516) took 1334 ms. Trace:
I20260709 13:15:24.685916  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 745) took 1402 ms. Trace:
I20260709 13:15:24.640916  6254 rpcz_store.cc:276] 0709 13:15:22.959817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.639306 (+1679489us) service_pool.cc:224] Handling call
0709 13:15:24.640564 (+  1258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.728787  6328 rpcz_store.cc:276] 0709 13:15:23.394375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.727746 (+1333371us) service_pool.cc:224] Handling call
0709 13:15:24.727989 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.728162 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.728186 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:24.728224 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:24.728259 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.728308 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.728405 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:24.729524  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.729238  6325 rpcz_store.cc:276] 0709 13:15:23.279105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.672163 (+1393058us) service_pool.cc:224] Handling call
0709 13:15:24.672425 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.680430 (+  8005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.681007 (+   577us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:24.681050 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:24.681083 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.681166 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.681266 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.642793  9635 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:24.674819  9160 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:24.657418  8611 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:24.028522  9443 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.688045  6255 rpcz_store.cc:276] 0709 13:15:23.624458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.730829 (+106371us) service_pool.cc:224] Handling call
0709 13:15:24.642703 (+911874us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.688699  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:24.678476  9630 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:24.691068  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 1.30796e+06us
I20260709 13:15:23.710856  9367 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:24.696152  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1484) took 1737 ms. Trace:
I20260709 13:15:24.657863  9530 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:24.695647  6942 rpcz_store.cc:276] 0709 13:15:23.465576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.480390 (+1014814us) service_pool.cc:224] Handling call
0709 13:15:24.650995 (+170605us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.699920  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:24.648254  6396 rpcz_store.cc:269] 0709 13:15:22.123952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.145543 (+ 21591us) service_pool.cc:224] Handling call
0709 13:15:24.287207 (+2141664us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400124654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:24.287323 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3341364096}
W20260709 13:15:24.694476  9669 log.cc:927] Time spent T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:15:24.655532  9663 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:24.694636  9648 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:24.676098  9333 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:24.744781  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2518) took 1349 ms. Trace:
I20260709 13:15:24.709817  6326 rpcz_store.cc:276] 0709 13:15:23.598640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.658326 (+ 59686us) service_pool.cc:224] Handling call
0709 13:15:24.631655 (+973329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.710247  6323 raft_consensus.cc:2410] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:24.716137  9491 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.748131  9491 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.749996  9606 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:24.750123  9553 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:24.751340  9438 raft_consensus.cc:3055] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:24.751744  9438 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:24.752795  9553 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:24.754307  6256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2236) took 2751 ms (client timeout 1965 ms). Trace:
I20260709 13:15:24.754649  9333 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:24.754686  6256 rpcz_store.cc:269] 0709 13:15:22.002430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.887661 (+885231us) service_pool.cc:224] Handling call
0709 13:15:24.754134 (+1866473us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54001482d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:24.754237 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534246144}
I20260709 13:15:24.751340  6253 raft_consensus.cc:2393] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:24.718248  6933 rpcz_store.cc:276] 0709 13:15:23.642281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.649338 (+1007057us) service_pool.cc:224] Handling call
0709 13:15:24.717894 (+ 68556us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.721807  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 731) took 3495 ms. Trace:
I20260709 13:15:24.722638  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.720587  9496 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:24.709434  9349 raft_consensus.cc:697] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:24.723826  6327 raft_consensus.cc:1240] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:24.721167  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1486) took 1761 ms. Trace:
I20260709 13:15:24.731160  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2519) took 1336 ms. Trace:
I20260709 13:15:24.732064  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.768213  6248 raft_consensus.cc:2368] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7.
I20260709 13:15:24.732306  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:24.769186  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.734261  6330 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:24.739336  6937 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:24.740477  6252 rpcz_store.cc:276] 0709 13:15:22.959096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.625056 (+1665960us) service_pool.cc:224] Handling call
0709 13:15:24.696093 (+ 71037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.741307  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:24.742162  6250 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.739979  9630 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:24.734783  9613 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:24.725745  9546 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:24.739881  9443 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:24.776284  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2514) took 1382 ms. Trace:
I20260709 13:15:24.776669  6330 rpcz_store.cc:276] 0709 13:15:23.393840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.717093 (+1323253us) service_pool.cc:224] Handling call
0709 13:15:24.732808 (+ 15715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.776030 (+ 43222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.776227 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.779096  9681 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.746423  6328 rpcz_store.cc:276] 0709 13:15:23.394901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.729877 (+1334976us) service_pool.cc:224] Handling call
0709 13:15:24.738034 (+  8157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.744450 (+  6416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.744479 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:24.744524 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:24.744571 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.744625 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.744729 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.747292  9648 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:24.766032  6249 rpcz_store.cc:276] 0709 13:15:22.959635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.675596 (+1715961us) service_pool.cc:224] Handling call
0709 13:15:24.721086 (+ 45490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.766285  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2515) took 1372 ms. Trace:
I20260709 13:15:24.780790  6327 rpcz_store.cc:276] 0709 13:15:23.394118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.719302 (+1325184us) service_pool.cc:224] Handling call
0709 13:15:24.723619 (+  4317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.766033 (+ 42414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.766234 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.780666  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.783100  6249 raft_consensus.cc:2410] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:15:24.701794  9667 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:24.733554  9645 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 13:15:24.770859  6295 leader_election.cc:336] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.572s (SENT)
I20260709 13:15:24.708432  9596 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:24.771711  6325 rpcz_store.cc:276] 0709 13:15:23.395169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.730304 (+1335135us) service_pool.cc:224] Handling call
0709 13:15:24.730612 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.730895 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.730921 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:24.730958 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:24.730994 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.731049 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.731121 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.757468  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 702) took 2694 ms. Trace:
W20260709 13:15:24.793892  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 180138us
I20260709 13:15:24.744680  6905 leader_election.cc:400] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8.
I20260709 13:15:24.794617  6905 leader_election.cc:403] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:24.765419  6329 rpcz_store.cc:276] 0709 13:15:21.226460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.114872 (+888412us) service_pool.cc:224] Handling call
0709 13:15:22.115631 (+   759us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.116696 (+  1065us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:22.116758 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:23.646643 (+1529885us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b2c0002aad8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f45744dea11 00007f45744ee372 00007f4575c20a01 00007f4575be543a 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2
0709 13:15:23.647099 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:15:24.713562 (+1066463us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:24.713600 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.713662 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.713699 (+    37us) raft_consensus.cc:1685] finished
0709 13:15:24.713710 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.721746 (+  8036us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":172,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":96130944,"thread_start_us":1066076,"threads_started":1,"wal-append.queue_time_us":960033}
I20260709 13:15:24.775597  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2529) took 1091 ms. Trace:
I20260709 13:15:24.777611  9630 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:24.795897  6323 rpcz_store.cc:276] 0709 13:15:23.683948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.644000 (+960052us) service_pool.cc:224] Handling call
0709 13:15:24.775533 (+131533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.756471  9663 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:24.769306  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:24.780643  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2242) took 1156 ms. Trace:
I20260709 13:15:24.798925  6251 rpcz_store.cc:276] 0709 13:15:23.624281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.705886 (+1081605us) service_pool.cc:224] Handling call
0709 13:15:24.780572 (+ 74686us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:24.787156  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 65082.2us
I20260709 13:15:24.790726  6330 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:24.790634  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.791540  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:24.800710  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 184216us
I20260709 13:15:24.800812  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2521) took 1405 ms. Trace:
W20260709 13:15:24.801573  6296 leader_election.cc:336] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.588s (SENT)
I20260709 13:15:24.801469  6330 rpcz_store.cc:276] 0709 13:15:23.395674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.777562 (+1381888us) service_pool.cc:224] Handling call
0709 13:15:24.790442 (+ 12880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.799918 (+  9476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.800761 (+   843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.801915  6369 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:24.707221  6322 rpcz_store.cc:276] 0709 13:15:23.393550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.699676 (+1306126us) service_pool.cc:224] Handling call
0709 13:15:24.699962 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.700159 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.700184 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:24.700227 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:24.704009 (+  3782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.706415 (+  2406us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.706525 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.802326  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:24.752657  9438 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:24.803370  6256 raft_consensus.cc:2410] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:24.803429  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.806535  6254 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:24.807592  6368 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:24.788044  9333 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:24.808580  6251 raft_consensus.cc:2393] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:24.809743  6219 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:24.814424  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.815203  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 606) took 2802 ms. Trace:
I20260709 13:15:24.815234  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:24.815722  6254 rpcz_store.cc:276] 0709 13:15:22.004326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.804866 (+2800540us) service_pool.cc:224] Handling call
0709 13:15:24.806422 (+  1556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.806867 (+   445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.806985 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.816056  6219 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:24.817405  6296 leader_election.cc:336] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.814s (SENT)
I20260709 13:15:24.817857  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:24.818796  9613 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:24.819869  9496 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:24.823375  9659 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:24.823770  9659 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.824024  8611 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:24.824119  9659 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:24.824698  8611 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8.
I20260709 13:15:24.825640  9675 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:24.790045  9681 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:24.827898  9681 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:24.828734  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:24.829794  9663 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:24.830878  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:24.831360  9606 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:24.798004  9650 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.832058  9650 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:24.832846  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:24.833961  9650 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:24.837281  9349 consensus_queue.cc:237] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:24.841025  9635 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:24.841836  9672 log.cc:927] Time spent T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:15:24.846088  9530 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:24.829948  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:24.847391  6942 raft_consensus.cc:2376] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4. Re-sending same reply.
I20260709 13:15:24.848255  9333 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:24.849831  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 45109.7us
I20260709 13:15:24.850205  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:24.850749  6937 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.851208  9640 raft_consensus.cc:2764] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:15:24.852238  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.852835  6256 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
W20260709 13:15:24.853855  9676 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:15:24.815033  9638 consensus_queue.cc:1059] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:15:24.854950  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 740) took 3584 ms. Trace:
I20260709 13:15:24.855567  9638 raft_consensus.cc:3055] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:24.856086  9638 raft_consensus.cc:740] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:24.855388  6324 rpcz_store.cc:276] 0709 13:15:21.273534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.467231 (+2193697us) service_pool.cc:224] Handling call
0709 13:15:23.558643 (+ 91412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:23.625643 (+ 67000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:23.625685 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:23.641192 (+ 15507us) log.cc:844] Serialized 26 byte log entry
0709 13:15:24.505189 (+863997us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b180043cb40. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:15:24.689221 (+184032us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:24.689259 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.689321 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.854687 (+165366us) raft_consensus.cc:1685] finished
0709 13:15:24.854706 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.854896 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41692,"raft.queue_time_us":32836,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":37937536,"thread_start_us":183817,"threads_started":1,"wal-append.queue_time_us":1078678}
W20260709 13:15:24.859922  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 43932.3us
W20260709 13:15:24.861743  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 126612us
I20260709 13:15:24.792778  6941 rpcz_store.cc:276] 0709 13:15:22.062828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.431062 (+1368234us) service_pool.cc:224] Handling call
0709 13:15:23.431396 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:23.443059 (+ 11663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:23.443091 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:23.443643 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:15:24.728953 (+1285310us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:24.728992 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.729056 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.746740 (+ 17684us) raft_consensus.cc:1685] finished
0709 13:15:24.746758 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.757410 (+ 10652us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11254,"raft.queue_time_us":37111,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":85797,"thread_start_us":1272815,"threads_started":1,"wal-append.queue_time_us":1133827}
W20260709 13:15:24.865768  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 47528.8us
W20260709 13:15:24.865291  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 227253us
W20260709 13:15:24.867380  6222 leader_election.cc:336] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.954s (SENT)
W20260709 13:15:24.872054  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:24.872412  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.850651  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:24.873986  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:24.874591  6325 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:15:24.875936  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 74074.4us
I20260709 13:15:24.887156  6250 raft_consensus.cc:2410] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:24.860601  6219 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:24.896906  6937 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:24.898947  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:24.899602  6250 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:24.898083  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:24.887380  6297 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:24.902925  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:24.904541  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:24.904563  6937 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:24.906471  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:24.828971  9648 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:24.911959  6251 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:24.912485  6254 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:24.919595  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:24.937280  6323 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:24.910596  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2250) took 1219 ms. Trace:
I20260709 13:15:24.938784  6253 rpcz_store.cc:276] 0709 13:15:23.690812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.725694 (+1034882us) service_pool.cc:224] Handling call
0709 13:15:24.910398 (+184704us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b54001487d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:24.910535 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56719232}
I20260709 13:15:24.935820  6935 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:15:25.000356  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 92683.6us
W20260709 13:15:24.941221  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 53897.8us
I20260709 13:15:25.001802  6297 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:25.003077  6936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 611) took 3718 ms. Trace:
I20260709 13:15:25.003458  6936 rpcz_store.cc:276] 0709 13:15:21.284810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.138728 (+1853918us) service_pool.cc:224] Handling call
0709 13:15:23.156500 (+ 17772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:23.164621 (+  8121us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:23.663305 (+498684us) log.cc:844] Serialized 14 byte log entry
0709 13:15:25.002549 (+1339244us) log.cc:844] Serialized 14 byte log entry
0709 13:15:25.002731 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:25.002776 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:25.002821 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.002897 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.003021 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32224,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":2204,"thread_start_us":925544,"threads_started":2,"wal-append.queue_time_us":900895}
I20260709 13:15:25.010048  9663 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.010447  6297 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:25.001096  6371 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 2.017s (SENT) [suppressed 70 similar messages]
I20260709 13:15:25.011446  6297 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:24.902588  9488 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:24.908717  9438 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:25.005751  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 609) took 2777 ms. Trace:
W20260709 13:15:25.021039  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 144011us
I20260709 13:15:25.037137  6251 rpcz_store.cc:276] 0709 13:15:22.190036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.816805 (+2626769us) service_pool.cc:224] Handling call
0709 13:15:24.904044 (+ 87239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.936182 (+ 32138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.967124 (+ 30942us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:25.038177  6369 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:24.888650  9650 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:24.898330  9606 raft_consensus.cc:697] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:15:25.033721  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 216301us
W20260709 13:15:25.034548  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 183991us
I20260709 13:15:25.021683  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:25.042752  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:25.006624  9530 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:25.012887  9635 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:25.010823  9663 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:24.905550  9613 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.138s
W20260709 13:15:25.063868  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 44024.4us
I20260709 13:15:25.005288  6249 raft_consensus.cc:2955] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:25.038725  9433 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:25.038363  9367 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:24.857025  9638 consensus_queue.cc:260] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:24.926920  9160 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:25.055478  9673 log.cc:927] Time spent T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:15:25.038561  9653 consensus_queue.cc:1059] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:15:25.102711  6368 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:25.103919  6295 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:15:25.115669  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 71408.5us
I20260709 13:15:25.067667  9433 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.070657  9668 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:25.072463  9367 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:25.122656  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:25.114609  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 102280us
I20260709 13:15:25.132489  6938 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:25.102113  9553 consensus_queue.cc:1059] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:15:25.122815  9488 raft_consensus.cc:697] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:25.116928  9650 raft_consensus.cc:697] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:25.138058  9678 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:25.117868  9530 raft_consensus.cc:697] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:25.114065  9203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.098s	user 0.011s	sys 0.026s
I20260709 13:15:25.136619  9433 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:25.143906  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 132535us
I20260709 13:15:25.079933  9684 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:15:25.148379  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 147303us
W20260709 13:15:25.152510  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 73432.5us
I20260709 13:15:25.101012  9349 consensus_queue.cc:1059] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:15:25.157326  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:25.170903  6329 raft_consensus.cc:2376] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7. Re-sending same reply.
I20260709 13:15:25.144246  9367 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:25.132189  9679 raft_consensus.cc:3055] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:25.197417  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:25.164774  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:25.198553  6936 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:25.144539  9638 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:25.169982  6297 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:25.200521  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:25.202462  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.154374  9668 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.173223  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:25.207628  6327 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:25.174134  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:25.208271  6324 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:25.154249  9203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.140s	user 0.012s	sys 0.027s
I20260709 13:15:25.172144  6222 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:25.147418  9635 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:25.149504  9640 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.195878  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:25.263223  6368 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:25.263725  6329 raft_consensus.cc:2393] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:25.172464  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:25.265271  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 93192.8us
I20260709 13:15:25.215680  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:25.164280  9546 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:25.259677  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 155844us
W20260709 13:15:25.259997  6907 leader_election.cc:336] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.552s (SENT)
W20260709 13:15:25.260902  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 90979.5us
I20260709 13:15:25.268616  9546 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.254817  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:25.269016  6907 leader_election.cc:336] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.563s (SENT)
I20260709 13:15:25.269330  9546 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:25.269747  6936 raft_consensus.cc:2393] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:25.270761  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:25.272460  6936 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:25.269052  6297 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:25.267694  6905 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:25.274555  6940 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:25.274753  6222 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:25.197151  9679 raft_consensus.cc:740] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:25.262633  9491 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:25.282701  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:25.284668  6295 leader_election.cc:336] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.708s (SENT)
I20260709 13:15:25.285362  6295 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:25.285686  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:25.286351  6329 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:25.262986  9349 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.308941  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:25.288434  6222 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:25.164142  9696 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 13:15:25.290364  6330 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:25.331466  9696 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:25.332049  9696 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.332518  9696 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:25.338855  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 50468.4us
I20260709 13:15:25.322784  6936 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:25.284323  9653 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.345619  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 607) took 3316 ms. Trace:
I20260709 13:15:25.284741  9443 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:25.195180  9647 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:25.356616  6254 rpcz_store.cc:276] 0709 13:15:22.004644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.816709 (+2812065us) service_pool.cc:224] Handling call
0709 13:15:24.912328 (+ 95619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.936846 (+ 24518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.320373 (+383527us) spinlock_profiling.cc:243] Waited 95.3 ms on lock 0x7b54001487d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:25.320547 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219112704}
I20260709 13:15:25.358834  6327 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:25.346004  6297 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:25.359373  6222 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:25.360265  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 105015us
I20260709 13:15:25.363511  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:25.368855  6905 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:25.357878  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:25.370201  6938 raft_consensus.cc:2393] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:25.311009  9496 raft_consensus.cc:2764] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:15:25.174885  9606 consensus_queue.cc:237] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:25.371320  6325 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:25.308635  9694 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:25.301142  9691 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:25.171770  9684 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:25.348088  9635 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:25.283968  9640 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:25.378602  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 93990.2us
I20260709 13:15:25.379065  6933 raft_consensus.cc:2393] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:25.282146  9530 consensus_queue.cc:237] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:25.260241  9668 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:25.373519  9095 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:25.371055  9443 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:25.282305  9679 consensus_queue.cc:260] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:25.379717  9659 consensus_meta.cc:287] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.000s
I20260709 13:15:25.378165  9691 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.348232  9349 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:25.470181  9095 raft_consensus.cc:697] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:15:25.392138  9596 consensus_meta.cc:287] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.003s
I20260709 13:15:25.477442  9596 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:25.478597  9688 log.cc:927] Time spent T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:15:25.388296  9496 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.340900  9650 consensus_queue.cc:237] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:25.361312  9653 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:25.468142  6368 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:25.393045  6254 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:25.401649  6295 leader_election.cc:400] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7.
W20260709 13:15:25.468514  6907 leader_election.cc:336] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.787s (SENT)
I20260709 13:15:25.384083  9704 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.394726  9707 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.545197  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2520) took 2112 ms. Trace:
I20260709 13:15:25.391968  9694 raft_consensus.cc:697] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:25.288702  9667 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:25.472800  9691 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:25.571938  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 173399us
I20260709 13:15:25.395023  9635 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:25.479797  9689 log.cc:927] Time spent T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:15:25.446096  9685 log.cc:927] Time spent T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
W20260709 13:15:25.480641  9686 log.cc:927] Time spent T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:15:25.499190  6252 raft_consensus.cc:2393] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:25.392252  9713 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:25.502329  6324 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:15:25.501190  6934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 701) took 4133 ms. Trace:
I20260709 13:15:25.505363  6295 leader_election.cc:403] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:25.505681  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:25.507678  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 311800us
I20260709 13:15:25.540344  9681 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:25.541204  9675 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:25.542879  9640 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:25.510550  9613 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:25.546746  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:25.508206  9687 log.cc:927] Time spent T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
W20260709 13:15:25.670384  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 301606us
W20260709 13:15:25.687256  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 285787us
I20260709 13:15:25.580442  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:25.509951  6396 raft_consensus.cc:2955] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:25.545608  6326 rpcz_store.cc:276] 0709 13:15:23.395419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.746642 (+1351223us) service_pool.cc:224] Handling call
0709 13:15:24.785435 (+ 38793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.788839 (+  3404us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:24.904000 (+115161us) log.cc:844] Serialized 14 byte log entry
0709 13:15:25.507103 (+603103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:25.507161 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:25.507208 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.507277 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.507383 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":219288,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":92936,"spinlock_wait_cycles":9548672,"thread_start_us":686057,"threads_started":3,"wal-append.queue_time_us":267564}
I20260709 13:15:25.583222  6368 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:25.511834  9663 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:25.622663  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:25.370080  9488 consensus_queue.cc:237] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:25.776995  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 417809us
I20260709 13:15:25.760936  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:25.780198  6403 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:25.671095  6400 raft_consensus.cc:2376] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7. Re-sending same reply.
I20260709 13:15:25.671871  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:25.691710  6253 consensus_meta.cc:287] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.000s
I20260709 13:15:25.620868  9667 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:25.590107  9443 raft_consensus.cc:697] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:25.686266  9693 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:25.687523  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:25.687055  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:25.763576  6327 raft_consensus.cc:2955] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:25.500581  9659 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:25.571934  9679 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:25.618413  9674 log.cc:927] Time spent T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.965s	user 0.003s	sys 0.005s
I20260709 13:15:25.782820  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:25.782672  6253 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:25.783888  6295 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:25.846063  6329 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:25.568228  9496 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:25.784067  6222 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:25.766227  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:25.776394  6397 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:25.670522  6934 rpcz_store.cc:276] 0709 13:15:21.367686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.430152 (+2062466us) service_pool.cc:224] Handling call
0709 13:15:23.430450 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:23.471595 (+ 41145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:23.471630 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:23.577367 (+105737us) log.cc:844] Serialized 26 byte log entry
0709 13:15:24.647920 (+1070553us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:24.663945 (+ 16025us) log.cc:844] Serialized 14 byte log entry
0709 13:15:24.912786 (+248841us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180026a3a0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af5455 00007f4575bdd060 00007f4575bef716 00007f4575c00287 00007f4575c00208
0709 13:15:25.467827 (+555041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.467950 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:25.467994 (+    44us) raft_consensus.cc:1685] finished
0709 13:15:25.500945 (+ 32951us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.501082 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24405,"prepare.queue_time_us":14667,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2035,"raft.queue_time_us":190981,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":6211,"spinlock_wait_cycles":23762176,"thread_start_us":1514606,"threads_started":2,"wal-append.queue_time_us":1052459}
I20260709 13:15:25.858004  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:25.766974  6254 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:25.568769  9704 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:25.817070  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 349187us
W20260709 13:15:25.862166  6907 leader_election.cc:336] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.778s (SENT)
I20260709 13:15:25.728257  9160 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:25.792568  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 209416us
I20260709 13:15:25.868275  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:25.774783  9535 raft_consensus.cc:3055] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:25.881587  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 99808.2us
I20260709 13:15:25.817713  6401 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:25.817066  6405 raft_consensus.cc:2376] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7. Re-sending same reply.
I20260709 13:15:25.827217  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:25.883621  6402 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:15:25.791985  9491 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:25.785696  9667 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:25.829591  9585 consensus_meta.cc:287] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.195s	user 0.010s	sys 0.001s
I20260709 13:15:25.830209  9553 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:25.830664  9503 consensus_meta.cc:287] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 1.125s	user 0.008s	sys 0.003s
W20260709 13:15:25.831529  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.832871  9668 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:25.839756  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2512) took 4563 ms. Trace:
I20260709 13:15:25.841904  6322 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:15:25.768458  9675 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:25.840797  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:25.899881  9693 raft_consensus.cc:697] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:25.760617  9698 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7.
W20260709 13:15:25.858239  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 74435.5us
W20260709 13:15:25.818455  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.869001  6253 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:25.870720  6254 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:25.881207  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:25.775139  9681 consensus_queue.cc:1243] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:15:25.788975  9640 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:25.885318  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:25.888260  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 203215us
I20260709 13:15:25.668877  9635 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:26.040855  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:26.041595  6330 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:25.767201  9648 consensus_queue.cc:1059] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:15:25.571337  9707 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:25.909229  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 140396us
I20260709 13:15:25.865890  9695 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.930326  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:25.868904  9596 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:25.929239  9585 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:25.930287  6331 rpcz_store.cc:276] 0709 13:15:21.276226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.662622 (+3386396us) service_pool.cc:224] Handling call
0709 13:15:24.684012 (+ 21390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:24.700421 (+ 16409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.700449 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:24.703424 (+  2975us) log.cc:844] Serialized 26 byte log entry
0709 13:15:24.887764 (+184340us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b18004140a0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:15:25.085880 (+198116us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:25.085932 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.086024 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:25.839421 (+753397us) raft_consensus.cc:1685] finished
0709 13:15:25.839441 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.839688 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8134,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":1678,"spinlock_wait_cycles":3795712,"thread_start_us":197897,"threads_started":1,"wal-append.queue_time_us":430301}
I20260709 13:15:25.964386  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:26.075790  6934 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:25.967451  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2533) took 1154 ms. Trace:
I20260709 13:15:26.076815  6322 rpcz_store.cc:276] 0709 13:15:24.812679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.940623 (+127944us) service_pool.cc:224] Handling call
0709 13:15:25.020675 (+ 80052us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:25.841612 (+820937us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b54001e21a0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575b5cdc0 00007f4575be71c0 00007f4575be8231 00007f4575be4d8f 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c
0709 13:15:25.967187 (+125575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.967399 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107033472}
I20260709 13:15:25.881933  9535 raft_consensus.cc:740] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:26.079347  6907 leader_election.cc:336] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.176s (SENT)
I20260709 13:15:25.909199  9667 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:25.970949  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1482) took 3012 ms. Trace:
I20260709 13:15:25.964752  9668 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:15:25.789001  9095 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:25.922461  9647 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:25.964540  9676 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:15:25.840788  9696 consensus_meta.cc:287] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.000s
I20260709 13:15:26.037497  6397 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:26.051618  6368 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:25.883034  9708 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:26.040512  9630 consensus_meta.cc:287] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 1.233s	user 0.008s	sys 0.009s
I20260709 13:15:26.076275  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:25.950707  9503 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:26.079814  6907 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:25.974506  6939 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:25.979948  9706 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:26.103355  6256 rpcz_store.cc:276] 0709 13:15:22.958538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.853508 (+1894970us) service_pool.cc:224] Handling call
0709 13:15:24.853863 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:24.854289 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.854322 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:24.857515 (+  3193us) log.cc:844] Serialized 52 byte log entry
0709 13:15:25.039072 (+181557us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:25.039120 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.039199 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:25.970735 (+931536us) raft_consensus.cc:1685] finished
0709 13:15:25.970751 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.970893 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32178,"raft.queue_time_us":6733,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":22571,"thread_start_us":181170,"threads_started":1,"wal-append.queue_time_us":303474}
I20260709 13:15:26.121556  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:26.135494  6247 raft_consensus.cc:2368] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9.
I20260709 13:15:26.174064  6939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 617) took 1017 ms. Trace:
I20260709 13:15:25.909376  9694 consensus_queue.cc:237] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:26.226282  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:26.230324  6256 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:26.229221  6939 rpcz_store.cc:276] 0709 13:15:25.156752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.840497 (+683745us) service_pool.cc:224] Handling call
0709 13:15:26.173999 (+333502us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:26.229574  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 252008us
W20260709 13:15:26.226415  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 188176us
I20260709 13:15:26.122138  9596 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:26.234349  6295 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:26.144451  9702 log.cc:927] Time spent T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.574s	user 0.001s	sys 0.000s
I20260709 13:15:26.225376  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:25.980755  9443 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:26.305202  6322 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:26.268850  6295 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:26.246531  6402 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
W20260709 13:15:26.309505  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:26.302958  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 252294us
W20260709 13:15:26.311972  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 232635us
W20260709 13:15:26.302455  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:26.191200  9438 consensus_meta.cc:287] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.147s	user 0.014s	sys 0.006s
I20260709 13:15:26.235433  9684 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:26.077696  9695 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:26.224980  9729 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.264117  9640 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:26.223145  9730 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:26.331766  6939 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:26.264395  9708 raft_consensus.cc:697] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:26.305845  9722 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:26.281677  6329 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:26.193900  9706 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:26.344125  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 75362.8us
W20260709 13:15:26.335668  9705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.000s	sys 0.011s
I20260709 13:15:26.355149  6255 raft_consensus.cc:2410] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:26.356236  9503 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:26.357405  9720 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.292s	user 0.005s	sys 0.005s
I20260709 13:15:26.362478  9635 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:26.362653  6219 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:26.380512  9638 consensus_meta.cc:287] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 1.170s	user 0.009s	sys 0.002s
W20260709 13:15:26.332358  9717 log.cc:927] Time spent T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.543s	user 0.001s	sys 0.000s
I20260709 13:15:26.161175  9696 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:26.374809  6371 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:26.378050  9729 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:26.378727  9640 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:26.385269  9700 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:26.386437  6933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 662) took 1558 ms. Trace:
I20260709 13:15:26.512460  6933 rpcz_store.cc:276] 0709 13:15:24.828380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.828497 (+   117us) service_pool.cc:224] Handling call
0709 13:15:26.386184 (+1557687us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54004f8154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:26.386342 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263899520}
I20260709 13:15:26.388996  6941 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:26.389460  9704 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:26.391846  6296 connection.cc:256] RPC call timeout handler was delayed by -1.5571185429998877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30400000000000005s for a response
W20260709 13:15:26.344529  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.446630  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:26.434439  6396 consensus_meta.cc:287] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.655s	user 0.020s	sys 0.000s
I20260709 13:15:26.446305  6295 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:26.166666  9606 consensus_queue.cc:1059] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.209s
I20260709 13:15:26.363533  9585 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:26.174278  9630 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:26.489930  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1489) took 3529 ms. Trace:
I20260709 13:15:26.519323  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:26.520036  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 73820.8us
I20260709 13:15:26.403489  9695 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:26.491597  6253 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
W20260709 13:15:26.453601  9705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.000s	sys 0.012s
W20260709 13:15:26.496884  9682 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:15:24.621889 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:54784 (local address 127.4.254.4:33105)
0709 13:15:25.262788 (+640899us) server_negotiation.cc:207] Beginning negotiation
0709 13:15:25.275965 (+ 13177us) server_negotiation.cc:400] Waiting for connection header
0709 13:15:25.289296 (+ 13331us) server_negotiation.cc:408] Connection header received
0709 13:15:25.353980 (+ 64684us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0709 13:15:25.359232 (+  5252us) server_negotiation.cc:462] Received NEGOTIATE request from client
0709 13:15:25.394662 (+ 35430us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0709 13:15:25.468890 (+ 74228us) server_negotiation.cc:227] Negotiated authn=SASL
0709 13:15:26.078298 (+609408us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0709 13:15:26.224970 (+146672us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0709 13:15:26.400047 (+175077us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54784: BlockingRecv error: recv got EOF from 127.0.0.1:54784 (error 108)
Metrics: {"server-negotiator.queue_time_us":273183,"thread_start_us":147105,"threads_started":1}
I20260709 13:15:26.418093  9333 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:26.495576  9724 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:26.481273  6322 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
W20260709 13:15:26.506138  9701 log.cc:927] Time spent T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.740s	user 0.002s	sys 0.000s
I20260709 13:15:26.446727  9722 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.404953  9707 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:26.511406  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 161466us
I20260709 13:15:26.552130  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:26.405355  9675 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:26.519814  6249 rpcz_store.cc:276] 0709 13:15:22.960438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.867014 (+1906576us) service_pool.cc:224] Handling call
0709 13:15:24.891369 (+ 24355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.939752 (+ 48383us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:25.504074 (+564322us) log.cc:844] Serialized 14 byte log entry
0709 13:15:26.458871 (+954797us) log.cc:844] Serialized 14 byte log entry
0709 13:15:26.489440 (+ 30569us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:26.489515 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:26.489584 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.489697 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.489854 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16526,"raft.queue_time_us":346740,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":15378,"thread_start_us":720752,"threads_started":3,"wal-append.queue_time_us":587396}
W20260709 13:15:26.490561  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 128015us
I20260709 13:15:26.524078  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:26.520887  6295 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:26.565798  6402 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
W20260709 13:15:26.565912  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 45105.4us
W20260709 13:15:26.525877  6296 leader_election.cc:336] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.911s (SENT)
I20260709 13:15:26.523483  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:26.527747  6907 leader_election.cc:336] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.817s (SENT)
I20260709 13:15:26.566859  6907 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:26.508288  9433 consensus_meta.cc:287] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.309s	user 0.009s	sys 0.002s
W20260709 13:15:26.415783  9367 consensus_meta.cc:287] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.210s	user 0.009s	sys 0.000s
I20260709 13:15:26.512979  9640 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:26.570917  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 51558us
W20260709 13:15:26.532879  6369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.007s	sys 0.015s
W20260709 13:15:26.571722  6369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.007s	sys 0.015s
I20260709 13:15:26.571566  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:26.531394  9741 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.533680  9724 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:15:26.546931  9546 consensus_meta.cc:287] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.277s	user 0.019s	sys 0.005s
I20260709 13:15:26.547468  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:26.556372  6933 raft_consensus.cc:1240] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:15:26.529307  9613 raft_consensus.cc:2764] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:15:26.560901  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:26.566452  6295 connection.cc:256] RPC call timeout handler was delayed by -1.2849052070000653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
I20260709 13:15:26.532024  9668 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:26.569245  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:26.533988  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:26.332928  9693 consensus_queue.cc:237] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:26.571564  6296 leader_election.cc:336] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.023s (SENT)
I20260709 13:15:27.390888  6296 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:27.373032  6906 connection.cc:256] RPC call timeout handler was delayed by -1.1906156560000909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 13:15:27.397917  6906 connection.cc:256] RPC call timeout handler was delayed by -1.1870156560000851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 13:15:27.398612  6906 leader_election.cc:336] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.516s (SENT)
W20260709 13:15:27.387317  6907 leader_election.cc:336] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.871s (SENT)
I20260709 13:15:26.594205  6397 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:15:26.911038  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:26.618604  6934 consensus_meta.cc:287] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.003s
I20260709 13:15:27.402967  6934 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
W20260709 13:15:27.403941  6934 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 719) took 1516 ms (client timeout 1608 ms). Trace:
W20260709 13:15:27.404461  6934 rpcz_store.cc:269] 0709 13:15:25.887423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.921875 (+ 34452us) service_pool.cc:224] Handling call
0709 13:15:27.403870 (+1481995us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.885360  6905 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:26.866679  6255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2257) took 2203 ms (client timeout 2016 ms). Trace:
I20260709 13:15:26.868808  6251 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:15:27.406139  6251 pending_rounds.cc:85] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 7
W20260709 13:15:26.605355  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 43882us
I20260709 13:15:27.406569  6251 pending_rounds.cc:107] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:15:27.406937  6251 raft_consensus.cc:2889] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:26.656309  6297 leader_election.cc:336] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 2.169s (SENT)
I20260709 13:15:26.773833  6328 raft_consensus.cc:1240] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 13:15:27.407810  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 751489us
I20260709 13:15:26.548115  9722 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:27.409449  6295 leader_election.cc:336] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.016s (SENT)
W20260709 13:15:27.405957  6255 rpcz_store.cc:269] 0709 13:15:24.663208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.741068 (+ 77860us) service_pool.cc:224] Handling call
0709 13:15:26.866384 (+2125316us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54001739d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:26.866585 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3642441088}
W20260709 13:15:27.425894  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 540616us
I20260709 13:15:27.406965  6371 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:27.430932  6906 connection.cc:256] RPC call timeout handler was delayed by -1.1627156560000458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 13:15:27.431846  6906 leader_election.cc:336] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.552s (SENT)
I20260709 13:15:27.432343  6906 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:27.436071  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2539) took 2179 ms. Trace:
I20260709 13:15:27.436587  6328 rpcz_store.cc:276] 0709 13:15:25.256957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.264938 (+  7981us) service_pool.cc:224] Handling call
0709 13:15:25.303480 (+ 38542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:27.407895 (+2104415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.435732 (+ 27837us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54003935d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:27.435995 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3380673408}
I20260709 13:15:27.438639  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2245) took 3813 ms. Trace:
I20260709 13:15:27.439139  6251 rpcz_store.cc:276] 0709 13:15:23.624786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.048502 (+1423716us) service_pool.cc:224] Handling call
0709 13:15:26.868343 (+1819841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.407516 (+539173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.438398 (+ 30882us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54001739d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:27.438569 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4184320768}
W20260709 13:15:26.692663  9691 consensus_meta.cc:287] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.023s	user 0.004s	sys 0.005s
I20260709 13:15:27.455475  6940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 667) took 2165 ms. Trace:
I20260709 13:15:27.416736  6151 catalog_manager.cc:5697] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 4, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:27.388381  9662 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:15:23.284236 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.4.254.4:33105 (local address 127.0.0.1:54784)
0709 13:15:23.647303 (+363067us) negotiation.cc:107] Waiting for socket to connect
0709 13:15:23.647385 (+    82us) client_negotiation.cc:175] Beginning negotiation
0709 13:15:23.647901 (+   516us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0709 13:15:25.468847 (+1820946us) client_negotiation.cc:281] Received NEGOTIATE NegotiatePB response
0709 13:15:25.502103 (+ 33256us) client_negotiation.cc:404] Received NEGOTIATE response from server
0709 13:15:25.544821 (+ 42718us) client_negotiation.cc:190] Negotiated authn=SASL
0709 13:15:25.963554 (+418733us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0709 13:15:26.001635 (+ 38081us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0709 13:15:26.303253 (+301618us) client_negotiation.cc:281] Received TLS_HANDSHAKE NegotiatePB response
0709 13:15:26.306461 (+  3208us) client_negotiation.cc:543] Received TLS_HANDSHAKE response from server
0709 13:15:26.398927 (+ 92466us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0709 13:15:26.399013 (+    86us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0709 13:15:26.399807 (+   794us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.4.254.4:33105: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":362061,"thread_start_us":226823,"threads_started":1}
W20260709 13:15:27.463109  6222 leader_election.cc:336] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.618s (SENT)
W20260709 13:15:26.716509  6330 consensus_meta.cc:287] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.671s	user 0.013s	sys 0.006s
I20260709 13:15:27.482915  6330 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
W20260709 13:15:27.115442  6256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 633) took 1747 ms (client timeout 1708 ms). Trace:
I20260709 13:15:27.006517  9643 raft_consensus.cc:3055] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:27.123725  9709 log.cc:927] Time spent T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 1.146s	user 0.010s	sys 0.000s
I20260709 13:15:27.008641  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:26.862705  9653 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:27.498411  6937 raft_consensus.cc:2393] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 5: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:15:27.499205  6937 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 718) took 1612 ms (client timeout 1840 ms). Trace:
W20260709 13:15:27.499712  6937 rpcz_store.cc:269] 0709 13:15:25.886970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.008318 (+1121348us) service_pool.cc:224] Handling call
0709 13:15:27.499123 (+490805us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:27.470479  6254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 640) took 1740 ms (client timeout 1734 ms). Trace:
W20260709 13:15:27.500835  6254 rpcz_store.cc:269] 0709 13:15:25.386682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.126251 (+1739569us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.126386 (+   135us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:27.010162  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:27.470530  6251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 623) took 2076 ms (client timeout 1778 ms). Trace:
W20260709 13:15:27.502147  6251 rpcz_store.cc:269] 0709 13:15:25.365356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.441616 (+2076260us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.441741 (+   125us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:26.880415  6252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2260) took 2174 ms (client timeout 2258 ms). Trace:
I20260709 13:15:26.571141  9695 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:27.474077  6255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 639) took 2071 ms (client timeout 1744 ms). Trace:
W20260709 13:15:27.505566  6255 rpcz_store.cc:269] 0709 13:15:25.379547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.451088 (+2071541us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.451214 (+   126us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:27.506352  6255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 641) took 1798 ms (client timeout 1533 ms). Trace:
I20260709 13:15:27.506454  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:27.506824  6255 rpcz_store.cc:269] 0709 13:15:25.707445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.506193 (+1798748us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.506293 (+   100us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:27.476612  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.460709  6401 raft_consensus.cc:2410] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:15:27.477048  6327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.311s	user 0.025s	sys 0.026s
W20260709 13:15:27.508806  6327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.343s	user 0.025s	sys 0.026s
I20260709 13:15:27.506381  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:26.590260  6219 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:26.572351  6369 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:26.864913  9635 raft_consensus.cc:3055] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:27.475181  6940 rpcz_store.cc:276] 0709 13:15:25.290433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.317076 (+ 26643us) service_pool.cc:224] Handling call
0709 13:15:25.317435 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:25.368120 (+ 50685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.368151 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:25.374660 (+  6509us) log.cc:844] Serialized 52 byte log entry
0709 13:15:25.401845 (+ 27185us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:25.401900 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.401990 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:26.718194 (+1316204us) raft_consensus.cc:1685] finished
0709 13:15:26.718221 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.455405 (+737184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51917,"raft.queue_time_us":59973,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":4978,"thread_start_us":11894,"threads_started":1,"wal-append.queue_time_us":185777}
I20260709 13:15:27.511363  6405 raft_consensus.cc:1240] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:27.426720  9700 consensus_meta.cc:287] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.896s	user 0.007s	sys 0.003s
I20260709 13:15:27.481370  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:26.691514  6253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 634) took 1323 ms (client timeout 1614 ms). Trace:
I20260709 13:15:27.484781  6151 catalog_manager.cc:5697] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:26.881986  6248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2258) took 2200 ms (client timeout 2042 ms). Trace:
W20260709 13:15:27.483619  6256 rpcz_store.cc:269] 0709 13:15:25.367474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.115235 (+1747761us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.115353 (+   118us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:27.486950  6330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2542) took 1505 ms (client timeout 1619 ms). Trace:
I20260709 13:15:26.722191  9630 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:27.405934  9668 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:26.864516  9667 consensus_meta.cc:287] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.722s	user 0.009s	sys 0.000s
W20260709 13:15:27.106042  6247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2248) took 3480 ms (client timeout 1572 ms). Trace:
W20260709 13:15:27.563069  6247 rpcz_store.cc:269] 0709 13:15:23.625340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.479465 (+854125us) service_pool.cc:224] Handling call
0709 13:15:27.105776 (+2626311us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54003129d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:27.105943 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3481386368}
W20260709 13:15:27.564146  6247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 631) took 2197 ms (client timeout 1903 ms). Trace:
W20260709 13:15:27.564616  6247 rpcz_store.cc:269] 0709 13:15:25.367118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.563940 (+2196822us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.564078 (+   138us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:27.557600  6397 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
W20260709 13:15:27.565503  6247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2269) took 1859 ms (client timeout 1660 ms). Trace:
I20260709 13:15:27.565683  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2430) took 1041 ms. Trace:
W20260709 13:15:27.565943  6247 rpcz_store.cc:269] 0709 13:15:25.706550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.565338 (+1858788us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.565443 (+   105us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:26.691562  9706 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:27.488574  9643 raft_consensus.cc:740] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:26.692816  9679 consensus_meta.cc:287] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.832s	user 0.012s	sys 0.004s
I20260709 13:15:27.430492  9678 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:26.723017  9696 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:27.503223  6252 rpcz_store.cc:269] 0709 13:15:24.706173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.775785 (+ 69612us) service_pool.cc:224] Handling call
0709 13:15:26.880176 (+2104391us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b5400356e54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:26.880337 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560235904}
I20260709 13:15:27.454614  9730 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:27.509502  6400 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
W20260709 13:15:27.508836  6221 connection.cc:256] RPC call timeout handler was delayed by -1.049721793000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
I20260709 13:15:27.565536  9703 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:27.514781  6254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 636) took 2146 ms (client timeout 1856 ms). Trace:
W20260709 13:15:27.515556  6251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 630) took 2148 ms (client timeout 1871 ms). Trace:
I20260709 13:15:27.482460  9546 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:27.117259  9535 consensus_queue.cc:260] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:26.572712  9694 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:27.107522  9496 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:27.121740  9349 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:26.593786  9367 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:27.541500  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 951284us
W20260709 13:15:27.518016  6255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 637) took 2149 ms (client timeout 1890 ms). Trace:
W20260709 13:15:27.542050  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 969704us
I20260709 13:15:27.553117  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:27.558033  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:26.571679  9433 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:27.557659  6248 rpcz_store.cc:269] 0709 13:15:24.682111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.768864 (+ 86753us) service_pool.cc:224] Handling call
0709 13:15:26.881758 (+2112894us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54001b8fd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:26.881903 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651508608}
W20260709 13:15:27.558655  6330 rpcz_store.cc:269] 0709 13:15:25.981477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.003106 (+ 21629us) service_pool.cc:224] Handling call
0709 13:15:27.486870 (+1483764us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:27.558773  6253 rpcz_store.cc:269] 0709 13:15:25.367614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.041429 (+673815us) service_pool.cc:224] Handling call
0709 13:15:26.691320 (+649891us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400337554. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:26.691449 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796157184}
I20260709 13:15:26.656329  9675 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.833s
I20260709 13:15:27.558594  6151 catalog_manager.cc:5697] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index 5 to 7, term changed from 6 to 8, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to <none>, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 8 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:27.566717  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:27.566196  6397 rpcz_store.cc:276] 0709 13:15:26.524736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.480961 (+956225us) service_pool.cc:224] Handling call
0709 13:15:27.565618 (+ 84657us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:26.884720  9715 log.cc:927] Time spent T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.905s	user 0.007s	sys 0.013s
I20260709 13:15:27.541649  6250 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
I20260709 13:15:26.976441  9640 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:27.574049  6256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1493) took 2465 ms (client timeout 2285 ms). Trace:
I20260709 13:15:27.765622  6331 raft_consensus.cc:2393] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 10: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:15:27.576758  5112 auto_leader_rebalancer.cc:438] leader transfer for tablet 1c399f07ba644d25ba3579e60d6962bd from 8600a3fead0e48a7aa813822ec44d0fe to 2d6410349fdc47f5a98ba3c6f7d5510b failed: Timed out: Client connection negotiation failed: client connection to 127.4.254.4:33105: sent 0 of 16 requested bytes
W20260709 13:15:27.765480  6250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1498) took 2650 ms (client timeout 1955 ms). Trace:
I20260709 13:15:27.577325  9630 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:27.580294  9643 consensus_queue.cc:260] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:27.581512  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:27.583227  9726 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:27.541760  9747 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.581573  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:27.512794  9714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.013s	sys 0.014s
W20260709 13:15:27.585590  6247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2270) took 1865 ms (client timeout 1809 ms). Trace:
I20260709 13:15:27.588255  6249 raft_consensus.cc:2410] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:27.511443  9635 raft_consensus.cc:740] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:26.569907  9708 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:27.118765  9716 raft_consensus.cc:3055] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:27.484359  9691 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:27.541898  9613 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:27.476986  9724 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.570746  9700 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:27.648145  9749 log.cc:927] Time spent T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:15:27.738204  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2438) took 1190 ms. Trace:
I20260709 13:15:27.834528  6399 rpcz_store.cc:276] 0709 13:15:26.548026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.482015 (+933989us) service_pool.cc:224] Handling call
0709 13:15:27.738131 (+256116us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:27.781478  9714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.244s	user 0.015s	sys 0.016s
W20260709 13:15:27.645398  9752 log.cc:927] Time spent T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:15:27.731701  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 331671us
I20260709 13:15:27.584020  9160 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:27.590895  6252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 625) took 2225 ms (client timeout 2164 ms). Trace:
W20260709 13:15:27.840555  6252 rpcz_store.cc:269] 0709 13:15:25.365847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.589512 (+2223665us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.590810 (+  1298us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:27.733595  6251 rpcz_store.cc:269] 0709 13:15:25.366964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.515345 (+2148381us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.515484 (+   139us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:27.733348  6400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2429) took 1208 ms. Trace:
I20260709 13:15:27.841979  6400 rpcz_store.cc:276] 0709 13:15:26.524491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.481639 (+957148us) service_pool.cc:224] Handling call
0709 13:15:27.733281 (+251642us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.565233  9668 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:27.567255  9653 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:27.575547  9659 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:27.586422  9695 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:27.734344  6254 rpcz_store.cc:269] 0709 13:15:25.368002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.514207 (+2146205us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.514614 (+   407us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:27.871522  6254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 632) took 2504 ms (client timeout 2455 ms). Trace:
W20260709 13:15:27.872005  6254 rpcz_store.cc:269] 0709 13:15:25.367330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.871274 (+2503944us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.871445 (+   171us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:27.758095  6405 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:27.759985  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:27.758090  6253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 622) took 2393 ms (client timeout 2169 ms). Trace:
I20260709 13:15:27.873061  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:27.877317  6253 rpcz_store.cc:269] 0709 13:15:25.365043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.736934 (+2371891us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.758003 (+ 21069us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:27.759382  6248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1490) took 2651 ms (client timeout 2440 ms). Trace:
W20260709 13:15:27.878211  6254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2271) took 2171 ms (client timeout 2169 ms). Trace:
W20260709 13:15:27.878409  6248 rpcz_store.cc:269] 0709 13:15:25.108015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.737665 (+2629650us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.759297 (+ 21632us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:27.878772  6254 rpcz_store.cc:269] 0709 13:15:25.707162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.872768 (+2165606us) service_pool.cc:224] Handling call
0709 13:15:27.878129 (+  5361us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.879668  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:27.880440  6248 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:27.758888  6403 raft_consensus.cc:2410] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:15:27.880988  9755 log.cc:927] Time spent T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:15:27.881934  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:27.883297  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:27.883455  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 620) took 2411 ms. Trace:
I20260709 13:15:27.884253  6403 raft_consensus.cc:2410] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:27.761742  6219 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:27.885485  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 123807us
W20260709 13:15:27.766578  6250 rpcz_store.cc:269] 0709 13:15:25.114664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.009852 (+1895188us) service_pool.cc:224] Handling call
0709 13:15:27.765389 (+755537us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.890071  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:27.890914  6250 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:27.891971  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:27.765712  6256 rpcz_store.cc:269] 0709 13:15:25.108955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.573832 (+2464877us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.573967 (+   135us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:27.770632  6401 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:27.613682  9729 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:27.774057  6221 leader_election.cc:336] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.609s (SENT)
I20260709 13:15:27.567530  9667 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:27.485314  9741 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:27.775936  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2435) took 1248 ms. Trace:
I20260709 13:15:27.761655  6151 catalog_manager.cc:5697] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 5 to 6, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 6 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:27.759379  9730 raft_consensus.cc:697] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:27.801614  6326 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:27.916188  6151 catalog_manager.cc:5697] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.798621  9747 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:27.810808  6331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2543) took 1772 ms (client timeout 1608 ms). Trace:
W20260709 13:15:27.923448  6331 rpcz_store.cc:269] 0709 13:15:26.038840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.075455 (+ 36615us) service_pool.cc:224] Handling call
0709 13:15:27.810540 (+1735085us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400292cd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:27.810718 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3685274880}
I20260709 13:15:27.762778  9349 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.757798  9694 raft_consensus.cc:697] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:27.733862  6255 rpcz_store.cc:269] 0709 13:15:25.368436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.517818 (+2149382us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.517939 (+   121us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:27.591571  9678 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:27.781221  9535 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:27.770453  9630 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.801275  9496 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:27.855154  6252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 638) took 2486 ms (client timeout 2363 ms). Trace:
W20260709 13:15:27.855283  6249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 629) took 2488 ms (client timeout 1681 ms). Trace:
I20260709 13:15:27.866169  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:27.945523  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:27.834867  9643 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:27.870230  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:27.893103  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:27.948297  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:27.881039  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1491) took 2772 ms. Trace:
I20260709 13:15:27.949249  6248 rpcz_store.cc:276] 0709 13:15:25.108373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.879386 (+2771013us) service_pool.cc:224] Handling call
0709 13:15:27.880974 (+  1588us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.761073  9703 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:27.855320  9754 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:15:27.907121  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 752) took 2652 ms. Trace:
W20260709 13:15:27.914186  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 140221us
I20260709 13:15:27.898229  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:27.903899  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:27.951040  6221 leader_election.cc:336] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.618s (SENT)
I20260709 13:15:27.883869  6398 rpcz_store.cc:276] 0709 13:15:25.471903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.472035 (+   132us) service_pool.cc:224] Handling call
0709 13:15:25.508746 (+ 36711us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:26.146270 (+637524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:26.146315 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:26.215967 (+ 69652us) log.cc:844] Serialized 26 byte log entry
0709 13:15:26.532657 (+316690us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:26.532698 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.114609 (+581911us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54001f4854. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:27.114661 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.883143 (+768482us) raft_consensus.cc:1685] finished
0709 13:15:27.883162 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.883374 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17487,"raft.queue_time_us":102161,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":35706,"spinlock_wait_cycles":1404211072,"thread_start_us":159999,"threads_started":1,"wal-append.queue_time_us":1173438}
I20260709 13:15:27.951560  6221 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:27.908962  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:27.915977  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 484143us
W20260709 13:15:27.781544  6247 rpcz_store.cc:269] 0709 13:15:25.706875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.571933 (+1865058us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.572128 (+   195us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:27.860050  9714 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:27.922109  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:27.915366  6402 rpcz_store.cc:276] 0709 13:15:26.527032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.569676 (+1042644us) service_pool.cc:224] Handling call
0709 13:15:27.775857 (+206181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33024}
I20260709 13:15:27.918059  6151 catalog_manager.cc:5697] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 5, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 5 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.955819  6400 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:27.955971  6151 catalog_manager.cc:5697] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 5 to 8, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 8 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.867838  9653 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.836668  9613 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:27.939128  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 1.36746e+06us
W20260709 13:15:27.962704  6296 connection.cc:256] RPC call timeout handler was delayed by -1.3995465220002643s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2579s for a response
W20260709 13:15:27.964179  6296 connection.cc:256] RPC call timeout handler was delayed by -1.3761977390001903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29150000000000004s for a response
I20260709 13:15:27.941247  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2541) took 1961 ms. Trace:
I20260709 13:15:27.965306  6326 rpcz_store.cc:276] 0709 13:15:25.979529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.979736 (+   207us) service_pool.cc:224] Handling call
0709 13:15:26.001540 (+ 21804us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:27.917314 (+1915774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.940864 (+ 23550us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54002418d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:27.941160 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4137996544}
I20260709 13:15:27.944685  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:27.966732  6401 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:27.809211  9716 raft_consensus.cc:740] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:15:27.944731  6252 rpcz_store.cc:269] 0709 13:15:25.368651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.853658 (+2485007us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:27.855065 (+  1407us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:27.944871  6249 rpcz_store.cc:269] 0709 13:15:25.366816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.571314 (+1204498us) service_pool.cc:224] Handling call
0709 13:15:27.835909 (+1264595us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400173ed4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:27.855194 (+ 19285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281692928}
I20260709 13:15:27.948850  6250 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
W20260709 13:15:27.915196  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:27.968699  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:27.969141  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.968986  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:27.915269  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:27.952548  6906 connection.cc:256] RPC call timeout handler was delayed by -1.0997156559999439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
I20260709 13:15:27.950776  6323 rpcz_store.cc:276] 0709 13:15:25.254510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.255421 (+   911us) service_pool.cc:224] Handling call
0709 13:15:25.255764 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:25.301210 (+ 45446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.303862 (+  2652us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:25.305794 (+  1932us) log.cc:844] Serialized 26 byte log entry
0709 13:15:25.395423 (+ 89629us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:25.395468 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.395541 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:26.884037 (+1488496us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:27.895315 (+1011278us) raft_consensus.cc:1685] finished
0709 13:15:27.895336 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.907020 (+ 11684us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27975,"raft.queue_time_us":28172,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":28894,"spinlock_wait_cycles":88293120,"thread_start_us":28092,"threads_started":1,"wal-append.queue_time_us":477711}
I20260709 13:15:27.970060  6254 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:27.855136  9160 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:27.896287  9679 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:27.957640  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:27.970633  6253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 642) took 2003 ms (client timeout 2242 ms). Trace:
I20260709 13:15:27.970956  6399 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
W20260709 13:15:27.971170  6253 rpcz_store.cc:269] 0709 13:15:25.966897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.878216 (+1911319us) service_pool.cc:224] Handling call
0709 13:15:27.970567 (+ 92351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.957894  6151 catalog_manager.cc:5697] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:27.958611  6221 leader_election.cc:336] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.732s (SENT)
W20260709 13:15:27.972607  6221 leader_election.cc:336] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.745s (SENT)
I20260709 13:15:27.972433  6151 catalog_manager.cc:5697] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 4, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:27.973968  6221 leader_election.cc:336] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.840s (SENT)
I20260709 13:15:27.974248  6151 catalog_manager.cc:5697] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:27.975235  6221 leader_election.cc:336] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.896s (SENT)
W20260709 13:15:27.976629  6906 leader_election.cc:336] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.614s (SENT)
I20260709 13:15:27.959133  6397 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:27.950282  9496 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:27.959594  9640 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:27.959847  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:27.960335  9714 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:27.950101  9630 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:27.982632  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:27.983369  6403 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:27.961076  9703 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:27.961140  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:27.951156  6251 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
W20260709 13:15:27.987833  6251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1502) took 1637 ms (client timeout 1676 ms). Trace:
W20260709 13:15:27.976816  6221 leader_election.cc:336] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.954s (SENT)
I20260709 13:15:27.978577  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:27.978721  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:27.988531  6221 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:27.984480  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:27.991079  6252 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:15:27.988360  6251 rpcz_store.cc:269] 0709 13:15:26.350682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.898000 (+1547318us) service_pool.cc:224] Handling call
0709 13:15:27.987763 (+ 89763us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.962917  9653 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:27.986680  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:27.987936  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2266) took 3120 ms. Trace:
I20260709 13:15:27.995074  6247 raft_consensus.cc:2410] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:27.994895  6249 rpcz_store.cc:276] 0709 13:15:24.861185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.980743 (+3119558us) service_pool.cc:224] Handling call
0709 13:15:27.981084 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.981306 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.981342 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:27.981393 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:27.981436 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.981500 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.981628 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.948158  9349 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:27.977085  6906 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:27.959615  9659 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:27.996446  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1496) took 2878 ms. Trace:
I20260709 13:15:27.997026  6401 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:27.988657  6400 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:27.976130  6151 catalog_manager.cc:5697] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 6, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 6 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:15:27.997668  6403 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: [5.8-5.8]
W20260709 13:15:27.991776  6221 leader_election.cc:336] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.992s (SENT)
I20260709 13:15:28.006966  6221 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:27.996510  6249 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:28.007853  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1497) took 2893 ms. Trace:
I20260709 13:15:28.008152  6249 rpcz_store.cc:276] 0709 13:15:25.114369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.996110 (+2881741us) service_pool.cc:224] Handling call
0709 13:15:27.996362 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.007635 (+ 11273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.007805 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.996635  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2431) took 1471 ms. Trace:
I20260709 13:15:28.009804  6398 rpcz_store.cc:276] 0709 13:15:26.524971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.985772 (+1460801us) service_pool.cc:224] Handling call
0709 13:15:27.996183 (+ 10411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.996345 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.996372 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:27.996411 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:27.996445 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.996492 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.996585 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.005455  6251 rpcz_store.cc:276] 0709 13:15:25.114090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.991864 (+2877774us) service_pool.cc:224] Handling call
0709 13:15:27.992119 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.992271 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.992296 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:27.992337 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:27.992366 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.992419 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.992521 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.012002  6254 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:28.012699  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1495) took 2898 ms. Trace:
I20260709 13:15:28.000471  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2251) took 4224 ms. Trace:
I20260709 13:15:28.013108  6254 rpcz_store.cc:276] 0709 13:15:25.113834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.989673 (+2875839us) service_pool.cc:224] Handling call
0709 13:15:28.011775 (+ 22102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.012450 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.012638 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.015484  6252 rpcz_store.cc:276] 0709 13:15:23.767415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.978140 (+4210725us) service_pool.cc:224] Handling call
0709 13:15:27.990780 (+ 12640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.991473 (+   693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.991646 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.017943  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1499) took 2903 ms. Trace:
I20260709 13:15:28.018424  6247 rpcz_store.cc:276] 0709 13:15:25.114959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.954628 (+2839669us) service_pool.cc:224] Handling call
0709 13:15:28.017866 (+ 63238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.019812  6403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2432) took 1494 ms. Trace:
I20260709 13:15:28.020207  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2428) took 1496 ms. Trace:
I20260709 13:15:27.986270  9679 raft_consensus.cc:697] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:28.020292  6403 rpcz_store.cc:276] 0709 13:15:26.526212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.988290 (+1462078us) service_pool.cc:224] Handling call
0709 13:15:27.997345 (+  9055us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.019542 (+ 22197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.019754 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.941603  9635 consensus_queue.cc:260] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:28.007407  6151 catalog_manager.cc:5697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index 4 to 5, term changed from 4 to 6, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.020637  6399 rpcz_store.cc:276] 0709 13:15:26.524228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.985501 (+1461273us) service_pool.cc:224] Handling call
0709 13:15:27.994373 (+  8872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.001443 (+  7070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.001484 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.019888 (+ 18404us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:28.019944 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.020020 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.020156 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:28.034160  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 57572.7us
W20260709 13:15:28.034909  6906 leader_election.cc:336] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.614s (SENT)
I20260709 13:15:28.035359  6906 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:28.036381  6401 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:28.037119  6151 catalog_manager.cc:5697] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 7, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 7 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.037040  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2434) took 1510 ms. Trace:
I20260709 13:15:28.039188  6151 catalog_manager.cc:5697] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 6, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 6 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.041903  6400 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:28.041934  6254 pending_rounds.cc:85] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 8
I20260709 13:15:28.042434  6254 pending_rounds.cc:107] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:15:28.042680  6254 raft_consensus.cc:2889] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:27.997023  9703 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:28.039943  6401 rpcz_store.cc:276] 0709 13:15:26.526789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.005957 (+1479168us) service_pool.cc:224] Handling call
0709 13:15:28.030350 (+ 24393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.036785 (+  6435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.036986 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:28.046439  6906 connection.cc:256] RPC call timeout handler was delayed by -1.0295156560000578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260709 13:15:28.046834  6906 connection.cc:256] RPC call timeout handler was delayed by -1.016015656000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
I20260709 13:15:28.047371  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.048004  6906 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:28.051455  9706 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:28.038069  9730 consensus_queue.cc:237] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:28.057148  9751 log.cc:927] Time spent T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:15:28.020290  9546 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:28.063359  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.063947  6400 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:28.031980  9433 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:27.989420  9714 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:28.065677  6295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.034s	sys 0.055s
W20260709 13:15:28.068274  6295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.035s	sys 0.055s
I20260709 13:15:28.067067  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.068756  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.069480  6403 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:28.067258  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:28.065696  6906 leader_election.cc:336] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:15:28.070873  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.074584  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.075184  6400 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
W20260709 13:15:28.076944  6295 leader_election.cc:336] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.660s (SENT)
I20260709 13:15:28.077551  6295 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:28.062120  9762 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:28.089085  6222 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.011s	sys 0.010s
W20260709 13:15:28.089553  6222 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.011s	sys 0.010s
W20260709 13:15:28.089879  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 607449us
W20260709 13:15:28.090524  6222 leader_election.cc:336] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.732s (SENT)
W20260709 13:15:28.091426  6327 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.018s	sys 0.003s
I20260709 13:15:28.066294  9675 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:28.083535  6295 leader_election.cc:336] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.042s (SENT)
I20260709 13:15:28.115337  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.115016  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.117537  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.118278  6400 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:28.109921  6396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.010s	sys 0.011s
W20260709 13:15:28.125005  6396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.010s	sys 0.011s
I20260709 13:15:28.129895  6401 raft_consensus.cc:2410] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:15:28.109714  6371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.000s	sys 0.028s
W20260709 13:15:28.133303  6371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.000s	sys 0.028s
W20260709 13:15:28.133679  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 726739us
W20260709 13:15:28.110195  6908 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.010s	sys 0.011s
W20260709 13:15:28.134531  6908 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.010s	sys 0.011s
W20260709 13:15:28.110991  6327 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.018s	sys 0.003s
W20260709 13:15:28.115464  6295 connection.cc:256] RPC call timeout handler was delayed by -1.1717785379998986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 13:15:28.140944  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 76760.9us
W20260709 13:15:28.141861  6906 leader_election.cc:336] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:15:28.067174  6151 catalog_manager.cc:5697] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 5, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 5 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:15:28.146549  6403 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:28.073079  9766 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:28.158676  6151 catalog_manager.cc:5697] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 8, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 8 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.130671  9726 raft_consensus.cc:697] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:28.164626  6940 raft_consensus.cc:1240] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:28.166244  6404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.008s	sys 0.017s
I20260709 13:15:28.097759  9433 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:28.137857  9757 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:15:28.152231  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.053716  9694 consensus_queue.cc:237] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:28.148429  9691 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:28.090939  6222 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:28.156288  6907 leader_election.cc:336] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.062s (SENT)
W20260709 13:15:28.176887  6907 leader_election.cc:336] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.363s (SENT)
I20260709 13:15:28.178570  9730 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:28.179162  9730 consensus_queue.cc:1243] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer b940f12ed61a49c4b3c11f13ef50fa92 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:28.142524  6906 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:28.161005  6151 catalog_manager.cc:5697] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 2 to 5, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 5 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:28.181087  6151 catalog_manager.cc:5697] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 2 to 5, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 5 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:28.183151  6151 catalog_manager.cc:5697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 6, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 6 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.152791  9678 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:28.168228  6404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.008s	sys 0.017s
I20260709 13:15:28.185465  6151 catalog_manager.cc:5697] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:28.128400  9633 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.004s	sys 0.017s
I20260709 13:15:28.157990  9762 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:28.189455  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:28.200027  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.194259  6151 catalog_manager.cc:5697] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 5, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 5 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:28.201974  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 111500us
W20260709 13:15:28.203123  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.157889  9613 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:28.191089  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:28.206583  6939 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:28.066318  9716 consensus_queue.cc:260] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:28.137617  9675 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:28.115024  9679 consensus_queue.cc:237] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:28.187310  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:28.155987  9667 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:28.198442  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 233717us
W20260709 13:15:28.211918  6296 connection.cc:256] RPC call timeout handler was delayed by -1.2599449290000848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2896s for a response
W20260709 13:15:28.193393  9633 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.004s	sys 0.017s
W20260709 13:15:28.217295  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 440988us
I20260709 13:15:28.173914  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:28.212353  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.211838  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1501) took 1866 ms. Trace:
W20260709 13:15:28.213093  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 221295us
W20260709 13:15:28.220359  6221 leader_election.cc:336] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.099s (SENT)
I20260709 13:15:28.219998  6251 rpcz_store.cc:276] 0709 13:15:26.345852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.011305 (+1665453us) service_pool.cc:224] Handling call
0709 13:15:28.011627 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.061763 (+ 50136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.061795 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.061844 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:28.061887 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.211626 (+149739us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b54000f7154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:28.211673 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.211788 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114862336}
I20260709 13:15:28.222060  6403 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:28.203897  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.228318  6400 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:28.224040  6151 catalog_manager.cc:5697] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 6 to 7, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 7 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.233745  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.191804  9741 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:28.233498  6151 catalog_manager.cc:5697] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 2 to 5, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 5 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.249553  6295 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:28.198905  9762 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:28.259408  6398 raft_consensus.cc:2410] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:28.210587  9678 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.258244  6151 catalog_manager.cc:5697] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.243662  6905 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:28.209553  9696 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:28.261070  6222 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:28.263911  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:28.272607  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 117297us
I20260709 13:15:28.271611  6151 catalog_manager.cc:5697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 5 to 6, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 6 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.275056  6151 catalog_manager.cc:5697] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 7, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 7 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.277209  6151 catalog_manager.cc:5697] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 7, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 7 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:28.280049  6403 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:28.287032  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:28.288969  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 147141us
W20260709 13:15:28.289785  6906 leader_election.cc:336] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:15:28.290496  6906 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:28.193540  9765 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:15:28.290974  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:28.291944  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 112605us
I20260709 13:15:28.254810  9160 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:28.284724  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:28.295508  6252 raft_consensus.cc:2393] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:28.281906  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.283353  6251 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:28.296335  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:28.279513  6151 catalog_manager.cc:5697] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 6 to 7, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 7 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:28.284325  6370 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.004s	sys 0.017s
W20260709 13:15:28.297261  6370 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.005s	sys 0.017s
I20260709 13:15:28.257513  9747 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:28.259227  9613 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.296906  6330 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.270541  9762 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:28.305325  6222 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:28.306250  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.302232  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.307619  6403 raft_consensus.cc:2376] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9. Re-sending same reply.
I20260709 13:15:28.308512  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.304751  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:28.309834  6296 connection.cc:256] RPC call timeout handler was delayed by -3.0323290210001232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
I20260709 13:15:28.310663  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.311661  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.313146  6939 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
W20260709 13:15:28.313850  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 70283us
I20260709 13:15:28.318444  6325 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:28.323168  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:28.323755  6324 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:15:28.255062  9691 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:15:28.289072  9716 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:28.422993  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 104982us
I20260709 13:15:28.326910  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:28.423861  6296 connection.cc:256] RPC call timeout handler was delayed by -2.9207290209999428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 13:15:28.356916  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.425810  6403 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:28.368476  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 619) took 2944 ms. Trace:
I20260709 13:15:28.370410  6330 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
W20260709 13:15:28.424875  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 109722us
W20260709 13:15:28.462576  6221 leader_election.cc:336] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.136s (SENT)
I20260709 13:15:28.463110  6221 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:28.482708  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 58201.5us
I20260709 13:15:28.291450  9667 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.294121  9765 consensus_queue.cc:1243] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:28.522742  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.523219  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:28.526536  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:28.527464  6935 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:15:28.526528  6296 connection.cc:256] RPC call timeout handler was delayed by -2.8397290210000392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260709 13:15:28.528709  6296 connection.cc:256] RPC call timeout handler was delayed by -2.2772290210000392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2801s for a response
I20260709 13:15:28.528959  9768 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:28.305332  9700 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:28.281036  9678 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:28.575560  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:28.423198  9759 log.cc:927] Time spent T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:15:28.485623  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.532367  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.533219  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.328890  9433 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.242s
W20260709 13:15:28.570760  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 280976us
I20260709 13:15:28.571988  6328 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:28.593668  6906 leader_election.cc:336] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:15:28.559866  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:28.594100  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:28.594264  6247 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:28.536568  9758 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
I20260709 13:15:28.605608  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.606365  6403 raft_consensus.cc:2393] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:28.328584  9771 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:28.607144  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.535614  9730 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.315837  9613 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:28.422868  9773 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:28.531068  9775 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.610860  6403 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:28.611428  6323 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:28.607548  6325 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:28.627223  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2433) took 2100 ms. Trace:
W20260709 13:15:28.609292  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 146722us
I20260709 13:15:28.533615  9659 consensus_queue.cc:1059] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:15:28.629016  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:28.628630  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:28.485286  9696 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:28.624646  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2249) took 4951 ms. Trace:
I20260709 13:15:28.637786  6402 rpcz_store.cc:276] 0709 13:15:26.526504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.994736 (+1468232us) service_pool.cc:224] Handling call
0709 13:15:28.023921 (+ 29185us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:28.033295 (+  9374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.033338 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:28.063281 (+ 29943us) log.cc:844] Serialized 52 byte log entry
0709 13:15:28.201383 (+138102us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:28.479332 (+277949us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.523781 (+ 44449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.523853 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.627016 (+103163us) raft_consensus.cc:1685] finished
0709 13:15:28.627037 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.627164 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69826,"prepare.queue_time_us":123375,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":33,"raft.queue_time_us":242086,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":64048,"spinlock_wait_cycles":48945920,"thread_start_us":282277,"threads_started":2,"wal-append.queue_time_us":550650}
I20260709 13:15:28.652654  6256 rpcz_store.cc:276] 0709 13:15:23.673552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.978242 (+4304690us) service_pool.cc:224] Handling call
0709 13:15:27.993049 (+ 14807us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:27.993486 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.993510 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:27.994018 (+   508us) log.cc:844] Serialized 52 byte log entry
0709 13:15:28.232481 (+238463us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:28.232534 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.232629 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.624413 (+391784us) raft_consensus.cc:1685] finished
0709 13:15:28.624436 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.624582 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2303,"raft.queue_time_us":50391,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":13447,"thread_start_us":195455,"threads_started":1,"wal-append.queue_time_us":592775}
I20260709 13:15:28.654953  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:28.656256  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:28.633769  6331 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:15:28.638204  6221 leader_election.cc:336] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.201s (SENT)
W20260709 13:15:28.643067  9668 consensus_meta.cc:287] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.746s	user 0.008s	sys 0.000s
W20260709 13:15:28.601715  9757 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:15:28.645390  6942 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:28.650704  6940 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:15:28.650822  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.691500  6403 raft_consensus.cc:2376] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9. Re-sending same reply.
I20260709 13:15:28.692322  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.692461  9792 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:28.611773  9349 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:28.693522  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:28.688937  6328 raft_consensus.cc:1275] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:28.605001  9793 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:28.658659  6221 leader_election.cc:336] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.265s (SENT)
I20260709 13:15:28.710235  6221 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:28.663921  6324 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:28.661332  9775 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:28.650959  9730 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:28.681931  9678 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:28.315945  9782 consensus_queue.cc:1059] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.311s
I20260709 13:15:28.692870  6403 raft_consensus.cc:2376] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7. Re-sending same reply.
I20260709 13:15:28.293919  9726 consensus_queue.cc:237] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:28.657902  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 352626us
I20260709 13:15:28.612203  9763 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:28.709367  6296 connection.cc:256] RPC call timeout handler was delayed by -1.7679863179998847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260709 13:15:28.710462  6326 raft_consensus.cc:1275] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:28.671173  6247 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
W20260709 13:15:28.736598  6296 connection.cc:256] RPC call timeout handler was delayed by -1.7022863180000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 13:15:28.538379  9667 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:28.645701  9714 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:28.736958  6296 connection.cc:256] RPC call timeout handler was delayed by -1.6914863179999884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
I20260709 13:15:28.738955  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.739133  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.734256  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.743391  6371 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:28.742033  6401 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 3.
W20260709 13:15:28.742327  6296 connection.cc:256] RPC call timeout handler was delayed by -1.6554863179999302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
I20260709 13:15:28.742817  6402 raft_consensus.cc:2376] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10. Re-sending same reply.
I20260709 13:15:28.747359  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.747628  9801 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.748093  6402 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:28.749217  9794 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:28.749606  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.750655  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:28.751298  9630 consensus_meta.cc:287] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.758s	user 0.004s	sys 0.004s
I20260709 13:15:28.751438  6403 raft_consensus.cc:2393] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:28.751731  9630 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:28.752447  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.752849  6405 raft_consensus.cc:2368] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6.
I20260709 13:15:28.748921  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.657564  9668 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:28.754343  6403 raft_consensus.cc:2368] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7.
W20260709 13:15:28.746753  6296 connection.cc:256] RPC call timeout handler was delayed by -1.4331863179997981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 13:15:28.755542  6296 connection.cc:256] RPC call timeout handler was delayed by -1.4034863179999775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
W20260709 13:15:28.755882  6296 connection.cc:256] RPC call timeout handler was delayed by -1.3818863179999425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
W20260709 13:15:28.756172  6296 connection.cc:256] RPC call timeout handler was delayed by -1.3755863179999324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
I20260709 13:15:28.756686  9805 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:28.740411  9798 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:28.784989  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.786298  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.787312  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.788843  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.789444  6331 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:28.791002  9613 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:28.791558  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.792122  6403 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:28.792853  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.793403  6403 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:28.795398  9367 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:28.796324  9630 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:28.798903  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.799278  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1494) took 3685 ms. Trace:
I20260709 13:15:28.799579  6400 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.799860  6253 rpcz_store.cc:276] 0709 13:15:25.113553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.971932 (+2858379us) service_pool.cc:224] Handling call
0709 13:15:27.982378 (+ 10446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.215132 (+232754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.215177 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.243432 (+ 28255us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.603217 (+359785us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:28.603273 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.603351 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.799028 (+195677us) raft_consensus.cc:1685] finished
0709 13:15:28.799050 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.799214 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2026,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":53371,"thread_start_us":536780,"threads_started":2,"wal-append.queue_time_us":471021}
I20260709 13:15:28.800518  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.801833  6402 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:28.800283  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 756) took 3037 ms. Trace:
I20260709 13:15:28.800625  6399 raft_consensus.cc:2393] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:28.802933  6327 rpcz_store.cc:276] 0709 13:15:25.762758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.762892 (+   134us) service_pool.cc:224] Handling call
0709 13:15:25.763193 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:25.763438 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:26.165585 (+402147us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.312509 (+2146924us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.317441 (+  4932us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.799823 (+482382us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.799882 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:28.799931 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.800128 (+   197us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.800231 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4158,"prepare.queue_time_us":825699,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":876952,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":242,"thread_start_us":2587614,"threads_started":4,"wal-append.queue_time_us":1646210}
W20260709 13:15:28.759770  9724 consensus_meta.cc:287] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.915s	user 0.008s	sys 0.001s
I20260709 13:15:28.836278  6935 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:28.842742  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:28.843360  6942 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.760650  9805 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.864359  6400 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:28.865465  6329 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:15:28.810787  9713 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:28.859993  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.860239  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.865876  6329 pending_rounds.cc:85] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 1
I20260709 13:15:28.870527  6329 pending_rounds.cc:107] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:15:28.870805  6329 raft_consensus.cc:2889] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:28.866761  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.868567  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:28.871951  6327 raft_consensus.cc:2368] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7.
I20260709 13:15:28.871934  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:28.872216  6331 raft_consensus.cc:2393] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:28.873294  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.875511  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.876570  6324 raft_consensus.cc:2393] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 10: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:28.848393  6907 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:28.634714  9771 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:28.884634  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.887468  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:28.888239  6329 raft_consensus.cc:2376] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7. Re-sending same reply.
W20260709 13:15:28.893402  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 45133.8us
I20260709 13:15:28.894088  6907 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:28.742988  9763 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:28.716212  9793 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:28.899219  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.899329  6322 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:28.895783  6402 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:28.693619  9773 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:28.866523  9805 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:28.892692  9643 consensus_meta.cc:287] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.942s	user 0.007s	sys 0.004s
I20260709 13:15:28.843405  9804 consensus_queue.cc:1048] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:15:28.899943  6329 raft_consensus.cc:2368] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 8. Current term is 9.
I20260709 13:15:28.900628  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.748114  9801 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:28.901666  6331 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:28.902215  6324 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:28.799345  6403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:15:28.907372  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:28.901384  9535 consensus_meta.cc:287] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.949s	user 0.005s	sys 0.006s
I20260709 13:15:28.899534  9791 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:28.842574  9724 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:28.908878  6403 raft_consensus.cc:606] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:28.914780  6403 raft_consensus.cc:614] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:28.909499  6256 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:28.908290  6328 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:28.868144  9806 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 13:15:28.910995  9796 log.cc:927] Time spent T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:15:28.911331  9667 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:28.914063  6254 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:15:28.918105  6254 pending_rounds.cc:85] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 6
I20260709 13:15:28.918380  6254 pending_rounds.cc:107] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:15:28.918649  6254 raft_consensus.cc:2889] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:28.899379  9774 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.897035  9792 raft_consensus.cc:697] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:28.903817  9768 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:28.919714  6907 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:28.918215  9722 consensus_meta.cc:287] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.435s	user 0.010s	sys 0.003s
I20260709 13:15:28.924891  6250 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:28.925105  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.924929  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.926693  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.926901  6402 raft_consensus.cc:2410] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:28.929333  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.929935  6403 raft_consensus.cc:2376] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10. Re-sending same reply.
I20260709 13:15:28.930698  9794 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:28.930888  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2427) took 2407 ms. Trace:
I20260709 13:15:28.923676  9768 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.931756  9768 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:28.932294  9724 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:28.933023  6331 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:28.923751  9774 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:28.935863  9774 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:15:28.936429  9801 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:28.931329  6404 rpcz_store.cc:276] 0709 13:15:26.523964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.485922 (+961958us) service_pool.cc:224] Handling call
0709 13:15:27.516738 (+ 30816us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.192349 (+675611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.192377 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.211850 (+ 19473us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.560626 (+348776us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:28.590161 (+ 29535us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.730596 (+140435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.730799 (+   203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.930714 (+199915us) raft_consensus.cc:1685] finished
0709 13:15:28.930731 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.930838 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55270,"raft.queue_time_us":508323,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":21103,"thread_start_us":1058538,"threads_started":3,"wal-append.queue_time_us":484491}
I20260709 13:15:28.937839  9775 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:28.938305  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.938525  9815 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:28.939193  9730 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:28.941490  9771 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:28.945271  9762 consensus_meta.cc:287] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.001s
I20260709 13:15:28.945283  6937 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:28.945791  9762 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:28.948151  9762 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:28.948243  6933 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:28.950420  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.951139  6327 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:28.951860  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:28.924902  9791 raft_consensus.cc:697] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:28.952085  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.952513  6327 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:28.956353  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.930698  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:28.982975  6330 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:28.986506  6296 leader_election.cc:336] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.572s (SENT)
I20260709 13:15:28.977864  6401 raft_consensus.cc:2368] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9.
I20260709 13:15:28.986946  6296 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:28.987260  6327 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
W20260709 13:15:28.987936  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 59478.2us
I20260709 13:15:28.984547  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.981499  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.991081  6328 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:28.993225  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:28.993896  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.994506  6328 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:28.997409  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:28.996304  9160 consensus_queue.cc:1059] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:15:28.998407  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:28.999672  6296 leader_election.cc:336] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.657s (SENT)
I20260709 13:15:29.047770  6296 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:29.048003  6939 raft_consensus.cc:2393] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 4: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:29.013523  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.053732  6401 raft_consensus.cc:2393] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:28.997941  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.056213  9818 raft_consensus.cc:3055] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:29.056842  9818 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:29.042591  9496 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:29.057797  9818 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:29.054100  6905 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:29.059311  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 59651us
W20260709 13:15:29.027456  9653 consensus_meta.cc:287] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.012s	user 0.008s	sys 0.003s
W20260709 13:15:29.059928  6296 leader_election.cc:336] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.697s (SENT)
I20260709 13:15:29.060637  6296 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:29.061321  9693 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:29.061798  9693 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.062258  9693 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:28.998055  9708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.006s	sys 0.027s
I20260709 13:15:28.968012  6942 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
W20260709 13:15:29.060909  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 460915us
I20260709 13:15:29.067216  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:28.982157  9763 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:28.996377  9668 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:29.065573  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:29.065624  6296 leader_election.cc:336] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.086s (SENT)
W20260709 13:15:29.067725  6906 leader_election.cc:336] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:15:29.068315  6328 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 10: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:29.071612  6906 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:29.071429  6402 raft_consensus.cc:2376] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8. Re-sending same reply.
W20260709 13:15:29.072546  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.059917  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:29.073119  6906 leader_election.cc:336] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:15:29.073378  6403 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:29.058681  9805 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:29.014067  9791 consensus_queue.cc:237] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:29.078457  9805 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:29.080679  6296 leader_election.cc:336] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.176s (SENT)
I20260709 13:15:29.080832  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:29.081169  6296 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:29.061342  9812 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:29.082484  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.001415  9771 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:29.084108  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:29.086899  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.081552  9818 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.088420  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:29.070520  9708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.178s	user 0.006s	sys 0.028s
I20260709 13:15:29.088660  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.086067  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:29.080482  9693 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:29.106623  6397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2446) took 1532 ms (client timeout 1649 ms). Trace:
W20260709 13:15:29.107102  6397 rpcz_store.cc:269] 0709 13:15:27.574679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.759720 (+185041us) service_pool.cc:224] Handling call
0709 13:15:29.106433 (+1346713us) spinlock_profiling.cc:243] Waited 82 ms on lock 0x7b5400386654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:29.106556 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188588416}
I20260709 13:15:29.108271  9693 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:29.106667  6939 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:29.090811  6401 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:29.110594  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.110960  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:29.111377  6397 raft_consensus.cc:2393] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:29.111682  6402 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:29.066846  9667 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:29.094187  9773 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:29.114662  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2471) took 1057 ms. Trace:
I20260709 13:15:29.115043  6399 rpcz_store.cc:276] 0709 13:15:28.057729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.074495 (+ 16766us) service_pool.cc:224] Handling call
0709 13:15:29.114482 (+1039987us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b540006ac54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:29.114609 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572019072}
I20260709 13:15:29.115957  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.117385  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.118135  6401 raft_consensus.cc:2410] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:29.118805  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.119400  6401 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:29.116921  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:29.119379  6939 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:15:29.097697  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.088111  9714 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:29.085160  9819 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:29.100409  9793 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:29.102330  9768 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:29.068615  9653 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:28.997639  9810 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
W20260709 13:15:29.103631  9807 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.355s	user 0.002s	sys 0.000s
I20260709 13:15:29.019516  9792 consensus_queue.cc:237] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:29.087458  6906 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:28.928318  9722 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:29.112569  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.120507  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.121249  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.298214  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 624) took 3932 ms. Trace:
W20260709 13:15:29.259065  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 524592us
I20260709 13:15:29.183844  6404 raft_consensus.cc:1275] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:15:29.127605  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.299772  6397 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:29.121660  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:29.298969  6399 raft_consensus.cc:2410] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:15:29.179659  6933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 728) took 1020 ms. Trace:
W20260709 13:15:29.277596  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 397349us
W20260709 13:15:29.299897  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 641264us
I20260709 13:15:29.301079  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:29.302704  6221 leader_election.cc:336] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.443s (SENT)
I20260709 13:15:29.302322  6933 rpcz_store.cc:276] 0709 13:15:28.158793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.158896 (+   103us) service_pool.cc:224] Handling call
0709 13:15:29.179470 (+1020574us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b540072b354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:29.179595 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696340224}
W20260709 13:15:29.303076  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.303207  6221 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:29.303865  6397 raft_consensus.cc:2393] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 9: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:29.304760  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.298846  6249 rpcz_store.cc:276] 0709 13:15:25.365621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.008904 (+2643283us) service_pool.cc:224] Handling call
0709 13:15:28.009268 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.009499 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:28.218658 (+209159us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.233251 (+1014593us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b18000b3f20. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572a72c0a 00007f457c1b2219 00007f4572afaa40 00007f4572af54e4 00007f4572af5455 00007f4575bdd060 00007f4575bef716 00007f4575c00287 00007f4575c00208
0709 13:15:29.265272 (+ 32021us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:29.265328 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:29.277267 (+ 11939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.277349 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.298152 (+ 20803us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4039,"prepare.queue_time_us":284413,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":776287,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":129,"spinlock_wait_cycles":100333440,"thread_start_us":420186,"threads_started":3,"wal-append.queue_time_us":616251}
I20260709 13:15:29.299422  6222 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:29.180377  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2460) took 1184 ms. Trace:
I20260709 13:15:29.183461  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2465) took 1130 ms. Trace:
I20260709 13:15:29.307889  6398 rpcz_store.cc:276] 0709 13:15:28.053200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.062321 (+  9121us) service_pool.cc:224] Handling call
0709 13:15:29.183225 (+1120904us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54000253d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:29.183396 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423185664}
I20260709 13:15:29.307428  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.171567  9635 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:29.299392  6404 pending_rounds.cc:85] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 3
I20260709 13:15:29.310329  6397 raft_consensus.cc:2410] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:15:29.301295  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 213903us
I20260709 13:15:29.307018  6405 rpcz_store.cc:276] 0709 13:15:27.996244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.022694 (+ 26450us) service_pool.cc:224] Handling call
0709 13:15:29.180143 (+1157449us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b5400124654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:29.180308 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1620784000}
I20260709 13:15:29.312122  6404 pending_rounds.cc:107] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:15:29.312934  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:29.313643  6219 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:29.314046  6322 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:29.313020  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.314738  6404 raft_consensus.cc:2889] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:29.312903  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.313180  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:29.315136  6399 raft_consensus.cc:3055] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:29.315608  6326 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.315649  6399 raft_consensus.cc:740] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:29.316087  6397 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:29.316347  6402 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:29.316838  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2479) took 1084 ms. Trace:
I20260709 13:15:29.306358  9496 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.309686  9798 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:29.322055  9496 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:29.323068  9729 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:29.324174  9496 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:29.324417  9729 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.324698  9496 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:29.258172  9349 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:29.277884  9643 consensus_queue.cc:1059] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:15:29.325619  9349 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:29.325876  9643 raft_consensus.cc:3055] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:29.326103  9349 raft_consensus.cc:697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:29.326293  9643 raft_consensus.cc:740] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:29.327219  9643 consensus_queue.cc:260] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:29.327260  9349 consensus_queue.cc:237] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:29.328755  9722 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:15:29.171730  9675 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:29.311195  9724 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:29.328430  9643 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:29.334120  9724 raft_consensus.cc:697] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:29.338372  9724 consensus_queue.cc:237] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:29.259711  9781 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.320904  6907 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:29.319345  6397 rpcz_store.cc:276] 0709 13:15:28.232677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.315599 (+1082922us) service_pool.cc:224] Handling call
0709 13:15:29.315833 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.316586 (+   753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.316792 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.453722  6396 rpcz_store.cc:276] 0709 13:15:25.471245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.471533 (+   288us) service_pool.cc:224] Handling call
0709 13:15:25.509661 (+ 38128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:25.509846 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:26.518498 (+1008652us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.282141 (+1763643us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.302965 (+ 20824us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.368102 (+ 65137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.368158 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:28.368207 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.368279 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.368413 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":771855,"prepare.queue_time_us":152287,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":868566,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":105371,"spinlock_wait_cycles":138275584,"thread_start_us":1014349,"threads_started":3,"wal-append.queue_time_us":1060865}
W20260709 13:15:29.316862  6906 leader_election.cc:336] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:15:29.343596  6906 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:29.277701  9679 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:29.298215  9791 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:29.233687  9803 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:29.334983  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1492) took 4226 ms. Trace:
I20260709 13:15:29.351173  6250 rpcz_store.cc:276] 0709 13:15:25.108675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.968514 (+2859839us) service_pool.cc:224] Handling call
0709 13:15:27.972891 (+  4377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.925325 (+952434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.334745 (+409420us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54000f5d54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:29.334926 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2189005184}
I20260709 13:15:29.319693  6405 raft_consensus.cc:3055] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:29.342094  6326 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:29.344221  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.355096  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.333356  6398 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:29.348479  6906 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:29.356395  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.353749  6405 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:29.350257  6402 pending_rounds.cc:85] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 5
W20260709 13:15:29.357511  6906 leader_election.cc:336] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:15:29.358096  6402 pending_rounds.cc:107] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:15:29.358237  6906 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:29.358654  6402 raft_consensus.cc:2889] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:29.358178  6397 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:29.326318  9653 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:29.359570  6906 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:29.359908  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 637) took 1221 ms. Trace:
I20260709 13:15:29.360087  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.360751  6906 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:29.360562  6398 rpcz_store.cc:276] 0709 13:15:28.138387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.311525 (+1173138us) service_pool.cc:224] Handling call
0709 13:15:29.333168 (+ 21643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.359594 (+ 26426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.359838 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:29.361078  6397 raft_consensus.cc:2410] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:29.346487  6399 consensus_queue.cc:260] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:29.365811  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.371556  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:29.371800  6396 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:29.368568  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:29.373201  6934 raft_consensus.cc:2393] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:29.368845  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:29.374302  6939 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.377308  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:29.357694  6405 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:29.380475  6405 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:29.381795  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:29.382784  6326 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:29.350251  9819 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:29.384600  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:29.385208  6322 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:15:29.348644  9696 raft_consensus.cc:697] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:29.389767  6940 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:29.384140  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:29.353101  9798 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:29.394011  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:29.324977  9729 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:29.395179  6941 raft_consensus.cc:2410] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:15:29.401697  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:29.402441  9729 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:29.403221  6941 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:29.367442  9693 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:29.397284  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:29.397768  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 84180.1us
I20260709 13:15:29.400624  6939 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:29.365477  9818 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:29.395758  6399 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:29.369829  9793 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:29.408735  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:29.440131  6398 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:29.427212  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:29.429088  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:29.441350  6934 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:29.432818  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:29.442709  6940 raft_consensus.cc:2393] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:29.365573  9695 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.357378  9791 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:29.439132  6941 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:29.445722  6397 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:29.446791  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:29.446659  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 143953us
I20260709 13:15:29.348217  9781 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:29.448336  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.440490  6219 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:29.444232  6297 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:29.452126  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.453768  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:29.454144  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:29.454553  6368 connection.cc:256] RPC call timeout handler was delayed by -1.6982356280000204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 13:15:29.394922  9810 consensus_queue.cc:1059] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 13:15:29.455269  6368 connection.cc:256] RPC call timeout handler was delayed by -1.5875356279998414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
I20260709 13:15:29.455896  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:29.454733  6397 raft_consensus.cc:2376] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8. Re-sending same reply.
I20260709 13:15:29.457726  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.458328  6397 raft_consensus.cc:2393] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 9: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:15:29.455685  6368 connection.cc:256] RPC call timeout handler was delayed by -1.5659356280000338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
I20260709 13:15:29.460083  6297 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:29.465623  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:29.466032  6368 connection.cc:256] RPC call timeout handler was delayed by -1.5551356280000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260709 13:15:29.466418  6368 connection.cc:256] RPC call timeout handler was delayed by -1.2482356279999749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 13:15:29.466713  6368 connection.cc:256] RPC call timeout handler was delayed by -1.1645356280000669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
I20260709 13:15:29.466743  6248 raft_consensus.cc:2410] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:15:29.467075  6368 connection.cc:256] RPC call timeout handler was delayed by -1.0853356279999389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2198s for a response
I20260709 13:15:29.461514  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:29.461469  6249 pending_rounds.cc:85] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 6
I20260709 13:15:29.467667  6249 pending_rounds.cc:107] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:15:29.467760  6252 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
W20260709 13:15:29.467389  6368 connection.cc:256] RPC call timeout handler was delayed by -1.0511356279998836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
W20260709 13:15:29.463986  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.431696  9714 consensus_queue.cc:1059] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:15:29.462702  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:29.467972  6249 raft_consensus.cc:2889] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:29.470408  6397 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:29.470692  6252 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:29.472469  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:29.473726  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:29.473229  6252 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:29.458720  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:29.474828  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:29.474272  6247 raft_consensus.cc:2376] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8. Re-sending same reply.
I20260709 13:15:29.476670  6295 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:29.445233  9693 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:29.478971  6219 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:29.453708  9729 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:29.468631  6368 connection.cc:256] RPC call timeout handler was delayed by -1.0070356280000397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22850000000000004s for a response
I20260709 13:15:29.498383  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:29.499259  6368 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:29.459200  9675 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:29.505968  6219 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:29.464455  9812 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:29.446853  9667 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:15:29.481222  9760 log.cc:927] Time spent T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 1.599s	user 0.005s	sys 0.008s
I20260709 13:15:29.478000  9763 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:29.482064  9693 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.517956  6219 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:29.520057  6219 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:29.515303  6397 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4.
I20260709 13:15:29.526489  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.518108  6368 leader_election.cc:400] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7.
I20260709 13:15:29.532074  6368 leader_election.cc:403] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:15:29.509214  9679 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:29.543200  6219 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:29.480762  9830 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:15:29.497822  9832 consensus_queue.cc:1048] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:15:29.566617  9805 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.464214  9696 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:29.568107  9838 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:15:29.544163  9769 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:29.569484  9769 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:29.571568  9769 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:29.571854  6936 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 670) took 3898 ms (client timeout 2528 ms). Trace:
W20260709 13:15:29.572268  6936 rpcz_store.cc:269] 0709 13:15:25.672956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.673204 (+   248us) service_pool.cc:224] Handling call
0709 13:15:29.571658 (+3898454us) spinlock_profiling.cc:243] Waited 2.88 s on lock 0x7b5400538ed4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:29.571784 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6614406400}
I20260709 13:15:29.574751  6371 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:29.575557  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:29.575832  6371 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:29.576104  6328 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.540539  9768 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:29.531883  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.531782  9726 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:29.516844  9831 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:29.585538  9747 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:29.585732  9831 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.586148  9831 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.580742  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:29.536433  9643 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:29.557718  6219 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:29.549715  6934 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:15:29.558243  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 81685.4us
I20260709 13:15:29.549364  9833 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:29.540231  9714 raft_consensus.cc:3055] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:29.563647  6368 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:29.536588  6329 raft_consensus.cc:2955] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:29.580112  6397 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:29.627445  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:29.628233  6397 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:29.550539  9668 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:29.582926  9785 log.cc:927] Time spent T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.835s	user 0.003s	sys 0.000s
I20260709 13:15:29.586119  9747 raft_consensus.cc:697] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:29.587196  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2544) took 1302 ms. Trace:
I20260709 13:15:29.639887  6323 rpcz_store.cc:276] 0709 13:15:28.284998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.297368 (+ 12370us) service_pool.cc:224] Handling call
0709 13:15:29.587047 (+1289679us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b5400242cd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:29.587144 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700477312}
I20260709 13:15:29.518433  9763 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:29.509102  9675 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:29.600347  6328 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
W20260709 13:15:29.529174  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:29.616909  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 121452us
I20260709 13:15:29.643177  6219 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:29.621282  6398 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:29.617038  9829 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:29.559216  9782 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:29.625111  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:29.632153  6405 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:29.559350  9679 raft_consensus.cc:697] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:29.645247  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.651477  6398 raft_consensus.cc:2376] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 4. Re-sending same reply.
I20260709 13:15:29.651134  9679 consensus_queue.cc:237] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:29.547560  9729 consensus_queue.cc:1048] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:15:29.652281  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.652959  6398 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 9: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:29.588442  9805 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:29.644631  6905 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:29.576745  9722 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:29.655296  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2478) took 1457 ms. Trace:
I20260709 13:15:29.657482  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:29.657656  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:29.658458  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:29.626701  9833 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.634178  9714 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:29.683630  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:29.741573  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.687881  6405 rpcz_store.cc:276] 0709 13:15:28.193191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.312584 (+1119393us) service_pool.cc:224] Handling call
0709 13:15:29.319596 (+  7012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.650409 (+330813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.650594 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:29.743153  6405 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:15:29.663044  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 99514.9us
I20260709 13:15:29.745116  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:29.705724  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.736436  6397 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:29.738170  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:29.746093  6328 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:29.745481  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:29.752712  9633 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:29.753469  9633 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:29.755996  9633 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:29.647550  9782 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.648977  9763 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:29.741350  9812 raft_consensus.cc:697] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:29.779954  6368 leader_election.cc:400] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 8. Current term is 9.
I20260709 13:15:29.660193  9829 raft_consensus.cc:697] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:29.788607  6368 leader_election.cc:403] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:29.789186  9829 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:29.789723  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:29.636965  9726 consensus_queue.cc:1059] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:15:29.741236  9805 raft_consensus.cc:697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:29.746306  9769 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:29.739305  9833 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.761533  9810 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:29.779309  9694 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:29.761962  9830 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:29.779210  9782 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:29.785185  9633 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:29.792042  9791 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:29.861341  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 212696us
I20260709 13:15:29.866230  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2555) took 1333 ms. Trace:
I20260709 13:15:29.866751  6325 rpcz_store.cc:276] 0709 13:15:28.533221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.573607 (+ 40386us) service_pool.cc:224] Handling call
0709 13:15:28.574003 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.637246 (+ 63243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.865937 (+1228691us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b5400038754. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:29.866153 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76753664}
I20260709 13:15:29.870440  9643 raft_consensus.cc:697] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:29.870625  9865 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 8. Current term is 9.
W20260709 13:15:29.872416  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 82772us
I20260709 13:15:29.876087  6368 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:29.877770  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:29.824991  9781 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:29.829473  9830 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.882573  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:29.953027  6251 raft_consensus.cc:2410] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:29.933525  6252 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
W20260709 13:15:29.882853  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 239765us
I20260709 13:15:29.881059  6295 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:29.993907  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 116236us
I20260709 13:15:30.001650  6368 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:15:30.002063  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 426257us
W20260709 13:15:29.996441  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.800709  9839 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:15:29.863343  9810 raft_consensus.cc:697] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:15:30.011780  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 389604us
I20260709 13:15:30.029067  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:30.033535  6251 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:30.034720  6369 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:30.037520  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:29.824098  9840 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.211s
I20260709 13:15:29.992940  9830 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.885975  9726 consensus_queue.cc:1243] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:15:29.870947  9866 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:30.063252  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:30.063921  6248 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:30.064023  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:30.064739  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:30.065274  6248 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:29.826073  9747 consensus_queue.cc:237] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:30.067391  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:30.081144  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:30.080816  9349 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:30.051924  9835 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.488s	user 0.000s	sys 0.001s
I20260709 13:15:30.081280  9866 consensus_queue.cc:1059] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:15:30.101212  9546 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:30.101909  9675 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:30.111861  6247 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:30.112533  6221 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:30.067206  9769 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:30.063462  9667 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.070366  9726 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:30.117396  9160 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.010s	sys 0.048s
I20260709 13:15:30.085204  9349 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:30.143087  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:30.001472  9812 consensus_queue.cc:237] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:30.159153  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 649) took 1310 ms. Trace:
W20260709 13:15:30.138269  9836 log.cc:927] Time spent T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.505s	user 0.001s	sys 0.000s
I20260709 13:15:30.120426  9546 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.145910  6221 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:30.159776  6397 rpcz_store.cc:276] 0709 13:15:28.848442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.747401 (+898959us) service_pool.cc:224] Handling call
0709 13:15:29.747717 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.747944 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:29.749610 (+  1666us) log.cc:844] Serialized 14 byte log entry
0709 13:15:30.158735 (+409125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:30.158804 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:30.158863 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.158944 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.159094 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5006,"prepare.queue_time_us":247,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"thread_start_us":403720,"threads_started":1}
I20260709 13:15:30.141695  9643 consensus_queue.cc:237] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:30.147006  9857 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:30.144703  9769 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.173414  9633 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.030691  9805 consensus_queue.cc:237] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:30.140833  9778 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:30.178699  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:30.116755  6248 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:30.186132  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:30.149339  9160 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.011s	sys 0.048s
I20260709 13:15:30.185536  9546 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.144266  9675 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:30.204631  6397 raft_consensus.cc:2376] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7. Re-sending same reply.
I20260709 13:15:30.214934  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:30.196697  9769 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.221325  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:30.227267  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:30.227588  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:30.229727  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:30.159703  9667 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:30.204463  9778 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:30.237416  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:30.147146  9810 consensus_queue.cc:237] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:30.221359  9834 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:30.236852  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:30.252218  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 217607us
I20260709 13:15:30.252827  6397 raft_consensus.cc:2376] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9. Re-sending same reply.
I20260709 13:15:30.254590  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:30.255484  6397 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:30.257851  9675 consensus_queue.cc:1059] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:30.264655  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:30.144032  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2477) took 1969 ms. Trace:
I20260709 13:15:30.263170  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 642) took 1968 ms. Trace:
I20260709 13:15:30.265414  6399 rpcz_store.cc:276] 0709 13:15:28.174214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.314652 (+1140438us) service_pool.cc:224] Handling call
0709 13:15:29.314990 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:30.143242 (+828252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:30.143282 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:30.143335 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:30.143390 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.143473 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.143618 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85185,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":114311,"thread_start_us":342575,"threads_started":1}
I20260709 13:15:30.268862  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:30.270044  6399 raft_consensus.cc:2410] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:15:30.266010  6402 rpcz_store.cc:276] 0709 13:15:28.294329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.316960 (+1022631us) service_pool.cc:224] Handling call
0709 13:15:29.349997 (+ 33037us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:29.374644 (+ 24647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.374690 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:29.375435 (+   745us) log.cc:844] Serialized 52 byte log entry
0709 13:15:29.483483 (+108048us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:29.483536 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.483641 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.262977 (+779336us) raft_consensus.cc:1685] finished
0709 13:15:30.262994 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.263114 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":305,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":12053,"thread_start_us":79267,"threads_started":1,"wal-append.queue_time_us":154153}
I20260709 13:15:30.271255  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:30.272324  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:30.257048  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:30.206666  9633 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:30.241385  9842 log.cc:927] Time spent T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
I20260709 13:15:30.205901  9857 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:30.250293  9778 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:30.251564  6907 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.011s	sys 0.001s
W20260709 13:15:30.291010  6907 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.011s	sys 0.001s
I20260709 13:15:30.292029  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 644) took 1767 ms. Trace:
W20260709 13:15:30.216581  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 335547us
I20260709 13:15:30.271947  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:30.285254  6247 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:30.262494  9863 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:30.290519  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:30.292538  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.278919  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:30.277498  9696 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.004s	sys 0.010s
I20260709 13:15:30.296125  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:30.298830  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:30.299924  6399 raft_consensus.cc:2393] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:30.302632  6907 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:30.299130  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 295922us
I20260709 13:15:30.304404  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:30.308025  6247 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:30.302284  6295 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:30.302615  6403 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:30.311604  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:30.312867  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:30.315785  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:30.316537  6248 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:30.319913  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:30.321043  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:30.303861  6401 rpcz_store.cc:276] 0709 13:15:28.524678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.344260 (+819582us) service_pool.cc:224] Handling call
0709 13:15:29.361701 (+ 17441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.361948 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:29.569501 (+207553us) log.cc:844] Serialized 14 byte log entry
0709 13:15:30.291605 (+722104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:30.291670 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:30.291735 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.291814 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.291964 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":207185,"prepare.queue_time_us":208060,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":121154,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":20485,"thread_start_us":721652,"threads_started":2,"wal-append.queue_time_us":608399}
W20260709 13:15:30.303259  9696 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.004s	sys 0.010s
I20260709 13:15:30.289808  9694 raft_consensus.cc:697] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:30.331707  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:30.338901  6939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:47742
I20260709 13:15:30.340945  6397 raft_consensus.cc:2376] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7. Re-sending same reply.
W20260709 13:15:30.300699  9695 consensus_meta.cc:287] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.852s	user 0.002s	sys 0.013s
I20260709 13:15:30.333886  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:30.300783  9798 consensus_meta.cc:287] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.872s	user 0.011s	sys 0.000s
I20260709 13:15:30.335175  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:30.343431  6402 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.301745  9863 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:15:30.343938  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 154396us
I20260709 13:15:30.344605  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:30.345592  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:30.349812  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:30.353309  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:30.313983  9768 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:30.337358  9849 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 13:15:30.336882  9848 log.cc:927] Time spent T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:15:30.364828  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:30.303414  9839 consensus_queue.cc:1059] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:15:30.373823  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:30.386587  6403 raft_consensus.cc:2376] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6. Re-sending same reply.
I20260709 13:15:30.375116  6247 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:30.335675  9859 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:30.362601  9695 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:30.386116  9851 log.cc:927] Time spent T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:15:30.412889  6403 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:30.431025  6403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2135) took 1311 ms. Trace:
I20260709 13:15:30.431423  6403 rpcz_store.cc:276] 0709 13:15:29.119721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.387291 (+1267570us) service_pool.cc:224] Handling call
0709 13:15:30.412700 (+ 25409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:30.430765 (+ 18065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.430970 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:30.413062  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:30.417419  9694 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:30.362784  9863 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.410364  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:30.362287  9798 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:30.431592  6402 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:30.417332  9349 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:30.432616  6247 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:30.433638  6253 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.428402  6221 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:30.337116  9708 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 13:15:30.389252  9693 consensus_meta.cc:287] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.848s	user 0.011s	sys 0.000s
W20260709 13:15:30.533715  9890 log.cc:927] Time spent T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:15:30.535643  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:30.536615  6247 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:15:30.445566  9635 consensus_meta.cc:287] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 1.128s	user 0.011s	sys 0.001s
I20260709 13:15:30.446029  9693 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:30.566303  9633 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:30.566774  9803 consensus_meta.cc:287] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.193s	user 0.010s	sys 0.000s
I20260709 13:15:30.432679  9768 raft_consensus.cc:697] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:30.450133  9349 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:30.438742  9854 consensus_queue.cc:1059] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.171s
I20260709 13:15:30.628362  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 775) took 1054 ms. Trace:
I20260709 13:15:30.628898  6327 rpcz_store.cc:276] 0709 13:15:29.574131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.576728 (+  2597us) service_pool.cc:224] Handling call
0709 13:15:29.577034 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:29.577338 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.577364 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:29.583399 (+  6035us) log.cc:844] Serialized 26 byte log entry
0709 13:15:29.807569 (+224170us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:29.807625 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.807718 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.628051 (+820333us) raft_consensus.cc:1685] finished
0709 13:15:30.628085 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.628285 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69083,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":82920,"thread_start_us":223745,"threads_started":1,"wal-append.queue_time_us":624404}
I20260709 13:15:30.612165  9791 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:30.606493  9668 consensus_meta.cc:287] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.956s	user 0.011s	sys 0.000s
W20260709 13:15:30.663004  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 234682us
I20260709 13:15:30.608688  9667 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:30.672886  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:30.687727  6400 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:15:30.698541  6253 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
W20260709 13:15:30.717698  6295 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.873s (SENT) [suppressed 75 similar messages]
I20260709 13:15:30.611905  9803 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:30.758312  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.672255  9668 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7.
I20260709 13:15:30.789753  6253 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:30.648619  9858 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:30.792932  6251 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:30.713063  9770 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.813231  6398 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
W20260709 13:15:30.795979  9833 consensus_meta.cc:287] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.967s	user 0.009s	sys 0.002s
I20260709 13:15:30.649329  9349 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:30.798525  9802 raft_consensus.cc:3055] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:30.662729  9791 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:30.865506  9885 log.cc:927] Time spent T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:15:30.865772  9898 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:30.866814  9898 consensus_queue.cc:1243] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer b940f12ed61a49c4b3c11f13ef50fa92 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:30.866843  9871 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:30.868212  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 150544us
I20260709 13:15:30.868084  9871 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:30.869222  6295 leader_election.cc:336] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.809s (SENT)
W20260709 13:15:30.872064  9884 log.cc:927] Time spent T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:15:30.877995  9891 log.cc:927] Time spent T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:15:30.811757  9862 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.881186  6934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 685) took 1223 ms. Trace:
I20260709 13:15:30.882236  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2568) took 1292 ms. Trace:
I20260709 13:15:30.883983  6934 rpcz_store.cc:276] 0709 13:15:29.657544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.657684 (+   140us) service_pool.cc:224] Handling call
0709 13:15:29.738365 (+ 80681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:30.112319 (+373954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:30.112347 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:30.115910 (+  3563us) log.cc:844] Serialized 26 byte log entry
0709 13:15:30.329734 (+213824us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:30.329773 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.330471 (+   698us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.880908 (+550437us) raft_consensus.cc:1685] finished
0709 13:15:30.880935 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.881099 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":258,"raft.queue_time_us":126998,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":120898,"thread_start_us":544729,"threads_started":2,"wal-append.queue_time_us":293411}
I20260709 13:15:30.817075  9857 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:30.884037  6328 rpcz_store.cc:276] 0709 13:15:29.589958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.764036 (+174078us) service_pool.cc:224] Handling call
0709 13:15:29.779884 (+ 15848us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:30.229558 (+449674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:30.229608 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:30.240465 (+ 10857us) log.cc:844] Serialized 26 byte log entry
0709 13:15:30.371019 (+130554us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:30.371166 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.371352 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.881972 (+510620us) raft_consensus.cc:1685] finished
0709 13:15:30.882009 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.882167 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30536,"raft.queue_time_us":241161,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":15009,"thread_start_us":493365,"threads_started":2,"wal-append.queue_time_us":187653}
I20260709 13:15:30.889766  6322 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:15:30.893271  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 104322us
I20260709 13:15:30.894765  6327 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:30.896798  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:30.898571  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 771) took 1902 ms. Trace:
I20260709 13:15:30.901067  6396 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:30.901703  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2157) took 1533 ms. Trace:
I20260709 13:15:30.902000  6396 rpcz_store.cc:276] 0709 13:15:29.368237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.888182 (+1519945us) service_pool.cc:224] Handling call
0709 13:15:30.900886 (+ 12704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:30.901497 (+   611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.901655 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:30.898940  6331 rpcz_store.cc:276] 0709 13:15:29.053051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.054647 (+  1596us) service_pool.cc:224] Handling call
0709 13:15:29.055116 (+   469us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:29.059176 (+  4060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.059206 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:29.059731 (+   525us) log.cc:844] Serialized 52 byte log entry
0709 13:15:30.342197 (+1282466us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b180037d7a0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:15:30.425394 (+ 83197us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:30.425530 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.425805 (+   275us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.893418 (+467613us) raft_consensus.cc:1685] finished
0709 13:15:30.893442 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.898514 (+  5072us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10180,"raft.queue_time_us":5020,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":11670,"spinlock_wait_cycles":6551296,"thread_start_us":82577,"threads_started":1,"wal-append.queue_time_us":1610077}
I20260709 13:15:30.905561  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2464) took 2852 ms. Trace:
I20260709 13:15:30.825299  9802 raft_consensus.cc:740] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:30.906104  6404 rpcz_store.cc:276] 0709 13:15:28.052912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.939173 (+886261us) service_pool.cc:224] Handling call
0709 13:15:29.183376 (+244203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.315198 (+131822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.905342 (+1590144us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54000253d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:30.905503 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560934144}
I20260709 13:15:30.817937  9803 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:15:30.813400  9770 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:30.914783  6369 leader_election.cc:336] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.676s (SENT)
I20260709 13:15:30.911170  6221 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:30.917358  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 652) took 1845 ms. Trace:
I20260709 13:15:30.923400  6369 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:30.822397  9833 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:30.816063  9768 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:30.804204  9858 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:30.965274  6906 leader_election.cc:336] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.533s (SENT)
I20260709 13:15:30.916085  9747 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.970922  6906 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:30.976697  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 61959.6us
I20260709 13:15:30.966766  6295 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:30.919346  9635 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:30.891299  9862 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.017199  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:31.022171  6222 leader_election.cc:336] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.682s (SENT)
I20260709 13:15:31.021570  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:31.022249  6250 raft_consensus.cc:2393] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:30.977744  9881 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:31.023195  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 52416.1us
I20260709 13:15:30.960481  9857 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:31.034721  6906 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:31.025683  6222 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:31.041922  6906 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:31.044839  6906 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:31.062717  6404 raft_consensus.cc:1275] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:15:31.063151  6906 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:31.033227  9830 consensus_meta.cc:287] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.964s	user 0.008s	sys 0.005s
I20260709 13:15:31.033625  9708 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:31.046743  9861 log.cc:927] Time spent T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.486s	user 0.000s	sys 0.005s
I20260709 13:15:31.040421  9880 raft_consensus.cc:2764] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:15:31.074810  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:31.040503  9635 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.086819  9791 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:31.087847  9895 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:15:31.087983  9635 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:31.089681  9899 log.cc:927] Time spent T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 13:15:31.092054  9546 consensus_meta.cc:287] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.865s	user 0.005s	sys 0.002s
I20260709 13:15:31.092451  9546 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:31.074090  9160 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:31.093360  9160 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.075639  9857 raft_consensus.cc:697] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:31.093725  9160 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:31.094009  9763 consensus_meta.cc:287] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.296s	user 0.014s	sys 0.001s
I20260709 13:15:31.094271  9862 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:31.094578  9777 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:31.073305  9830 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:31.081471  9845 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:30.989745  9747 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:31.073868  9860 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:31.097283  9831 consensus_meta.cc:287] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.511s	user 0.013s	sys 0.000s
I20260709 13:15:30.977838  9802 consensus_queue.cc:260] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.094439  9763 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.094451  9857 consensus_queue.cc:237] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:31.103833  9892 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 13:15:31.124128  9802 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:31.120357  9860 raft_consensus.cc:697] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:15:31.125420  9894 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:15:31.131197  9875 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:15:31.135622  9896 log.cc:927] Time spent T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:15:31.135957  9875 raft_consensus.cc:697] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:31.136863  9875 consensus_queue.cc:237] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:31.139214  9830 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:31.140187  9858 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:31.142701  9833 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:31.153707  9865 raft_consensus.cc:3055] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:31.154165  9865 raft_consensus.cc:740] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:15:31.154855  9847 log.cc:927] Time spent T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.003s	user 0.005s	sys 0.005s
I20260709 13:15:31.155052  9865 consensus_queue.cc:260] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.144647  9860 consensus_queue.cc:237] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.194144  6252 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:15:31.194350  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 203222us
I20260709 13:15:31.196043  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2572) took 1151 ms. Trace:
I20260709 13:15:31.196656  6325 rpcz_store.cc:276] 0709 13:15:30.044091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.044205 (+   114us) service_pool.cc:224] Handling call
0709 13:15:30.044495 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:30.315442 (+270947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:30.315470 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:30.315916 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:15:30.535369 (+219453us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:30.535410 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.535482 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:31.195224 (+659742us) raft_consensus.cc:1685] finished
0709 13:15:31.195287 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:31.195725 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4609,"raft.queue_time_us":42769,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9928,"thread_start_us":431914,"threads_started":2,"wal-append.queue_time_us":454824}
I20260709 13:15:31.198275  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2573) took 1151 ms. Trace:
I20260709 13:15:31.199159  6330 rpcz_store.cc:276] 0709 13:15:30.047062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.047202 (+   140us) service_pool.cc:224] Handling call
0709 13:15:30.061391 (+ 14189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:30.066280 (+  4889us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:30.304267 (+237987us) log.cc:844] Serialized 14 byte log entry
0709 13:15:30.445910 (+141643us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:30.540788 (+ 94878us) log.cc:844] Serialized 26 byte log entry
0709 13:15:30.540932 (+   144us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:30.540967 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.541030 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:31.197614 (+656584us) raft_consensus.cc:1685] finished
0709 13:15:31.197670 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:31.198051 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95512,"prepare.queue_time_us":268263,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":13099,"raft.queue_time_us":105899,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":91786,"thread_start_us":230026,"threads_started":2,"wal-append.queue_time_us":273832}
W20260709 13:15:31.208357  6369 leader_election.cc:336] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.955s (SENT)
W20260709 13:15:31.211447  6369 leader_election.cc:336] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.440s (SENT)
I20260709 13:15:31.213506  6369 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:31.212836  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2141) took 1877 ms. Trace:
I20260709 13:15:31.214368  6402 rpcz_store.cc:276] 0709 13:15:29.335138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.441165 (+1106027us) service_pool.cc:224] Handling call
0709 13:15:30.441453 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:30.441665 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:30.441681 (+    16us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:30.448720 (+  7039us) log.cc:844] Serialized 26 byte log entry
0709 13:15:30.890404 (+441684us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:30.909622 (+ 19218us) log.cc:844] Serialized 14 byte log entry
0709 13:15:30.919605 (+  9983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.919679 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:31.212170 (+292491us) raft_consensus.cc:1685] finished
0709 13:15:31.212216 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:31.212586 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9695,"prepare.queue_time_us":18553,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":5942,"raft.queue_time_us":66528,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":34514,"thread_start_us":281980,"threads_started":1,"wal-append.queue_time_us":519864}
W20260709 13:15:31.214391  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 133447us
I20260709 13:15:31.219156  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:31.222038  6402 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:31.238224  9160 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.241744  9160 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:31.243592  9675 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:31.244210  9349 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:31.244729  9675 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.245220  9763 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:31.245713  9675 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:31.246236  9763 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:31.247092  9546 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:31.251297  9747 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:31.245016  9349 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:31.118870  9831 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:31.266151  6402 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
W20260709 13:15:31.269969  9919 log.cc:927] Time spent T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:15:31.273434  9898 consensus_queue.cc:1048] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:31.274235  9831 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:31.280377  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:31.281961  6253 raft_consensus.cc:1240] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:31.294664  6221 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:31.295434  6400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 646) took 2447 ms (client timeout 2073 ms). Trace:
I20260709 13:15:31.296151  9857 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:31.295971  6400 rpcz_store.cc:269] 0709 13:15:28.847437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.866406 (+ 18969us) service_pool.cc:224] Handling call
0709 13:15:31.294981 (+2428575us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400386154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:31.295168 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3945230592}
I20260709 13:15:31.297026  9857 raft_consensus.cc:697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:31.298206  6405 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:31.287467  9763 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:31.288929  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2282) took 1840 ms. Trace:
I20260709 13:15:31.291226  6942 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:31.292299  6369 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:31.301642  9882 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:31.302172  9882 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:31.302028  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:31.302708  9882 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:31.291241  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:31.306618  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:31.307458  6942 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:31.308394  9860 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:31.309589  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:31.309275  9860 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.310384  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:31.310832  6941 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:15:31.311866  9860 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:31.310412  6330 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:31.312639  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:31.313055  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:31.308409  6938 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 678) took 1940 ms. Trace:
I20260709 13:15:31.314877  6938 rpcz_store.cc:276] 0709 13:15:29.368200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.371157 (+  2957us) service_pool.cc:224] Handling call
0709 13:15:29.394241 (+ 23084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.440554 (+ 46313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.440583 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:29.440622 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:29.440650 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:31.307926 (+1867276us) spinlock_profiling.cc:243] Waited 46.1 ms on lock 0x7b5400663ad4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:31.308016 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:31.308240 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106044800}
I20260709 13:15:31.307473  6933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 673) took 1940 ms. Trace:
W20260709 13:15:31.316848  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.299976  6249 rpcz_store.cc:276] 0709 13:15:29.448606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.448715 (+   109us) service_pool.cc:224] Handling call
0709 13:15:29.449038 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:29.476424 (+ 27386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.476460 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:29.476977 (+   517us) log.cc:844] Serialized 52 byte log entry
0709 13:15:29.782158 (+305181us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:29.782203 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:31.288051 (+1505848us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54001739d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:31.288145 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:31.288228 (+    83us) raft_consensus.cc:1685] finished
0709 13:15:31.288239 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:31.288632 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8535,"raft.queue_time_us":6177,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":27216,"spinlock_wait_cycles":28120832,"thread_start_us":265255,"threads_started":1,"wal-append.queue_time_us":362343,"wal-append.run_cpu_time_us":1812,"wal-append.run_wall_time_us":1001817}
I20260709 13:15:31.316991  6933 rpcz_store.cc:276] 0709 13:15:29.366778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.366903 (+   125us) service_pool.cc:224] Handling call
0709 13:15:29.367194 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.459711 (+ 92517us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:29.480439 (+ 20728us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.649658 (+169219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:29.649711 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:29.649761 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:31.306910 (+1657149us) spinlock_profiling.cc:243] Waited 92.2 ms on lock 0x7b5400615154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:31.306978 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:31.307241 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18103,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":4459,"raft.queue_time_us":97,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":31758,"spinlock_wait_cycles":212129024,"thread_start_us":168830,"threads_started":1,"wal-append.queue_time_us":321945,"wal-append.run_cpu_time_us":2426,"wal-append.run_wall_time_us":1475368}
I20260709 13:15:31.319253  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:31.320780  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:31.316956  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:31.323427  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:31.330883  6402 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:31.333832  6369 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:31.335175  9633 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:31.298511  9857 consensus_queue.cc:237] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:31.335798  9633 raft_consensus.cc:697] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:31.337447  9633 consensus_queue.cc:237] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.326756  9693 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:31.347679  9714 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.351222  9865 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.351725  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:31.353157  9770 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:31.353803  6254 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:15:31.357292  6936 raft_consensus.cc:2393] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:15:31.365830  9837 log.cc:927] Time spent T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 1.799s	user 0.009s	sys 0.005s
I20260709 13:15:31.366288  9818 raft_consensus.cc:3055] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:31.366815  9818 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:31.368086  9818 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.370285  6255 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:31.381717  9850 raft_consensus.cc:3055] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:31.382230  9850 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:31.382261  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1417) took 2011 ms. Trace:
I20260709 13:15:31.383373  9850 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:31.384238  6942 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:31.384749  9850 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:31.387063  6403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2140) took 2052 ms. Trace:
I20260709 13:15:31.387428  6403 rpcz_store.cc:276] 0709 13:15:29.334822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.432480 (+1097658us) service_pool.cc:224] Handling call
0709 13:15:30.452677 (+ 20197us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:31.039607 (+586930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:31.039649 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:31.061906 (+ 22257us) log.cc:844] Serialized 52 byte log entry
0709 13:15:31.361684 (+299778us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:31.386622 (+ 24938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:31.386727 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:31.386763 (+    36us) raft_consensus.cc:1685] finished
0709 13:15:31.386772 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:31.386916 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25455,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":765120,"threads_started":2,"wal-append.queue_time_us":193019}
I20260709 13:15:31.382822  6329 rpcz_store.cc:276] 0709 13:15:29.370346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.370466 (+   120us) service_pool.cc:224] Handling call
0709 13:15:29.370968 (+   502us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:29.395471 (+ 24503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.395528 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:29.444930 (+ 49402us) log.cc:844] Serialized 574 byte log entry
0709 13:15:29.536460 (+ 91530us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:29.658806 (+122346us) log.cc:844] Serialized 14 byte log entry
0709 13:15:30.139182 (+480376us) log.cc:844] Serialized 14 byte log entry
0709 13:15:30.139397 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.139473 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:31.364328 (+1224855us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:31.381760 (+ 17432us) raft_consensus.cc:1685] finished
0709 13:15:31.381792 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:31.382048 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6559,"prepare.queue_time_us":568994,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":184576,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":10178,"spinlock_wait_cycles":25923456,"thread_start_us":451670,"threads_started":2,"wal-append.queue_time_us":112344}
I20260709 13:15:31.357685  9770 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:15:31.406680  6935 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
W20260709 13:15:31.409969  9863 consensus_meta.cc:287] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.948s	user 0.002s	sys 0.013s
I20260709 13:15:31.410499  9863 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:31.396942  9675 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:31.414522  6254 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:31.417271  9714 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:31.409113  9856 raft_consensus.cc:3055] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:31.421715  9856 raft_consensus.cc:740] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:31.423274  6250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 652) took 1358 ms (client timeout 1678 ms). Trace:
I20260709 13:15:31.429299  6939 raft_consensus.cc:606] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:31.434727  9863 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:31.423717  6250 rpcz_store.cc:269] 0709 13:15:30.064266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.141095 (+ 76829us) service_pool.cc:224] Handling call
0709 13:15:31.422820 (+1281725us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b5400202454. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:31.423102 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1922853248}
W20260709 13:15:31.444782  9829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.209s	user 0.017s	sys 0.000s
W20260709 13:15:31.448523  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.422991  9856 consensus_queue.cc:260] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:31.450377  9856 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:31.455199  9778 consensus_meta.cc:287] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 1.155s	user 0.008s	sys 0.009s
I20260709 13:15:31.455664  9778 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.427801  9818 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:31.457083  6399 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:31.467901  9713 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.469403  6400 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:31.468842  9713 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.445029  9763 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:31.468938  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2502) took 1441 ms. Trace:
I20260709 13:15:31.485662  6399 rpcz_store.cc:276] 0709 13:15:30.027120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.312590 (+285470us) service_pool.cc:224] Handling call
0709 13:15:31.468684 (+1156094us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540006a754. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:31.468866 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2629182720}
I20260709 13:15:31.484582  6368 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:31.472180  9829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.260s	user 0.017s	sys 0.000s
I20260709 13:15:31.478410  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:31.496263  6934 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:15:31.482033  6297 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:31.497799  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 648) took 2649 ms. Trace:
I20260709 13:15:31.503178  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.505236  6405 rpcz_store.cc:276] 0709 13:15:28.848126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.744061 (+895935us) service_pool.cc:224] Handling call
0709 13:15:31.297332 (+1553271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:31.298649 (+  1317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:31.497525 (+198876us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400386150. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:31.497704 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3571187584}
I20260709 13:15:31.505803  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.506332  6940 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:31.507293  6405 pending_rounds.cc:85] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 5
I20260709 13:15:31.507697  6405 pending_rounds.cc:107] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:15:31.507984  6405 raft_consensus.cc:2889] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:31.513644  6399 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:15:31.461817  9782 consensus_meta.cc:287] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.593s	user 0.017s	sys 0.006s
I20260709 13:15:31.482519  9700 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:15:31.532388  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 50593us
W20260709 13:15:31.537959  9925 log.cc:927] Time spent T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:15:31.602288  6935 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 676) took 2234 ms (client timeout 2165 ms). Trace:
I20260709 13:15:31.600497  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:31.602876  6935 rpcz_store.cc:269] 0709 13:15:29.367640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.383857 (+ 16217us) service_pool.cc:224] Handling call
0709 13:15:31.601916 (+2218059us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400210cd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:31.602185 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4540625792}
I20260709 13:15:31.606243  6937 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:31.596787  9763 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:31.556607  9769 consensus_meta.cc:287] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 1.310s	user 0.005s	sys 0.015s
I20260709 13:15:31.533732  9713 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:31.552502  9633 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:31.572247  9782 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:31.619520  6221 leader_election.cc:336] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.103s (SENT)
I20260709 13:15:31.621613  9535 raft_consensus.cc:3055] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:31.630661  9535 raft_consensus.cc:740] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:31.631834  9535 consensus_queue.cc:260] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:31.637794  9928 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.099s	user 0.001s	sys 0.001s
W20260709 13:15:31.638680  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.617846  9769 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:31.643319  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:31.644340  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:31.644747  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:31.645025  6296 connection.cc:256] RPC call timeout handler was delayed by -1.5202474269999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
I20260709 13:15:31.619545  9763 raft_consensus.cc:697] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:31.646317  9696 raft_consensus.cc:3055] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:31.646806  9696 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:31.646517  9763 consensus_queue.cc:237] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.648154  9696 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:31.645433  6401 raft_consensus.cc:2368] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7.
I20260709 13:15:31.650449  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:31.650632  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2493) took 1626 ms. Trace:
I20260709 13:15:31.651261  6249 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:31.651779  9782 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:31.652139  6402 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:15:31.652410  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:31.651068  6401 rpcz_store.cc:276] 0709 13:15:30.024700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.328770 (+304070us) service_pool.cc:224] Handling call
0709 13:15:31.650398 (+1321628us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003769d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:31.650576 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2973122816}
W20260709 13:15:31.645453  6296 connection.cc:256] RPC call timeout handler was delayed by -1.5130474269999468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 13:15:31.654613  6296 connection.cc:256] RPC call timeout handler was delayed by -1.4815474269998958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 13:15:31.655025  6296 connection.cc:256] RPC call timeout handler was delayed by -1.458147426999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
I20260709 13:15:31.644974  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:31.655442  6296 connection.cc:256] RPC call timeout handler was delayed by -1.4527474269998493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
W20260709 13:15:31.655877  6296 connection.cc:256] RPC call timeout handler was delayed by -1.4329474270000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260709 13:15:31.656383  6296 connection.cc:256] RPC call timeout handler was delayed by -1.3906474269999762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
W20260709 13:15:31.656774  6296 connection.cc:256] RPC call timeout handler was delayed by -1.3726474269999471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 13:15:31.657167  6296 connection.cc:256] RPC call timeout handler was delayed by -1.3636474269999326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 13:15:31.658018  6296 connection.cc:256] RPC call timeout handler was delayed by -1.3384474269998918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 13:15:31.659261  6296 connection.cc:256] RPC call timeout handler was delayed by -1.252947426999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
I20260709 13:15:31.660698  6933 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:15:31.662328  6936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 647) took 1342 ms. Trace:
I20260709 13:15:31.662755  6936 rpcz_store.cc:276] 0709 13:15:30.319585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.319691 (+   106us) service_pool.cc:224] Handling call
0709 13:15:31.662101 (+1342410us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54007b8754. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:31.662255 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2376315136}
I20260709 13:15:31.664278  9897 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:31.664963  9897 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:31.665723  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.666029  9852 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:15:31.666648  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:31.667095  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.667459  9897 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:31.667222  9675 consensus_queue.cc:1059] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:31.668665  9805 raft_consensus.cc:3055] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:31.636548  9535 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:31.673774  6296 connection.cc:256] RPC call timeout handler was delayed by -1.1116474269999799s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23220000000000002s for a response
I20260709 13:15:31.650465  9696 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:31.682535  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:31.669068  9805 raft_consensus.cc:740] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:31.662320  9778 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:31.693192  6249 raft_consensus.cc:2393] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:31.694335  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:31.695003  6249 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:31.699647  6937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 645) took 1382 ms. Trace:
I20260709 13:15:31.700057  6937 rpcz_store.cc:276] 0709 13:15:30.317504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.317606 (+   102us) service_pool.cc:224] Handling call
0709 13:15:31.605922 (+1288316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:31.606701 (+   779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:31.699457 (+ 92756us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400210cd0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:31.699593 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2899685120}
I20260709 13:15:31.704764  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:31.707261  9875 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.707886  9875 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.710461  9875 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:31.714049  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1524) took 1416 ms. Trace:
I20260709 13:15:31.714908  6249 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:31.714636  6253 rpcz_store.cc:276] 0709 13:15:30.297249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.803021 (+505772us) service_pool.cc:224] Handling call
0709 13:15:30.861463 (+ 58442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:31.293502 (+432039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:31.713638 (+420136us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54000e2ed4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:31.713936 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":931566848}
W20260709 13:15:31.715423  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 97415.2us
I20260709 13:15:31.716318  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:31.717697  6906 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
W20260709 13:15:31.717990  6907 leader_election.cc:336] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.073s (SENT)
W20260709 13:15:31.718921  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 118953us
W20260709 13:15:31.719372  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.716346  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:31.720393  6249 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:31.720249  9805 consensus_queue.cc:260] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.721119  9870 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:31.720407  6252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1510) took 1715 ms (client timeout 1676 ms). Trace:
I20260709 13:15:31.722245  6253 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.925015  6397 rpcz_store.cc:276] 0709 13:15:29.072282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.371655 (+1299373us) service_pool.cc:224] Handling call
0709 13:15:30.372269 (+   614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:30.372514 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:30.445455 (+ 72941us) log.cc:844] Serialized 14 byte log entry
0709 13:15:30.916765 (+471310us) log.cc:844] Serialized 14 byte log entry
0709 13:15:30.916978 (+   213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:30.917032 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:30.917097 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.917188 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.917301 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35073,"prepare.queue_time_us":202922,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":2420,"raft.queue_time_us":43728,"thread_start_us":507728,"threads_started":2}
I20260709 13:15:31.689764  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.706278  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:31.726361  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 261717us
W20260709 13:15:31.732877  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 44476.2us
I20260709 13:15:31.740341  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:31.741720  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 77653us
W20260709 13:15:31.734912  6252 rpcz_store.cc:269] 0709 13:15:30.013581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.036974 (+ 23393us) service_pool.cc:224] Handling call
0709 13:15:31.720171 (+1683197us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003d0754. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:31.720342 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2655363328}
I20260709 13:15:31.734855  9870 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.750680  6254 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:31.750972  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:31.745224  6221 leader_election.cc:336] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.218s (SENT)
W20260709 13:15:31.758996  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.764127  6248 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:31.750730  6907 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:31.773284  6396 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:15:31.773622  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 48423.1us
I20260709 13:15:31.767673  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2139) took 2407 ms. Trace:
I20260709 13:15:31.751298  9870 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:31.779376  9713 consensus_queue.cc:1059] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:31.783004  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.785174  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:31.786613  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.776506  6398 rpcz_store.cc:276] 0709 13:15:29.334528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.657446 (+322918us) service_pool.cc:224] Handling call
0709 13:15:31.726319 (+2068873us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003ae8d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:31.741489 (+ 15170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2585704320}
I20260709 13:15:31.796398  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.796770  6937 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 10: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:31.765980  9839 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.793305  6250 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:31.801823  6938 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:31.805173  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.807080  6296 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:31.808846  9876 log.cc:927] Time spent T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.376s	user 0.008s	sys 0.004s
I20260709 13:15:31.809291  9695 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:31.804090  6252 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:31.815690  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.816030  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.816948  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.774833  9882 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:31.826370  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.827847  9769 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:31.835023  6296 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:31.835968  9937 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:31.837560  6907 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:31.838171  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:31.839547  9866 consensus_queue.cc:1059] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:31.839996  6935 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:31.840448  9866 raft_consensus.cc:3055] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:31.840830  9866 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:31.840549  9792 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:31.841328  6402 raft_consensus.cc:1240] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:31.841920  9866 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.818044  9875 raft_consensus.cc:3055] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:31.845402  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 109891us
I20260709 13:15:31.842334  9792 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:31.831390  6937 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:31.843186  9866 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:31.847971  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:31.849169  6936 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:31.860240  9908 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:31.860283  9793 consensus_queue.cc:1059] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:15:31.862200  9793 consensus_queue.cc:1243] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer b940f12ed61a49c4b3c11f13ef50fa92 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:15:31.862733  9793 raft_consensus.cc:3055] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:31.863070  9793 raft_consensus.cc:740] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:31.863953  9793 consensus_queue.cc:260] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.845279  9875 raft_consensus.cc:740] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:31.866066  6397 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:31.866605  9875 consensus_queue.cc:260] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:31.867193  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:31.867990  6397 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:31.868085  9875 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.853338  9713 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:31.830965  9818 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:15:31.873490  6402 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:31.874159  6906 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:31.853936  9897 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:15:31.874315  9818 raft_consensus.cc:3055] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:31.875002  9818 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:31.875182  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:31.876133  9818 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.876832  9860 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:31.877282  9860 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.877386  9856 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:31.877755  9860 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:31.878048  9693 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:31.878468  9693 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:31.878861  9693 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:31.889866  9882 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:31.892057  9782 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.893697  9782 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:31.894464  9782 consensus_queue.cc:1243] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer b940f12ed61a49c4b3c11f13ef50fa92 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:15:31.894506  9904 log.cc:927] Time spent T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.764s	user 0.001s	sys 0.001s
I20260709 13:15:31.857754  9839 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:31.898726  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.836745  9937 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.868949  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:31.925309  6397 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:31.922155  6253 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:31.930982  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.931623  6254 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:31.934237  6249 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:31.939594  9871 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:31.940603  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:31.947430  9936 log.cc:927] Time spent T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 13:15:31.950836  6251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1511) took 1901 ms (client timeout 1955 ms). Trace:
I20260709 13:15:31.951303  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.951613  6248 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:31.952476  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:31.952252  9870 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:31.953433  6933 raft_consensus.cc:2368] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 9.
I20260709 13:15:31.955454  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:31.956136  6933 raft_consensus.cc:2393] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 5: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:31.861061  9908 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:31.957804  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2284) took 2506 ms. Trace:
I20260709 13:15:31.958189  6256 rpcz_store.cc:276] 0709 13:15:29.451886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.452044 (+   158us) service_pool.cc:224] Handling call
0709 13:15:29.454776 (+  2732us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:29.473300 (+ 18524us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:29.510041 (+ 36741us) log.cc:844] Serialized 14 byte log entry
0709 13:15:31.718422 (+2208381us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b180043d3e0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f457578523a 00007f4575befa2a
0709 13:15:31.822749 (+104327us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:31.919951 (+ 97202us) log.cc:844] Serialized 26 byte log entry
0709 13:15:31.933021 (+ 13070us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:31.933059 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:31.957334 (+ 24275us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:31.957379 (+    45us) raft_consensus.cc:1685] finished
0709 13:15:31.957468 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:31.957632 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8320,"prepare.queue_time_us":32145,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":9377,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":24360,"spinlock_wait_cycles":3721600,"thread_start_us":73885,"threads_started":1,"wal-append.queue_time_us":2397886}
I20260709 13:15:31.959573  9908 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:31.960286  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:31.960577  6250 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:31.961414  9855 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:31.962100  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.962729  6933 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:31.963375  9855 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:31.963822  9855 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:31.963596  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:31.964389  9839 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:31.965344  9793 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:31.965715  9818 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:31.951151  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 116227us
I20260709 13:15:31.968595  6296 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:31.969884  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.970017  6296 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:31.970849  9856 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:31.971077  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.971479  9856 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:31.972740  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:31.973299  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:31.965009  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:31.973759  9917 log.cc:927] Time spent T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:15:31.974912  6933 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:31.975927  9937 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:31.974927  6938 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:15:31.978472  6906 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:31.976150  6933 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEARNER]: Advancing to term 7
W20260709 13:15:31.951256  6251 rpcz_store.cc:269] 0709 13:15:30.049249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.063800 (+ 14551us) service_pool.cc:224] Handling call
0709 13:15:31.950494 (+1886694us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b5400336b54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:31.950661 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1674820992}
I20260709 13:15:31.979419  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:31.972800  6937 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:31.992556  9856 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:31.995384  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:31.995996  6937 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.000730  6248 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:32.006685  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:32.013762  6296 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.009335  6252 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:31.991379  9937 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.016036  6256 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:32.017405  6940 raft_consensus.cc:1240] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:32.017591  6906 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.025575  9798 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:32.026000  9667 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:32.026402  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.028313  9667 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:32.028823  6296 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:32.032919  9838 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:32.033380  9838 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:32.033768  9838 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.038370  6296 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.051772  9764 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:32.052192  6296 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.053098  9764 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:32.054929  6296 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.049659  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:32.055776  9764 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:32.056665  9870 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:32.056917  6252 raft_consensus.cc:2393] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:32.060055  6933 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:32.060794  9856 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:32.023190  9695 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:32.061594  9695 raft_consensus.cc:697] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:32.062429  9695 consensus_queue.cc:237] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.063838  6934 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:32.063827  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:32.065934  6297 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:32.066839  9764 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:32.068557  9874 consensus_queue.cc:1059] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:32.069391  9874 consensus_queue.cc:1243] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer 8600a3fead0e48a7aa813822ec44d0fe log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:15:32.069867  9714 raft_consensus.cc:3055] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:32.070245  9714 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:32.044355  9838 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:32.050556  9871 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:32.055142  6939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47742 (request call id 0) took 1742 ms. Trace:
I20260709 13:15:32.072516  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:32.045915  9855 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:32.071691  6939 rpcz_store.cc:276] 0709 13:15:30.324785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.333944 (+  9159us) service_pool.cc:224] Handling call
0709 13:15:32.054893 (+1720949us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54004f8154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575bdf853 00007f457abad60a 00007f45741337d4 00007f4574133762 00007f4574133691 00007f457413360c 00007f45741328c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:32.055043 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501207424}
I20260709 13:15:32.076633  6937 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:32.023074  9937 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.083801  9937 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:32.084163  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:32.084830  6404 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:32.044760  9860 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.096786  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:32.025607  9659 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:32.105093  9659 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.107195  9838 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:32.111302  6295 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:32.112315  9838 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.109053  9937 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:32.107750  9659 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:32.109023  9855 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:32.103410  9875 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.071274  9714 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:32.182134  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 89390.1us
I20260709 13:15:32.095927  9871 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:15:32.150427  9792 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:32.215456  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.229040  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.114956  9937 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.259369  6296 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:32.261538  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.246256  9798 raft_consensus.cc:697] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:15:32.269016  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 196607us
I20260709 13:15:32.262773  9714 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:32.283366  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:32.268257  9713 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:32.246307  9792 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.257283  9855 consensus_queue.cc:1059] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:15:32.179155  6939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:47742
I20260709 13:15:32.304559  6939 raft_consensus.cc:606] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:32.265964  9875 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:32.268563  9693 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.293748  9667 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:32.317432  6397 pending_rounds.cc:85] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 7
I20260709 13:15:32.321039  6397 pending_rounds.cc:107] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:15:32.321434  6397 raft_consensus.cc:2889] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:32.321802  9944 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:15:32.322081  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 72354.1us
I20260709 13:15:32.323776  9855 raft_consensus.cc:3055] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:32.324232  9855 raft_consensus.cc:740] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:32.325407  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2516) took 1038 ms. Trace:
I20260709 13:15:32.325196  9855 consensus_queue.cc:260] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:32.326340  9875 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:32.326483  9855 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.326983  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:32.335202  6247 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:32.325776  6401 rpcz_store.cc:276] 0709 13:15:31.287159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.669262 (+382103us) service_pool.cc:224] Handling call
0709 13:15:31.723359 (+ 54097us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:31.776608 (+ 53249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:31.776640 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:31.806054 (+ 29414us) log.cc:844] Serialized 26 byte log entry
0709 13:15:32.019251 (+213197us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:32.019284 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.019342 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:32.325193 (+305851us) raft_consensus.cc:1685] finished
0709 13:15:32.325215 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:32.325349 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":719,"raft.queue_time_us":21824,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":164,"spinlock_wait_cycles":26880,"thread_start_us":136661,"threads_started":1,"wal-append.queue_time_us":325375}
W20260709 13:15:32.337862  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 82858.2us
I20260709 13:15:32.338830  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:32.340139  6940 raft_consensus.cc:1240] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:32.325206  9878 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:32.359283  6252 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:32.359050  9798 consensus_queue.cc:237] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.368156  6296 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.369527  6219 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:32.369153  9878 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.370842  9887 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:32.371232  9887 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.371551  9887 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:32.371807  9878 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:32.374300  9693 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:32.376740  9805 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:32.381714  9937 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:32.384879  9866 consensus_meta.cc:287] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.003s
I20260709 13:15:32.387133  9792 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:32.388209  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2301) took 1001 ms. Trace:
W20260709 13:15:32.388522  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.392412  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:32.392838  6400 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:32.393168  6941 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:15:32.393558  6941 pending_rounds.cc:85] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: Aborting all ops after (but not including) 8
I20260709 13:15:32.393769  6941 pending_rounds.cc:107] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:15:32.393766  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:32.394276  6941 raft_consensus.cc:2889] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:32.394420  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:32.395427  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:32.388618  6249 rpcz_store.cc:276] 0709 13:15:31.386458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.794175 (+407717us) service_pool.cc:224] Handling call
0709 13:15:31.927092 (+132917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:31.934667 (+  7575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.388022 (+453355us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54001b94d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:32.388156 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290525440}
W20260709 13:15:32.398757  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.429611  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:32.437359  6402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce99643832824368978841e0265f9d2d"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:15:32.438146  6402 raft_consensus.cc:606] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:32.438669  6402 raft_consensus.cc:614] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:32.421016  9838 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:32.443253  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 89924.1us
I20260709 13:15:32.458880  6938 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:32.417845  9950 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:15:32.462740  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:32.467543  6250 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:32.467350  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1532) took 1234 ms. Trace:
I20260709 13:15:32.468078  6248 rpcz_store.cc:276] 0709 13:15:31.232689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.765859 (+533170us) service_pool.cc:224] Handling call
0709 13:15:31.951434 (+185575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:32.010609 (+ 59175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.467080 (+456471us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400336b50. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:32.467271 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425817856}
I20260709 13:15:32.469575  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:32.470646  6249 raft_consensus.cc:1240] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:32.471381  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2510) took 1265 ms. Trace:
I20260709 13:15:32.471782  6396 rpcz_store.cc:276] 0709 13:15:31.206321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.481942 (+275621us) service_pool.cc:224] Handling call
0709 13:15:31.731779 (+249837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:31.773782 (+ 42003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.471228 (+697446us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54003ae8d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:32.471330 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569781504}
W20260709 13:15:32.479907  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.454047  9667 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:32.438004  9793 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:15:32.455552  9546 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:32.505456  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:32.505671  6248 raft_consensus.cc:3055] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:32.511317  6248 raft_consensus.cc:740] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:32.511468  6296 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.512297  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:32.512260  6248 consensus_queue.cc:260] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.512564  9937 consensus_queue.cc:1059] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:32.510095  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:32.513319  9764 consensus_queue.cc:1059] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:15:32.513265  9886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.406s	user 0.010s	sys 0.010s
I20260709 13:15:32.513260  9839 consensus_queue.cc:1059] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:32.513622  9937 raft_consensus.cc:3055] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:32.524111  9937 raft_consensus.cc:740] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:32.524447  6296 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:32.525416  9667 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:32.525302  9937 consensus_queue.cc:260] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:32.526962  9937 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:32.528717  9839 raft_consensus.cc:3055] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:32.534965  6247 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
W20260709 13:15:32.519037  9886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.450s	user 0.010s	sys 0.010s
I20260709 13:15:32.538937  9839 raft_consensus.cc:740] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:32.539894  6248 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:32.516892  9367 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:32.514178  9713 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:15:32.567636  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.571727  9367 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.575716  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:32.576030  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:32.578883  9839 consensus_queue.cc:260] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.580246  9839 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:32.580554  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:32.581903  9764 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:32.543462  9887 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.582324  9764 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:32.582752  9764 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:32.583673  6252 raft_consensus.cc:2393] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:32.583813  9887 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:32.571626  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.584822  9792 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.585554  6906 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:32.587973  9798 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.517637  9546 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.588647  9819 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:32.589221  9819 raft_consensus.cc:697] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:32.589546  9860 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:32.589905  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.590497  9546 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:32.590106  9819 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.591325  6906 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.585346  9792 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:32.588068  9946 log.cc:927] Time spent T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.234s	user 0.003s	sys 0.001s
I20260709 13:15:32.594913  6251 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:32.588519  9798 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:32.571579  9952 log.cc:927] Time spent T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:15:32.539247  9805 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:15:32.603425  6369 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:32.605307  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:32.607612  9866 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:32.606824  6396 raft_consensus.cc:2955] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:32.608140  9866 raft_consensus.cc:697] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:32.609362  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:32.609175  9866 consensus_queue.cc:237] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.610059  6400 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:32.601166  9908 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:15:32.612664  9773 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:32.613370  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:32.613583  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:32.614919  6405 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:32.616209  6405 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:32.568823  9675 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:15:32.617880  6250 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:32.597637  9695 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:32.619418  6404 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:15:32.619776  6404 pending_rounds.cc:85] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 7
I20260709 13:15:32.619992  6404 pending_rounds.cc:107] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:15:32.620204  6404 raft_consensus.cc:2889] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:32.620527  6255 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:32.622476  9546 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:32.626585  6222 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.542407  9956 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.184s
I20260709 13:15:32.550524  9770 consensus_queue.cc:1059] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:15:32.630406  6371 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:32.637633  6248 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:15:32.649818  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 78287.1us
I20260709 13:15:32.632131  9860 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:32.673164  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:32.674131  6255 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:32.640652  9535 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:32.678824  6906 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:32.686472  9367 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:32.686585  9818 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:32.688372  9818 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:32.690126  9967 log.cc:927] Time spent T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:15:32.691380  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 64872.2us
I20260709 13:15:32.692371  6222 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.694494  9792 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:32.700177  6329 raft_consensus.cc:1275] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:15:32.699870  9781 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:32.717062  6296 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.635160  9695 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:15:32.688869  9818 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.722590  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:32.726851  6400 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
W20260709 13:15:32.720088  9966 log.cc:927] Time spent T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:15:32.677048  9798 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:32.645351  9959 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
W20260709 13:15:32.725729  9935 log.cc:927] Time spent T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:15:32.724913  9818 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:32.732425  9367 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:32.747179  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:32.747126  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:32.746047  6905 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:32.756755  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 79440.4us
W20260709 13:15:32.757648  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 78929.4us
I20260709 13:15:32.750406  6323 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:32.763451  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:32.764729  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.765018  6331 raft_consensus.cc:1240] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:32.733156  9870 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:15:32.756596  9886 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:32.772990  6329 raft_consensus.cc:2393] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:32.762259  9793 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:32.753314  9781 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:15:32.781600  9694 raft_consensus.cc:3055] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:32.782730  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:32.786777  6323 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:32.792589  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:32.799448  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 138415us
I20260709 13:15:32.805984  6326 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:32.821852  9693 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.822436  9693 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.823793  6323 raft_consensus.cc:1275] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:15:32.824216  6323 pending_rounds.cc:85] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 4
I20260709 13:15:32.824457  6323 pending_rounds.cc:107] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:15:32.824683  6323 raft_consensus.cc:2889] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:32.825692  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:32.826401  6401 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:15:32.817533  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:32.828769  9693 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:32.837333  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 658) took 1329 ms. Trace:
I20260709 13:15:32.838011  9675 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:32.840394  6402 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:32.828902  6324 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:32.792186  9694 raft_consensus.cc:740] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:32.844651  9694 consensus_queue.cc:260] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:32.845877  9694 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:32.846426  6330 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:32.829937  6907 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:32.830349  6323 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:32.847366  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:32.847853  6330 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:32.830996  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:32.848348  9871 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:32.848774  9871 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.849138  9871 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:32.850513  6326 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:32.833541  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:32.858256  9818 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.825618  6296 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.861310  9367 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:32.837683  6399 rpcz_store.cc:276] 0709 13:15:31.507802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.692268 (+184466us) service_pool.cc:224] Handling call
0709 13:15:32.350767 (+658499us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5800102f98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0e9c 00007f4572ac0a5b 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abbefc0 00007f457aba9929 00007f457aba93d2 00007f4574120bd4
0709 13:15:32.351009 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:32.351294 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:32.505792 (+154498us) log.cc:844] Serialized 14 byte log entry
0709 13:15:32.836778 (+330986us) log.cc:844] Serialized 14 byte log entry
0709 13:15:32.836956 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:32.836999 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:32.837045 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.837116 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:32.837284 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192436,"prepare.queue_time_us":86360,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":182797,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":131,"spinlock_wait_cycles":4563072,"thread_start_us":216042,"threads_started":2,"wal-append.queue_time_us":215637}
I20260709 13:15:32.863613  6296 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:32.866370  9713 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:32.833702  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:32.834395  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:32.834473  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:32.870309  6327 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:32.870361  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:32.871026  6935 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:32.835175  9726 raft_consensus.cc:3055] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:32.871973  9726 raft_consensus.cc:740] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:32.872856  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:32.872802  9726 consensus_queue.cc:260] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:32.873564  6935 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:32.874110  9726 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:32.836119  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 205808us
W20260709 13:15:32.868978  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.875905  6399 raft_consensus.cc:1275] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:32.877408  6297 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:32.878274  6322 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:32.881729  9546 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:15:32.883313  9968 log.cc:927] Time spent T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.174s	user 0.000s	sys 0.003s
I20260709 13:15:32.866994  9818 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:32.889755  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:32.890214  9961 log.cc:927] Time spent T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.414s	user 0.001s	sys 0.001s
W20260709 13:15:32.891059  9957 log.cc:927] Time spent T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
W20260709 13:15:32.902156  9962 log.cc:927] Time spent T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.329s	user 0.001s	sys 0.001s
I20260709 13:15:32.905424  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:32.906718  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.915261  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.886806  9713 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:32.919550  6322 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:32.920957  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:32.921897  6252 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:15:32.925006  6368 leader_election.cc:336] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.574s (SENT)
I20260709 13:15:32.925750  6368 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:32.920619  9713 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:32.933266  6324 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:32.934057  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:32.935127  6253 raft_consensus.cc:2410] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:32.908311  9764 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:32.931039  9713 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:32.942871  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 250597us
I20260709 13:15:32.958463  6324 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:32.960132  6154 catalog_manager.cc:5697] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:32.963142  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 45705.1us
I20260709 13:15:32.962623  6154 catalog_manager.cc:5697] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:32.964213  6154 catalog_manager.cc:5697] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.972182  6326 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:32.975430  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 47064.2us
I20260709 13:15:32.973207  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:32.976459  6253 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:33.017495  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 73585.9us
I20260709 13:15:33.045094  6322 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:15:33.045607  6322 pending_rounds.cc:85] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 8
I20260709 13:15:33.045846  6322 pending_rounds.cc:107] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:15:33.046101  6322 raft_consensus.cc:2889] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:33.047165  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:33.047948  6324 raft_consensus.cc:2410] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:15:33.047436  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:33.049227  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:33.049697  6252 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:33.055001  6935 raft_consensus.cc:1240] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:33.056710  9937 consensus_queue.cc:1059] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:33.058185  9937 raft_consensus.cc:3055] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:33.058575  9937 raft_consensus.cc:740] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:33.059566  6222 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:33.048832  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:33.064512  6253 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:33.080595  6324 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:15:33.085994  9668 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:33.087723  9956 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:15:33.090674  6935 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:33.094261  9764 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:33.094197  9839 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:33.102337  9802 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:33.102452  9964 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:33.103271  9802 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.103731  9802 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:33.105427  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.109193  9802 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:33.115561  9802 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:15:33.131059  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 48286.8us
W20260709 13:15:33.184759  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 125280us
I20260709 13:15:33.076053  9798 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:15:33.168972  6154 catalog_manager.cc:5697] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:33.079628  9959 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 13:15:33.195011  6296 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:33.198943  6221 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:33.085175  9695 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:15:33.202973  6222 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:33.082448  9937 consensus_queue.cc:260] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:33.186093  9675 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.187222  9700 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.190088  9956 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:33.199632  9714 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:33.249055  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 52500.1us
I20260709 13:15:33.264902  6222 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:33.252527  6219 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:33.197544  9781 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:15:33.207301  9695 consensus_queue.cc:1243] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer a13ffe92eb374309a5c8476d9fbbb2b8 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:33.213722  9887 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:33.204308  9964 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:15:33.254997  9839 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:33.319903  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 137009us
I20260709 13:15:33.320899  6296 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:33.212011  9982 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:15:33.217976  9675 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:33.205785  9985 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:15:33.219637  9700 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:33.249445  9903 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:15:33.250772  9956 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:33.412544  6326 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:15:33.399609  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 78808.9us
I20260709 13:15:33.310169  9964 consensus_queue.cc:1243] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer a13ffe92eb374309a5c8476d9fbbb2b8 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:33.388648  9659 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:33.255026  9714 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:33.315342  9839 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.403268  9886 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:33.459491  6154 catalog_manager.cc:5697] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 6, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 6 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.251147  9871 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:33.488787  6330 consensus_meta.cc:287] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.001s
I20260709 13:15:33.392680  9887 raft_consensus.cc:697] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:33.500823  6330 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:33.424284  6296 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:15:33.510880  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.404404  9367 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:15:33.446900  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.544509  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.499109  9839 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:33.546442  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 122255us
I20260709 13:15:33.556736  6296 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:33.415144  9713 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:33.595619  6368 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.018s	sys 0.027s
I20260709 13:15:33.518000  9855 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:33.513799  9860 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:15:33.601948  6368 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.019s	sys 0.027s
W20260709 13:15:33.606913  6325 consensus_meta.cc:287] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.811s	user 0.008s	sys 0.004s
I20260709 13:15:33.607769  6325 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
W20260709 13:15:33.552019  9643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.025s	sys 0.026s
I20260709 13:15:33.520455  9886 raft_consensus.cc:697] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:33.606065  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 641726us
W20260709 13:15:33.625836  6328 consensus_meta.cc:287] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.758s	user 0.010s	sys 0.000s
I20260709 13:15:33.626593  6328 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:33.628721  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:33.519075  9696 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.081s
W20260709 13:15:33.610224  9643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.025s	sys 0.026s
I20260709 13:15:33.560195  9764 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:33.642681  6328 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11. Ops: [10.11-10.11]
W20260709 13:15:33.665854  9987 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:15:33.667795  9886 consensus_queue.cc:237] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:33.553718  9978 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.133s
W20260709 13:15:33.678480  6368 leader_election.cc:336] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.762s (SENT)
I20260709 13:15:33.679142  6368 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:33.681969  9988 log.cc:927] Time spent T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:15:33.705982  9887 consensus_queue.cc:237] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:33.711113  9700 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:33.712774  9714 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:33.717459  9956 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:33.722685  9675 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:33.643630  6325 raft_consensus.cc:2393] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:33.594666  9546 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:33.565356  9959 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
W20260709 13:15:33.759847  6935 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.012s	sys 0.047s
I20260709 13:15:33.655573  9908 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:33.761771  6935 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.012s	sys 0.047s
I20260709 13:15:33.659659  9764 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.723806  9675 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:33.737033  9937 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:33.781350  6324 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.002s	sys 0.059s
W20260709 13:15:33.781832  6324 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.002s	sys 0.059s
I20260709 13:15:33.622614  9860 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:33.774245  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:33.782948  6328 raft_consensus.cc:2393] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:15:33.757813  9819 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.028s	sys 0.030s
I20260709 13:15:33.747469  9546 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:33.769207  9770 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.009s	sys 0.053s
I20260709 13:15:33.773754  9764 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:33.799170  6941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.015s	sys 0.049s
I20260709 13:15:33.799856  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:33.774878  9713 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:33.805230  6221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.006s	sys 0.028s
W20260709 13:15:33.805677  6221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.006s	sys 0.028s
W20260709 13:15:33.803248  6941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.015s	sys 0.049s
W20260709 13:15:33.785486  9819 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.029s	sys 0.031s
W20260709 13:15:33.797662  9770 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.009s	sys 0.054s
W20260709 13:15:33.801820  6222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.011s	sys 0.023s
I20260709 13:15:33.784659  9546 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:33.824587  6222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.012s	sys 0.023s
I20260709 13:15:33.804641  6154 catalog_manager.cc:5697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 7, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 7 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:33.825193  6219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.032s
W20260709 13:15:33.825645  6219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.002s	sys 0.032s
W20260709 13:15:33.806318  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 555856us
W20260709 13:15:33.828985  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 564123us
I20260709 13:15:33.829941  6222 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:33.832122  9781 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:15:33.833472  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 580989us
I20260709 13:15:33.766539  9908 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:33.843299  6219 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:33.826212  6327 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.032s	sys 0.089s
W20260709 13:15:33.844270  6327 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.032s	sys 0.089s
W20260709 13:15:33.841871  6323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.000s	sys 0.032s
W20260709 13:15:33.845264  6323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.000s	sys 0.033s
I20260709 13:15:33.879251  6219 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:33.883530  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2601) took 1046 ms. Trace:
W20260709 13:15:33.886786  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.911692  6908 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.014s	sys 0.027s
I20260709 13:15:33.868534  9675 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:33.926637  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 96759.7us
W20260709 13:15:33.929050  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.932214  6908 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.016s	sys 0.027s
I20260709 13:15:33.878098  9871 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:33.892877  9802 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:33.884191  6323 rpcz_store.cc:276] 0709 13:15:32.831396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.848068 (+ 16672us) service_pool.cc:224] Handling call
0709 13:15:32.848323 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:32.852782 (+  4459us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:33.263827 (+411045us) log.cc:844] Serialized 14 byte log entry
0709 13:15:33.877668 (+613841us) log.cc:844] Serialized 14 byte log entry
0709 13:15:33.877854 (+   186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:33.877904 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:33.877948 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.878011 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:33.878131 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21288,"prepare.queue_time_us":750710,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":32001,"thread_start_us":904582,"threads_started":2}
I20260709 13:15:33.960889  6222 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:33.969329  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.897964  9659 consensus_queue.cc:1059] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:15:33.993358  6936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 678) took 1028 ms. Trace:
I20260709 13:15:33.995385  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:33.996181  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.000150  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:33.954659  9950 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.038s	sys 0.075s
W20260709 13:15:34.034226  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.992731  9882 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.036s	sys 0.060s
I20260709 13:15:34.057045  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:34.002875 10000 log.cc:927] Time spent T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:15:33.947829  9675 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:34.066397  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:34.064320  9882 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.037s	sys 0.060s
W20260709 13:15:34.065047  6369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.014s	sys 0.004s
W20260709 13:15:34.069314  6369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.014s	sys 0.004s
I20260709 13:15:34.073484  6252 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:34.008862  9871 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:15:34.045161  9950 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.038s	sys 0.076s
I20260709 13:15:34.033711  9713 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.084872  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:34.084687  6401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.000s	sys 0.020s
W20260709 13:15:34.088922  6401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.000s	sys 0.021s
I20260709 13:15:34.091822  6255 raft_consensus.cc:1240] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:34.109467  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:34.082701  9659 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:34.063304 10012 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:34.115585  6329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.007s	sys 0.018s
W20260709 13:15:34.120576  6329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.007s	sys 0.018s
W20260709 13:15:34.120604  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 442105us
I20260709 13:15:34.122803  9887 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:34.117225  9694 consensus_meta.cc:287] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.271s	user 0.007s	sys 0.006s
W20260709 13:15:34.158233  6368 leader_election.cc:336] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.811s (SENT)
I20260709 13:15:34.118029 10008 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.116165  9860 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:34.176084  6368 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:34.088006  9871 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:34.108971  9713 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:34.196295  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 682) took 1122 ms. Trace:
I20260709 13:15:34.155043  9887 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:34.230841  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 793) took 1186 ms. Trace:
I20260709 13:15:34.206240  6251 rpcz_store.cc:276] 0709 13:15:33.074421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.074578 (+   157us) service_pool.cc:224] Handling call
0709 13:15:33.084775 (+ 10197us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:33.100811 (+ 16036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.100839 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:33.101366 (+   527us) log.cc:844] Serialized 52 byte log entry
0709 13:15:33.543065 (+441699us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:33.543108 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.543175 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.195996 (+652821us) raft_consensus.cc:1685] finished
0709 13:15:34.196024 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.196215 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15624,"raft.queue_time_us":18022,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":441305,"threads_started":1,"wal-append.queue_time_us":723207}
I20260709 13:15:34.161078  9659 raft_consensus.cc:697] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:34.185405  9991 log.cc:927] Time spent T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 13:15:34.181339  9773 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.183979  9886 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:34.187325  9908 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:34.246127  6327 rpcz_store.cc:276] 0709 13:15:33.044542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.049806 (+  5264us) service_pool.cc:224] Handling call
0709 13:15:33.050126 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.050362 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:33.844687 (+794325us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.207992 (+363305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:34.208044 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:34.230532 (+ 22488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.230625 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.230771 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":634104,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"thread_start_us":1118795,"threads_started":2}
W20260709 13:15:34.298583  6294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.009s	sys 0.013s
W20260709 13:15:34.298979  6294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.009s	sys 0.013s
I20260709 13:15:34.298638  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:34.303022  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 342176us
W20260709 13:15:34.289511 10001 log.cc:927] Time spent T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
W20260709 13:15:34.289863  9997 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
I20260709 13:15:34.289743 10014 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.290802  9802 raft_consensus.cc:697] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:34.280884  9773 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:34.348693  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 202572us
I20260709 13:15:34.354488  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 678) took 1475 ms. Trace:
W20260709 13:15:34.349895 10003 log.cc:927] Time spent T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
W20260709 13:15:34.361004  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 56852.3us
I20260709 13:15:34.358023  6250 rpcz_store.cc:276] 0709 13:15:32.878604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.878716 (+   112us) service_pool.cc:224] Handling call
0709 13:15:32.878997 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:32.883550 (+  4553us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:32.883579 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:32.884054 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:15:33.316381 (+432327us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:33.316417 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.316485 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.354300 (+1037815us) raft_consensus.cc:1685] finished
0709 13:15:34.354319 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.354433 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1580,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":33078,"thread_start_us":431982,"threads_started":1,"wal-append.queue_time_us":912781}
W20260709 13:15:34.361423  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 201852us
I20260709 13:15:34.332244 10022 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:34.376554  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:34.377277  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1547) took 1731 ms. Trace:
I20260709 13:15:34.377393  6397 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:34.377693  6248 rpcz_store.cc:276] 0709 13:15:32.646015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.658382 (+ 12367us) service_pool.cc:224] Handling call
0709 13:15:32.658746 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:33.100864 (+442118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.100890 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:33.101366 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:15:33.601327 (+499961us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:33.601379 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.601469 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.377062 (+775593us) raft_consensus.cc:1685] finished
0709 13:15:34.377081 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.377220 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7123,"raft.queue_time_us":74061,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6033,"spinlock_wait_cycles":32512,"thread_start_us":848949,"threads_started":2,"wal-append.queue_time_us":781435}
I20260709 13:15:34.356146 10031 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:34.386202  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:34.368938 10018 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:34.346895  9992 log.cc:927] Time spent T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
W20260709 13:15:34.350550 10002 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:15:34.014564  6936 rpcz_store.cc:276] 0709 13:15:32.965381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.965670 (+   289us) service_pool.cc:224] Handling call
0709 13:15:32.971688 (+  6018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:32.971907 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:33.518166 (+546259us) log.cc:844] Serialized 14 byte log entry
0709 13:15:33.992913 (+474747us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:33.992982 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:33.993048 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.993154 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:33.993304 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22306,"prepare.queue_time_us":844353,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":14013,"raft.queue_time_us":22431,"thread_start_us":919150,"threads_started":2}
I20260709 13:15:34.412976  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:34.411929  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 69970.8us
W20260709 13:15:34.362704  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.420692  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2606) took 1588 ms. Trace:
I20260709 13:15:34.421226  6329 rpcz_store.cc:276] 0709 13:15:32.832562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.868681 (+ 36119us) service_pool.cc:224] Handling call
0709 13:15:32.868987 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:32.876127 (+  7140us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:33.219691 (+343564us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.413986 (+1194295us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:34.414038 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:34.420454 (+  6416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.420519 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.420638 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":760718,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":60401,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":31377,"thread_start_us":1451087,"threads_started":3}
W20260709 13:15:34.429438 10011 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
W20260709 13:15:34.430305 10006 log.cc:927] Time spent T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:15:34.430030  9802 consensus_queue.cc:237] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:34.431059  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1551) took 1324 ms. Trace:
W20260709 13:15:34.432183 10030 log.cc:927] Time spent T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:15:34.432451  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 706) took 1336 ms. Trace:
I20260709 13:15:34.388094  9950 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:15:34.433799 10027 log.cc:927] Time spent T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:15:34.432812  6941 rpcz_store.cc:276] 0709 13:15:33.096371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.096500 (+   129us) service_pool.cc:224] Handling call
0709 13:15:33.096796 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:33.097212 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.097239 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:33.169600 (+ 72361us) log.cc:844] Serialized 26 byte log entry
0709 13:15:33.806654 (+637054us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:33.806707 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.806798 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.432259 (+625461us) raft_consensus.cc:1685] finished
0709 13:15:34.432279 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.432398 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3215,"raft.queue_time_us":988,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":69053,"thread_start_us":598449,"threads_started":1,"wal-append.queue_time_us":950748}
I20260709 13:15:34.395509  9675 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:34.439667  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 797) took 1393 ms. Trace:
I20260709 13:15:34.443060  6322 rpcz_store.cc:276] 0709 13:15:33.045844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.055701 (+  9857us) service_pool.cc:224] Handling call
0709 13:15:33.056082 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:33.077495 (+ 21413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.077532 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:33.183104 (+105572us) log.cc:844] Serialized 26 byte log entry
0709 13:15:33.743755 (+560651us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:33.743793 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.743868 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.439398 (+695530us) raft_consensus.cc:1685] finished
0709 13:15:34.439424 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.439596 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2736,"raft.queue_time_us":15984,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":494509,"threads_started":1,"wal-append.queue_time_us":697617}
I20260709 13:15:34.440357  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1552) took 1331 ms. Trace:
I20260709 13:15:34.431448  6247 rpcz_store.cc:276] 0709 13:15:33.106976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.107150 (+   174us) service_pool.cc:224] Handling call
0709 13:15:33.107475 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:33.107782 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.107807 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:33.108239 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:15:33.540865 (+432626us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:34.083005 (+542140us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.111049 (+ 28044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.111115 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.430817 (+319702us) raft_consensus.cc:1685] finished
0709 13:15:34.430840 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.430976 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18655,"prepare.queue_time_us":703704,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":210963,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":11136,"spinlock_wait_cycles":28928,"thread_start_us":905944,"threads_started":2,"wal-append.queue_time_us":833918}
I20260709 13:15:34.445062  6256 rpcz_store.cc:276] 0709 13:15:33.109301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.109423 (+   122us) service_pool.cc:224] Handling call
0709 13:15:33.109735 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:33.110094 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.110125 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:33.110576 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:15:33.514663 (+404087us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:33.514720 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.514866 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.440108 (+925242us) raft_consensus.cc:1685] finished
0709 13:15:34.440135 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.440280 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1417,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":69,"thread_start_us":403636,"threads_started":1,"wal-append.queue_time_us":820779}
I20260709 13:15:34.341336  9659 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:34.185392 10008 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:34.421983 10013 log.cc:927] Time spent T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
W20260709 13:15:34.448915 10026 log.cc:927] Time spent T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:15:34.330711 10014 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:34.425369 10018 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:34.433422  9950 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:34.472360  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:34.475437  6329 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:34.456866 10047 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:34.459071  9713 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:34.396437 10031 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:34.466629 10023 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:15:34.480345 10035 log.cc:927] Time spent T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:15:34.462715  9871 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:34.497097 10055 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:34.497666 10055 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:34.499747 10055 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:34.500205 10055 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:34.500372  9764 consensus_meta.cc:287] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.676s	user 0.005s	sys 0.003s
I20260709 13:15:34.491182  9713 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:34.502508  9726 consensus_meta.cc:287] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 1.617s	user 0.013s	sys 0.000s
I20260709 13:15:34.502854  9713 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:34.504060 10008 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:34.506068  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 801) took 1315 ms. Trace:
I20260709 13:15:34.506462  6328 rpcz_store.cc:276] 0709 13:15:33.190970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.817841 (+626871us) service_pool.cc:224] Handling call
0709 13:15:33.848661 (+ 30820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:33.881558 (+ 32897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.881605 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:33.882189 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:15:34.117107 (+234918us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:34.117168 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.117233 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.505870 (+388637us) raft_consensus.cc:1685] finished
0709 13:15:34.505889 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.506012 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32425,"raft.queue_time_us":43118,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":57395,"thread_start_us":154333,"threads_started":1,"wal-append.queue_time_us":375576}
W20260709 13:15:34.508122  9937 consensus_meta.cc:287] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.723s	user 0.006s	sys 0.003s
I20260709 13:15:34.508184  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.509519  9818 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:34.509886 10058 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:34.510111  9818 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:34.510426 10058 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:34.512269  9818 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:34.512472 10058 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:34.513074  6323 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:34.508924  6328 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:34.504825  9713 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:34.514211  9887 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:34.492033  9839 consensus_meta.cc:287] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.887s	user 0.015s	sys 0.000s
I20260709 13:15:34.514941  9839 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:34.516062  6326 raft_consensus.cc:1240] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:15:34.517449 10057 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:34.518366 10057 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:34.519729 10004 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.520s	user 0.000s	sys 0.001s
I20260709 13:15:34.520569 10057 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:34.522554 10031 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:34.522872  9882 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:34.523576  9882 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:34.502249  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.526881  6327 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:15:34.530134  9726 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:34.530679  9882 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:34.531239  9713 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:34.531373 10018 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:34.531800  9713 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:34.530707  9726 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:34.535790  9713 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:34.536518  9726 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:34.500648 10055 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:34.538003  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.538655  6328 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:34.539155 10055 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:34.539590  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.540306  6328 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:34.541064  9839 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:34.541285  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.528342  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:34.543118  6327 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:34.534103  9773 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:34.550271  6328 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:34.547821  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.552484  6323 raft_consensus.cc:2393] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:34.548664  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:34.500860  9764 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:34.555727  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.554020  6331 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:15:34.553079  6329 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:34.554446  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:34.569859  6325 raft_consensus.cc:2410] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:15:34.500449  9546 consensus_meta.cc:287] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.000s
I20260709 13:15:34.577039  6327 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:15:34.560448  9367 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.580591  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:34.581444 10029 log.cc:927] Time spent T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:15:34.581725  9764 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:34.582127 10042 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.580663  9367 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:34.582054  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:34.583709  9950 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:34.584185  6941 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:34.492898 10047 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:34.582768 10042 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:34.581403  6325 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:34.587608  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.589164  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 798) took 1543 ms. Trace:
I20260709 13:15:34.589775  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:34.550530  9694 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.591607  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:34.592852  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.572299  9793 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.600322  9793 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:34.601682  6906 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:34.593823  6324 rpcz_store.cc:276] 0709 13:15:33.046097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.081462 (+ 35365us) service_pool.cc:224] Handling call
0709 13:15:33.099780 (+ 18318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.196549 (+ 96769us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:33.782256 (+585707us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.588458 (+806202us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.588763 (+   305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:34.588819 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:34.588884 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.588950 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.589083 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":488209,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":86356,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":18207,"spinlock_wait_cycles":4862208,"thread_start_us":1308086,"threads_started":3,"wal-append.queue_time_us":483414}
I20260709 13:15:34.597700  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:34.563156 10058 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:34.599458  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.605777  6327 raft_consensus.cc:2410] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:15:34.606700  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.607615  6325 raft_consensus.cc:2410] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:34.609007  6906 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:34.611138  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:34.611261  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.613269  6906 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:34.632965  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.634094  6328 raft_consensus.cc:2410] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:34.635602  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.636569  6325 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:34.673419  6397 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:15:34.612421  9950 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:34.649278  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.641258  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.675307  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 683) took 1763 ms. Trace:
I20260709 13:15:34.801487  6401 rpcz_store.cc:276] 0709 13:15:32.912144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.912603 (+   459us) service_pool.cc:224] Handling call
0709 13:15:32.912937 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:32.969232 (+ 56295us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:32.969278 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:32.970015 (+   737us) log.cc:844] Serialized 26 byte log entry
0709 13:15:34.089401 (+1119386us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:34.089456 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.089544 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.675097 (+585553us) raft_consensus.cc:1685] finished
0709 13:15:34.675118 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.675250 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55775,"raft.queue_time_us":56961,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":65749,"thread_start_us":1030451,"threads_started":1,"wal-append.queue_time_us":1483488}
I20260709 13:15:34.805598  6325 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:34.829758 10042 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:34.839447  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.854468  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1422) took 1179 ms. Trace:
I20260709 13:15:34.854971  6330 rpcz_store.cc:276] 0709 13:15:33.675599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.839127 (+1163528us) service_pool.cc:224] Handling call
0709 13:15:34.854382 (+ 15255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:34.856166  6941 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
W20260709 13:15:34.861542  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 395985us
I20260709 13:15:34.627991  9694 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:34.863839  6221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.011s	sys 0.025s
W20260709 13:15:34.866407  6221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.011s	sys 0.025s
I20260709 13:15:34.670706  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.590098  9546 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:34.631698  9798 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:34.672868 10027 log.cc:927] Time spent T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:15:34.687156  6297 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:34.784988  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.810654 10055 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:15:34.852958  9982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.018s	sys 0.026s
I20260709 13:15:34.847038  9793 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:34.679334  9818 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.187s
W20260709 13:15:34.893486  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:34.936206  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:34.937053  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.894022  6327 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:34.895569  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2607) took 1710 ms. Trace:
W20260709 13:15:34.898434  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 211380us
I20260709 13:15:34.940122  6297 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:34.900781  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:34.941495  6942 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:34.943581  6297 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:34.911768  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 804) took 1388 ms. Trace:
I20260709 13:15:34.944690  6322 rpcz_store.cc:276] 0709 13:15:33.523224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.865419 (+1342195us) service_pool.cc:224] Handling call
0709 13:15:34.911164 (+ 45745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.911373 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.911408 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:34.911460 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:34.911503 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.911570 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.911700 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:34.635010 10058 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:34.938354  6326 rpcz_store.cc:276] 0709 13:15:33.184824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.556591 (+371767us) service_pool.cc:224] Handling call
0709 13:15:33.621805 (+ 65214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.516457 (+894652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.895307 (+378850us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b5400167bd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:34.895509 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2056091520}
I20260709 13:15:34.989172  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:34.984546  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:34.895493  9882 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.993408  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 805) took 1469 ms. Trace:
I20260709 13:15:34.994939  6330 rpcz_store.cc:276] 0709 13:15:33.523497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.878458 (+1354961us) service_pool.cc:224] Handling call
0709 13:15:34.949319 (+ 70861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.992895 (+ 43576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.992936 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:34.993010 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:34.993060 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.993184 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.993332 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:34.989950  6938 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:15:35.005999  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:34.892303 10042 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:35.012980  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:34.929422  9982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.019s	sys 0.026s
I20260709 13:15:34.623824  9871 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.266s
I20260709 13:15:35.022634  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2317) took 1133 ms. Trace:
I20260709 13:15:35.030954  6253 rpcz_store.cc:276] 0709 13:15:33.888909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.889055 (+   146us) service_pool.cc:224] Handling call
0709 13:15:33.928995 (+ 39940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.190024 (+261029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.190070 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.190653 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:15:34.399856 (+209203us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:34.399897 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.399966 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:35.022402 (+622436us) raft_consensus.cc:1685] finished
0709 13:15:35.022432 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.022570 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17240,"raft.queue_time_us":228367,"spinlock_wait_cycles":16203648,"thread_start_us":356897,"threads_started":2,"wal-append.queue_time_us":728861}
I20260709 13:15:35.029816  6328 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 4.
W20260709 13:15:35.026655 10039 log.cc:927] Time spent T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:15:35.005700 10057 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:35.027640 10047 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:35.028847 10010 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:34.982211  9668 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:35.039433  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 673086us
I20260709 13:15:35.010040  9798 raft_consensus.cc:697] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:35.040225  6222 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:35.039619  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:35.034174  6405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.025s	sys 0.082s
I20260709 13:15:35.002421  9793 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:15:35.040982  6405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.025s	sys 0.082s
W20260709 13:15:35.042025  6295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.011s	sys 0.032s
W20260709 13:15:35.044697  6295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.011s	sys 0.032s
W20260709 13:15:35.042284  6402 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.022s	sys 0.041s
W20260709 13:15:35.048616  6402 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.022s	sys 0.041s
W20260709 13:15:35.048964  6368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.017s	sys 0.033s
W20260709 13:15:35.049291  6368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.017s	sys 0.033s
I20260709 13:15:34.986701 10055 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.062376  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:35.033097 10012 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.062260  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:35.004007  9792 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.025004 10014 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:35.040742  9659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.019s	sys 0.027s
I20260709 13:15:35.014175  9882 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:35.104976  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 64816.4us
I20260709 13:15:35.029493 10042 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:35.126948  6370 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.016s	sys 0.047s
W20260709 13:15:35.127290  6370 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.016s	sys 0.047s
W20260709 13:15:35.108374  9659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.019s	sys 0.028s
I20260709 13:15:35.127851  6400 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:35.111243  6322 pending_rounds.cc:85] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 6
I20260709 13:15:35.108489  9535 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:35.072194  9675 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:35.129150  6322 pending_rounds.cc:107] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:15:35.131920  6322 raft_consensus.cc:2889] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:35.135368  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.136099  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.128295 10042 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:35.039534 10057 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.042898  9668 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:35.145036  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.126467  9818 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.176004  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.076581  9793 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.179912  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.179600 10036 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.115509 10044 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:15:35.186404  9546 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:35.186370 10036 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:35.188163  6329 consensus_meta.cc:287] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.000s
I20260709 13:15:35.188565  6329 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
W20260709 13:15:35.193698  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 80506.1us
I20260709 13:15:35.194532  6329 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 7 index: 9. (term mismatch)
I20260709 13:15:35.194916  6329 pending_rounds.cc:85] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 8
I20260709 13:15:35.195183  6329 pending_rounds.cc:107] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:15:35.195403  6329 raft_consensus.cc:2889] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:35.177668 10034 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.175721 10014 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:35.207793  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 807) took 1656 ms. Trace:
W20260709 13:15:35.201953  9802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.036s	sys 0.086s
W20260709 13:15:35.202934  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.208324  6329 rpcz_store.cc:276] 0709 13:15:33.543981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.192084 (+1648103us) service_pool.cc:224] Handling call
0709 13:15:35.192441 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.200229 (+  7788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.200438 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:35.125747 10012 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:35.114694  9792 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.187469  9818 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.188776  9798 consensus_queue.cc:237] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.140750  9675 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.204965 10034 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.216398  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.217561  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:35.218509 10033 log.cc:927] Time spent T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.906s	user 0.002s	sys 0.000s
I20260709 13:15:35.220021  9668 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:35.195434  9700 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:35.198498  9696 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:15:35.208060  9694 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:35.221872  6327 raft_consensus.cc:1240] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:35.240973  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1430) took 1300 ms. Trace:
I20260709 13:15:35.241425  6327 rpcz_store.cc:276] 0709 13:15:33.940700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.221374 (+1280674us) service_pool.cc:224] Handling call
0709 13:15:35.221673 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.240673 (+ 19000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.240905 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:35.221946 10060 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:15:35.221819 10049 log.cc:927] Time spent T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:15:35.223693  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.223694 10057 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:35.225579  6329 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:35.247390  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1425) took 1453 ms. Trace:
I20260709 13:15:35.247443  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.247875  6329 rpcz_store.cc:276] 0709 13:15:33.793847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.210880 (+1417033us) service_pool.cc:224] Handling call
0709 13:15:35.225380 (+ 14500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.247114 (+ 21734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.247330 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:35.248301  6253 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:35.225730  9882 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:35.225848  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.250722  6248 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:35.226174  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.251149  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:35.227252  9802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.036s	sys 0.086s
I20260709 13:15:35.227471  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.252732  6254 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:35.229436  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.231027 10036 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:35.231630 10058 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:35.232616  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.209713 10014 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:35.235304  6247 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:35.232093  9367 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:35.243880  6222 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:35.251765  6327 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:35.253672  6255 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:15:35.256266  6250 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:35.259558  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:35.260584  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 256931us
I20260709 13:15:35.261565  6222 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:35.252557 10060 raft_consensus.cc:697] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:35.264223  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:35.264245  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:35.264986  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:35.268996  6329 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:35.263898  6905 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:35.276178  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.279443  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.282075  6371 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:35.286253  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:35.343600  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 75314.7us
I20260709 13:15:35.263064  9802 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:35.270044 10032 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:35.345278  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:35.359459  6327 raft_consensus.cc:2410] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:15:35.270243 10036 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:35.344498  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:35.369964 10061 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:15:35.373665  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:35.374032  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:35.373624  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:35.280432  9871 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:35.285830  9855 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.378369  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:35.352833  6371 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:35.371594  6248 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:35.374312  6942 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:35.377192  9818 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:35.377337 10067 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:15:35.377454  9802 raft_consensus.cc:697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:35.577549  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:35.578425  6327 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:33.849211  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:35.408263  6247 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:15:35.581326  6247 pending_rounds.cc:85] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 5
I20260709 13:15:35.507230  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:35.581804  6401 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.003s	sys 0.017s
W20260709 13:15:35.587108  6401 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.004s	sys 0.017s
I20260709 13:15:35.587044  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:35.583901  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 231127us
I20260709 13:15:35.584190  6906 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:35.407510  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 355774us
I20260709 13:15:35.581696  6247 pending_rounds.cc:107] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:15:35.591172  6247 raft_consensus.cc:2889] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:35.597757  6368 leader_election.cc:336] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.988s (SENT)
I20260709 13:15:35.597975  6369 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:35.598452  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.600960  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:35.602837  6331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2597) took 2717 ms (client timeout 1951 ms). Trace:
I20260709 13:15:35.594307  6906 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:35.608065  6906 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:35.609078  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
W20260709 13:15:35.613190  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:35.613735  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:35.511169 10074 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:15:35.615367  6368 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:35.616724  6295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.009s	sys 0.010s
W20260709 13:15:35.603441  6331 rpcz_store.cc:269] 0709 13:15:32.830191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.833218 (+  3027us) service_pool.cc:224] Handling call
0709 13:15:35.547516 (+2714298us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400393fd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:35.547651 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3044073728}
I20260709 13:15:35.393546  9983 raft_consensus.cc:3055] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:35.370254 10034 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:35.365505  9805 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:35.375511  9978 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:35.629199  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:35.666033  6324 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
W20260709 13:15:35.630247  6295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.011s	sys 0.010s
I20260709 13:15:35.530093 10055 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:35.418399  9793 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:35.529153  9367 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.395287  9839 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.646730  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:35.683905  6331 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:35.533702 10012 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:35.576056  9781 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:35.466563  9659 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:35.649776  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.693671  6254 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:35.546150 10068 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.660153  9805 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:35.730619  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 803) took 2207 ms. Trace:
I20260709 13:15:35.731045  6323 rpcz_store.cc:276] 0709 13:15:33.522920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.829020 (+1306100us) service_pool.cc:224] Handling call
0709 13:15:34.829392 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.845664 (+ 16272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.845693 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.858103 (+ 12410us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.138232 (+280129us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:35.138287 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.138383 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:35.730403 (+592020us) raft_consensus.cc:1685] finished
0709 13:15:35.730422 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.730564 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15890,"raft.queue_time_us":28641,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":8561,"thread_start_us":241971,"threads_started":1,"wal-append.queue_time_us":421832}
I20260709 13:15:35.678263  9792 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:35.370700  9887 consensus_queue.cc:1059] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.253s
I20260709 13:15:35.732928  9773 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:35.733060  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:35.733736  9887 raft_consensus.cc:3055] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:35.734216  9887 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:35.730662  9805 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:35.735059  9887 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.735214  9781 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.736282  9887 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:35.737589  9781 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:35.603156  9871 raft_consensus.cc:697] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:35.738677 10073 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:35.738639  9871 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.739217 10073 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:35.739609 10076 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:35.636587  9950 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:35.398330  9855 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:35.672809  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.672809  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.743956  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.677913  9882 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:35.636819 10014 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:35.624233 10063 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:35.747726 10063 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:35.748863  9855 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:35.751897 10063 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:35.393680  9724 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.408s
I20260709 13:15:35.653328  9779 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:35.655086  9983 raft_consensus.cc:740] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:35.698046  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:35.583128  9959 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:35.690397  9367 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:35.512039 10060 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.717701  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.718421 10068 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.718947  6295 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:15:35.825357  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 106493us
I20260709 13:15:35.827759  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:35.719981 10034 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:35.828536  9694 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:35.828995  9694 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.829411  9694 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:35.828863 10034 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.678241  9793 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:35.821785  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:35.695036  9839 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:35.683012  9978 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:35.671097 10058 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:35.728349  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:35.727852  9802 consensus_queue.cc:237] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.728860 10055 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.729058  9659 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.605288 10057 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:35.740080 10076 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.733738  6323 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:35.739656 10073 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:35.734673 10049 log.cc:927] Time spent T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:35.852818  9793 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:15:35.753677  6907 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.023s	sys 0.027s
I20260709 13:15:35.755087  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:35.872730  6907 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.023s	sys 0.027s
I20260709 13:15:35.853391 10034 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:35.818907  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:35.763401  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:35.823984  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:35.877257  6933 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:35.851452  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:35.832710  6247 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:35.832966  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:35.861048  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:35.820019  9855 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:35.850517  9714 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:35.870103  6249 raft_consensus.cc:2410] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:35.870354  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:35.872923  6938 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:35.756552  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:35.886054  6331 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
W20260709 13:15:35.873092  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 868180us
I20260709 13:15:35.873680  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:35.879905  6324 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:35.880908  6936 raft_consensus.cc:2393] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:35.866277 10057 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:35.885756  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 287828us
I20260709 13:15:35.854226  9700 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:15:35.897105  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:35.874261  9675 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:35.870995 10076 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:35.875449  9793 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:35.939025  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:35.935300  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:35.861732 10058 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:35.937479  6296 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.515s (SENT) [suppressed 27 similar messages]
I20260709 13:15:35.952023  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:35.951124  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 353355us
I20260709 13:15:35.891126  6369 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:35.890228  9714 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:35.956342  6368 leader_election.cc:336] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.992s (SENT)
I20260709 13:15:35.957304  6368 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:35.949296  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 340308us
I20260709 13:15:35.865960 10055 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.892882 10057 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:35.965242  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:35.834108  9959 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:35.966542  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 75470.2us
I20260709 13:15:35.892446  9805 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:35.959086  9714 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:35.971688  9882 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:35.898486  9855 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:35.883951  9983 consensus_queue.cc:260] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:35.969012  9675 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:35.970924  6369 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:35.991710  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:36.004190  6368 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:36.018533  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:36.053153  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 56855.4us
W20260709 13:15:36.105072  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 86896.4us
I20260709 13:15:36.000851  9675 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.122771  9675 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.125694 10068 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:36.010607  9908 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:36.121654  9839 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:36.106045  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:36.134688  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 197222us
I20260709 13:15:36.135082  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:36.131599  6403 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:36.152716  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:36.135497  9908 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:36.162144  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 176798us
I20260709 13:15:36.173903  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:36.177551 10106 log.cc:927] Time spent T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:15:36.177832 10090 log.cc:927] Time spent T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
W20260709 13:15:36.179278 10086 log.cc:927] Time spent T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:15:36.179527  6368 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:15:36.180857 10092 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:15:36.180985  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 806) took 2657 ms. Trace:
I20260709 13:15:36.181394  6322 rpcz_store.cc:276] 0709 13:15:33.523774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.048584 (+1524810us) service_pool.cc:224] Handling call
0709 13:15:35.110978 (+ 62394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:35.138968 (+ 27990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.139012 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:35.139649 (+   637us) log.cc:844] Serialized 52 byte log entry
0709 13:15:35.651268 (+511619us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:35.651321 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.652244 (+   923us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.180765 (+528521us) raft_consensus.cc:1685] finished
0709 13:15:36.180782 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.180927 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48289,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":459051,"threads_started":1,"wal-append.queue_time_us":690793}
I20260709 13:15:36.139621 10097 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:36.144976 10014 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:36.149456 10022 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:36.171690  9908 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.196295  6933 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:15:36.205078  9694 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.206303  6323 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 10: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:36.207957  9694 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:36.212440 10111 log.cc:927] Time spent T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:15:36.220635 10104 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:15:36.220866 10102 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:15:36.225494  9793 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.227831  9793 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:36.233503 10058 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:36.236168  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:36.242478  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2609) took 1928 ms. Trace:
I20260709 13:15:36.242931  6331 rpcz_store.cc:276] 0709 13:15:34.314592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.955754 (+1641162us) service_pool.cc:224] Handling call
0709 13:15:35.956141 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:35.956488 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.956512 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:35.959436 (+  2924us) log.cc:844] Serialized 26 byte log entry
0709 13:15:36.187711 (+228275us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:36.187759 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.187826 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.222846 (+ 35020us) raft_consensus.cc:1685] finished
0709 13:15:36.222877 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.242421 (+ 19544us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2705,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":6366,"thread_start_us":204329,"threads_started":1,"wal-append.queue_time_us":243857}
I20260709 13:15:36.219805 10063 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:36.193166 10014 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.249712  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.250716  6396 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 4.
I20260709 13:15:36.251809  6331 raft_consensus.cc:1240] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:36.252633  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2613) took 1937 ms. Trace:
I20260709 13:15:36.254025  6907 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:36.244305  9978 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:36.253031  6331 rpcz_store.cc:276] 0709 13:15:34.315506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.244533 (+1929027us) service_pool.cc:224] Handling call
0709 13:15:36.251550 (+  7017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.252328 (+   778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.252568 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.246097  9959 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:36.196673 10022 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:36.259567 10098 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:36.262095 10087 log.cc:927] Time spent T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
W20260709 13:15:36.274264  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.266155  9714 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.269014  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2612) took 1953 ms. Trace:
I20260709 13:15:36.248664 10063 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:36.248821 10055 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:36.270766  9675 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.275673  6322 rpcz_store.cc:276] 0709 13:15:34.315287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.188893 (+1873606us) service_pool.cc:224] Handling call
0709 13:15:36.203207 (+ 14314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.204267 (+  1060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.204293 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:36.204720 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:15:36.217958 (+ 13238us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:36.218005 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.218084 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.268764 (+ 50680us) raft_consensus.cc:1685] finished
0709 13:15:36.268792 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.268943 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1126,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":12863,"threads_started":1,"wal-append.queue_time_us":13261}
W20260709 13:15:36.281327  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 101917us
I20260709 13:15:36.282105  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:36.274734 10098 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:36.279703 10063 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.284775  6331 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:15:36.285218  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1426) took 2477 ms. Trace:
I20260709 13:15:36.285574  6328 rpcz_store.cc:276] 0709 13:15:33.807657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.218723 (+1411066us) service_pool.cc:224] Handling call
0709 13:15:35.219047 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:35.219376 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.219403 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:35.219876 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.659356 (+439480us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:35.660044 (+   688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.660257 (+   213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.285004 (+624747us) raft_consensus.cc:1685] finished
0709 13:15:36.285028 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.285162 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3041,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":104,"thread_start_us":436980,"threads_started":1,"wal-append.queue_time_us":655516}
W20260709 13:15:36.286896 10110 log.cc:927] Time spent T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:15:36.288303 10098 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:36.288166  9908 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:36.290517  9887 consensus_meta.cc:287] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.000s
I20260709 13:15:36.293259  6368 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:36.292750  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:36.306425  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:36.305254  9770 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:36.309324  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:36.308835  6154 catalog_manager.cc:5697] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:36.309969  6327 raft_consensus.cc:2376] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11. Re-sending same reply.
I20260709 13:15:36.292418 10054 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:36.310297  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:36.310568  6154 catalog_manager.cc:5697] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 6, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 6 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:36.315008  9675 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:36.313302 10073 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.319242 10073 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:36.319836  6940 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:36.319962  9659 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:36.320400  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:36.312793  6368 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:36.322574  9675 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:36.322688 10076 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.323514  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:36.332757  6941 raft_consensus.cc:2368] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9.
I20260709 13:15:36.339375  6326 pending_rounds.cc:85] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 3
I20260709 13:15:36.339715  6326 pending_rounds.cc:107] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:15:36.339967  6326 raft_consensus.cc:2889] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:36.340719 10077 log.cc:927] Time spent T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.680s	user 0.000s	sys 0.004s
I20260709 13:15:36.342231  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 802) took 3025 ms. Trace:
I20260709 13:15:36.342744  6325 rpcz_store.cc:276] 0709 13:15:33.317008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.829678 (+1512670us) service_pool.cc:224] Handling call
0709 13:15:34.829996 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.867125 (+ 37129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.867157 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.893155 (+ 25998us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.193814 (+300659us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:35.193872 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.194023 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.340197 (+1146174us) spinlock_profiling.cc:243] Waited 47.3 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:36.341900 (+  1703us) raft_consensus.cc:1685] finished
0709 13:15:36.341922 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.342163 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15861,"raft.queue_time_us":31452,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":2831,"spinlock_wait_cycles":108777728,"thread_start_us":163107,"threads_started":1,"wal-append.queue_time_us":536193}
I20260709 13:15:36.332899  6324 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:15:36.345641  9886 consensus_queue.cc:1059] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:36.328472  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 811) took 2010 ms. Trace:
I20260709 13:15:36.346809  6327 rpcz_store.cc:276] 0709 13:15:34.317864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.311386 (+1993522us) service_pool.cc:224] Handling call
0709 13:15:36.327878 (+ 16492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.328066 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.328104 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.328159 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:36.328208 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.328275 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.328406 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.348121  6324 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:36.350106  9714 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:36.351152 10014 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:36.352473 10066 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.692s	user 0.001s	sys 0.003s
I20260709 13:15:36.330998  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1449) took 1934 ms. Trace:
I20260709 13:15:36.345789  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:36.355306  6328 rpcz_store.cc:276] 0709 13:15:34.397221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.311846 (+1914625us) service_pool.cc:224] Handling call
0709 13:15:36.330510 (+ 18664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.330682 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.330708 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.330748 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:36.330788 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.330838 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.330938 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.355836  6219 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:36.354198  6371 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:36.354799  9886 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:36.357179  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:36.352797  6905 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:36.358966  6905 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:36.362989  6324 raft_consensus.cc:1275] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:36.323925  6368 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:36.366433  6368 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:36.368342  6368 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:36.372473  6905 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:36.383011  6371 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:36.384801 10125 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:36.338474 10063 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:36.386863  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:36.385293 10125 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.313944 10054 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:36.361505 10034 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:36.411887 10115 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:36.378055 10073 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:36.382859  9793 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:36.362641  9805 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:36.379840  9972 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:36.312070 10057 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.387888  9693 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:36.382371  9770 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:36.382498  9882 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:36.381747  9792 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:15:36.424961  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:36.416865 10054 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:36.417342 10034 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:36.420224 10076 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:36.395390 10125 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.427296  6368 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:36.443418  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:36.430323  6222 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:36.451362  6403 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:36.408488  9886 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.430786 10022 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:36.454017  6368 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:36.386595 10098 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.439245  9693 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.462800  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:36.463424  6938 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
I20260709 13:15:36.443177  9770 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:36.443032  9882 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:36.450488 10034 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:36.510427  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 154664us
I20260709 13:15:36.457643 10097 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:36.511528  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:36.458681  9805 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:36.464756  9693 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:36.497699  9770 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:36.499508  9882 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:36.521248  9805 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.525722  9805 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.531031 10063 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:36.556547  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:36.557268  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2611) took 2242 ms. Trace:
I20260709 13:15:36.557617  6330 rpcz_store.cc:276] 0709 13:15:34.315072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.158599 (+1843527us) service_pool.cc:224] Handling call
0709 13:15:36.173399 (+ 14800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.183590 (+ 10191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.183633 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:36.193537 (+  9904us) log.cc:844] Serialized 26 byte log entry
0709 13:15:36.395728 (+202191us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:36.395768 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.395832 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.557030 (+161198us) raft_consensus.cc:1685] finished
0709 13:15:36.557053 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.557211 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":365,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2737,"thread_start_us":186175,"threads_started":1,"wal-append.queue_time_us":255663}
W20260709 13:15:36.536069  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 82169.8us
I20260709 13:15:36.526455 10069 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:36.511649  9972 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:36.565055 10128 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:36.542996  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 695) took 1525 ms. Trace:
I20260709 13:15:36.544106 10094 consensus_queue.cc:1059] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.158s
I20260709 13:15:36.554327 10057 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:36.555480  9886 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:36.559463  6368 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:15:36.560122  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 129905us
I20260709 13:15:36.569621 10094 raft_consensus.cc:3055] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:36.569978 10094 raft_consensus.cc:740] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:36.570746 10094 consensus_queue.cc:260] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.567054  6397 rpcz_store.cc:276] 0709 13:15:35.016036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.016203 (+   167us) service_pool.cc:224] Handling call
0709 13:15:35.016692 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.190686 (+173994us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:35.636966 (+446280us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.972036 (+335070us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:35.972092 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:35.972141 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.540926 (+568785us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54003755d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:36.540970 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.541077 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":526658,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":144,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":399473536,"thread_start_us":767475,"threads_started":2,"wal-append.queue_time_us":579414}
I20260709 13:15:36.572227  6222 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
W20260709 13:15:36.539430 10114 log.cc:927] Time spent T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:15:36.574832  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:36.577322  6368 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:36.586479  9972 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:36.587072  6936 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:15:36.563357 10097 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.587831 10097 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.589828  6396 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:36.574839 10124 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:36.635151 10098 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:36.578652 10128 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:36.639052 10128 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:36.639509 10128 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:36.582861 10063 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:36.593425 10124 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:36.669188  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 157746us
I20260709 13:15:36.694636  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 815) took 1336 ms. Trace:
I20260709 13:15:36.685844 10124 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:36.699816  6322 rpcz_store.cc:276] 0709 13:15:35.358490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.327033 (+968543us) service_pool.cc:224] Handling call
0709 13:15:36.327282 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.327439 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:36.433687 (+106248us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.694279 (+260592us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.694332 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:36.694390 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.694452 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.694580 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":120381,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":1645,"thread_start_us":362739,"threads_started":2}
I20260709 13:15:36.668322 10063 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:36.640899  9982 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:15:36.709444 10063 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:36.725411  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 148192us
I20260709 13:15:36.726344  6368 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:36.725201  6219 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:36.733718  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:36.734544  6397 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:36.742301  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 324439us
I20260709 13:15:36.750778  6397 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:36.754566  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:36.756032 10115 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:36.762185  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:36.762662  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 757) took 1008 ms. Trace:
I20260709 13:15:36.763031  6941 rpcz_store.cc:276] 0709 13:15:35.754253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.754691 (+   438us) service_pool.cc:224] Handling call
0709 13:15:36.762456 (+1007765us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54004803d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:36.762585 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048105216}
I20260709 13:15:36.765585  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:36.766144  6942 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:36.794302  9818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.111s	user 0.019s	sys 0.017s
W20260709 13:15:36.816152  9818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.020s	sys 0.017s
W20260709 13:15:36.821465  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 71712.9us
I20260709 13:15:36.822144  9693 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.823014  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.823558  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:36.823832  6403 raft_consensus.cc:2410] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:15:36.824245  6400 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:36.825249  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:36.825471  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.825980  6399 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:36.826318  6398 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:36.827301  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.827946  6405 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:36.835614  6399 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:36.820878  6942 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:15:36.788300 10073 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.845433  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.847488  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.848472  6399 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:36.849081  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.849859  6404 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:36.855365  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:36.837253  9675 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:36.862766  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.863821  6397 raft_consensus.cc:2393] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:36.848477 10131 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:36.855067  9693 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:36.855937 10097 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:36.872476  6402 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:36.873188  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 148112us
I20260709 13:15:36.874701  6397 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:36.851361 10073 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.875607  6219 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:36.867175 10131 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.893261  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.894132  6397 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:36.881275 10131 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.898046 10128 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.898903 10073 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:36.900192 10128 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:36.899917 10034 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.902591 10034 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:36.904305 10131 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:36.913637 10069 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:36.916116 10131 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:36.918123 10128 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:36.918676 10128 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.919116 10128 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:36.924374  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:36.924625  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.924997  6400 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.925429  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:36.926035  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.926129  6404 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:36.926887  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:36.929469 10131 consensus_queue.cc:1059] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:36.929741  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.930510  6405 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:36.931699  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.932452  6398 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:15:36.934366  6404 raft_consensus.cc:2410] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:36.934600  6400 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:36.935930  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.952522  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:36.953404  6398 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:15:36.976608  6399 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:37.002210 10063 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:36.969794 10125 consensus_meta.cc:287] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.010s
W20260709 13:15:37.049154  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 158126us
I20260709 13:15:36.938727  9805 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:37.052263  6222 leader_election.cc:400] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9.
I20260709 13:15:37.052253  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.052716  6222 leader_election.cc:403] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:36.908802  9882 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:36.939057  9770 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.004985 10063 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:37.049875 10140 raft_consensus.cc:3055] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:37.050858  9950 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:37.055912 10137 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:37.116284  6403 raft_consensus.cc:2393] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 5: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:37.114662  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.049345 10125 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:37.128888  6398 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 11: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:15:37.116564 10054 consensus_meta.cc:287] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.666s	user 0.005s	sys 0.016s
I20260709 13:15:37.137508  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.138295  6399 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:37.091840 10128 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:37.083992 10124 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.114238 10140 raft_consensus.cc:740] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:37.150298  9882 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:37.151676  9770 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:37.152873  6399 raft_consensus.cc:1240] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:37.155795  6906 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:37.158550 10132 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:37.159063 10132 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.160245  9367 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:37.161314 10098 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:37.162460  6151 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55326 (request call id 376) took 14107 ms (client timeout 15000 ms). Trace:
I20260709 13:15:37.166432  6154 catalog_manager.cc:5697] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 3 to 7, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 7 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:37.168560  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2620) took 1805 ms. Trace:
I20260709 13:15:37.129878 10137 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.168911  6325 rpcz_store.cc:276] 0709 13:15:35.363047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.344504 (+981457us) service_pool.cc:224] Handling call
0709 13:15:36.344850 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.357597 (+ 12747us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:36.896812 (+539215us) log.cc:844] Serialized 14 byte log entry
0709 13:15:37.084871 (+188059us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.094505 (+  9634us) log.cc:844] Serialized 26 byte log entry
0709 13:15:37.094864 (+   359us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:37.095329 (+   465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.095430 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:37.168336 (+ 72906us) raft_consensus.cc:1685] finished
0709 13:15:37.168355 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.168499 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155956,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":19319,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":16677,"thread_start_us":666919,"threads_started":2,"wal-append.queue_time_us":269694}
I20260709 13:15:37.171012 10137 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:37.171454  6399 raft_consensus.cc:1240] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:37.171689 10141 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:37.172224 10141 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.173653  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.174286 10141 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:37.174998 10064 consensus_queue.cc:1059] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:15:37.131765 10107 log.cc:927] Time spent T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.902s	user 0.003s	sys 0.000s
I20260709 13:15:37.149931 10140 consensus_queue.cc:260] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:37.179250  6906 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:37.168258  6154 catalog_manager.cc:5697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 5 to 4, term changed from 6 to 7, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from VOTER to NON_VOTER, now has a pending config: VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1), VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2), VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3), VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 7 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:37.214268 10128 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:37.215278  9983 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:37.215886 10138 raft_consensus.cc:3055] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:37.216367 10138 raft_consensus.cc:740] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:37.217280 10138 consensus_queue.cc:260] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:37.217718  6154 catalog_manager.cc:5697] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:37.145759 10054 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.219588  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 810) took 2902 ms. Trace:
I20260709 13:15:37.221120 10054 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:37.221408  6401 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:37.222496  9805 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:37.223310  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:37.147492 10146 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:37.224520 10146 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.227219 10125 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:37.228111 10140 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:37.182008 10036 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:15:37.120836  9950 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.220075  6331 rpcz_store.cc:276] 0709 13:15:34.317620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.258783 (+1941163us) service_pool.cc:224] Handling call
0709 13:15:36.269862 (+ 11079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.285553 (+ 15691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.219245 (+933692us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5400293bd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:37.219511 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32700160}
I20260709 13:15:37.294214  9950 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:37.294939 10146 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:37.220541  6154 catalog_manager.cc:5697] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 4 to 6, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 6 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:37.296208  6154 catalog_manager.cc:5697] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 7, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 7 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:37.233644  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:37.289600  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 132543us
I20260709 13:15:37.266563  9818 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:37.161037 10132 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:37.298511  9818 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.298987  9818 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:37.234035  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:37.297524  6154 catalog_manager.cc:5697] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 1 to 4, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 4 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:37.162849  6151 rpcz_store.cc:269] 0709 13:15:23.144990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.145176 (+   186us) service_pool.cc:224] Handling call
0709 13:15:37.162246 (+14017070us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:28.997373 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:29.038614 (+ 41241us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:29.038665 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:15:29.038686 (+    21us) tablet.cc:662] Decoding operations
0709 13:15:29.056208 (+ 17522us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:29.056315 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:29.056354 (+    39us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:15:29.063293 (+  6939us) tablet.cc:701] Row locks acquired
0709 13:15:29.063343 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:15:29.063518 (+   175us) write_op.cc:270] Start()
0709 13:15:29.063666 (+   148us) write_op.cc:276] Timestamp: P: 1783602929063450 usec, L: 0
0709 13:15:29.063695 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:15:29.069481 (+  5786us) log.cc:844] Serialized 10924 byte log entry
0709 13:15:29.871422 (+801941us) op_driver.cc:464] REPLICATION: finished
0709 13:15:30.337294 (+465872us) write_op.cc:301] APPLY: starting
0709 13:15:30.337406 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:30.337963 (+   557us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:30.397250 (+ 59287us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:30.920565 (+523315us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:31.110999 (+190434us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 13:15:31.118592 (+  7593us) write_op.cc:312] APPLY: finished
0709 13:15:31.136850 (+ 18258us) log.cc:844] Serialized 188 byte log entry
0709 13:15:31.278023 (+141173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:31.278525 (+   502us) write_op.cc:454] Released schema lock
0709 13:15:31.278689 (+   164us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:31.279535 (+   846us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:31.279575 (+    40us) write_op.cc:454] Released schema lock
0709 13:15:31.892530 (+612955us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b18002af880. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
Metrics: {"mutex_wait_us":38401,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":439671,"apply.run_cpu_time_us":21898,"apply.run_wall_time_us":942134,"num_ops":28,"prepare.queue_time_us":163391,"prepare.run_cpu_time_us":15563,"prepare.run_wall_time_us":185770,"raft.queue_time_us":465563,"raft.run_cpu_time_us":10153,"raft.run_wall_time_us":389849,"replication_time_us":807567,"spinlock_wait_cycles":228277632,"thread_start_us":859155,"threads_started":5,"wal-append.queue_time_us":323776,"wal-append.run_cpu_time_us":31987,"wal-append.run_wall_time_us":2462790}]]}
I20260709 13:15:37.307571  6402 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:37.309343  6154 catalog_manager.cc:5697] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 3 to 5, term changed from 3 to 6, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:37.315407  6398 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:15:37.315799  6398 pending_rounds.cc:85] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 6
I20260709 13:15:37.316031  6398 pending_rounds.cc:107] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:15:37.316263  6398 raft_consensus.cc:2889] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:37.231607  9908 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:37.319024  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2623) took 1939 ms. Trace:
I20260709 13:15:37.321440  6323 rpcz_store.cc:276] 0709 13:15:35.375986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.873372 (+497386us) service_pool.cc:224] Handling call
0709 13:15:37.314863 (+1441491us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54002a4c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:37.315027 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733150976}
I20260709 13:15:37.319864  6933 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:37.316627  6154 catalog_manager.cc:5697] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:37.323531  6907 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:37.334022  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 323917us
I20260709 13:15:37.341728  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:37.350021  6398 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:37.352108  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:37.358919  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:37.359706  6940 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:37.365157  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:37.365206  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:37.367131  6941 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:37.372674  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.373320  6400 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:37.374207  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.374742  6400 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:37.375483  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.376377  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.376550  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.377326  6399 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:37.377911  6405 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 13:15:37.378237  6399 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:15:37.378340  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.378921  6400 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:37.379376  6399 raft_consensus.cc:1275] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:37.379887  6400 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:37.384698 10036 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9.
I20260709 13:15:37.384887  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2619) took 2022 ms. Trace:
I20260709 13:15:37.348080  9802 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:37.385800  6397 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:37.398221  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 346395us
I20260709 13:15:37.363772  9819 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:37.408350  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:37.401602  6405 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:37.355494 10098 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:37.379333  6940 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:37.389461  6326 rpcz_store.cc:276] 0709 13:15:35.362793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.338818 (+976025us) service_pool.cc:224] Handling call
0709 13:15:36.339175 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:36.340880 (+  1705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.340911 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:36.345560 (+  4649us) log.cc:844] Serialized 52 byte log entry
0709 13:15:37.136105 (+790545us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b18000fb260. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:15:37.384286 (+248181us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b18000fb260. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f457578d4bc 00007f4572adb48b 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1
0709 13:15:37.384474 (+   188us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:37.384522 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.384606 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:37.384658 (+    52us) raft_consensus.cc:1685] finished
0709 13:15:37.384678 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.384818 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16787,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":19008,"spinlock_wait_cycles":21253888,"thread_start_us":41732,"threads_started":1,"wal-append.queue_time_us":40392}
I20260709 13:15:37.421810  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:37.422518  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.422659  6937 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:37.385800 10124 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:37.435768  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.432566  6371 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:37.428030 10103 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.282s	user 0.004s	sys 0.007s
I20260709 13:15:37.452325 10141 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:37.458794  9855 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:37.460034  6937 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:37.461334 10141 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.466086 10147 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:37.466837 10147 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.468617 10080 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:37.468832  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:37.469195 10080 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.471449 10080 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:37.471982 10080 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:37.473453  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:37.474336  6256 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:37.475251  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:37.475924  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:37.477448  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:37.480460  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:37.481619  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:37.482317 10032 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:37.482056 10054 consensus_queue.cc:1059] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:37.472581 10080 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.482839 10032 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.483759  9882 raft_consensus.cc:3055] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:37.484324  9882 raft_consensus.cc:740] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:37.484508 10080 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:37.484752 10032 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:37.485562  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.485494  9882 consensus_queue.cc:260] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:37.486589  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:37.498997  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.428227 10098 raft_consensus.cc:697] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:37.497210  6397 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:15:37.510957  6397 pending_rounds.cc:85] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 4
I20260709 13:15:37.511319  6397 pending_rounds.cc:107] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:15:37.511616  6397 raft_consensus.cc:2889] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:37.497807  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:37.493244 10042 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:37.507099  6942 raft_consensus.cc:1240] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:37.513262  6400 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:37.507866  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:37.514382  6940 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:37.509244  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:37.515424  6403 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:37.517004  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:37.518846  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:37.445984 10069 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:37.401233  9802 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.523216  6251 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:37.532518  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:37.533489  6935 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:37.534997  6369 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:37.535444  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:37.424779  9819 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.541819  9908 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:37.517004 10141 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:37.536594 10147 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:37.551260 10010 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:37.552630 10094 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:37.554112  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 694) took 1963 ms. Trace:
I20260709 13:15:37.554540  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:37.556044  6934 raft_consensus.cc:2393] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:37.562927  6253 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:15:37.569594  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:37.574716  6397 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:37.572456 10010 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:37.582576  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 291314us
W20260709 13:15:37.585624  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 256007us
I20260709 13:15:37.534044 10064 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.572839  6250 rpcz_store.cc:276] 0709 13:15:35.591096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.591461 (+   365us) service_pool.cc:224] Handling call
0709 13:15:35.591778 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:35.595306 (+  3528us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:35.595346 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:35.596095 (+   749us) log.cc:844] Serialized 52 byte log entry
0709 13:15:35.878006 (+281911us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:35.878047 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.878116 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:37.290061 (+1411945us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:37.553807 (+263746us) raft_consensus.cc:1685] finished
0709 13:15:37.553827 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.554049 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3033,"raft.queue_time_us":3146,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":21888,"spinlock_wait_cycles":19047680,"thread_start_us":219365,"threads_started":1,"wal-append.queue_time_us":365120}
I20260709 13:15:37.611267  6400 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:37.559093 10069 raft_consensus.cc:697] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:37.616629  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:37.617552  6935 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 11: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:37.617165  9693 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:37.619107  9693 consensus_queue.cc:1059] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:37.620391 10073 raft_consensus.cc:3055] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:37.620765 10073 raft_consensus.cc:740] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:37.621553 10073 consensus_queue.cc:260] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.622685 10073 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:37.622699  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.624032  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:37.624996  6397 raft_consensus.cc:2368] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8.
I20260709 13:15:37.626449  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:37.627099  6937 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:37.627591  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:37.628254  6400 raft_consensus.cc:2376] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8. Re-sending same reply.
I20260709 13:15:37.629791  6934 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:37.528908 10042 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:37.631450  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.629282  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.630941  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:37.584182  9908 raft_consensus.cc:697] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:15:37.637398  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.646438  6399 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:37.646610  6250 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 13:15:37.654834  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 337200us
I20260709 13:15:37.554733  9818 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.657572  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:37.655345  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:37.658579  6249 raft_consensus.cc:2393] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:37.659369 10069 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.659593  9908 consensus_queue.cc:237] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.661697 10042 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:37.654958  9781 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.629318 10138 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:37.659813  9700 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:37.682734  6253 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:37.656132  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:37.663684  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:37.677964  6296 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:37.655225  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:37.664175  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:37.664259  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:37.686080  6255 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:37.630172  9882 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:37.665515  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:37.665807  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:37.663040  9781 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.669584  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:37.670332  6297 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:37.671921  6222 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:37.669019  6934 raft_consensus.cc:1240] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:37.677928  6369 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:37.690181  6222 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:37.690227  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:37.691043  6222 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:37.692119  9889 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:37.692549  9889 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:37.692744  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:37.695526 10147 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:37.695905 10147 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:37.696306 10147 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:37.692929  9889 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:37.693332 10149 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:37.702625 10149 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:37.703155 10149 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:37.693769  9887 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:37.704286  9887 raft_consensus.cc:697] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:37.705338  9887 consensus_queue.cc:237] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.694197 10141 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:37.707854 10141 raft_consensus.cc:697] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:37.708983 10141 consensus_queue.cc:237] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.694609 10044 consensus_queue.cc:1059] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:37.714191 10044 raft_consensus.cc:3055] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:37.714625 10044 raft_consensus.cc:740] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:37.715644 10044 consensus_queue.cc:260] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.717643 10044 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:37.731460  6399 raft_consensus.cc:1240] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:37.736178  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.736923  6399 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:37.741714  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.626559  9956 consensus_queue.cc:1059] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:15:37.743027  6247 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:37.744773  6253 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:37.743688  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:37.744264  6938 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:37.744855  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:37.745289  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:37.629251  9792 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:15:37.747212  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.753051  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:37.602151 10064 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:37.760428  6219 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:37.749048 10010 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:37.764631  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:37.767863  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 63178.6us
I20260709 13:15:37.770751  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.772117  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.777494  6397 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:37.688064  9700 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.789212  6252 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:37.780743 10131 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:37.656951 10098 consensus_queue.cc:237] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.775638 10155 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.785504 10156 raft_consensus.cc:3055] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:37.786582 10042 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:37.815857  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.762499 10139 consensus_queue.cc:1048] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:15:37.831861 10034 consensus_queue.cc:1059] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:37.833199 10034 raft_consensus.cc:3055] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:37.833593 10034 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:37.862049  6403 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:37.814209 10156 raft_consensus.cc:740] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:37.886044  6221 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:37.817639  9802 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:37.890292  9855 consensus_queue.cc:1059] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:15:37.901450  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:37.902562  6404 raft_consensus.cc:2393] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:37.892594 10042 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:37.834542 10034 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:37.818243 10155 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.917622  6221 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:37.906525 10140 consensus_meta.cc:287] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.678s	user 0.011s	sys 0.000s
W20260709 13:15:37.945453  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.913676 10032 raft_consensus.cc:3055] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:37.927537  9855 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:37.916653 10042 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:37.986131  6221 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:37.991873  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:37.963124 10032 raft_consensus.cc:740] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:37.973140 10034 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:37.962935  9985 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:38.090106  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 99828.8us
I20260709 13:15:38.094427 10116 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.098626  9818 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:38.098688  6250 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:38.090364 10150 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:38.099465 10148 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:37.994074 10147 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.993957  9855 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:38.120707  6255 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:37.982857 10042 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:38.152546  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:38.153640  6396 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:37.974483 10036 consensus_queue.cc:1059] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.158s
I20260709 13:15:37.989849  9781 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:37.982589 10140 consensus_queue.cc:1048] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.163s
I20260709 13:15:38.151746  9908 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:15:38.166531  9700 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:38.169015 10032 consensus_queue.cc:260] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:37.995079 10139 consensus_queue.cc:1059] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.162s
I20260709 13:15:38.190414  6401 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
W20260709 13:15:38.130348  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 452701us
I20260709 13:15:38.146492 10116 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:37.986126 10156 consensus_queue.cc:260] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:38.227662  6297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.029s	sys 0.075s
W20260709 13:15:38.228345  6297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.030s	sys 0.075s
I20260709 13:15:38.228664  6296 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:15:38.228708  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 558395us
W20260709 13:15:38.243431  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:38.258354  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 499338us
W20260709 13:15:38.261466  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 58693.3us
W20260709 13:15:38.233700 10141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.026s	sys 0.039s
I20260709 13:15:38.263530  6906 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:38.267366  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:38.271703  6906 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:38.275345  6906 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:38.268383 10167 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:15:38.278932 10168 log.cc:927] Time spent T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:15:38.269975 10149 consensus_meta.cc:287] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.003s
W20260709 13:15:38.284581  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 291080us
I20260709 13:15:38.286274  6221 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:38.259029 10155 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:38.267153  9818 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:38.273608  9693 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:15:38.287151 10141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.026s	sys 0.039s
I20260709 13:15:38.267645 10132 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:15:38.268695 10088 consensus_queue.cc:1059] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:15:38.330387 10116 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:38.323232  9802 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:38.314610  6221 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:38.323499  9700 consensus_queue.cc:1059] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:15:38.330742  6934 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:38.311134 10147 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:38.353433  6221 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:38.328088 10155 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:38.359002  6221 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:38.367213  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 106176us
I20260709 13:15:38.328944  9696 raft_consensus.cc:3055] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:38.316851 10169 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:38.307581 10149 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:38.376797  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 100628us
I20260709 13:15:38.377743  6940 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:38.380872  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:38.381505  6933 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:38.357414 10139 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:38.389211  6937 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:38.391196  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:38.391348  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:38.393038  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:38.357867 10177 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:38.396045  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 133477us
I20260709 13:15:38.394394  6906 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:38.396803  6252 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:15:38.404350  6252 pending_rounds.cc:85] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 10
I20260709 13:15:38.404587  6252 pending_rounds.cc:107] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:15:38.404793  6252 raft_consensus.cc:2889] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:38.399967  6402 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:38.405599  6296 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:38.393376  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.376786 10150 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:38.376096  9696 raft_consensus.cc:740] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:38.377552 10169 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:38.381028  9700 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.369554 10080 consensus_queue.cc:1059] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:15:38.365654 10141 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 13:15:38.427035  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.382771  9802 raft_consensus.cc:697] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:38.395592 10174 consensus_queue.cc:1059] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:15:38.396245 10036 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:38.422917  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 46332.9us
W20260709 13:15:38.456562  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 51203.4us
I20260709 13:15:38.384096 10175 consensus_queue.cc:1059] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:15:38.420708 10150 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:38.442425 10132 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:38.465106  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:38.423391 10147 consensus_queue.cc:1059] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:15:38.463824  6296 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:38.427563 10169 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.469833  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:38.480571  6248 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
W20260709 13:15:38.469446 10164 log.cc:927] Time spent T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:15:38.485077  6221 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:38.485666 10132 raft_consensus.cc:697] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:38.489888  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:38.444484  9700 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:38.494738  6251 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:38.474774 10176 raft_consensus.cc:3055] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:38.469272 10190 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:38.471410 10150 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.462970 10195 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 13:15:38.498091 10094 consensus_meta.cc:287] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.894s	user 0.006s	sys 0.006s
I20260709 13:15:38.471760  9802 consensus_queue.cc:237] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:38.515890 10064 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:38.515987 10172 log.cc:927] Time spent T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:15:38.518466  9889 consensus_meta.cc:287] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.821s	user 0.010s	sys 0.010s
I20260709 13:15:38.506539 10190 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.527887  6297 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:38.500000 10176 raft_consensus.cc:740] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:38.515296  9700 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:38.534617  6399 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
W20260709 13:15:38.553303  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 89556.7us
I20260709 13:15:38.554049  6296 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:38.544556  9889 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.555771 10196 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:38.556658 10196 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.557641  9889 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:38.557212 10196 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.560016 10196 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:38.560865 10196 raft_consensus.cc:3055] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:38.561802  6398 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:38.561942 10196 raft_consensus.cc:740] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:38.562777 10196 consensus_queue.cc:260] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.561373 10186 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:38.564164 10138 consensus_meta.cc:287] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.821s	user 0.005s	sys 0.009s
I20260709 13:15:38.563970 10186 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.564505 10188 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:38.565066 10188 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.544026 10194 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:38.574779  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 73072.2us
I20260709 13:15:38.579739  6400 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:38.511577 10197 consensus_queue.cc:1059] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:15:38.580505 10197 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:38.581223 10197 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:38.581584 10197 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:38.581957 10197 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:38.582186 10188 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:38.582417 10190 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:38.582901 10190 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:38.583163 10188 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:38.583673 10188 raft_consensus.cc:697] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:38.551100 10187 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:38.519706 10132 consensus_queue.cc:237] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.590888  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:38.602098  6402 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:38.619966  6221 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:38.575603 10174 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:38.566176 10186 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:38.575294 10149 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:38.621388  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 55374.7us
I20260709 13:15:38.584545 10188 consensus_queue.cc:237] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:38.647384  6396 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:15:38.623488 10141 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:38.598161 10064 consensus_queue.cc:1059] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:15:38.664178  6296 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:38.661031 10131 consensus_meta.cc:287] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.852s	user 0.006s	sys 0.011s
I20260709 13:15:38.667897 10094 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:38.676865 10042 consensus_meta.cc:287] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.513s	user 0.006s	sys 0.005s
I20260709 13:15:38.661836 10139 consensus_queue.cc:1059] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:15:38.659886 10080 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:38.665728 10044 consensus_meta.cc:287] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.946s	user 0.019s	sys 0.000s
I20260709 13:15:38.685184  9950 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:38.670115  6296 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:38.624763 10174 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:38.702579  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 238710us
I20260709 13:15:38.720288  6323 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:38.720729  6295 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:38.662811 10141 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.721732 10198 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:38.721969 10141 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:38.688118 10034 consensus_meta.cc:287] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.004s
W20260709 13:15:38.718508  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 48497.7us
I20260709 13:15:38.726158  6296 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:38.619175 10194 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.693387 10204 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:38.739357 10186 consensus_queue.cc:1059] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:38.740322 10201 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:38.622421 10187 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.703267 10131 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:38.713647 10042 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.702487  9889 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:38.719455 10169 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:38.735169 10209 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:38.736675  6326 raft_consensus.cc:1240] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:15:38.740382 10186 raft_consensus.cc:3055] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:38.713768 10094 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.727455  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:38.724817  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:38.746666  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:38.760128  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:38.765822  6328 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:15:38.767468  6325 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:38.766000  6324 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:38.771337  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:38.772315  6331 raft_consensus.cc:2393] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:15:38.775861  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 51152.7us
I20260709 13:15:38.718894 10205 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:38.776602  6295 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:38.776620  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:38.768630  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:38.779211  6324 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.783726  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:38.784744  6942 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:38.785071  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:38.786238  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:38.786782  6935 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:15:38.787844  6936 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:38.790011  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:38.790526  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:38.785398  6222 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:38.799176  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:38.799912  6330 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:38.800355  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:38.802397  6222 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:38.802816  6327 raft_consensus.cc:1240] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:38.763859 10186 raft_consensus.cc:740] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:38.764689 10209 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:38.803658  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 76266.1us
I20260709 13:15:38.804456  6296 leader_election.cc:400] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8.
I20260709 13:15:38.804715  6296 leader_election.cc:403] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:15:38.805598  6296 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:38.807180  6325 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:38.807842  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:38.808817  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:38.809954  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:38.717523 10197 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.812001  6296 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:38.777030 10198 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:38.813200  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:38.815357  6941 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:38.813807  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:38.816457  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:38.810460  6322 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:38.817111  6325 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:38.821682 10194 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:38.821971  9802 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:38.822386  6253 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:38.810504 10188 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:38.823217  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:38.823758 10188 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:38.823875  6322 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:38.824729 10188 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:38.824783  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:38.826392  6322 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.811239 10209 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:38.747743  9950 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.822434  9802 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.830370  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:38.841463  6248 raft_consensus.cc:2410] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:38.832008  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:38.810663 10131 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:38.766599 10150 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:38.831633  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:38.854347  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:38.838501  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:38.839206  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:38.763669  9889 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.834431  6324 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:38.857868 10186 consensus_queue.cc:260] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.858698 10187 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:38.858948 10186 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:38.833247 10204 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:38.864436 10174 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:38.815232 10149 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:15:38.851975  6941 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:38.853583  6404 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:15:38.887423  6330 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:38.831346 10195 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:38.888425  6325 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:38.822295 10194 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:38.843242  9802 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:38.860973  9889 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:38.842012 10203 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:15:38.857885 10215 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8.
I20260709 13:15:38.893380 10169 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:38.893571  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:38.894484 10094 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:38.889393  6404 raft_consensus.cc:1240] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:38.906719  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:38.814124 10205 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:38.908927  6253 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:38.935503  6329 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:38.909920  6248 raft_consensus.cc:1240] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:38.929491  6327 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:38.937415  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:38.929472  6322 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:38.928184 10194 raft_consensus.cc:697] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:38.937981  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 126052us
I20260709 13:15:38.939857  6322 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: [7.9-9.10]
I20260709 13:15:38.844785 10188 consensus_queue.cc:1059] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:15:38.941536  6327 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:38.943822  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:38.917958 10140 consensus_queue.cc:1059] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:15:38.990316  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:38.991206  6327 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:15:38.982120  9950 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:38.984299 10131 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:39.020951 10140 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:39.046208 10219 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:15:39.046139 10140 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:38.981784 10141 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:39.164646  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.177280  6322 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:39.183135  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.185509  6327 raft_consensus.cc:2368] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8.
I20260709 13:15:39.021548 10131 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:39.190200  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 204206us
I20260709 13:15:39.194474  6905 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:15:39.195891  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.196049 10188 consensus_queue.cc:1059] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:39.196149  6905 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:39.186132  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.196905 10188 raft_consensus.cc:3055] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:39.197007  9950 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:39.197322 10188 raft_consensus.cc:740] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:39.196988  6322 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:39.197875 10175 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:39.198276 10188 consensus_queue.cc:260] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:39.198601  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.199084  6905 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:39.199294  6322 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:39.176899 10197 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:39.200798  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.203632  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.214919  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2570) took 1471 ms. Trace:
I20260709 13:15:39.217614  6399 rpcz_store.cc:276] 0709 13:15:37.745795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.746883 (+  1088us) service_pool.cc:224] Handling call
0709 13:15:39.214722 (+1467839us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b5400386654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:39.214849 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1798279424}
I20260709 13:15:39.199818 10175 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:39.201645 10130 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:39.215617  6322 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:39.218914 10130 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:39.219043 10175 raft_consensus.cc:697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:39.219436 10130 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:39.219632  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.220650  6322 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:39.221310  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.213296  9950 consensus_queue.cc:1059] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:39.201707 10221 consensus_queue.cc:1059] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:15:39.204039 10213 log.cc:927] Time spent T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:15:39.205436 10150 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:39.098905 10194 consensus_queue.cc:237] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:39.203055  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 730) took 1218 ms. Trace:
I20260709 13:15:39.181494 10147 consensus_queue.cc:1059] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 13:15:39.223161  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.235664  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.228716  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.199224 10188 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:39.233592  6398 rpcz_store.cc:276] 0709 13:15:37.984428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.985152 (+   724us) service_pool.cc:224] Handling call
0709 13:15:38.093439 (+108287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.562259 (+468820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.202826 (+640567us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b540007d354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:39.202993 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076648192}
I20260709 13:15:39.221578  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.223287 10169 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:39.181756 10124 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:15:39.195278 10203 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.222698  6327 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:39.184815  9855 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:15:39.243830  6326 raft_consensus.cc:2368] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 8. Current term is 9.
I20260709 13:15:39.234666  9793 raft_consensus.cc:3055] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:15:39.255895  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 73740.2us
W20260709 13:15:39.258353  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.236361 10141 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:39.220078 10175 consensus_queue.cc:237] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:39.257236  9793 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:39.265988 10176 consensus_queue.cc:260] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:39.259038 10169 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:39.270372 10130 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:39.257314  9770 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:15:39.272125  9696 consensus_queue.cc:260] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:39.274662  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:39.268994  9802 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:39.292879  6255 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:15:39.281193  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.282094  6327 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:39.256410 10205 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:39.258237 10203 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:39.295089  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.295660  6252 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:39.299758  6905 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:39.275262  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:39.285746  6322 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:15:39.298365  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.301653  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.299885  6247 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:15:39.298413  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.301827  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.302580  6219 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:39.296125  9802 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:39.303110  6322 raft_consensus.cc:2410] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:15:39.303646  6326 raft_consensus.cc:2393] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:39.303225  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.306239  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.303712 10141 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:39.308133  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.309216  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.309887 10140 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:39.310295  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.310423 10130 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:39.310799  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1593) took 1210 ms. Trace:
I20260709 13:15:39.311303  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.311743  9793 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:39.312959  9793 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:39.305321  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.311142  6254 rpcz_store.cc:276] 0709 13:15:38.100536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.100647 (+   111us) service_pool.cc:224] Handling call
0709 13:15:38.100899 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.160559 (+ 59660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.160602 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.160657 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:38.160700 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.310582 (+1149882us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b54002b11d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:39.310637 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.310746 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136649088}
W20260709 13:15:39.305183 10201 consensus_meta.cc:287] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.000s
I20260709 13:15:39.301265  9950 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:39.320123  6325 raft_consensus.cc:2393] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:39.322183  6322 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:39.328095  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.328596  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.328747  6326 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:39.329303  6322 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:39.317878  6219 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:39.320410 10233 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:39.314561 10141 consensus_queue.cc:1059] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:15:39.324272 10203 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:39.325564 10169 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:39.296569 10209 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:39.330844  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.337733  6328 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:39.338038  9781 raft_consensus.cc:3055] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:39.338258 10141 raft_consensus.cc:3055] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:39.338433  9781 raft_consensus.cc:740] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:39.338853 10209 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:39.331553  6254 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:15:39.339646  6254 pending_rounds.cc:85] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 5
I20260709 13:15:39.339566  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.340008  6254 pending_rounds.cc:107] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:15:39.317687  9696 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:39.334594  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.334293  9819 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:39.338798 10141 raft_consensus.cc:740] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:39.333220  6252 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:39.340291  6254 raft_consensus.cc:2889] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:39.336490  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.340713  6327 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:39.340265  6328 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:15:39.341784  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1590) took 1386 ms. Trace:
I20260709 13:15:39.348501  6325 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:39.342429  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:39.314649 10186 consensus_queue.cc:1059] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:15:39.349852 10233 raft_consensus.cc:697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:39.350442  6328 raft_consensus.cc:1240] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:39.351524  6328 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:39.350988 10233 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:39.354548  6401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2571) took 1605 ms (client timeout 2087 ms). Trace:
W20260709 13:15:39.354925  6401 rpcz_store.cc:269] 0709 13:15:37.751303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.751797 (+   494us) service_pool.cc:224] Handling call
0709 13:15:39.354414 (+1602617us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b5400376ed4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:39.354498 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973551872}
I20260709 13:15:39.357059 10124 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:39.334020 10131 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:39.333019 10201 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:39.361555  6934 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:39.360973  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:39.363350  6325 raft_consensus.cc:2410] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:39.348606  6256 rpcz_store.cc:276] 0709 13:15:37.955224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.955369 (+   145us) service_pool.cc:224] Handling call
0709 13:15:37.955662 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.986622 (+ 30960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:37.986652 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:37.986689 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:37.986727 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.341595 (+1354868us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b5400203854. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:39.341637 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.341734 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70747520}
I20260709 13:15:39.365625  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:39.366257  6936 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:39.336221  9802 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:39.367398  6222 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:39.368075  6325 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:15:39.376750  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:39.377565  6933 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:39.387101  6324 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:39.363903 10186 consensus_queue.cc:1243] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:15:39.362190 10130 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:39.366724 10203 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:39.339407  9781 consensus_queue.cc:260] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:39.371622 10147 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:39.369705  9802 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:39.368567 10169 consensus_queue.cc:1059] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
W20260709 13:15:39.420467  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.370355 10225 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:15:39.368660 10080 consensus_queue.cc:1059] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:15:39.420576  6933 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:15:39.428845  6330 raft_consensus.cc:1240] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:39.430743  6222 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:39.409804  9802 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:39.432763  6940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 721) took 1820 ms. Trace:
I20260709 13:15:39.397691 10148 consensus_queue.cc:1059] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:15:39.409592 10203 raft_consensus.cc:697] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:39.410652 10147 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:39.437438  6907 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:39.440162  6402 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:39.441015  9950 consensus_queue.cc:1059] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:39.455507  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.456493 10208 raft_consensus.cc:3055] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:39.443225  6369 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:39.462967 10043 raft_consensus.cc:2764] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:15:39.433156  6940 rpcz_store.cc:276] 0709 13:15:37.612644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.612786 (+   142us) service_pool.cc:224] Handling call
0709 13:15:37.632071 (+ 19285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.378493 (+746422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.432551 (+1054058us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b5400289bd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:39.432712 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1698269056}
I20260709 13:15:39.402959 10130 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:39.460768  6368 leader_election.cc:336] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.528s (SENT)
I20260709 13:15:39.465428  6368 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:39.471604  6368 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:39.452957 10171 log.cc:927] Time spent T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.137s	user 0.001s	sys 0.002s
I20260709 13:15:39.474234  6368 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:39.468189  9819 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:39.442116 10150 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:39.476761  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:39.479395  6368 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:39.464275 10147 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:39.482514  6325 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:39.464442 10208 raft_consensus.cc:740] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:39.484985  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:39.414302 10141 consensus_queue.cc:260] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:39.475286  9668 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:39.475308 10054 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:39.488818  6221 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:39.488641  6368 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:39.491812 10238 consensus_queue.cc:1059] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:39.489885 10047 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:39.493151  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:39.493635 10242 log.cc:927] Time spent T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:15:39.494351 10203 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:39.497139 10150 raft_consensus.cc:697] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:39.500079  6368 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:39.530809  6368 leader_election.cc:400] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 8. Current term is 9.
I20260709 13:15:39.531140  6368 leader_election.cc:403] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:15:39.481899 10043 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:39.503232  6221 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:39.481593  9770 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:15:39.533515  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 66240.7us
I20260709 13:15:39.541428  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.534540  6940 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:39.536422  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.540004  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.540654  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.540920  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.546105  6402 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:39.541312  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:39.546710  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.546855  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.547111  6399 raft_consensus.cc:2410] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:39.546994 10080 consensus_queue.cc:1059] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:39.541956  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.542223  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.547798  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.547926  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.548313  6397 raft_consensus.cc:2393] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:39.487735 10222 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:39.549950  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.550455  6330 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:39.518167 10138 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:39.553081  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.516350  9805 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:39.558462  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:39.596661  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.610024  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:39.613737  6405 raft_consensus.cc:2393] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:39.543855  9668 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:39.535936 10043 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.622412  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:39.616151  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 171015us
I20260709 13:15:39.613901  6401 raft_consensus.cc:2376] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9. Re-sending same reply.
I20260709 13:15:39.549193 10054 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 8. Current term is 9.
I20260709 13:15:39.544405  9982 raft_consensus.cc:2764] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:15:39.544109  9770 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:39.714037  9770 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:39.713898 10247 consensus_queue.cc:1059] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:39.552584 10141 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:39.625291  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.625396 10043 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:39.632944  6326 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:39.717721  6330 raft_consensus.cc:2376] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8. Re-sending same reply.
I20260709 13:15:39.718274  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.718523  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.719385  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.720093  6326 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:39.659260  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:39.660763 10187 raft_consensus.cc:3055] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:39.723078 10187 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:39.724319 10187 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:39.725627 10187 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:39.726333  9781 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:39.666787  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.667568  6404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36156
I20260709 13:15:39.729053 10130 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:39.729494  6404 raft_consensus.cc:606] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:15:39.673110  9908 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.652227  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.730588  6327 raft_consensus.cc:2376] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9. Re-sending same reply.
I20260709 13:15:39.730532  9908 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:39.731067 10244 log.cc:927] Time spent T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:15:39.731902  6327 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:15:39.732820  9908 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:39.630991  9668 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.681533  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.612571 10233 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:39.632197  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.719447  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.733152 10238 raft_consensus.cc:3055] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:39.733783  6402 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:39.734776 10248 raft_consensus.cc:3055] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:39.735543  6322 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:39.738965  6404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36156
I20260709 13:15:39.750890  6404 raft_consensus.cc:606] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Received request to transfer leadership
W20260709 13:15:39.739367  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.625320  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:39.611418 10138 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:39.745059  6326 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:39.747978 10238 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:39.752122  9668 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:39.753412 10238 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:39.754369  9668 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:39.755122 10238 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:39.759673  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:39.750473 10248 raft_consensus.cc:740] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:39.656198 10208 consensus_queue.cc:260] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:39.762209 10208 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:39.761888 10248 consensus_queue.cc:260] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:39.763094 10196 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:39.763494 10248 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:39.764731  6396 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:39.655310 10150 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:39.765720  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:39.771003  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.773118  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:39.774549  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.746325  6397 raft_consensus.cc:2410] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:15:39.749763  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:39.770207  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:39.782783  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.783705  9982 consensus_queue.cc:1059] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:39.786463  6219 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:39.788566 10044 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:39.789047 10044 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.789635 10044 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:39.728138  9802 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:39.803197  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 107705us
I20260709 13:15:39.809325  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:39.812860  6404 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:15:39.815258  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 255275us
I20260709 13:15:39.775615 10138 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:39.817600  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.775686 10233 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:39.820820  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 194897us
I20260709 13:15:39.800822  6219 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:39.824930  6255 raft_consensus.cc:1240] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:39.826326  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.825879 10044 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:39.879844 10233 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:39.839609  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:39.882357 10044 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:39.883139  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:39.889232 10243 log.cc:927] Time spent T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:15:39.887672  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.889225  9982 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:15:39.890648  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 51940us
W20260709 13:15:39.894340  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.898744  6397 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:39.836045  6404 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:15:39.910337  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.839387  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.914038  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:39.937050  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.947140  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:39.966311  6396 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:39.962905  6328 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:39.950729  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:39.827324 10140 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:39.909684  9982 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.909420 10233 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:39.980733  6404 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:39.984159  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.829922 10080 consensus_queue.cc:1059] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.145s
I20260709 13:15:39.832868  9793 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.141s
I20260709 13:15:39.989836  6405 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:15:40.010792  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:40.014289  6296 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.015969  6296 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.021561 10233 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:40.024587 10233 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:40.025511 10069 raft_consensus.cc:993] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:15:40.026002 10022 raft_consensus.cc:1081] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:15:40.027895  6256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:49996
I20260709 13:15:40.028494  6256 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:40.028810  6256 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.025533  6396 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:40.029776  9659 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:40.030558  6404 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:39.934617  9770 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:40.034010  9802 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:40.034317  9770 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:40.035156  6248 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:40.036128  6398 raft_consensus.cc:2393] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:15:40.039127 10147 consensus_meta.cc:287] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.001s
I20260709 13:15:40.030269  9659 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:40.039567 10147 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:40.040541  6252 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:40.040886  9659 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:39.831164 10195 consensus_queue.cc:1059] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.146s
I20260709 13:15:39.964308 10043 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:40.047374  6296 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.051434  6256 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:40.061542  6256 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:40.062937 10179 log.cc:927] Time spent T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.578s	user 0.004s	sys 0.005s
I20260709 13:15:40.065444 10195 raft_consensus.cc:3055] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:40.067396 10043 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:40.068137  6399 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:40.068575  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:40.076325  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:40.102588  6324 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:40.104485  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 281861us
I20260709 13:15:40.046154  9982 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:40.078171  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:40.081491  6323 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:40.085525  6247 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:40.045806 10173 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:40.047839 10233 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.124966  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:40.086200  6296 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:40.054067 10064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.192s	user 0.026s	sys 0.031s
W20260709 13:15:40.110335  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.114143  6324 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:40.086676 10187 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:40.124295  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.129148  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:40.100790 10208 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:40.153614 10147 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:40.174978  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.144343 10190 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:40.198745  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:40.144042  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 57915.2us
W20260709 13:15:40.144057  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.202265  6296 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.203996  6933 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:40.151142  6940 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:15:40.161870  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:40.206305  6324 raft_consensus.cc:2410] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:40.207231  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:40.100890 10195 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:40.131388 10064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.269s	user 0.026s	sys 0.031s
I20260709 13:15:40.144212  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.143453 10233 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:40.212247  6934 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:40.209681  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.211153  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:40.219901  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:15:40.208107 10131 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.013s	sys 0.019s
I20260709 13:15:40.222048 10147 raft_consensus.cc:3055] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:40.222479 10147 raft_consensus.cc:740] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:40.223284 10147 consensus_queue.cc:260] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:40.223798 10233 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:40.205463  6296 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:40.226647  6140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 315987us
I20260709 13:15:40.228300  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.229943  9982 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:40.205638 10187 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:40.230232  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:40.230684 10190 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:40.230809  6934 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.233455 10195 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:40.234727 10195 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:40.237591 10259 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:15:40.237831  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:40.239365 10128 raft_consensus.cc:3055] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:40.239740 10128 raft_consensus.cc:740] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:40.239406 10190 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:40.239691  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.240770 10128 consensus_queue.cc:260] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:40.241266 10043 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:40.212543  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:40.238694  6936 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:40.253188  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.230279  6219 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:40.279848  6324 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:40.242007  6296 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.295954  6934 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:40.299472  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:40.299674  6221 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.300616  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:40.301298  9982 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.301862  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:40.301959  9982 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:40.304766  9982 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:40.305076  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 63141.3us
I20260709 13:15:40.306388 10141 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:40.311726  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:40.314308  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.314854  6322 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:15:40.312199  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.317222  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.296870 10036 raft_consensus.cc:3055] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:40.254300 10128 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:40.222072 10131 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.013s	sys 0.019s
I20260709 13:15:40.319618  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:40.320255  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 90049.9us
I20260709 13:15:40.321272  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.321589  6936 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:15:40.317951  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.313763  6296 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.324249  6296 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.295954 10187 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:40.297894 10184 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:40.327584  6295 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.241752 10043 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:40.328555  6322 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:40.311478  9908 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.331549  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:40.332858  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.333596  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.335180  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:40.338166  6219 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.331431  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:40.343663  6296 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.344647  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:40.346594  6255 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:40.350174  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:40.354506  6255 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:40.355289  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:40.356137  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.357885  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:40.361956  6250 raft_consensus.cc:2393] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:40.363547  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:40.364334  6322 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:40.365847  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:40.366590  6322 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:40.326232 10036 raft_consensus.cc:740] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:40.371598  6256 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:40.373746  6219 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:40.328210 10173 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:40.378079  6251 raft_consensus.cc:1240] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:40.312455 10203 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:15:40.383415  6322 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:15:40.385076  6936 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEARNER]: Advancing to term 8
I20260709 13:15:40.328898 10270 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:15:40.390482  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 335888us
W20260709 13:15:40.430467  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.430860  6368 leader_election.cc:336] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.929s (SENT)
I20260709 13:15:40.431461  6368 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:40.361675 10197 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:40.400688  6935 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:40.385632 10187 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.382305 10080 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:40.341884 10184 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:40.389788 10175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.095s	user 0.018s	sys 0.041s
I20260709 13:15:40.384443  9659 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:15:40.395107 10138 consensus_meta.cc:287] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.567s	user 0.006s	sys 0.004s
I20260709 13:15:40.419974  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.361750  9908 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:40.421489  6934 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:40.399626 10173 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:40.422391  6396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36156
I20260709 13:15:40.442723  6396 raft_consensus.cc:606] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Received request to transfer leadership
W20260709 13:15:40.423954  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 44834.7us
W20260709 13:15:40.438395 10175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.018s	sys 0.041s
I20260709 13:15:40.377851 10141 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:40.393687 10036 consensus_queue.cc:260] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:40.436328 10270 raft_consensus.cc:697] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:40.441728  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 114237us
I20260709 13:15:40.422276  6906 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.443711  6368 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:40.426823  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 220661us
I20260709 13:15:40.448446  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:40.451193  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.439251  9770 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:40.444317 10266 log.cc:927] Time spent T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:15:40.455396 10036 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:40.453083  6905 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:40.470072  6368 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:40.442730 10138 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:40.454946  6222 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:40.472507  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 261924us
I20260709 13:15:40.453083  6906 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:40.475044  6906 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.456282 10264 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:40.464766  6936 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:15:40.472028  6368 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:40.485226  6936 pending_rounds.cc:85] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Aborting all ops after (but not including) 5
I20260709 13:15:40.485620  6936 pending_rounds.cc:107] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:15:40.485915  6936 raft_consensus.cc:2889] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:40.462800 10054 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:40.493672  6933 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:40.467522 10141 raft_consensus.cc:697] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:40.523828  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 180230us
I20260709 13:15:40.488005  9983 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:40.483597 10265 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:15:40.454486 10080 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:15:40.490456 10043 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:40.472139 10069 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:40.532975  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 61019.9us
I20260709 13:15:40.481207 10263 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:40.525588  6296 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.535463 10131 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 13:15:40.539438 10275 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:15:40.540599  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1594) took 1102 ms. Trace:
I20260709 13:15:40.546092  9908 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:40.547375 10218 log.cc:927] Time spent T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 1.689s	user 0.000s	sys 0.007s
I20260709 13:15:40.547163 10141 consensus_queue.cc:237] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:40.548287  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:40.540951  6254 rpcz_store.cc:276] 0709 13:15:39.438197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.438308 (+   111us) service_pool.cc:224] Handling call
0709 13:15:39.442336 (+  4028us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.442637 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.442667 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.443828 (+  1161us) log.cc:844] Serialized 26 byte log entry
0709 13:15:40.076767 (+632939us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b18002e3a80. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:15:40.342481 (+265714us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:40.342517 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.342575 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:40.540337 (+197762us) raft_consensus.cc:1685] finished
0709 13:15:40.540357 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.540542 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16828,"raft.queue_time_us":545,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":11940,"spinlock_wait_cycles":3080448,"thread_start_us":265550,"threads_started":1,"wal-append.queue_time_us":998794}
W20260709 13:15:40.555279  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 79196.8us
I20260709 13:15:40.527043 10233 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:40.562641  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.532366 10246 raft_consensus.cc:2764] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:15:40.611605  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 63450us
I20260709 13:15:40.610169  6327 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:40.537583 10054 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:40.612439  6368 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:40.616694  6371 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:40.617448 10069 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:40.620151 10184 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:40.553844 10270 consensus_queue.cc:237] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:40.622936  6368 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:15:40.628764  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.634182  6371 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:40.632798  9908 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:40.637140  9908 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:40.637594  9908 raft_consensus.cc:697] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:40.638478  9908 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:40.641454  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.621469 10054 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:40.649801  6371 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:40.622085 10032 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.622969 10149 raft_consensus.cc:3055] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:15:40.654307  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.557899 10197 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:40.558305 10130 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:40.630652 10292 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:40.668612  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 179451us
I20260709 13:15:40.622011 10138 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:40.557902  9659 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 13:15:40.628175 10263 raft_consensus.cc:697] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:40.657689 10054 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:40.668058  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 117911us
W20260709 13:15:40.657472 10150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.006s	sys 0.034s
I20260709 13:15:40.657590 10149 raft_consensus.cc:740] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:40.688120  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 213149us
I20260709 13:15:40.672381  6400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2580) took 2083 ms. Trace:
I20260709 13:15:40.621094 10233 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:40.682705  6254 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:40.561229 10208 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.127s
W20260709 13:15:40.704219  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 54515.3us
I20260709 13:15:40.648269 10022 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:15:40.688544 10184 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.712215  6400 rpcz_store.cc:276] 0709 13:15:38.588847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.589252 (+   405us) service_pool.cc:224] Handling call
0709 13:15:38.589715 (+   463us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:38.621898 (+ 32183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.621929 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:38.629304 (+  7375us) log.cc:844] Serialized 78 byte log entry
0709 13:15:38.763266 (+133962us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:38.942590 (+179324us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.163768 (+221178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.163846 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:40.489347 (+1325501us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:40.652660 (+163313us) raft_consensus.cc:1685] finished
0709 13:15:40.672141 (+ 19481us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.672313 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72340,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":24749,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":45720,"spinlock_wait_cycles":25062144,"thread_start_us":280514,"threads_started":2,"wal-append.queue_time_us":216367}
I20260709 13:15:40.724025  6906 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:40.705449 10150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.006s	sys 0.035s
I20260709 13:15:40.700834 10292 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:40.741531 10292 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:40.741978 10292 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:40.726981 10043 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:40.745434 10043 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:40.745857 10043 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.746529 10264 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:40.737596 10233 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:40.738011  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.753607 10263 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:40.758205 10022 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.758935 10022 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:40.759603  6296 leader_election.cc:336] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.546s (SENT)
I20260709 13:15:40.760017  6296 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:40.761022 10208 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:40.761637 10184 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:40.764175 10184 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:40.777102  6249 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:40.780758 10149 consensus_queue.cc:260] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:40.793336  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:40.794113  6936 raft_consensus.cc:2393] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:15:40.799700  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 121338us
W20260709 13:15:40.800607  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 76896us
I20260709 13:15:40.829331  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2664) took 1308 ms. Trace:
I20260709 13:15:40.829906  6328 rpcz_store.cc:276] 0709 13:15:39.520751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.666492 (+145741us) service_pool.cc:224] Handling call
0709 13:15:40.829097 (+1162605us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400038c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:40.829255 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396524928}
I20260709 13:15:40.831508  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.772836 10187 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:40.776867 10042 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:40.798815 10022 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:40.773113 10292 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:40.861769  6401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2192) took 1322 ms (client timeout 1546 ms). Trace:
W20260709 13:15:40.862352  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 164188us
W20260709 13:15:40.862286  6401 rpcz_store.cc:269] 0709 13:15:39.539376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.539502 (+   126us) service_pool.cc:224] Handling call
0709 13:15:40.861559 (+1322057us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b54002f4254. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:40.861696 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6817152}
W20260709 13:15:40.856721 10128 consensus_meta.cc:287] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.000s
I20260709 13:15:40.867653  6400 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:40.861253 10137 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:40.875455 10043 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:40.945928 10130 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:15:40.946755  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 76004us
W20260709 13:15:40.944947  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.870019 10140 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.011s	sys 0.002s
W20260709 13:15:40.945050  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 81980.2us
I20260709 13:15:40.953047  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 794) took 1590 ms. Trace:
I20260709 13:15:40.948411  6403 raft_consensus.cc:1240] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:40.950773 10187 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:40.859601 10299 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:15:40.953514  6941 rpcz_store.cc:276] 0709 13:15:39.362607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.362714 (+   107us) service_pool.cc:224] Handling call
0709 13:15:39.362980 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.363284 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.363310 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.363765 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:15:40.070338 (+706573us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b180014da60. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:15:40.437723 (+367385us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:40.437762 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.437832 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:40.947585 (+509753us) raft_consensus.cc:1685] finished
0709 13:15:40.947607 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.952987 (+  5380us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":624,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":2740,"spinlock_wait_cycles":6064896,"thread_start_us":367211,"threads_started":1,"wal-append.queue_time_us":1358020}
I20260709 13:15:40.957149 10187 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:40.951846 10140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.012s	sys 0.002s
I20260709 13:15:40.959928 10140 raft_consensus.cc:697] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:40.960111 10292 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:40.961103 10140 consensus_queue.cc:237] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:40.965914  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1595) took 1527 ms. Trace:
I20260709 13:15:40.966279  6252 rpcz_store.cc:276] 0709 13:15:39.438479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.438600 (+   121us) service_pool.cc:224] Handling call
0709 13:15:39.438850 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.040864 (+602014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.965681 (+924817us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b5400336b54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:40.965845 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383369088}
I20260709 13:15:40.967615 10137 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:40.967772  6398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2191) took 1428 ms (client timeout 1804 ms). Trace:
I20260709 13:15:40.960223 10187 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:40.968346  6398 rpcz_store.cc:269] 0709 13:15:39.539073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.539225 (+   152us) service_pool.cc:224] Handling call
0709 13:15:40.967586 (+1428361us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54003755d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:40.967717 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108549888}
I20260709 13:15:40.969352  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.973249 10187 consensus_queue.cc:1059] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:40.974167 10042 raft_consensus.cc:3055] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:40.974599 10042 raft_consensus.cc:740] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:40.975587 10042 consensus_queue.cc:260] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:40.977097 10042 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:40.982744 10305 consensus_queue.cc:1059] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:40.986505  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:40.987725  6369 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.531s (SENT) [suppressed 31 similar messages]
I20260709 13:15:40.965065 10043 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:40.991946 10176 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.992498  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:40.993276  6938 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:15:40.994218  6401 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:40.995463  6935 raft_consensus.cc:1240] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:40.998148  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:40.999778  6371 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:41.001114  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:15:41.010732  6296 leader_election.cc:336] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.804s (SENT)
I20260709 13:15:41.011248  6296 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:41.012487 10215 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:40.985049 10305 raft_consensus.cc:3055] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:41.013198  9770 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:41.016065  9770 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.016402  9770 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:41.014312 10305 raft_consensus.cc:740] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:15:41.019465  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.021485  6331 raft_consensus.cc:2410] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:41.023835  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:41.023945  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:41.025015  6935 raft_consensus.cc:2393] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 12: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:41.025144  6934 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:40.994211 10069 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:41.050806  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.069796  9700 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.013855 10043 consensus_queue.cc:1059] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:15:41.071053 10148 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.018035 10305 consensus_queue.cc:260] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.071573 10148 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.072080  6222 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:41.070394  9700 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.072207 10305 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:41.081919 10308 log.cc:927] Time spent T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:15:41.077239  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.077579  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:41.073659  9985 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:41.085116  6934 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:41.085646  9985 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.086076  9985 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:41.086659  6222 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:41.087057 10042 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.087586 10042 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.087930 10124 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:41.074267 10148 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.088511 10124 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.088959 10124 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:41.089278 10301 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.078195 10054 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.089775 10301 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:41.091239 10042 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.091596 10054 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.092806  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:41.095623  9770 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.097368  6398 raft_consensus.cc:1240] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:41.100666  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 93287.8us
I20260709 13:15:41.105165 10124 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.109236 10176 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.109676 10124 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.109732  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:41.110136 10042 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.110555  6934 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:41.110653 10042 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:41.113718  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 98229.7us
I20260709 13:15:41.114300  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:41.115155  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:41.115423  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:41.115978  6942 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:41.116472  6937 raft_consensus.cc:1217] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Deduplicated request from leader. Original: 3.5->[6.6-6.6]   Dedup: 6.6->[]
I20260709 13:15:41.116964  6937 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:15:41.117738 10173 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.118201 10173 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:41.112941 10042 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.119840  6297 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:41.120286 10173 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:41.120751  6934 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:41.120959  6297 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:41.121219 10173 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:41.122149 10042 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:41.122488  9770 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.109814 10176 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.123349  6297 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:41.124359 10273 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.632s	user 0.001s	sys 0.001s
I20260709 13:15:41.124995 10176 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.125244  6297 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:41.126170 10187 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:41.126685  6297 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:41.128131  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2374) took 1724 ms. Trace:
I20260709 13:15:41.129520  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2203) took 1586 ms. Trace:
I20260709 13:15:41.129676  6222 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:41.129904  6399 rpcz_store.cc:276] 0709 13:15:39.543276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.547723 (+  4447us) service_pool.cc:224] Handling call
0709 13:15:41.129326 (+1581603us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54001f4354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:41.129469 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1194557184}
I20260709 13:15:41.131220 10124 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:41.131541  6397 raft_consensus.cc:1240] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:15:41.133544 10124 raft_consensus.cc:697] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:41.137667  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.138134  6297 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:41.128491  6247 rpcz_store.cc:276] 0709 13:15:39.404005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.404187 (+   182us) service_pool.cc:224] Handling call
0709 13:15:39.404563 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.117895 (+713332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.127928 (+1010033us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b54001739d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:41.128078 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1563669760}
I20260709 13:15:41.140374  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:41.146852  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:41.147806  6254 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:41.139946  6297 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:41.154665  6255 raft_consensus.cc:1240] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:41.155296  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:41.160452  6297 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:41.167718  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:41.169396  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:41.170203  6251 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:15:41.171831  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:41.172861  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.165524  6295 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:41.177628  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.221745  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:41.219193  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.137949 10042 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:41.138217 10069 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:41.148470 10187 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:41.151789 10270 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.228818  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:41.230376  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2209) took 1537 ms. Trace:
I20260709 13:15:41.231716  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:41.236876  6936 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:41.232831  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:41.237973  6942 raft_consensus.cc:2410] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:15:41.233250  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:41.238649  6937 raft_consensus.cc:2393] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:41.234338  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:41.158082 10148 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:41.239522  6251 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:41.162192 10176 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:41.240473  6939 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:15:41.242012  6402 rpcz_store.cc:276] 0709 13:15:39.693551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.693877 (+   326us) service_pool.cc:224] Handling call
0709 13:15:39.694270 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.748205 (+ 53935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.228126 (+1479921us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b540044f7d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:41.230322 (+  2196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90345728}
I20260709 13:15:41.242897  6254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:41.244900  6254 raft_consensus.cc:606] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:41.245311  6254 raft_consensus.cc:614] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:41.222236 10190 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:41.240021  6369 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:41.221800 10269 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:41.164499 10288 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:41.162381 10054 consensus_queue.cc:1059] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
W20260709 13:15:41.247135 10314 log.cc:927] Time spent T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:15:41.241813 10208 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:41.162418 10124 consensus_queue.cc:237] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.261686  6251 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:15:41.229269 10197 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:15:41.273702  6936 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:15:41.246263 10148 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.235334 10069 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:41.249785 10300 consensus_queue.cc:1059] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:15:41.277704  6371 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:41.265202 10208 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.243732 10270 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:41.262193  9668 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:41.262636 10288 raft_consensus.cc:697] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:41.287134  6249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2354) took 2894 ms (client timeout 1963 ms). Trace:
I20260709 13:15:41.252621 10292 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:15:41.260172 10269 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:41.290678  6249 rpcz_store.cc:269] 0709 13:15:38.389706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.391135 (+  1429us) service_pool.cc:224] Handling call
0709 13:15:41.283761 (+2892626us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b54001473d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:41.283885 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5467763968}
I20260709 13:15:41.288712 10208 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:41.315670  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 150193us
I20260709 13:15:41.317634  6295 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:41.326277 10285 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:41.326884 10069 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
W20260709 13:15:41.328800 10315 log.cc:927] Time spent T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:15:41.337489  6219 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:41.337641  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:41.338721  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 891080us
W20260709 13:15:41.341465  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.313802 10300 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:41.339601  6219 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:41.329670 10312 log.cc:927] Time spent T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:15:41.366907  6249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:41.367651  6249 raft_consensus.cc:606] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:41.329646 10148 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.345445 10044 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:41.378544  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 127017us
I20260709 13:15:41.342718  9985 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.366071 10131 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:41.382966  6369 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:15:41.388173  6296 leader_election.cc:336] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.182s (SENT)
I20260709 13:15:41.413843  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:41.412936  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 101116us
I20260709 13:15:41.373818 10300 raft_consensus.cc:697] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:41.381011 10044 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.365711 10128 consensus_queue.cc:1059] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:15:41.412906 10131 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.422204 10054 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:41.441716 10319 log.cc:927] Time spent T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:15:41.424777 10322 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:41.436141 10044 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:41.440032 10131 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:41.456272 10317 log.cc:927] Time spent T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:15:41.414341 10288 consensus_queue.cc:237] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.447376  9985 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.473688 10270 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:41.460172 10269 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:41.459874 10300 consensus_queue.cc:237] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.489431 10285 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:41.503677 10301 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:41.536652  6143 maintenance_manager.cc:419] P c499d062fa5b4229bfb05f1ac581a6c6: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033397
W20260709 13:15:41.543336  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 150042us
W20260709 13:15:41.544238  6248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1597) took 2101 ms (client timeout 1531 ms). Trace:
W20260709 13:15:41.545075  6248 rpcz_store.cc:269] 0709 13:15:39.442556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.492858 (+ 50302us) service_pool.cc:224] Handling call
0709 13:15:41.543455 (+2050597us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b5400337054. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:41.543851 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191428992}
W20260709 13:15:41.550676  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.546308  6219 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:41.554101  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:41.552879  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2595) took 1711 ms. Trace:
I20260709 13:15:41.556631  6397 rpcz_store.cc:276] 0709 13:15:39.840662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.900858 (+ 60196us) service_pool.cc:224] Handling call
0709 13:15:41.131317 (+1230459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:41.131960 (+   643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.552239 (+420279us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54001f4350. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:41.552520 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2828974336}
W20260709 13:15:41.566735  6368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.025s	sys 0.060s
W20260709 13:15:41.567279  6368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.025s	sys 0.060s
W20260709 13:15:41.573889  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.574728  6256 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:41.575984  9770 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:41.577067  9770 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:41.579787  6331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2650) took 2807 ms (client timeout 1775 ms). Trace:
W20260709 13:15:41.580349  6331 rpcz_store.cc:269] 0709 13:15:38.772651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.790305 (+ 17654us) service_pool.cc:224] Handling call
0709 13:15:41.579194 (+2788889us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b54002418d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:41.579493 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5128670464}
I20260709 13:15:41.583940  9887 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:41.584674  9887 raft_consensus.cc:697] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:41.586488  9887 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.580329  9770 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:41.589478  9770 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:41.590140  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:41.590246  9770 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:41.591037  6934 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:41.592785  9770 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:41.593446  9770 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:41.593663  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 970724us
I20260709 13:15:41.594386  9770 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:41.595168  6368 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:41.600152  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2661) took 2080 ms. Trace:
I20260709 13:15:41.601145  9908 raft_consensus.cc:3055] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:41.601794  9908 raft_consensus.cc:740] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:41.600684  6325 rpcz_store.cc:276] 0709 13:15:39.519959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.543565 (+ 23606us) service_pool.cc:224] Handling call
0709 13:15:41.598074 (+2054509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.598868 (+   794us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:41.598908 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:41.598993 (+    85us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:41.599034 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.599140 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.599760 (+   620us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b54002418d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:41.599926 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4695066368}
W20260709 13:15:41.620484  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.623842  6941 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:15:41.625603  6202 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:15:41.626427  6202 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for b91f0c50e2de47c299569a0a5d7af6b8 already in progress
W20260709 13:15:41.626950  6202 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for b91f0c50e2de47c299569a0a5d7af6b8 already in progress
I20260709 13:15:41.627461  9700 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.604007  9908 consensus_queue.cc:260] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:41.630206  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 56948.7us
I20260709 13:15:41.630040 10270 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:41.631723 10323 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:41.632441  9668 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:41.632627 10323 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:41.655902 10300 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:41.641896 10285 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.701323  9668 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:41.702185  9668 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:41.705348  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:41.704560  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:41.707361  6297 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:41.729954  9700 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:41.745409  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.743366  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.736918  6329 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:41.704599  9668 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:41.732992  6322 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:15:41.738906  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:41.747902  9770 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:41.766674  6934 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:15:41.661935 10328 consensus_queue.cc:1059] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:15:41.725008 10301 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.084s
W20260709 13:15:41.797076  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.818584  9700 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.819358  9700 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:41.820235 10147 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:41.823459 10156 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:41.826545 10322 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.827246 10322 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
W20260709 13:15:41.830614  6323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2636) took 3084 ms (client timeout 1942 ms). Trace:
I20260709 13:15:41.830775 10173 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:41.831148  6323 rpcz_store.cc:269] 0709 13:15:38.745895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.746362 (+   467us) service_pool.cc:224] Handling call
0709 13:15:41.830200 (+3083838us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54003935d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:41.830429 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3000430464}
I20260709 13:15:41.831449 10173 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:41.833446 10197 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:41.834156 10197 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:41.835516  6330 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:41.837327  6222 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
W20260709 13:15:41.816883  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 93959.8us
I20260709 13:15:41.796738  9770 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:41.829687 10288 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:41.853147 10288 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:41.854010  9700 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:41.855446 10288 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:41.792155 10285 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:41.867421  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 145702us
I20260709 13:15:41.858246  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:41.866860  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 51872.6us
I20260709 13:15:41.798749 10300 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.855456 10173 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:41.876858  6368 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:41.876974 10270 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:41.902554 10044 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.906790  6322 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
W20260709 13:15:41.916767  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 64480us
I20260709 13:15:41.910807  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:41.900682 10197 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:41.911001 10173 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:41.911365 10288 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.937481 10288 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:41.938560  6331 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
W20260709 13:15:41.920862  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 213330us
I20260709 13:15:41.912431 10301 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:41.974351  6323 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:41.949043 10043 raft_consensus.cc:3055] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:41.976194 10043 raft_consensus.cc:740] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:41.977831 10043 consensus_queue.cc:260] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.951155 10339 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:41.980993 10043 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:41.980800 10339 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.983150 10285 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.983892 10339 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.951607  6933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 810) took 1325 ms. Trace:
I20260709 13:15:41.939648 10270 raft_consensus.cc:697] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:41.952195 10176 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.985365  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:41.985527 10270 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.985926 10176 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.984599  6933 rpcz_store.cc:276] 0709 13:15:40.541720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.541869 (+   149us) service_pool.cc:224] Handling call
0709 13:15:40.542213 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:40.675270 (+133057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:40.675299 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:40.698442 (+ 23143us) log.cc:844] Serialized 26 byte log entry
0709 13:15:41.567549 (+869107us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b180032c500. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:15:41.755077 (+187528us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:41.779410 (+ 24333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.788325 (+  8915us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:41.839719 (+ 51394us) raft_consensus.cc:1685] finished
0709 13:15:41.839748 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.867214 (+ 27466us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71854,"raft.queue_time_us":162802,"raft.run_cpu_time_us":463,"raft.run_wall_time_us":9093,"spinlock_wait_cycles":7652608,"thread_start_us":235730,"threads_started":2,"wal-append.queue_time_us":1128857}
I20260709 13:15:41.988265 10176 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.988884 10246 consensus_queue.cc:1059] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:41.989108 10256 consensus_queue.cc:1059] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:41.990185 10246 raft_consensus.cc:3055] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:41.990694 10246 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:41.990890 10256 raft_consensus.cc:3055] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:41.991325 10256 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:41.992437 10256 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.954712 10335 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:42.012252 10335 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:41.963120  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 742) took 1849 ms. Trace:
I20260709 13:15:42.013270  6404 rpcz_store.cc:276] 0709 13:15:40.113148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.113369 (+   221us) service_pool.cc:224] Handling call
0709 13:15:41.228284 (+1114915us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:41.229552 (+  1268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:41.229585 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:41.237085 (+  7500us) log.cc:844] Serialized 52 byte log entry
0709 13:15:41.334828 (+ 97743us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:41.558781 (+223953us) log.cc:844] Serialized 14 byte log entry
0709 13:15:41.559438 (+   657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.559645 (+   207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:41.559744 (+    99us) raft_consensus.cc:1685] finished
0709 13:15:41.559767 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.962767 (+403000us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540044f7d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:41.962920 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10486,"prepare.queue_time_us":134887,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":17621,"raft.run_cpu_time_us":544,"raft.run_wall_time_us":16528,"spinlock_wait_cycles":2535044352,"thread_start_us":258744,"threads_started":2,"wal-append.queue_time_us":163586}
W20260709 13:15:41.946125 10208 consensus_meta.cc:287] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.004s
I20260709 13:15:42.015974 10208 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.018306 10208 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.018857  6939 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:42.019099  6329 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 6. Ops: []
I20260709 13:15:42.022244 10335 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:42.022855 10335 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:42.025668 10256 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:42.025954  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:41.969437 10288 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:41.969563  9985 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:42.029563  9985 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:42.031859  9985 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:41.970199 10262 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:42.032624 10262 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.035454  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.035835 10262 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.036192  6325 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:42.037549  6323 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:42.038769  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.039363  6331 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 4.
I20260709 13:15:41.970875  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:41.960626 10322 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:15:41.989655 10334 consensus_queue.cc:1059] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:41.972465 10044 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.991892 10246 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.045051 10334 raft_consensus.cc:3055] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:42.045933 10334 raft_consensus.cc:740] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:42.046921 10334 consensus_queue.cc:260] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.048156 10334 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:41.998555  6398 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:42.051357  6940 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:42.052218 10238 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.052799 10238 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:41.999651 10131 consensus_meta.cc:287] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.001s
I20260709 13:15:42.000352 10300 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:41.954250 10149 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:42.054255 10131 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.056412 10131 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.001224  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:41.991901  6942 raft_consensus.cc:1240] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:42.058722  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.059616  6398 raft_consensus.cc:2393] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:42.005537 10285 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.060706 10285 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.062992 10297 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:42.065214 10285 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:42.010793  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2681) took 2236 ms. Trace:
I20260709 13:15:42.065800  6330 rpcz_store.cc:276] 0709 13:15:39.773895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.804292 (+ 30397us) service_pool.cc:224] Handling call
0709 13:15:41.834854 (+2030562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.835929 (+  1075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.010554 (+174625us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b54003935d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:42.010704 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4668934912}
I20260709 13:15:42.037429  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:42.067162  6322 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:42.069559  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:41.952945 10173 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.073582 10173 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:42.009346  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 132721us
I20260709 13:15:42.087291  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:42.088018  6329 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:42.093315  9908 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:42.132308  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:42.144325  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.153054  6322 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:15:42.131642  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.155966  6933 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:42.159857  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.163121  6324 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:42.168830 10292 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:42.169073 10173 raft_consensus.cc:1064] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:15:42.169616 10292 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.172003 10292 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:42.171909 10173 consensus_queue.cc:237] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:42.175731  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.179775 10350 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.180485 10350 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.182543  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:42.183235  6322 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.184087 10350 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:42.187407  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:42.188156  6325 raft_consensus.cc:2368] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6.
I20260709 13:15:42.189023  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.189544  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:42.189699  6331 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:42.190205  6327 raft_consensus.cc:2376] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11. Re-sending same reply.
I20260709 13:15:42.190645  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:42.191260  6323 raft_consensus.cc:2376] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8. Re-sending same reply.
I20260709 13:15:42.189026  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:42.196297  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.207860  6934 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:42.196951  6329 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:15:42.209180  6937 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:42.165640 10156 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.214296  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.221031  6324 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:15:42.224053  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 60556.9us
I20260709 13:15:42.211545 10285 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:42.233136  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.234412  6329 raft_consensus.cc:2393] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:42.248373  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:42.237812 10175 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.271622  6324 pending_rounds.cc:85] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 10
I20260709 13:15:42.272219  6324 pending_rounds.cc:107] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:15:42.272604  6324 raft_consensus.cc:2889] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:42.282526  6248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47628993693e4f69a935e61e4071de94"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:42.283537  6248 raft_consensus.cc:606] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:42.283972  6248 raft_consensus.cc:614] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:42.234119 10176 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:42.289848  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:42.294601  6322 raft_consensus.cc:2410] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:42.233916 10156 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.258628 10131 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.305218  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:42.306243  6327 raft_consensus.cc:1275] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:15:42.311667 10156 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.312318 10176 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.257432 10285 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:42.316999  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.318269  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:42.318416  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:42.319980  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:42.321681  6249 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:42.337261  6325 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
W20260709 13:15:42.338970  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.339241  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:42.343204  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.346139  6249 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:15:42.296665 10175 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.356635  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.340173 10131 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.373939  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:42.373430 10263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.399s	user 0.016s	sys 0.029s
W20260709 13:15:42.393553 10263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.544s	user 0.017s	sys 0.029s
I20260709 13:15:42.398658  6327 raft_consensus.cc:1240] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:42.401765 10246 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:42.396193  6255 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:15:42.402745 10285 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:42.409142  6251 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:42.412101 10238 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.392160 10176 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.412832  6401 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:42.421278  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:42.430924  6327 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:42.433805  6296 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:42.454155  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.455664  6941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:47742
I20260709 13:15:42.459991  6941 raft_consensus.cc:606] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:42.460300  6941 raft_consensus.cc:614] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:42.440987 10285 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.458247  6327 pending_rounds.cc:85] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 5
I20260709 13:15:42.462960  6327 pending_rounds.cc:107] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:15:42.450168  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:42.463239  6327 raft_consensus.cc:2889] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:42.465561  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.472950 10323 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:42.475811 10357 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:15:42.476070 10147 consensus_meta.cc:287] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.655s	user 0.006s	sys 0.007s
I20260709 13:15:42.477315 10285 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.479480 10285 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.482139  6938 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:42.484445  6938 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 815) took 1461 ms. Trace:
I20260709 13:15:42.486562  6253 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
W20260709 13:15:42.487175  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.488772 10325 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:42.489189 10362 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:42.489517 10325 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.491884 10325 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:42.493407  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:42.493938  6325 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.452855 10292 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:15:42.496320 10331 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.500010 10331 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.501490 10064 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.502064 10064 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:42.506234  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 77708.1us
I20260709 13:15:42.511270 10288 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:42.476985  6940 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 734) took 2160 ms (client timeout 2110 ms). Trace:
W20260709 13:15:42.512478  6940 rpcz_store.cc:269] 0709 13:15:40.316637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.316742 (+   105us) service_pool.cc:224] Handling call
0709 13:15:42.460675 (+2143933us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54003f6954. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:42.476889 (+ 16214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3974564736}
I20260709 13:15:42.495818 10322 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:42.516762  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 209716us
W20260709 13:15:42.528885  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.497535 10291 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:42.527494  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:42.529843  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 62648.6us
I20260709 13:15:42.487013 10175 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.484768  6938 rpcz_store.cc:276] 0709 13:15:41.023019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.023142 (+   123us) service_pool.cc:224] Handling call
0709 13:15:41.070765 (+ 47623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:42.482567 (+1411802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.484155 (+  1588us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540069f354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:42.484380 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3173642496}
I20260709 13:15:42.519640  6398 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:42.504351 10064 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:42.535403  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.541829  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.541726  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.543418  6297 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:42.550658  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.550920  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.552057  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.552587 10124 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:42.553359  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.553210 10124 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.554680  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.554175  6331 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:42.558233  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.554284  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.563020  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.536948 10043 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.573540  6328 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:42.539664 10325 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.576635  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.542536 10131 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:42.589345  6255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:42.590165  6255 raft_consensus.cc:606] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:42.590575  6255 raft_consensus.cc:614] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:42.591025  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:42.591502  6253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 723) took 2228 ms (client timeout 1530 ms). Trace:
I20260709 13:15:42.591884  6399 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
W20260709 13:15:42.591936  6253 rpcz_store.cc:269] 0709 13:15:40.344100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.344326 (+   226us) service_pool.cc:224] Handling call
0709 13:15:42.565239 (+2220913us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54001487d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:42.572508 (+  7269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4901169920}
I20260709 13:15:42.560639 10176 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:42.601342  6398 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:42.574059 10173 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:42.576284 10064 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.616362  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.619266  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.620148  6399 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:42.547827 10322 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:15:42.606196  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:42.624918 10064 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.625825  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.626633  6396 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:42.627633 10263 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:42.628319 10263 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.595932 10301 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.621543  6907 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:42.627712 10064 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.632969  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:42.641492  6324 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.604518 10173 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.561451 10291 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.618566 10131 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.652230  6938 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:42.646445  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.656358  6942 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:15:42.654071  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.656471  6255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:42.600736 10323 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:15:42.663256  6399 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:42.665884  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.621273 10288 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.663862  6255 raft_consensus.cc:606] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:42.668143  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.674868  9793 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:42.674993 10288 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.675585  9793 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.676075  9793 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.621814 10176 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.678989 10176 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:42.643790 10301 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.680945  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.681336 10301 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:42.681761  6399 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:42.683754 10064 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:42.684461 10064 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.656205  9696 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.685565  9696 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.688133  6323 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:42.642014 10339 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:42.688994 10339 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:42.689954 10361 log.cc:927] Time spent T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.280s	user 0.001s	sys 0.001s
I20260709 13:15:42.690732  6396 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:42.691861 10290 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:42.693735 10291 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:42.620661 10325 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.693805 10290 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:42.695969 10064 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:42.696177 10325 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:42.649428 10246 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:42.698547  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.633924 10043 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.699170  6329 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:42.700203  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.700805  6331 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:42.656416 10149 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.701333  6405 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:42.701511 10149 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.703147  9793 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.704027 10149 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.650894 10173 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.707350  9793 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.697860  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:42.675613 10371 log.cc:927] Time spent T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:15:42.716837  6325 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:42.710948  6400 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:42.722049  6398 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:42.722877  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.730758  6328 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:42.725991  6938 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:42.722877  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:42.729135 10196 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.737908  6399 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.735984  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:42.738252  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.736456  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:42.655181 10331 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:42.737159  6935 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:42.749737  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.698413 10246 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:42.794039  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 45151us
W20260709 13:15:42.803289  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 56284.2us
I20260709 13:15:42.803488  6940 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:42.792820  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:15:42.810284 10064 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:42.811110 10064 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:42.812850  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.813309 10298 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.813381  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.814124 10298 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.814862  6331 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:42.815876  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.816229 10298 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:42.816464  6331 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:42.816972  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.817564  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.817739  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:42.818264  6402 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:42.818408  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:42.818722  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.819348  6322 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:42.817601  6323 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:42.747565 10196 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.826490 10343 consensus_queue.cc:1059] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:42.827165 10176 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:42.830159 10331 raft_consensus.cc:3055] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:42.830574 10331 raft_consensus.cc:740] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:42.831450 10331 consensus_queue.cc:260] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.831974  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.721742 10131 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.832576  6396 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:42.840021  6399 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:42.842133  6907 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:42.832634 10288 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.844015  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.845062  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:42.845666  6328 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.852574  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.852923  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:42.855171  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.859143  6905 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:42.857662  6251 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:15:42.806936 10043 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:42.864185  6253 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:42.868778  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.869635  6399 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:15:42.812290 10173 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.889882  6330 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:42.890671  6324 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:42.891007 10173 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:42.891253  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.891808  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.877629  6369 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:42.866374 10064 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:42.878557  6404 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:42.897428 10196 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.880198 10131 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.857589 10238 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:42.898236  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.898566 10238 raft_consensus.cc:697] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:42.898761 10301 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:42.899181 10301 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.899528 10301 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.899859  6331 raft_consensus.cc:1240] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:15:42.899461 10238 consensus_queue.cc:237] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:42.900825  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.874195 10334 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.888411 10288 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.892076  6399 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
W20260709 13:15:42.894186  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.907306  6328 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
W20260709 13:15:42.907748  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.894563  6402 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:42.895147  9696 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:42.887251  6219 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:42.902395  6324 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:42.903409  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.911695  6937 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:42.887637  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:42.914933  6329 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:42.916011  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.919627  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.920567  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:42.917435  6907 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:42.935424  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.936170  6369 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:42.899366 10246 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:42.931545  6219 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:42.936088  6400 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:42.891081 10124 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:42.925246 10175 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:42.972357 10141 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:42.916608 10288 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:42.966749  9696 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:42.934612 10270 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 13:15:42.987594  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.989322  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.979955 10141 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.007769 10054 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:43.008190 10054 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:43.008549 10054 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.009145 10288 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:42.988077  9696 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:43.012691  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:42.977671 10124 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:15:43.019169  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.006873 10141 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.021070  6404 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:43.025401  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:43.034569 10339 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:43.035753  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:42.996484 10175 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:43.037565  6400 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:43.037542  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.039834  6936 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.017642  9696 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:43.052325 10054 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:43.042165  6398 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:43.001487 10131 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:15:43.062985  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:43.066984 10372 log.cc:927] Time spent T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:15:43.068521 10373 log.cc:927] Time spent T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:15:43.072753  6936 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:43.076409 10263 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:43.076813 10374 log.cc:927] Time spent T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:43.078336  6297 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:43.100152  6398 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:43.105017  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:43.057909 10339 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:15:43.060133 10147 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:15:43.102083 10322 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:43.122752  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:43.123049 10054 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:43.124866  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:43.133257 10369 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.424s	user 0.005s	sys 0.000s
I20260709 13:15:43.134464 10175 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:43.136332  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.145640  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.146005  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.146723  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.145663  6404 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 4. Current term is 6. Ops: []
I20260709 13:15:43.149048  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:43.149549  6402 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:43.160336  6405 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:43.165871  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.168768  6396 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:43.173712  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:43.175962  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 351822us
I20260709 13:15:43.159406 10322 raft_consensus.cc:697] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:43.177424  6396 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:43.178872  6399 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:43.150233 10301 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:43.180400  6327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.031s	sys 0.040s
W20260709 13:15:43.182710  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 323648us
I20260709 13:15:43.190042  6905 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:43.186702  6327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.031s	sys 0.040s
W20260709 13:15:43.192147  6941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.036s	sys 0.063s
I20260709 13:15:43.163213 10141 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:43.192936  6941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.036s	sys 0.063s
I20260709 13:15:43.193027  6905 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:43.193778  6396 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:43.209794  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.210558  6402 raft_consensus.cc:2393] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:43.207998  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.216446  6399 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:43.204713  9793 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:43.175729  9696 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:43.225069  6150 catalog_manager.cc:5697] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 2 to 5, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 5 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:43.229277 10304 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:43.238955 10331 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:43.243633  6251 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
W20260709 13:15:43.249754  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.257244  6399 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.224040  9793 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.258327  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:43.260620  6402 raft_consensus.cc:2376] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9. Re-sending same reply.
I20260709 13:15:43.241375 10175 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:43.245325 10288 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:43.247762 10323 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.254218 10196 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:43.268175  6369 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:43.269011  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 272668us
I20260709 13:15:43.262148  9793 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:43.279660  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 252678us
I20260709 13:15:43.265345 10175 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.288020  6255 raft_consensus.cc:1240] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:43.289577  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 312568us
W20260709 13:15:43.299068  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 87229.2us
I20260709 13:15:43.300354  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.295475  6222 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:43.285252 10298 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:43.302731  6222 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:43.291853 10175 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:43.272292 10288 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:43.312301 10149 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:15:43.317444  6371 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:43.314849  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:43.322059  6219 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:43.322443  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.265998 10322 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:43.326844 10304 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:43.327361 10304 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:43.329192 10384 consensus_queue.cc:1059] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:15:43.331540 10270 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:43.332041 10141 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:43.283072 10196 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:43.304966 10147 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:43.304769 10173 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:43.354077 10147 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.364259 10147 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.365437  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:43.366076  6934 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:43.341018  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:43.367079  6404 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.367208  6297 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:43.368093 10285 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:43.368463 10285 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:43.368801 10285 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:43.341758  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.302971 10339 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:15:43.371860 10381 log.cc:927] Time spent T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:15:43.337345  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:43.373198  6326 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:43.315588 10298 raft_consensus.cc:697] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:43.374547 10298 consensus_queue.cc:237] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:43.321089 10054 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:43.342679  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:43.345461  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.346825 10288 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:43.350453  9793 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:43.352821  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.353235 10238 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.340186 10301 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:43.312434 10131 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:43.353848 10384 raft_consensus.cc:3055] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:43.294394 10323 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:43.386901  6150 catalog_manager.cc:5697] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 2 to 4, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 4 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:43.363538  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:43.388974  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:43.362458 10196 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:43.363819 10173 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:43.392273 10377 log.cc:927] Time spent T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:15:43.400193  6404 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:43.421840  6399 raft_consensus.cc:1275] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:15:43.433174  6249 raft_consensus.cc:2393] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:43.416308 10131 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.449421  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.418803 10384 raft_consensus.cc:740] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:43.438356 10196 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:43.457542  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2720) took 1016 ms. Trace:
I20260709 13:15:43.458187  9793 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:43.416837 10238 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:43.458599 10173 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:43.447099  9696 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:43.459255 10285 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:43.452183 10131 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.460430  6150 catalog_manager.cc:5697] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 5 to 8, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 8 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.489328  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:43.490939  6396 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:43.493830  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.505353  6249 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
W20260709 13:15:43.488824  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 166849us
I20260709 13:15:43.501809  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:43.502324  6941 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:15:43.514914  6905 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:43.488245  6327 rpcz_store.cc:276] 0709 13:15:42.441330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.441475 (+   145us) service_pool.cc:224] Handling call
0709 13:15:42.458108 (+ 16633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:42.536231 (+ 78123us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:42.563963 (+ 27732us) log.cc:844] Serialized 14 byte log entry
0709 13:15:43.202669 (+638706us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:43.208281 (+  5612us) log.cc:844] Serialized 26 byte log entry
0709 13:15:43.208433 (+   152us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:43.208681 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 13:15:43.210727 (+  2046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.210943 (+   216us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:43.342231 (+131288us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b1800441b20. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:15:43.350579 (+  8348us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b1800441b20. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af8522 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:15:43.457263 (+106684us) raft_consensus.cc:1685] finished
0709 13:15:43.457294 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:43.457467 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":522,"prepare.queue_time_us":29307,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":11976,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":5693,"spinlock_wait_cycles":12151424,"thread_start_us":561216,"threads_started":1,"wal-append.queue_time_us":675999}
I20260709 13:15:43.517567  6368 leader_election.cc:400] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6.
I20260709 13:15:43.534145  6368 leader_election.cc:403] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:15:43.536381  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.538430  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.536866  6219 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:43.539126  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:43.539681  6330 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.552110  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.556663  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.558240  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.554734  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.552826  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.553458  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:43.494828 10196 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:43.551376  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.510872 10322 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:43.578274  6150 catalog_manager.cc:5697] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:43.554324  6154 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55346 (request call id 392) took 14899 ms (client timeout 15000 ms). Trace:
I20260709 13:15:43.584117  6248 raft_consensus.cc:2393] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 7: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:43.535907  9793 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:43.591769  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 55057us
I20260709 13:15:43.595306  6219 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:43.598970  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.555457 10323 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:43.600483  6400 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:43.593832  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.603929  6219 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:43.605521  6256 raft_consensus.cc:2410] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:43.603442 10263 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.606597 10263 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:43.609797 10238 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:43.611129 10301 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 5. Current term is 6.
I20260709 13:15:43.611457  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.612112  6399 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:15:43.564975 10339 consensus_queue.cc:1059] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:15:43.613099 10339 raft_consensus.cc:3055] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:43.613445 10285 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:43.598546 10064 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:43.614391 10064 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:43.614996 10064 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.615738  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:43.615840  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.616360  6254 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:43.617152  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.617756  6252 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:43.618568  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:43.619359  6219 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:43.619570  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.620159  6252 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:43.620267 10124 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:43.620839 10124 raft_consensus.cc:697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:43.614993  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.621477  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.621652  6253 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:43.621799 10124 consensus_queue.cc:237] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:43.622515 10389 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:43.622866  6253 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:43.623070 10389 raft_consensus.cc:697] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:43.623935 10389 consensus_queue.cc:237] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:43.625540  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.625507 10064 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:43.613458 10339 raft_consensus.cc:740] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:43.628062 10064 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:43.628428  6150 catalog_manager.cc:5697] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 2 to 5, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 5 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:43.629742  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.630838  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.631409  6219 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:43.620941  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.632342  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.632553  6252 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:43.633781  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:43.578806 10322 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.636807  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.637830  6219 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:43.638867  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.638904  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:43.640995  6219 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:43.593976  9793 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:43.640902  6250 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
W20260709 13:15:43.644651  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 105062us
I20260709 13:15:43.541416 10387 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:15:43.646720  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:43.574818 10304 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:43.650189  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 72453.1us
I20260709 13:15:43.652505  6296 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:43.650153  6400 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:15:43.651492  6329 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:43.637403 10263 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:43.577844 10399 consensus_queue.cc:1059] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:15:43.644126  9696 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:43.638324 10149 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:43.649966  9793 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:43.642630 10322 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.672143  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.641309 10064 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:43.644290 10331 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:43.653373  6296 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:43.655444 10285 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:43.657742  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:43.672547  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.548756 10384 consensus_queue.cc:260] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:43.677352  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 178296us
I20260709 13:15:43.660284  9696 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.628602 10339 consensus_queue.cc:260] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:43.694132 10339 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:43.673630  6906 leader_election.cc:336] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.530s (SENT)
I20260709 13:15:43.679927  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:43.651434 10147 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:43.697638  6331 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.698110  6251 raft_consensus.cc:2393] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:43.699105 10147 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:43.704234  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:43.704953  6331 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:43.705145  6941 raft_consensus.cc:2393] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:43.705885  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:43.705958  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.707105  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:43.707629  6327 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:43.713591  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:43.714044  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.715166  6219 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:43.718519  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:43.582533  6154 rpcz_store.cc:269] 0709 13:15:28.630216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.630651 (+   435us) service_pool.cc:224] Handling call
0709 13:15:43.510823 (+14880172us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:38.171184 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:38.172078 (+   894us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:38.172139 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:15:38.172166 (+    27us) tablet.cc:662] Decoding operations
0709 13:15:38.174064 (+  1898us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:38.174158 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:38.174201 (+    43us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:15:38.175882 (+  1681us) tablet.cc:701] Row locks acquired
0709 13:15:38.175941 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:15:38.176136 (+   195us) write_op.cc:270] Start()
0709 13:15:38.176337 (+   201us) write_op.cc:276] Timestamp: P: 1783602938176063 usec, L: 0
0709 13:15:38.176365 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:15:38.187246 (+ 10881us) log.cc:844] Serialized 6571 byte log entry
0709 13:15:38.631879 (+444633us) op_driver.cc:464] REPLICATION: finished
0709 13:15:38.835961 (+204082us) write_op.cc:301] APPLY: starting
0709 13:15:38.836056 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:38.988113 (+152057us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:39.016343 (+ 28230us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:39.223866 (+207523us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:39.315192 (+ 91326us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:15:39.326321 (+ 11129us) write_op.cc:312] APPLY: finished
0709 13:15:39.346674 (+ 20353us) log.cc:844] Serialized 113 byte log entry
0709 13:15:39.362806 (+ 16132us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:39.370987 (+  8181us) write_op.cc:454] Released schema lock
0709 13:15:39.388367 (+ 17380us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:39.415125 (+ 26758us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:39.420161 (+  5036us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3883602,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":168647,"apply.run_cpu_time_us":7158,"apply.run_wall_time_us":574053,"num_ops":16,"prepare.queue_time_us":488784,"prepare.run_cpu_time_us":34460,"prepare.run_wall_time_us":230778,"raft.queue_time_us":135131,"raft.run_cpu_time_us":30657,"raft.run_wall_time_us":129704,"replication_time_us":455350,"thread_start_us":630437,"threads_started":4,"wal-append.queue_time_us":235415,"wal-append.run_cpu_time_us":26306,"wal-append.run_wall_time_us":1934573}]]}
I20260709 13:15:43.720011  6368 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:43.719966  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:43.684085 10331 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.722570  6219 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:43.683511 10285 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:43.725937  6219 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:43.711414  9696 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:43.718146 10399 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:43.750818  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:43.778376  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 125069us
I20260709 13:15:43.723944 10343 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:43.803045  6254 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:43.786756  6296 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:43.787595 10138 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:43.723778 10064 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:43.732874 10301 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:43.730247 10331 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:43.740985 10175 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:43.736399 10270 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:43.738340 10285 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:43.809283  6941 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:43.810163  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 121909us
I20260709 13:15:43.809872  6296 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:43.813164  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.814073  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:43.777017 10399 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:43.777760 10384 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.816781  6907 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:43.806941 10064 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.817907  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:43.808624 10402 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:43.808744 10301 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:43.843616  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.812182 10138 raft_consensus.cc:697] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:43.823210 10290 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.873523  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.874846  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.816946 10411 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:43.856956  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:43.832867 10064 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:43.863574 10149 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:43.709757 10382 consensus_queue.cc:1175] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" responder_term: 9 status { last_received { term: 7 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:15:43.867129 10400 log.cc:927] Time spent T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 13:15:43.869823 10408 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:15:43.873574  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:43.844900 10402 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.869760 10263 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:43.832944 10399 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.850037 10301 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.906679  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:43.911966  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:43.913384  6940 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:43.879817  6330 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:15:43.919296  6295 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:43.917868  6326 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
W20260709 13:15:43.904727 10334 consensus_meta.cc:287] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.983s	user 0.013s	sys 0.000s
I20260709 13:15:43.905683 10149 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.933424  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:43.912379  6221 connection.cc:256] RPC call timeout handler was delayed by -1.5570741760000146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 13:15:43.934270  6323 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:43.906343 10304 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:43.921836 10263 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.924644 10175 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:43.944578  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 134787us
I20260709 13:15:43.955260  6296 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:43.946563  6256 raft_consensus.cc:2410] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:15:43.945010  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 117807us
I20260709 13:15:43.956593  6368 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:43.920929 10402 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.938423 10334 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:43.904366 10411 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:43.918318 10290 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:43.945120 10173 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:43.958894 10263 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:43.997257  6933 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:43.979704 10298 raft_consensus.cc:2764] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:15:43.998654  6935 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:15:43.995092  6296 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:43.997835  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 78602.7us
I20260709 13:15:44.000707  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:44.003029 10176 raft_consensus.cc:3055] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:44.003432 10176 raft_consensus.cc:740] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:44.004196 10176 consensus_queue.cc:260] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:44.006116 10412 log.cc:927] Time spent T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:15:44.010696 10290 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.012972 10176 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.014380  6329 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:43.978461 10138 consensus_queue.cc:237] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.001027  6295 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:44.008345  9696 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:44.031688 10131 consensus_meta.cc:287] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
I20260709 13:15:44.087402  6327 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 5.
W20260709 13:15:44.091331  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 93436.9us
W20260709 13:15:44.091758  6221 connection.cc:256] RPC call timeout handler was delayed by -1.1285049470000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 13:15:44.093840  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:44.093587  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 267143us
I20260709 13:15:44.094903  6250 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:44.053656 10043 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:44.100610  6368 leader_election.cc:304] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.110644 10406 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:15:44.111898 10420 log.cc:927] Time spent T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:15:44.112982 10404 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.423s	user 0.003s	sys 0.000s
I20260709 13:15:44.111344 10406 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:15:44.123201  6323 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:44.092900 10131 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:44.139860  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 152846us
W20260709 13:15:44.148097  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 147118us
W20260709 13:15:44.137590  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 320865us
I20260709 13:15:44.148301  6296 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:44.161303  6907 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:44.168375  6297 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:44.150858 10325 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:44.173810 10422 log.cc:927] Time spent T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:15:44.174338 10439 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:44.177336 10424 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:44.201331 10424 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.201736 10424 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:44.202417 10427 raft_consensus.cc:2764] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:15:44.203162 10173 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:44.203642 10173 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:44.205623 10285 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.207017  6325 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:44.207911 10285 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.162905 10043 raft_consensus.cc:697] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:44.209160 10043 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.180415 10322 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.182324 10437 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:44.188576  6296 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:44.161083 10141 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.194921 10439 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:44.195613 10411 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:44.199494 10417 consensus_queue.cc:1059] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:44.200465  6221 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:44.200511 10064 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:44.217639  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 49467.7us
I20260709 13:15:44.218451 10427 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:15:44.224766 10437 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.200752 10149 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.225522 10141 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.226500 10439 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:44.227196  9793 consensus_meta.cc:287] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.002s
I20260709 13:15:44.222246  6296 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:44.249626  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 163944us
I20260709 13:15:44.257184  6906 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.257581  6328 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:15:44.261057  6250 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:44.228295 10424 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.245726 10425 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:44.264660  6906 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:44.262615  9793 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.268895 10196 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.269470  6399 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:44.270723  9696 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:44.274664 10141 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.252991 10285 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:44.282155  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 81789.1us
I20260709 13:15:44.255285 10382 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.282052 10285 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:44.314599 10431 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:44.315295 10416 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:44.316901 10064 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.256175 10131 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:44.406201 10433 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:44.407021 10433 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.283757 10407 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.414088 10406 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:44.267112 10290 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.415432 10416 raft_consensus.cc:697] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:44.416792 10416 consensus_queue.cc:237] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.256512 10437 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:44.377815  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 155662us
I20260709 13:15:44.422149 10417 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:44.422842  6296 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:44.378098 10426 raft_consensus.cc:3055] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:44.396857 10176 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:44.423998 10417 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:44.397178 10422 log.cc:927] Time spent T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:15:44.426762  6296 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:44.429860  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 280834us
I20260709 13:15:44.278731 10425 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:44.428004  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 335827us
I20260709 13:15:44.424270 10176 raft_consensus.cc:697] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:44.445310  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:44.446125  6399 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.444113  6295 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:44.378647 10431 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:44.450924 10431 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:44.451095  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:44.451820  6400 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.453307 10418 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:44.453810 10418 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.454154 10418 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.454459  6295 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:44.381462 10285 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.458508 10322 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.459142 10322 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:44.458998 10431 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.459818 10322 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.460681 10149 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.461036 10431 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.424033 10426 raft_consensus.cc:740] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:44.461624  9793 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:44.462239 10426 consensus_queue.cc:260] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:44.463222 10331 consensus_meta.cc:287] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.641s	user 0.009s	sys 0.002s
I20260709 13:15:44.463264 10426 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.463794 10331 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.464581 10417 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:44.465113 10417 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.467770 10417 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:44.469977 10331 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.473685 10176 consensus_queue.cc:237] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.476253  6400 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:44.477828  6368 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.478008  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:44.472572 10402 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.481420  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:44.482090  6399 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:44.484512  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:44.487115  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:44.488699  6322 raft_consensus.cc:2410] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:44.487273  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:44.486886  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:44.484244  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:44.487006  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:44.490660  6327 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:44.476517 10173 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:44.492766  6935 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:15:44.494063  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:44.496443  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:44.447978 10425 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:44.497417  6329 raft_consensus.cc:2393] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:44.501799  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:44.502592  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:44.506479  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:44.483494 10432 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:44.514681 10432 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.514163 10442 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:44.518754  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 81479.2us
I20260709 13:15:44.523867  6368 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.535004 10442 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:44.536373 10263 consensus_meta.cc:287] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 13:15:44.538183 10442 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.541002  6933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 765) took 1651 ms. Trace:
I20260709 13:15:44.541405  6933 rpcz_store.cc:276] 0709 13:15:42.889203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.890532 (+  1329us) service_pool.cc:224] Handling call
0709 13:15:42.890820 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.998801 (+1107981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.540808 (+542007us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400615154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:44.540946 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2540294016}
I20260709 13:15:44.543208  9793 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:44.543517  6907 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:44.519918  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:44.501410 10433 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:44.496618 10443 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:44.544843 10430 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:44.487538 10417 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:15:44.503119 10426 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:15:44.544482 10411 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:44.562930 10301 consensus_meta.cc:287] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.002s
I20260709 13:15:44.544499 10432 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:44.536942 10263 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.568074 10405 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:44.592450  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 68676.6us
W20260709 13:15:44.594599 10399 consensus_meta.cc:287] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.003s
I20260709 13:15:44.568799 10430 raft_consensus.cc:697] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:44.599474  6368 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:44.600768  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 95519.1us
I20260709 13:15:44.568480 10285 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.605406 10424 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.605988 10263 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.606102 10285 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.606599 10441 consensus_queue.cc:1059] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 13:15:44.611322 10440 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 13:15:44.591395 10432 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.588539 10411 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.590042 10301 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.633044  6935 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:44.619354  6368 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.635828  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:44.636296  6935 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:44.635001 10384 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:44.637225  6938 raft_consensus.cc:1240] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:44.638463  6221 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:44.639566  6219 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.641319  6905 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:44.595029 10399 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.616282 10414 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:44.644172  6905 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:44.646164  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:44.646850  6938 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:44.647157 10301 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:44.647528  6368 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:44.647629 10263 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:44.648829  6368 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.649149 10064 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.643476 10331 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:44.654922  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.622656 10407 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:44.659889  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:44.660995  6328 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:44.629833 10402 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.654287 10427 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:44.663215 10427 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.661020 10288 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:44.664651 10288 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.665716  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:44.666617 10288 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.672389  6326 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:44.660713 10290 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:44.654347 10411 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.677232 10131 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:44.654958 10304 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:44.677526 10439 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.677971 10131 consensus_queue.cc:1243] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer 8600a3fead0e48a7aa813822ec44d0fe log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:15:44.678247 10304 raft_consensus.cc:697] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:44.679155 10131 consensus_queue.cc:1059] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:44.679593 10439 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.679208 10304 consensus_queue.cc:237] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.681128 10418 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.670248 10301 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:44.683316 10418 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.685112 10043 raft_consensus.cc:3055] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:44.685539 10043 raft_consensus.cc:740] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:44.677328 10290 raft_consensus.cc:697] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:44.676286  6328 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:15:44.686411 10043 consensus_queue.cc:260] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.687752 10043 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:44.687304 10290 consensus_queue.cc:237] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.687860  6324 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:44.688324  6219 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:44.680243 10131 raft_consensus.cc:3055] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:44.689071 10131 raft_consensus.cc:740] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:44.689858 10131 consensus_queue.cc:260] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.691166 10131 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.691670 10124 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:44.692090  6328 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:44.693670 10141 consensus_queue.cc:1059] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:44.696434  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2744) took 1026 ms. Trace:
I20260709 13:15:44.652045 10054 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:44.617074 10432 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.630247 10298 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:15:44.728433  6934 pending_rounds.cc:85] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Aborting all ops after (but not including) 7
I20260709 13:15:44.728768  6934 pending_rounds.cc:107] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:15:44.637215 10384 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.725884  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:44.729015  6934 raft_consensus.cc:2889] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:44.733433  6328 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:44.734026  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:44.734604  6327 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:44.734431  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:44.735201  6328 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:44.730705  6322 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:44.731659  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 113987us
I20260709 13:15:44.675312 10173 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:15:44.644825 10437 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.718688  6331 rpcz_store.cc:276] 0709 13:15:43.670366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.706776 (+ 36410us) service_pool.cc:224] Handling call
0709 13:15:43.707079 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.707282 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:43.707854 (+   572us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.696044 (+988190us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b1800441820. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f457578d4bc 00007f4572adb48b 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af5455 00007f4575bdd060 00007f4575bef716 00007f4575c00287
0709 13:15:44.696132 (+    88us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:44.696176 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:44.696223 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.696282 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.696382 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15890,"prepare.queue_time_us":179,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":182262,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":16720,"spinlock_wait_cycles":24465792,"thread_start_us":416240,"threads_started":2,"wal-append.queue_time_us":261999}
I20260709 13:15:44.742283  6905 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:44.738750  6328 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:15:44.739009  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 90242.2us
W20260709 13:15:44.718894 10447 log.cc:927] Time spent T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:15:44.748322  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:44.752569  6331 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:44.754366  6331 raft_consensus.cc:1240] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:44.749969  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:44.750424  6368 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.756155  6368 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.757347  6368 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.763947  6323 raft_consensus.cc:2368] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11.
I20260709 13:15:44.776665  6368 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.777666  6327 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:44.696848 10430 consensus_queue.cc:237] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.769536  9793 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:44.767927 10325 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.770911 10301 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.806092  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:44.750193 10339 consensus_queue.cc:1059] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:15:44.807360 10382 raft_consensus.cc:3055] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:44.807768 10382 raft_consensus.cc:740] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:44.808102 10339 raft_consensus.cc:3055] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:44.808498 10339 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:44.809335 10339 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.811414 10323 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.812300 10410 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:44.812860 10410 raft_consensus.cc:697] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:44.813699 10339 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:44.781175 10451 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.806205  6368 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:44.801180 10449 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:15:44.777880 10392 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.819813  6935 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:44.871263  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2750) took 1156 ms. Trace:
I20260709 13:15:44.871663  6326 rpcz_store.cc:276] 0709 13:15:43.715286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.980126 (+264840us) service_pool.cc:224] Handling call
0709 13:15:43.996121 (+ 15995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.674577 (+678456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.871044 (+196467us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54002918d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:44.871203 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549260160}
W20260709 13:15:44.874148  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 68030.7us
I20260709 13:15:44.874879  6368 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.876183  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:44.808575 10382 consensus_queue.cc:260] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.883800  6219 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.867331 10298 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.865585  9793 raft_consensus.cc:697] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:44.877559 10443 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:44.890304  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 152247us
I20260709 13:15:44.914500  6368 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.915934  6368 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.917955  6219 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:44.920169  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.924420  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:44.926970  6326 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:15:44.929018  6905 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:44.888515 10124 raft_consensus.cc:697] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:44.873301 10392 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.813716 10410 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.899260 10399 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.898392 10406 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.941884  6221 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:44.949321  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.955236  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 218239us
I20260709 13:15:44.938064 10382 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:44.963951  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 44082.6us
I20260709 13:15:44.936950  9696 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.967108  6368 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.901465 10298 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.972584  6368 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.974409  6222 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:44.974498  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:44.975270  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:44.975549  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:44.975632  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:44.957546 10246 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:44.954800 10054 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.956146 10323 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:44.992995 10452 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:15:44.993597 10124 consensus_queue.cc:237] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:44.987277  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:44.938457 10064 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:15:44.992009 10462 log.cc:927] Time spent T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:15:44.992080 10403 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:45.003674 10392 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:44.987793 10443 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:45.014902 10474 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.987705 10406 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:45.021720 10149 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:44.996291 10425 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:44.970170  9793 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:45.023293  6936 raft_consensus.cc:2368] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
I20260709 13:15:45.023756 10427 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:45.024932 10149 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:44.986136 10415 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:44.945708 10460 consensus_queue.cc:1059] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:15:45.025507 10149 raft_consensus.cc:697] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:45.026350 10460 raft_consensus.cc:3055] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:45.006382 10298 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:44.998502 10437 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.967255 10384 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:44.970880 10432 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:44.996739 10246 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:45.027596 10425 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:45.026698 10149 consensus_queue.cc:237] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:45.026716 10460 raft_consensus.cc:740] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:44.990234 10459 consensus_queue.cc:1059] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:15:45.025548 10415 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:45.025035  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 50651.7us
I20260709 13:15:45.031517  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:45.042455  6399 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:45.028102 10246 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:45.036067  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:45.044344  6330 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:15:45.043728 10459 raft_consensus.cc:3055] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:45.046002  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:45.046173  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:45.046729  6404 raft_consensus.cc:2393] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:45.047005  6934 raft_consensus.cc:2393] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:45.046034 10459 raft_consensus.cc:740] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:45.037638 10443 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:45.036871  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:45.043988 10415 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:45.050189 10459 consensus_queue.cc:260] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:45.089398 10459 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:45.094899 10402 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.095489  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.095463 10402 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:45.099104 10402 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:45.099874  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.103679  6941 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:45.105042 10402 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:45.106002  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:45.083174  6330 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:15:45.124801  6905 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:45.129973  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:45.134989  6325 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:45.137301  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:45.133394 10396 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:45.078387 10460 consensus_queue.cc:260] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:45.155875  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:45.236600  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.296737  6404 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:46.296324  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.297504  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2243) took 1167 ms. Trace:
I20260709 13:15:46.297569  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:46.297688  6397 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:15:46.297941  6404 rpcz_store.cc:276] 0709 13:15:45.129945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.130066 (+   121us) service_pool.cc:224] Handling call
0709 13:15:46.297415 (+1167349us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:46.298411  6397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2247) took 1143 ms (client timeout 1504 ms). Trace:
I20260709 13:15:46.298903  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.299265  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:46.298956  6397 rpcz_store.cc:269] 0709 13:15:45.155207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.155344 (+   137us) service_pool.cc:224] Handling call
0709 13:15:46.298358 (+1143014us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:45.354202  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.304159  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2252) took 1114 ms. Trace:
I20260709 13:15:46.299958  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:46.305061  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.301990  6940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 782) took 1327 ms. Trace:
I20260709 13:15:46.302191  6938 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 789) took 1193 ms. Trace:
I20260709 13:15:46.306140  6404 rpcz_store.cc:276] 0709 13:15:45.189941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.299029 (+1109088us) service_pool.cc:224] Handling call
0709 13:15:46.304105 (+  5076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.927886  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2753) took 1238 ms. Trace:
I20260709 13:15:46.306253  6940 rpcz_store.cc:276] 0709 13:15:44.974400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.976370 (+  1970us) service_pool.cc:224] Handling call
0709 13:15:44.976771 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.981230 (+  4459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.981264 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.981782 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.174105 (+192323us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:45.174163 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.174254 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.301777 (+1127523us) raft_consensus.cc:1685] finished
0709 13:15:46.301799 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.301936 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4117,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":191825,"threads_started":1,"wal-append.queue_time_us":1318497}
I20260709 13:15:46.308658  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 783) took 1076 ms. Trace:
I20260709 13:15:45.596084  6933 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:46.309340  6397 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
W20260709 13:15:45.378139  6296 leader_election.cc:336] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.999s (SENT)
W20260709 13:15:45.595633  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.303267  6934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 787) took 1201 ms. Trace:
W20260709 13:15:46.304780  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.681241  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.265307  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:46.305539  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 1.37405e+06us
I20260709 13:15:46.278048 10403 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.311892  6403 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.310696  6934 rpcz_store.cc:276] 0709 13:15:45.102148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.108570 (+  6422us) service_pool.cc:224] Handling call
0709 13:15:46.302766 (+1194196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:46.302976 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:46.303004 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:46.303040 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:46.303069 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.303126 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.303217 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.189824  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:45.245350  6295 leader_election.cc:336] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.501s (SENT)
I20260709 13:15:46.313587  6398 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:46.314273  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 1.06889e+06us
I20260709 13:15:46.308257  6324 rpcz_store.cc:276] 0709 13:15:44.689023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.689894 (+   871us) service_pool.cc:224] Handling call
0709 13:15:44.690173 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.991316 (+301143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.991349 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:44.991431 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:44.991499 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.874688 (+883189us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54002418d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:45.927642 (+ 52954us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.927810 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692103936}
W20260709 13:15:45.475907  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.266228  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 330128us
I20260709 13:15:46.320801  6219 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:46.306348  6938 rpcz_store.cc:276] 0709 13:15:45.108489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.111013 (+  2524us) service_pool.cc:224] Handling call
0709 13:15:45.111387 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.111821 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.111860 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:45.115023 (+  3163us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.291904 (+176881us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:45.291965 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.292595 (+   630us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.301989 (+1009394us) raft_consensus.cc:1685] finished
0709 13:15:46.302009 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.302135 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1379,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":1177,"thread_start_us":139351,"threads_started":1,"wal-append.queue_time_us":1168492}
I20260709 13:15:46.303242  6405 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:15:46.311980 10403 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.322599  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2249) took 1144 ms. Trace:
I20260709 13:15:46.299757  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2242) took 1179 ms. Trace:
I20260709 13:15:46.298456  6402 raft_consensus.cc:2393] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:46.322969  6296 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:46.309234  6941 rpcz_store.cc:276] 0709 13:15:45.232637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.232814 (+   177us) service_pool.cc:224] Handling call
0709 13:15:46.306152 (+1073338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:46.308361 (+  2209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:46.308386 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:46.308425 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:46.308455 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.308517 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.308610 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:46.310593  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2259) took 1080 ms. Trace:
I20260709 13:15:46.348237  6397 rpcz_store.cc:276] 0709 13:15:45.230413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.304195 (+1073782us) service_pool.cc:224] Handling call
0709 13:15:46.310531 (+  6336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.849202  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2755) took 1157 ms. Trace:
W20260709 13:15:45.592582 10246 consensus_meta.cc:287] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.002s
W20260709 13:15:46.315320  6295 leader_election.cc:336] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.533s (SENT)
I20260709 13:15:46.347543  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2245) took 1197 ms. Trace:
I20260709 13:15:46.352087  6402 rpcz_store.cc:276] 0709 13:15:45.150155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.297221 (+1147066us) service_pool.cc:224] Handling call
0709 13:15:46.347467 (+ 50246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.853230  6153 catalog_manager.cc:5697] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.352851  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:46.353529  6404 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.346392  6405 rpcz_store.cc:276] 0709 13:15:45.178302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.178467 (+   165us) service_pool.cc:224] Handling call
0709 13:15:46.302992 (+1124525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:46.322316 (+ 19324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.322541 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:46.354033  6295 leader_election.cc:336] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.551s (SENT)
I20260709 13:15:46.348342  6396 rpcz_store.cc:276] 0709 13:15:45.120851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.120977 (+   126us) service_pool.cc:224] Handling call
0709 13:15:46.299705 (+1178728us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:46.349316  6329 rpcz_store.cc:276] 0709 13:15:44.691358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.693457 (+  2099us) service_pool.cc:224] Handling call
0709 13:15:44.693793 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:44.748547 (+ 54754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.748573 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:44.754047 (+  5474us) log.cc:844] Serialized 52 byte log entry
0709 13:15:44.874441 (+120394us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:44.969183 (+ 94742us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.969579 (+   396us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.969770 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.848623 (+878853us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b5400293bd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:45.848686 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.848854 (+   168us) raft_consensus.cc:1685] finished
0709 13:15:45.848874 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.849104 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":84309,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":82,"raft.queue_time_us":709,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":5162,"spinlock_wait_cycles":125007744,"thread_start_us":164413,"threads_started":2,"wal-append.queue_time_us":129899,"wal-append.run_cpu_time_us":2555,"wal-append.run_wall_time_us":1093918}
W20260709 13:15:46.323117 10149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.003s	sys 0.000s
I20260709 13:15:46.360800  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:45.191418 10396 raft_consensus.cc:697] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:15:45.447224 10430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.024s	sys 0.009s
I20260709 13:15:46.369776  6399 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:46.362391  6402 raft_consensus.cc:2393] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:46.362882  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:46.364343  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:46.336371 10457 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:46.313580 10331 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.887425 10441 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.396596 10331 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.404649 10441 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:46.406706 10331 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.407743 10441 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:46.408257 10331 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:45.799288 10414 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:46.361765 10149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.004s	sys 0.000s
I20260709 13:15:46.387812  6401 raft_consensus.cc:2393] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 12: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:45.175066 10476 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:46.393963  6396 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:46.364951  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.393922  6397 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:45.230907 10263 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 1.180s
I20260709 13:15:46.394690  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2261) took 1102 ms. Trace:
W20260709 13:15:46.366324 10430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.558s	user 0.035s	sys 0.026s
I20260709 13:15:46.387460 10485 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.354830  6295 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.504s (SENT) [suppressed 22 similar messages]
I20260709 13:15:46.335830 10472 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:15:46.408532 10441 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.336094 10124 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.336043 10382 consensus_queue.cc:1059] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:15:46.361878 10481 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:46.415112  6404 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:46.423795  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2257) took 1194 ms. Trace:
I20260709 13:15:46.416189  6402 rpcz_store.cc:276] 0709 13:15:45.292013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.353069 (+1061056us) service_pool.cc:224] Handling call
0709 13:15:46.394636 (+ 41567us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:46.424176  6404 rpcz_store.cc:276] 0709 13:15:45.229745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.307850 (+1078105us) service_pool.cc:224] Handling call
0709 13:15:46.423731 (+115881us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:46.424371  6396 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:46.355645 10246 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.419646  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2260) took 1162 ms. Trace:
I20260709 13:15:46.425632  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2255) took 1234 ms. Trace:
I20260709 13:15:46.421595  6935 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:46.394258  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2251) took 1204 ms. Trace:
I20260709 13:15:46.414517 10492 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.425755  6405 rpcz_store.cc:276] 0709 13:15:45.257413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.354432 (+1097019us) service_pool.cc:224] Handling call
0709 13:15:46.419578 (+ 65146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:46.426570  6399 rpcz_store.cc:276] 0709 13:15:45.189573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.190363 (+   790us) service_pool.cc:224] Handling call
0709 13:15:46.394198 (+1203835us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:46.431265  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:46.431768  6404 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.425999  6396 rpcz_store.cc:276] 0709 13:15:45.190834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.354801 (+1163967us) service_pool.cc:224] Handling call
0709 13:15:46.425577 (+ 70776us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:46.433003  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.434032  6396 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:46.434405  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2253) took 1244 ms. Trace:
I20260709 13:15:46.434639  6396 rpcz_store.cc:276] 0709 13:15:45.190196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.432826 (+1242630us) service_pool.cc:224] Handling call
0709 13:15:46.434361 (+  1535us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:46.433393  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:46.435396  6399 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.440943  6937 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 12: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:46.427443 10149 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:15:46.443450 10486 log.cc:927] Time spent T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:15:46.426815 10124 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.448208  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:46.430758 10425 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.431483 10382 raft_consensus.cc:3055] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:46.453722  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2258) took 1223 ms. Trace:
I20260709 13:15:46.454109  6405 rpcz_store.cc:276] 0709 13:15:45.230106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.432555 (+1202449us) service_pool.cc:224] Handling call
0709 13:15:46.453655 (+ 21100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:46.452126  6399 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:46.455885  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:46.456743  6396 raft_consensus.cc:2410] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:15:46.414806 10414 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.423866 10441 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:46.410194 10457 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.477694  6403 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
W20260709 13:15:46.481251  6403 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2246) took 1328 ms (client timeout 1703 ms). Trace:
I20260709 13:15:46.459824  6404 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:46.465368  6398 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:46.481678  6397 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
W20260709 13:15:46.481967  6398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2250) took 1302 ms (client timeout 1598 ms). Trace:
I20260709 13:15:46.432394 10492 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.454012 10382 raft_consensus.cc:740] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:46.466753 10414 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.477653 10403 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.454607 10149 raft_consensus.cc:697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:46.462654  6935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 779) took 1489 ms. Trace:
I20260709 13:15:46.479893 10124 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:46.481634  6403 rpcz_store.cc:269] 0709 13:15:45.152806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.152922 (+   116us) service_pool.cc:224] Handling call
0709 13:15:46.481183 (+1328261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:46.483142  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2256) took 1291 ms. Trace:
I20260709 13:15:46.414561 10476 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.421211 10485 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:46.464802  6937 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 784) took 1489 ms (client timeout 1835 ms). Trace:
W20260709 13:15:46.484259  6398 rpcz_store.cc:269] 0709 13:15:45.179891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.179996 (+   105us) service_pool.cc:224] Handling call
0709 13:15:46.481914 (+1301918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:46.484534 10393 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:46.488852  6396 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:46.440299 10263 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:46.493970  6399 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:46.491418  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:46.491180  6935 rpcz_store.cc:276] 0709 13:15:44.973502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.973670 (+   168us) service_pool.cc:224] Handling call
0709 13:15:44.973972 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:46.426254 (+1452282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.462323 (+ 36069us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b540055c154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:46.462577 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3328787712}
I20260709 13:15:46.494993  6397 rpcz_store.cc:276] 0709 13:15:45.191149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.351563 (+1160414us) service_pool.cc:224] Handling call
0709 13:15:46.482346 (+130783us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:46.490911 10415 consensus_meta.cc:287] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.377s	user 0.011s	sys 0.002s
I20260709 13:15:46.428350 10481 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.458384 10425 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.504408  6402 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:46.502365  6937 rpcz_store.cc:269] 0709 13:15:44.974924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.975046 (+   122us) service_pool.cc:224] Handling call
0709 13:15:46.464533 (+1489487us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400210cd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:46.464699 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3339774720}
I20260709 13:15:46.428431 10396 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.498142 10384 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:46.502830 10491 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:46.501173 10149 consensus_queue.cc:237] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:46.503957 10403 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:46.501186 10393 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.508188 10263 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.514300 10384 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.505987 10415 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:46.524093  6402 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:15:46.524636  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2262) took 1047 ms. Trace:
I20260709 13:15:46.525063  6402 rpcz_store.cc:276] 0709 13:15:45.477186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.428495 (+951309us) service_pool.cc:224] Handling call
0709 13:15:46.524578 (+ 96083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:46.517864 10491 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:46.528717 10384 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:46.529409 10393 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:46.533217 10263 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:46.513262 10382 consensus_queue.cc:260] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:46.517623 10403 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:46.540988 10478 log.cc:927] Time spent T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 1.093s	user 0.005s	sys 0.006s
I20260709 13:15:46.544932 10492 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.535079 10491 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.549496  6400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 803) took 1674 ms. Trace:
I20260709 13:15:46.549832 10481 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.543120 10441 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:46.549890  6400 rpcz_store.cc:276] 0709 13:15:44.875325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.875557 (+   232us) service_pool.cc:224] Handling call
0709 13:15:44.886367 (+ 10810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.894381 (+  8014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.894409 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.939186 (+ 44777us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.041942 (+102756us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:45.045180 (+  3238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.045276 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.510694 (+1465418us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:46.549163 (+ 38469us) raft_consensus.cc:1685] finished
0709 13:15:46.549186 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.549419 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12585,"raft.queue_time_us":21145,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":18211,"spinlock_wait_cycles":57670016,"thread_start_us":79810,"threads_started":1,"wal-append.queue_time_us":219218}
I20260709 13:15:46.580292  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.580883  6397 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:46.579731  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.581739  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.582139  6400 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:46.582964  6396 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:46.547364 10382 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.584312  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.584610  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:46.584882  6396 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:46.586035  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.586561  6396 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:46.590195  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.591085  6368 leader_election.cc:400] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11.
I20260709 13:15:46.593010  6402 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:46.593327 10441 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.595424  6400 raft_consensus.cc:1240] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:46.595618 10441 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:46.596202  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:46.596604  6400 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:46.596328 10496 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:46.597702 10441 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:46.597453 10496 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.598209 10441 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:46.598945  6398 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:46.599543  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:46.600495  6403 raft_consensus.cc:2393] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:46.598681 10441 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.599584 10496 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.607683  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.608798  6397 raft_consensus.cc:2410] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:15:46.610172  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.611150  6396 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:46.612422  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:46.594400 10339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.295s	user 0.010s	sys 0.011s
I20260709 13:15:46.617558  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:46.621078  6323 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:46.621975  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 267142us
W20260709 13:15:46.622745  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.618496  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:46.618781  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:46.637674  6322 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:15:46.583199 10457 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.645264  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:46.646665  6322 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:15:46.601362 10497 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.650170  6330 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:46.600960 10498 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:15:46.620814 10339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.337s	user 0.010s	sys 0.011s
I20260709 13:15:46.654083  6905 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:46.619073 10443 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.660770  6295 leader_election.cc:336] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.815s (SENT)
I20260709 13:15:46.619408 10496 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:46.619249 10414 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:46.668923  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:46.664230  6323 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:15:46.669911  6328 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
W20260709 13:15:46.672068  6295 leader_election.cc:336] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.840s (SENT)
I20260709 13:15:46.672674  6295 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:46.642419 10500 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.654785 10492 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.649302 10425 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:46.690668 10425 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:46.691296 10425 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:46.691895 10425 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:46.660454 10485 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:46.684191 10414 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.673557 10497 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:46.709378  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 55094us
W20260709 13:15:46.712221  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 1.334e+06us
I20260709 13:15:46.714001  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:46.714870  6296 leader_election.cc:336] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.018s (SENT)
I20260709 13:15:46.715368  6296 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:46.682492 10496 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:46.709743 10459 consensus_meta.cc:287] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.620s	user 0.010s	sys 0.003s
I20260709 13:15:46.716809 10476 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:46.723476  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2254) took 1532 ms. Trace:
I20260709 13:15:46.724462  6405 rpcz_store.cc:276] 0709 13:15:45.190471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.454784 (+1264313us) service_pool.cc:224] Handling call
0709 13:15:46.474700 (+ 19916us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:46.481532 (+  6832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:46.481557 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:46.485100 (+  3543us) log.cc:844] Serialized 548 byte log entry
0709 13:15:46.713724 (+228624us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:46.713766 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.713845 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.723136 (+  9291us) raft_consensus.cc:1685] finished
0709 13:15:46.723154 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.723284 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896,"thread_start_us":228257,"threads_started":1,"wal-append.queue_time_us":228585}
I20260709 13:15:46.675832 10443 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.711002 10495 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:46.689069 10492 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.703583 10415 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:46.686184 10500 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.667003 10498 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:46.736619  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 64641.7us
W20260709 13:15:46.737380  6295 leader_election.cc:336] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.844s (SENT)
I20260709 13:15:46.737957  6400 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
W20260709 13:15:46.738140  6295 leader_election.cc:336] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.863s (SENT)
I20260709 13:15:46.738736 10491 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:46.739004  6295 leader_election.cc:336] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.874s (SENT)
I20260709 13:15:46.740248 10497 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.740635 10414 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.719022 10403 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.739270 10491 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:46.743016 10246 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:46.743222 10500 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.744277 10441 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.744623 10492 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.747056 10443 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.749840 10492 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.750003  6296 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:46.755713 10491 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.759281  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 76078.2us
I20260709 13:15:46.750403 10492 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.760069 10510 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:46.756412 10495 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:46.767935 10510 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:46.769161 10512 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:46.774216 10512 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.776605 10512 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:46.771209 10510 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:46.764087 10507 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:15:46.785383 10498 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:46.786761  6905 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:46.791168  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.763083 10491 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.794092  6933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 777) took 2030 ms. Trace:
I20260709 13:15:46.794484  6933 rpcz_store.cc:276] 0709 13:15:44.764015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.764158 (+   143us) service_pool.cc:224] Handling call
0709 13:15:44.777082 (+ 12924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:46.314887 (+1537805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.793819 (+478932us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54005b0c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:46.794028 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1882878336}
W20260709 13:15:46.803215  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 87010.9us
I20260709 13:15:46.803755  6905 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:46.803018 10517 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:46.806455 10498 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:46.806931  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:46.807016 10517 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.807657  6326 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:46.808455  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:46.808634 10491 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.808851  6330 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:46.809667 10517 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:46.809847  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:46.810494  6322 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:46.809876  6400 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:46.817926  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.818581  6405 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
W20260709 13:15:46.821851  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 71934.9us
I20260709 13:15:46.822160  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.822707  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:46.823403  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.824225  6397 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:46.825907  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:46.804857 10507 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:46.827998  6296 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:46.828754 10491 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:46.830924 10507 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:46.831324 10491 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:46.831521 10507 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:46.831779 10491 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:46.832177 10491 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:46.818715 10512 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:46.796164 10425 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.835134 10425 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:46.829084 10492 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.789875 10495 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.836177  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:46.836874  6322 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:46.837893 10495 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.838948  6296 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:46.841399  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:46.842262  6907 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:46.843689  6296 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:46.847657  6322 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:15:46.836206 10496 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:46.849516 10496 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:46.850234 10496 raft_consensus.cc:697] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:46.851426 10496 consensus_queue.cc:237] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:46.852648 10396 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:46.853039 10396 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.853400 10396 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.849481  6296 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:46.838563 10512 raft_consensus.cc:697] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:46.860426 10512 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.862370 10425 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:46.864106 10492 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:46.864537 10492 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:46.864905 10492 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:46.860858  6401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2248) took 1705 ms (client timeout 2032 ms). Trace:
W20260709 13:15:46.866945  6401 rpcz_store.cc:269] 0709 13:15:45.155948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.156453 (+   505us) service_pool.cc:224] Handling call
0709 13:15:46.860669 (+1704216us) spinlock_profiling.cc:243] Waited 68.9 ms on lock 0x7b5400322654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:46.860803 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158484352}
I20260709 13:15:46.872898 10520 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:46.844776 10495 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:46.878504 10476 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.879118 10476 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.883074  6905 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:46.887560  6906 leader_election.cc:336] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.522s (SENT)
I20260709 13:15:46.890724 10526 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:46.891963 10476 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:46.896776 10491 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:46.875183 10520 raft_consensus.cc:697] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:46.902138 10425 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:46.903072  6905 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:46.905462 10518 log.cc:927] Time spent T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:15:46.894210 10510 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:46.912370 10526 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:46.892323 10483 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 1.540s	user 0.008s	sys 0.003s
I20260709 13:15:46.908419 10396 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.913161 10495 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.924036 10495 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:46.917994 10476 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:46.918651 10520 consensus_queue.cc:237] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:46.908813  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 59383us
I20260709 13:15:46.921060  6905 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:46.923209 10510 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:46.925745 10526 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:46.923266 10492 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:46.926755 10476 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:46.928085  6296 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:46.936060  6296 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:46.935753 10476 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.944468 10515 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.945652 10396 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:46.945261 10515 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:46.933710 10425 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:46.948020 10495 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:46.936975  6296 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:46.953287 10425 raft_consensus.cc:697] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:46.953712  6296 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:46.954535 10496 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:46.953755 10460 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.955330 10495 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:46.955696 10515 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:46.954212 10425 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:46.956360  6296 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:46.950661 10510 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:15:46.957015  6222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.001s	sys 0.005s
I20260709 13:15:46.929998 10507 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:46.959049  6222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.001s	sys 0.005s
W20260709 13:15:46.959693  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.950881 10524 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:46.967834  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:46.968357  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.971309  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:46.971973  6937 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:15:46.975896  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:46.977239  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:46.977934  6222 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:46.979236  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:46.979800  6325 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.973037 10461 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.970927 10524 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.992568 10520 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:46.993312 10520 raft_consensus.cc:697] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:46.989900 10461 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:46.999722 10461 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:47.002601 10507 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:46.982311 10415 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:47.012228  6325 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:46.989485 10524 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:47.007033 10491 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:47.014171 10495 raft_consensus.cc:697] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:47.008415 10415 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:47.010257 10510 raft_consensus.cc:697] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:47.029654 10527 log.cc:927] Time spent T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:15:47.037473 10492 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:47.039728 10415 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:46.994580 10520 consensus_queue.cc:237] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:47.393551  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.809790  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.724761 10526 consensus_meta.cc:287] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.787s	user 0.009s	sys 0.000s
W20260709 13:15:47.818655 10496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.000s	sys 0.022s
I20260709 13:15:47.045013 10510 consensus_queue.cc:237] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:47.806471 10495 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:47.834996 10524 consensus_meta.cc:287] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.810s	user 0.008s	sys 0.000s
I20260709 13:15:47.835592 10524 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:47.821219 10496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.000s	sys 0.022s
I20260709 13:15:47.840885 10496 raft_consensus.cc:697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:47.841890 10496 consensus_queue.cc:237] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:47.838512 10524 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:47.819159 10526 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:48.307143 10536 log.cc:927] Time spent T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 1.011s	user 0.001s	sys 0.000s
W20260709 13:15:48.498080  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:48.514710 10495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.001s	sys 0.012s
W20260709 13:15:48.391247  6277 debug-util.cc:398] Leaking SignalData structure 0x7b080011af20 after lost signal to thread 5115
W20260709 13:15:48.546588 10520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.002s	sys 0.011s
I20260709 13:15:48.315196 10526 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:48.561700 10495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.001s	sys 0.013s
W20260709 13:15:48.567126 10520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.003s	sys 0.011s
W20260709 13:15:48.563470 10496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.006s	sys 0.017s
W20260709 13:15:48.577937 10510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.003s	sys 0.034s
W20260709 13:15:48.580575 10510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.003s	sys 0.034s
W20260709 13:15:48.579151 10496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.006s	sys 0.017s
W20260709 13:15:48.594105  6221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.239s	user 0.010s	sys 0.020s
W20260709 13:15:48.594630  6221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.240s	user 0.011s	sys 0.020s
W20260709 13:15:48.594926  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 2.24027e+06us
I20260709 13:15:48.595706  6221 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:48.600409  6221 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:48.602429  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:48.608722 10520 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.609292 10520 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:48.611282 10520 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:48.612470 10331 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:48.603534  6221 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:48.615391  6221 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:48.616505  6905 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.641s	user 0.012s	sys 0.003s
W20260709 13:15:48.616928  6905 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.641s	user 0.012s	sys 0.003s
I20260709 13:15:48.624475 10331 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:48.625662 10339 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:48.625682 10331 raft_consensus.cc:697] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:48.626570 10339 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:48.627408 10339 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:48.628805 10526 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:48.629343 10526 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:48.630314  6905 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:48.631493 10526 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:48.632035 10526 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:48.633836 10526 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:48.635097  6221 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:48.635852 10339 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:48.636227 10339 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:48.636584 10339 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:48.637483 10526 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:48.638664 10526 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:48.645203  6221 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:48.629988 10331 consensus_queue.cc:237] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:48.652734 10544 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:48.645452 10526 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:48.654027 10425 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:48.654569 10544 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:48.654625 10425 raft_consensus.cc:697] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:48.655131 10544 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:48.655591 10544 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:48.656176 10526 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:48.656553 10339 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:48.661228 10339 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:48.662312 10339 consensus_queue.cc:1059] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:48.669620 10339 raft_consensus.cc:3055] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:48.670078 10339 raft_consensus.cc:740] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:48.671106 10339 consensus_queue.cc:260] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:48.672374 10339 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:48.682117 10415 consensus_meta.cc:287] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.642s	user 0.026s	sys 0.005s
I20260709 13:15:48.697507  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:48.700152  6256 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:48.668581 10544 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:48.702955  6254 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:15:48.705560 10425 consensus_queue.cc:237] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:48.699870 10496 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:48.713462 10496 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:48.716791  6256 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:48.729182  6248 raft_consensus.cc:1240] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:48.729212  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:48.730268  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:48.700723 10415 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:48.730999  6247 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:48.731374  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:48.733152  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:48.733420  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:48.731494 10460 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.734314  6254 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:48.734139 10460 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:48.735080  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:48.736346 10460 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:48.731375 10331 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:48.736831  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:48.737252 10331 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:48.737830 10496 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:48.731207  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 51975.9us
I20260709 13:15:48.739732  6256 raft_consensus.cc:2410] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:15:48.740290  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 110058us
I20260709 13:15:48.749779 10544 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:48.750473 10415 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:48.740150 10331 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:48.751483  6253 raft_consensus.cc:2393] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:15:48.751636  6219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.396s	user 0.007s	sys 0.027s
I20260709 13:15:48.741760  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:48.752933  6219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.398s	user 0.008s	sys 0.028s
I20260709 13:15:48.752815  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:48.753249  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:48.754007  6254 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:48.755015  6935 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:48.756098  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:48.753347  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 2.43238e+06us
I20260709 13:15:48.754923  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:48.756749  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:48.758234 10331 consensus_queue.cc:1059] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:48.758551  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:48.759418  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:48.769498  6247 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:48.764899  6254 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:48.765106  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:48.776803  6331 raft_consensus.cc:2410] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
W20260709 13:15:48.777827  6906 connection.cc:256] RPC call timeout handler was delayed by -1.2631978389999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2671s for a response
I20260709 13:15:48.781657  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:48.783792  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:48.786177  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:48.789001  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:48.789671  6255 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:48.790206  6254 raft_consensus.cc:2410] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:48.760303 10331 raft_consensus.cc:3055] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:48.791010 10331 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:48.791133  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:48.792012 10331 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:48.793596 10331 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:48.795667  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:48.775506 10544 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:48.797564 10544 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:48.788020 10526 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:48.802511  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:48.802793  6255 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:48.805475  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:48.805598  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:48.809150  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:48.810220  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:48.810724  6331 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:48.811479  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:48.812426  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:48.814141  6331 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:48.802672 10545 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:48.825614  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:48.826201  6331 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:48.827235  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:48.827955 10544 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:48.829463 10545 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:48.836216  6906 leader_election.cc:336] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.517s (SENT)
I20260709 13:15:48.850271  6906 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:48.851328 10545 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:48.851863 10545 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:48.808765 10526 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:47.044797  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:48.857451  6400 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
W20260709 13:15:48.857906  6400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 827) took 1817 ms (client timeout 1575 ms). Trace:
W20260709 13:15:48.858265  6400 rpcz_store.cc:269] 0709 13:15:47.040514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.041236 (+   722us) service_pool.cc:224] Handling call
0709 13:15:47.044663 (+  3427us) spinlock_profiling.cc:243] Waited 971 us on lock 0x7b5800102f98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:15:48.857845 (+1813182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233088}
I20260709 13:15:48.845292 10549 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:48.859797 10549 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:48.829670  6254 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
W20260709 13:15:50.731508  6254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2422) took 1986 ms (client timeout 1703 ms). Trace:
W20260709 13:15:50.731932  6254 rpcz_store.cc:269] 0709 13:15:48.745501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.805282 (+ 59781us) service_pool.cc:224] Handling call
0709 13:15:50.731420 (+1926138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:50.732887  6254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2444) took 1913 ms (client timeout 1504 ms). Trace:
W20260709 13:15:50.733260  6254 rpcz_store.cc:269] 0709 13:15:48.819162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.732716 (+1913554us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:50.732815 (+    99us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:50.734014  6254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2446) took 1897 ms (client timeout 1527 ms). Trace:
W20260709 13:15:50.734326  6254 rpcz_store.cc:269] 0709 13:15:48.836514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.733854 (+1897340us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:50.733965 (+   111us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:50.735031  6254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2447) took 1897 ms (client timeout 1552 ms). Trace:
W20260709 13:15:50.735337  6254 rpcz_store.cc:269] 0709 13:15:48.837975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.734891 (+1896916us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:50.734985 (+    94us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:50.736039  6254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2418) took 1992 ms (client timeout 1840 ms). Trace:
W20260709 13:15:50.736341  6254 rpcz_store.cc:269] 0709 13:15:48.743960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.735896 (+1991936us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:50.735993 (+    97us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:48.836411  6247 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
W20260709 13:15:51.034818  6247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2434) took 2285 ms (client timeout 1641 ms). Trace:
W20260709 13:15:51.035288  6247 rpcz_store.cc:269] 0709 13:15:48.749446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.783462 (+ 34016us) service_pool.cc:224] Handling call
0709 13:15:51.034731 (+2251269us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:51.036242  6247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2417) took 2292 ms (client timeout 1863 ms). Trace:
W20260709 13:15:51.036602  6247 rpcz_store.cc:269] 0709 13:15:48.743663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.036056 (+2292393us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:51.036184 (+   128us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:48.837478  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 47114.9us
I20260709 13:15:48.875381  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:50.491641  6296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.534s	user 0.031s	sys 0.041s
W20260709 13:15:50.569612  6330 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.599s	user 0.018s	sys 0.021s
I20260709 13:15:50.571971  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 825) took 3532 ms. Trace:
W20260709 13:15:50.592065  6277 debug-util.cc:398] Leaking SignalData structure 0x7b080011c460 after lost signal to thread 6151
I20260709 13:15:51.040143  6249 raft_consensus.cc:2376] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7. Re-sending same reply.
I20260709 13:15:50.617590  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 934) took 1995 ms. Trace:
W20260709 13:15:51.040840  6249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 751) took 2342 ms (client timeout 1517 ms). Trace:
I20260709 13:15:51.040303  6401 rpcz_store.cc:276] 0709 13:15:47.039947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.042669 (+  2722us) service_pool.cc:224] Handling call
0709 13:15:47.043021 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:47.043407 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.043436 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:50.566449 (+3523013us) log.cc:844] Serialized 52 byte log entry
0709 13:15:50.567901 (+  1452us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:50.567942 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.568021 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:50.571698 (+  3677us) raft_consensus.cc:1685] finished
0709 13:15:50.571720 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.571879 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":256256,"thread_start_us":917,"threads_started":1,"wal-append.queue_time_us":987}
W20260709 13:15:51.041427  6249 rpcz_store.cc:269] 0709 13:15:48.698826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.875120 (+176294us) service_pool.cc:224] Handling call
0709 13:15:51.040751 (+2165631us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:50.634780  6325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 930) took 2013 ms (client timeout 1933 ms). Trace:
I20260709 13:15:50.637986  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:50.645996  6142 maintenance_manager.cc:643] P c499d062fa5b4229bfb05f1ac581a6c6: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.107s	user 0.179s	sys 0.036s Metrics: {"bytes_written":29913,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":1052,"dirs.run_cpu_time_us":420,"dirs.run_wall_time_us":1231,"drs_written":1,"lbm_read_time_us":294,"lbm_reads_lt_1ms":4,"lbm_write_time_us":116105,"lbm_writes_10-100_ms":3,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":1268,"threads_started":2,"update_count":5,"wal-append.queue_time_us":901}
W20260709 13:15:51.042488  6249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2416) took 2299 ms (client timeout 1874 ms). Trace:
W20260709 13:15:50.667882  6324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 936) took 1925 ms (client timeout 1577 ms). Trace:
I20260709 13:15:51.042078  6219 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:51.044780  6143 maintenance_manager.cc:419] P c499d062fa5b4229bfb05f1ac581a6c6: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10701 bytes on disk
W20260709 13:15:50.685735  6221 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49996 dropped due to backpressure: service queue is full with 50 items
I20260709 13:15:51.041844  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.046418  6250 raft_consensus.cc:2410] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:15:51.046855  6250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 748) took 2349 ms (client timeout 3015 ms). Trace:
W20260709 13:15:51.047205  6250 rpcz_store.cc:269] 0709 13:15:48.697620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.041597 (+2343977us) service_pool.cc:224] Handling call
0709 13:15:51.046795 (+  5198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.045648  6221 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49996 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2427)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2429)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2435)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2437)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2431)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1664)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2454)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2455)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 771)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2420)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1663)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1665)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1672)
I20260709 13:15:50.685883  6220 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49996 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2444)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2446)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2418)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2419)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2417)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2416)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2427)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2429)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2435)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2437)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2431)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1664)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2454)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2455)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 771)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2420)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1663)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1665)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1672)
W20260709 13:15:50.697561  6253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 764) took 1961 ms (client timeout 1772 ms). Trace:
W20260709 13:15:51.051050  6253 rpcz_store.cc:269] 0709 13:15:48.736428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.736581 (+   153us) service_pool.cc:224] Handling call
0709 13:15:50.697331 (+1960750us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b5400356954. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:50.697490 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10511616}
W20260709 13:15:51.052037  6253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 770) took 2312 ms (client timeout 1933 ms). Trace:
W20260709 13:15:50.708405  6328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 932) took 2086 ms (client timeout 2032 ms). Trace:
W20260709 13:15:51.052451  6253 rpcz_store.cc:269] 0709 13:15:48.741887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.051874 (+2309987us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:51.051979 (+   105us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:50.709374  6326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 935) took 1967 ms (client timeout 1957 ms). Trace:
W20260709 13:15:51.053345  6253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2427) took 2306 ms (client timeout 1947 ms). Trace:
W20260709 13:15:51.053762  6253 rpcz_store.cc:269] 0709 13:15:48.747166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.053196 (+2306030us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:51.053290 (+    94us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:47.044890  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:51.054142  6369 connection.cc:256] RPC call timeout handler was delayed by -3.8474441149999166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 13:15:50.720590  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 753) took 2020 ms. Trace:
W20260709 13:15:51.054461  6253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2429) took 2306 ms (client timeout 1951 ms). Trace:
W20260709 13:15:51.054885  6253 rpcz_store.cc:269] 0709 13:15:48.747796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.054308 (+2306512us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:51.054409 (+   101us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:50.723318  6297 connection.cc:256] RPC call timeout handler was delayed by -4.0811182729999018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
W20260709 13:15:51.055838  6297 connection.cc:256] RPC call timeout handler was delayed by -3.9038182729998425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 13:15:51.056032  6253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 769) took 2316 ms (client timeout 2012 ms). Trace:
I20260709 13:15:51.056514  6297 leader_election.cc:400] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
I20260709 13:15:51.052631  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2765) took 2293 ms. Trace:
W20260709 13:15:50.759066  6251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 750) took 2060 ms (client timeout 1522 ms). Trace:
I20260709 13:15:50.761322 10564 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:51.057789  6324 rpcz_store.cc:269] 0709 13:15:48.742733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.667641 (+1924908us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:50.667802 (+   161us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:51.058082 10564 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.058976  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:51.059571  6324 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:15:51.059928  6323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 933) took 2437 ms. Trace:
I20260709 13:15:51.060371 10564 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:51.060655  6324 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
W20260709 13:15:50.458281  6905 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.000s	sys 0.008s
W20260709 13:15:51.107563  6905 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.274s	user 0.001s	sys 0.009s
W20260709 13:15:49.789101  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 48730.7us
W20260709 13:15:50.634578  6908 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.650s	user 0.021s	sys 0.033s
I20260709 13:15:50.490500  6933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 787) took 1861 ms. Trace:
W20260709 13:15:50.738327  6937 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 789) took 2108 ms (client timeout 1744 ms). Trace:
W20260709 13:15:51.157742  6937 rpcz_store.cc:269] 0709 13:15:48.629992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.738118 (+2108126us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:50.738249 (+   131us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:50.489967  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:50.676851 10461 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.162078 10461 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.162925  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 821) took 4350 ms. Trace:
W20260709 13:15:50.646227  6938 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 795) took 1858 ms (client timeout 1645 ms). Trace:
I20260709 13:15:51.163425  6402 rpcz_store.cc:276] 0709 13:15:46.812540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.812682 (+   142us) service_pool.cc:224] Handling call
0709 13:15:46.812961 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:46.813371 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:46.813400 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:46.819362 (+  5962us) log.cc:844] Serialized 26 byte log entry
0709 13:15:51.117908 (+4298546us) spinlock_profiling.cc:243] Waited 886 us on lock 0x7b1800394ae0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:15:51.147677 (+ 29769us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:51.147736 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.147835 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.153578 (+  5743us) raft_consensus.cc:1685] finished
0709 13:15:51.153605 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.162816 (+  9211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4824,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":1796,"spinlock_wait_cycles":2036992,"thread_start_us":29507,"threads_started":1,"wal-append.queue_time_us":4328199}
I20260709 13:15:47.046361 10476 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.168116 10476 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:48.865275 10526 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:48.870795 10549 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:51.174072 10549 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.174553 10549 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:51.176466 10549 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:48.872731 10552 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:51.178012 10552 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.180009 10552 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:51.180444 10552 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:51.022543  6256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 757) took 2293 ms (client timeout 2671 ms). Trace:
W20260709 13:15:51.181316  6256 rpcz_store.cc:269] 0709 13:15:48.728755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.728937 (+   182us) service_pool.cc:224] Handling call
0709 13:15:51.022329 (+2293392us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b54001478d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:51.022476 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8436992}
W20260709 13:15:51.182309  6256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2440) took 2430 ms (client timeout 2136 ms). Trace:
W20260709 13:15:51.182631  6256 rpcz_store.cc:269] 0709 13:15:48.751398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.182142 (+2430744us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:51.182250 (+   108us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:51.183305  6256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2437) took 2432 ms (client timeout 2151 ms). Trace:
W20260709 13:15:51.183600  6256 rpcz_store.cc:269] 0709 13:15:48.750445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.183171 (+2432726us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:51.183258 (+    87us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:51.184334  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:51.184859  6256 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:50.630576  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 754) took 1929 ms. Trace:
W20260709 13:15:51.042229  6325 rpcz_store.cc:269] 0709 13:15:48.621313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.634587 (+2013274us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:50.634692 (+   105us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:51.043128  6249 rpcz_store.cc:269] 0709 13:15:48.743343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.042327 (+2298984us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:51.042437 (+   110us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:51.044946  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:51.054631  6252 rpcz_store.cc:276] 0709 13:15:48.700444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.719812 (+2019368us) service_pool.cc:224] Handling call
0709 13:15:50.720123 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.720286 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:50.720311 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:50.720350 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:50.720380 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.720429 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.720536 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:51.056416  6253 rpcz_store.cc:269] 0709 13:15:48.739499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.055880 (+2316381us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:51.055979 (+    99us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:51.187206  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.057060  6297 leader_election.cc:403] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:51.188021  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 131652us
I20260709 13:15:51.188148  6325 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:51.188755  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2768) took 2428 ms. Trace:
I20260709 13:15:50.723784 10565 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.189042  6325 rpcz_store.cc:276] 0709 13:15:48.759942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.187707 (+2427765us) service_pool.cc:224] Handling call
0709 13:15:51.187989 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.188544 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.188705 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.189606 10565 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:51.190292  6325 raft_consensus.cc:1240] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:51.190876  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2769) took 2430 ms. Trace:
I20260709 13:15:51.191154  6325 rpcz_store.cc:276] 0709 13:15:48.760209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.189893 (+2429684us) service_pool.cc:224] Handling call
0709 13:15:51.190138 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.190652 (+   514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.190818 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.191675 10565 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:51.192169 10565 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
W20260709 13:15:50.737040  6254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2419) took 1992 ms (client timeout 1844 ms). Trace:
W20260709 13:15:50.752285  6371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.939s	user 0.010s	sys 0.011s
W20260709 13:15:51.193428  6371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.386s	user 0.011s	sys 0.012s
W20260709 13:15:51.056995  6247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2435) took 2307 ms (client timeout 1971 ms). Trace:
I20260709 13:15:50.762449 10566 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:51.194264  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:51.042299  6330 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.072s	user 0.019s	sys 0.022s
I20260709 13:15:51.054497  6398 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:51.061005  6329 rpcz_store.cc:276] 0709 13:15:48.758934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.761226 (+  2292us) service_pool.cc:224] Handling call
0709 13:15:48.761578 (+   352us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:48.762043 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.762075 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:48.762808 (+   733us) log.cc:844] Serialized 78 byte log entry
0709 13:15:50.666599 (+1903791us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b180010b700. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f457578d4bc 00007f4572adb48b 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1
0709 13:15:50.666799 (+   200us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:50.668563 (+  1764us) log.cc:844] Serialized 14 byte log entry
0709 13:15:50.737842 (+ 69279us) log.cc:844] Serialized 14 byte log entry
0709 13:15:50.763818 (+ 25976us) log.cc:844] Serialized 14 byte log entry
0709 13:15:51.052234 (+288416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.052385 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.052427 (+    42us) raft_consensus.cc:1685] finished
0709 13:15:51.052439 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.052576 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1369,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":104,"raft.queue_time_us":635351,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":6490,"spinlock_wait_cycles":3075840,"thread_start_us":408247,"threads_started":6,"wal-append.queue_time_us":70953,"wal-append.run_cpu_time_us":1798,"wal-append.run_wall_time_us":1001825}
W20260709 13:15:51.064225  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.072760  6142 maintenance_manager.cc:643] P c499d062fa5b4229bfb05f1ac581a6c6: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":302,"lbm_reads_lt_1ms":4}
W20260709 13:15:51.052812  6328 rpcz_store.cc:269] 0709 13:15:48.621981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.708207 (+2086226us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:50.708334 (+   127us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:51.042618  6331 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
W20260709 13:15:51.196666  6331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 2771) took 2435 ms (client timeout 2848 ms). Trace:
W20260709 13:15:51.197091  6331 rpcz_store.cc:269] 0709 13:15:48.760751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.637695 (+1876944us) service_pool.cc:224] Handling call
0709 13:15:51.196596 (+558901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.041334  6322 rpcz_store.cc:276] 0709 13:15:48.622599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.616603 (+1994004us) service_pool.cc:224] Handling call
0709 13:15:50.616935 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.617173 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:50.617211 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:50.617267 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:50.617302 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.617379 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.617516 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:51.074173  6296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.116s	user 0.034s	sys 0.041s
W20260709 13:15:51.198184  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 4.24151e+06us
W20260709 13:15:51.194023  6247 rpcz_store.cc:269] 0709 13:15:48.749767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.056832 (+2307065us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:51.056928 (+    96us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:51.200098  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:51.200938  6247 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:15:51.201288  6247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2439) took 2450 ms (client timeout 2842 ms). Trace:
W20260709 13:15:51.201596  6247 rpcz_store.cc:269] 0709 13:15:48.751084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.199783 (+2448699us) service_pool.cc:224] Handling call
0709 13:15:51.201241 (+  1458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.202334  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.202956  6247 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:15:51.078477  6250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2443) took 2262 ms (client timeout 2066 ms). Trace:
W20260709 13:15:51.203565  6250 rpcz_store.cc:269] 0709 13:15:48.816312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.078268 (+2261956us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:51.078411 (+   143us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:15:51.053287  6326 rpcz_store.cc:269] 0709 13:15:48.741500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.709208 (+1967708us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:50.709313 (+   105us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:51.079450  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2767) took 2319 ms. Trace:
I20260709 13:15:51.204475  6324 rpcz_store.cc:276] 0709 13:15:48.759648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.060255 (+2300607us) service_pool.cc:224] Handling call
0709 13:15:51.060502 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.079192 (+ 18690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.079397 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:51.083029  6907 connection.cc:256] RPC call timeout handler was delayed by -2.2995210970000244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
W20260709 13:15:51.205288  6907 connection.cc:256] RPC call timeout handler was delayed by -2.1483210970000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
I20260709 13:15:51.083474 10557 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:51.207806  6329 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:51.208663  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2775) took 2442 ms. Trace:
W20260709 13:15:51.087390  6255 consensus_meta.cc:287] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 2.241s	user 0.019s	sys 0.014s
W20260709 13:15:51.094074  6277 debug-util.cc:398] Leaking SignalData structure 0x7b080011ace0 after lost signal to thread 6188
I20260709 13:15:51.209209  6255 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:51.209040  6329 rpcz_store.cc:276] 0709 13:15:48.766112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.195765 (+2429653us) service_pool.cc:224] Handling call
0709 13:15:51.196077 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.208340 (+ 12263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.208596 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:51.209743  6255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2430) took 2461 ms (client timeout 1770 ms). Trace:
W20260709 13:15:51.210242  6277 debug-util.cc:398] Leaking SignalData structure 0x7b08001a6b00 after lost signal to thread 6280
I20260709 13:15:47.788144  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:51.101970  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 931) took 2480 ms. Trace:
I20260709 13:15:51.210825  6327 rpcz_store.cc:276] 0709 13:15:48.621655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.080527 (+2458872us) service_pool.cc:224] Handling call
0709 13:15:51.080825 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.081021 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:51.085579 (+  4558us) log.cc:844] Serialized 14 byte log entry
0709 13:15:51.101626 (+ 16047us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.101680 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:51.101731 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.101793 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.101913 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4172,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":81,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":15469,"threads_started":1,"wal-append.queue_time_us":14535}
I20260709 13:15:51.102445 10460 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:51.092926  6153 catalog_manager.cc:5697] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 7 to 8, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 8 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:51.213006  6277 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4ee0 after lost signal to thread 6281
I20260709 13:15:51.113582 10334 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:51.116261 10568 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:51.120862 10563 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.121843  6905 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:51.216310  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 94550.6us
W20260709 13:15:47.050099  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.122367 10339 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.122923 10415 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.125574  6221 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:50006 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2437)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2431)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1664)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2454)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2455)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 775)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2462)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 771)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2420)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1663)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1665)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1672)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1675)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1678)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 776)
I20260709 13:15:51.150631 10149 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:51.153084  6906 leader_election.cc:336] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.012s (SENT)
W20260709 13:15:51.277751  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 124702us
I20260709 13:15:51.156751  6933 rpcz_store.cc:276] 0709 13:15:48.629291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.489635 (+1860344us) service_pool.cc:224] Handling call
0709 13:15:50.490046 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.490238 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:50.490262 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:50.490305 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:50.490330 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.490365 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.490453 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41600}
W20260709 13:15:51.159893  6940 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 797) took 2353 ms (client timeout 2935 ms). Trace:
W20260709 13:15:51.278949  6940 rpcz_store.cc:269] 0709 13:15:48.806213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.489549 (+1683336us) service_pool.cc:224] Handling call
0709 13:15:51.159821 (+670272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112512}
I20260709 13:15:50.493974  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 788) took 1864 ms. Trace:
I20260709 13:15:51.358824 10572 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:51.359625  6941 rpcz_store.cc:276] 0709 13:15:48.629672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.493106 (+1863434us) service_pool.cc:224] Handling call
0709 13:15:50.493441 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.493632 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:50.493659 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:50.493718 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:50.493750 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.493806 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.493916 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.359988 10572 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.177423 10570 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:51.363168 10570 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.230341 10563 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.185259  6248 rpcz_store.cc:276] 0709 13:15:48.700850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.700975 (+   125us) service_pool.cc:224] Handling call
0709 13:15:48.701307 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.730223 (+ 28916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.630256 (+1900033us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b54003d04d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:50.630484 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63559552}
I20260709 13:15:51.365823  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:51.366285 10563 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:51.366828  6248 raft_consensus.cc:2410] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:51.367877  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:51.193265  6254 rpcz_store.cc:269] 0709 13:15:48.744455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.736893 (+1992438us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:50.736995 (+   102us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:51.369119  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:50.747215  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:51.057570  6251 rpcz_store.cc:269] 0709 13:15:48.698411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.758876 (+2060465us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:50.758999 (+   123us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:51.371441  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:51.372114  6251 raft_consensus.cc:2376] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8. Re-sending same reply.
I20260709 13:15:51.198992  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:51.373538  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 174639us
I20260709 13:15:51.060292  6323 rpcz_store.cc:276] 0709 13:15:48.622299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.059214 (+2436915us) service_pool.cc:224] Handling call
0709 13:15:51.059481 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.059637 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.059659 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.059697 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:51.059728 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.059778 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.059873 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.375662  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:51.376313  6323 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:51.206884  6328 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:51.377677  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2777) took 2601 ms. Trace:
I20260709 13:15:51.378082  6328 rpcz_store.cc:276] 0709 13:15:48.775996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.196554 (+2420558us) service_pool.cc:224] Handling call
0709 13:15:51.196796 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.377373 (+180577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.377612 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.207660  6249 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:51.214136  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:51.214390  6277 debug-util.cc:398] Leaking SignalData structure 0x7b080022e580 after lost signal to thread 6355
W20260709 13:15:51.379849  6277 debug-util.cc:398] Leaking SignalData structure 0x7b0800349ba0 after lost signal to thread 6356
W20260709 13:15:51.380941  6277 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0ec0 after lost signal to thread 6429
W20260709 13:15:51.381207  6277 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4800 after lost signal to thread 6430
I20260709 13:15:51.373078  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.383361  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.384048  6251 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
W20260709 13:15:51.267208  6908 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.283s	user 0.025s	sys 0.033s
W20260709 13:15:51.228780  6369 connection.cc:256] RPC call timeout handler was delayed by -2.8846224329997767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 13:15:51.385241  6369 connection.cc:256] RPC call timeout handler was delayed by -2.8247219429999859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 13:15:51.385581  6369 connection.cc:256] RPC call timeout handler was delayed by -2.7766224329998295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260709 13:15:51.385840  6369 connection.cc:256] RPC call timeout handler was delayed by -2.6434224329998415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
W20260709 13:15:51.386142  6369 connection.cc:256] RPC call timeout handler was delayed by -2.5763219429998117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 13:15:51.386428  6369 connection.cc:256] RPC call timeout handler was delayed by -1.7738641670000561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2581s for a response
I20260709 13:15:51.266934  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2778) took 2485 ms. Trace:
I20260709 13:15:51.273865  6324 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:15:51.210114  6255 rpcz_store.cc:269] 0709 13:15:48.748091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.818808 (+ 70717us) service_pool.cc:224] Handling call
0709 13:15:51.209676 (+2390868us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:51.386706  6369 connection.cc:256] RPC call timeout handler was delayed by -1.6777224329998717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3085s for a response
I20260709 13:15:51.387521  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:51.212736  6938 rpcz_store.cc:269] 0709 13:15:48.788079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.646011 (+1857932us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:50.646133 (+   122us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:51.387861  6324 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:15:51.387954  6369 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.541s (SENT) [suppressed 35 similar messages]
I20260709 13:15:51.267517  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.386821  6331 rpcz_store.cc:276] 0709 13:15:48.781631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.215852 (+2434221us) service_pool.cc:224] Handling call
0709 13:15:51.266454 (+ 50602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.266619 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.266643 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.266684 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:51.266718 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.266769 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.266875 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.389297  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.290266 10574 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:51.286015 10460 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:51.374665  6296 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:51.393466 10460 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:51.293865  6327 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:15:51.180850 10552 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.176918 10549 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.295477 10461 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:51.298458  6295 connection.cc:256] RPC call timeout handler was delayed by -4.007789885999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2821s for a response
I20260709 13:15:51.305454  6398 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:51.406837  6153 catalog_manager.cc:5697] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 2 to 4, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 4 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:51.308202  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:51.408643  6322 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:51.273064 10529 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:15:51.309422  6221 leader_election.cc:336] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.607s (SENT)
I20260709 13:15:51.410302  6221 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:51.324980  6326 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:15:51.411413  6398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 829) took 4365 ms (client timeout 1743 ms). Trace:
I20260709 13:15:51.213109 10566 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.414980 10566 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:51.415469 10566 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:51.416699 10566 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:51.215422 10557 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.418624 10557 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:51.425269 10461 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:51.411262 10529 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:51.426321 10529 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:51.410233 10549 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:51.403182 10460 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:51.217994 10334 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.439136 10334 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:51.250494 10339 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:51.441567 10339 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:51.229063 10568 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.443675 10568 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:51.368323  6253 raft_consensus.cc:2393] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:15:51.382272  6277 debug-util.cc:398] Leaking SignalData structure 0x7b080030d0a0 after lost signal to thread 6966
W20260709 13:15:51.445158  6277 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3940 after lost signal to thread 10124
W20260709 13:15:51.445816  6277 debug-util.cc:398] Leaking SignalData structure 0x7b0800350980 after lost signal to thread 10457
W20260709 13:15:51.446146  6277 debug-util.cc:398] Leaking SignalData structure 0x7b0800383c60 after lost signal to thread 10472
W20260709 13:15:51.446447  6277 debug-util.cc:398] Leaking SignalData structure 0x7b08003f0fa0 after lost signal to thread 10481
W20260709 13:15:51.446959  6253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2445) took 2620 ms (client timeout 2649 ms). Trace:
W20260709 13:15:51.447345  6253 rpcz_store.cc:269] 0709 13:15:48.826212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.186969 (+2360757us) service_pool.cc:224] Handling call
0709 13:15:51.446763 (+259794us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400172fd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:51.446901 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414648192}
I20260709 13:15:51.448343  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:51.203281  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2428) took 2455 ms. Trace:
I20260709 13:15:51.449285  6247 rpcz_store.cc:276] 0709 13:15:48.747467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.202144 (+2454677us) service_pool.cc:224] Handling call
0709 13:15:51.203237 (+  1093us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:51.449921  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 165800us
I20260709 13:15:51.450266  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:51.450567  6221 leader_election.cc:336] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.621s (SENT)
I20260709 13:15:51.450878  6247 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:51.451745  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.452243  6247 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:15:51.386631  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:51.391747 10565 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:15:51.392386  6249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2436) took 2642 ms (client timeout 2821 ms). Trace:
I20260709 13:15:51.392587 10574 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.285835 10415 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:51.459851 10565 raft_consensus.cc:697] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:51.460843 10565 consensus_queue.cc:237] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:51.461335 10574 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:51.461841 10574 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.462100 10415 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:51.462263 10574 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:51.393530  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:51.464120  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.398144  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 938) took 2576 ms. Trace:
I20260709 13:15:51.464495  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.465147  6247 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:51.464926  6327 rpcz_store.cc:276] 0709 13:15:48.821782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.254504 (+2432722us) service_pool.cc:224] Handling call
0709 13:15:51.293502 (+ 38998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.397840 (+104338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.398079 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.466092  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:51.467044  6254 raft_consensus.cc:2376] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9. Re-sending same reply.
I20260709 13:15:51.300923 10149 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:51.399842  6323 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:51.404227  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.468801  6255 raft_consensus.cc:2393] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:15:51.411768  6398 rpcz_store.cc:269] 0709 13:15:47.041067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.044635 (+  3568us) service_pool.cc:224] Handling call
0709 13:15:51.406391 (+4361756us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.454704  6251 raft_consensus.cc:2376] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8. Re-sending same reply.
W20260709 13:15:51.457528  6249 rpcz_store.cc:269] 0709 13:15:48.750100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.194060 (+2443960us) service_pool.cc:224] Handling call
0709 13:15:51.392315 (+198255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.470219  6252 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:51.452791  6248 raft_consensus.cc:2376] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9. Re-sending same reply.
I20260709 13:15:51.470202  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.475764  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.476328  6249 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 5.
I20260709 13:15:51.476356 10149 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:51.476588 10552 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:51.477468 10552 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:51.478153 10552 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.478667  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:51.479882  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:51.480919  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.483278  6249 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:51.483664  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.484159  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.487877  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.488196  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.488608  6254 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:51.489260  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.482613  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.497735  6255 raft_consensus.cc:2393] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:51.498667  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.499588  6255 raft_consensus.cc:2410] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:15:51.500439  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.481326  6153 catalog_manager.cc:5697] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 7 to 8, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 8 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.481391 10552 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:51.486657 10570 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:51.487151  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.489485  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.502574  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.484845  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:51.503535  6250 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:51.503870  6254 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:51.504455  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 771) took 2761 ms. Trace:
I20260709 13:15:51.493487  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:51.504930  6250 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:15:51.505317  6250 pending_rounds.cc:85] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 9
I20260709 13:15:51.505535  6250 pending_rounds.cc:107] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:15:51.505762  6250 raft_consensus.cc:2889] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.486374  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:51.501060  6255 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:51.411053 10572 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:51.510290  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2442) took 2758 ms. Trace:
I20260709 13:15:51.514484  6252 rpcz_store.cc:276] 0709 13:15:48.752029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.509601 (+2757572us) service_pool.cc:224] Handling call
0709 13:15:51.509844 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.510006 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.510028 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.510067 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:51.510103 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.510151 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.510240 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.515568  6248 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:51.515852  6252 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:51.516147  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2441) took 2764 ms. Trace:
I20260709 13:15:51.516474  6248 rpcz_store.cc:276] 0709 13:15:48.751704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.508600 (+2756896us) service_pool.cc:224] Handling call
0709 13:15:51.508832 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.515932 (+  7100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.516099 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.512611  6153 catalog_manager.cc:5697] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 5 to 6, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 6 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.518599  6153 catalog_manager.cc:5697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 4 to 5, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1), VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2), VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3), VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 7 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.525720  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2438) took 2775 ms. Trace:
I20260709 13:15:51.526270  6249 rpcz_store.cc:276] 0709 13:15:48.750758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.489044 (+2738286us) service_pool.cc:224] Handling call
0709 13:15:51.525646 (+ 36602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.520897 10570 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.528630 10570 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.530797 10570 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:51.417114 10566 raft_consensus.cc:697] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:51.541009  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2420) took 2761 ms. Trace:
I20260709 13:15:51.541617  6250 rpcz_store.cc:276] 0709 13:15:48.744812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.504319 (+2759507us) service_pool.cc:224] Handling call
0709 13:15:51.504562 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.506168 (+  1606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.506311 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.543479 10574 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:51.544461  6150 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55342 (request call id 349) took 25143 ms (client timeout 15000 ms). Trace:
I20260709 13:15:51.544121 10566 consensus_queue.cc:237] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:51.547869  6368 connection.cc:256] RPC call timeout handler was delayed by -3.2038803779998943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 13:15:51.548380  6368 connection.cc:256] RPC call timeout handler was delayed by -3.0455571869997584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 13:15:51.548774  6368 connection.cc:256] RPC call timeout handler was delayed by -2.8285803779999696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260709 13:15:51.549146  6368 connection.cc:256] RPC call timeout handler was delayed by -2.8187571869998465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260709 13:15:51.549541  6368 connection.cc:256] RPC call timeout handler was delayed by -2.6855571869998585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
W20260709 13:15:51.550153  6368 connection.cc:256] RPC call timeout handler was delayed by -2.5683677509998688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 13:15:51.550452  6368 connection.cc:256] RPC call timeout handler was delayed by -2.529016966999734s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
W20260709 13:15:51.550805  6368 connection.cc:256] RPC call timeout handler was delayed by -2.4657677509999303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 13:15:51.551139  6368 connection.cc:256] RPC call timeout handler was delayed by -2.4576677509999172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 13:15:51.551527  6368 connection.cc:256] RPC call timeout handler was delayed by -1.808734270000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2581s for a response
W20260709 13:15:51.551846  6368 connection.cc:256] RPC call timeout handler was delayed by -1.7033721359998708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3085s for a response
W20260709 13:15:51.552207  6368 connection.cc:256] RPC call timeout handler was delayed by -1.6557677509999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29350000000000004s for a response
W20260709 13:15:51.552549  6368 connection.cc:256] RPC call timeout handler was delayed by -1.166280377999783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3961s for a response
I20260709 13:15:51.555220  6248 raft_consensus.cc:1240] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:51.571822  6250 raft_consensus.cc:3055] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:51.578114  6247 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:51.504750  6254 rpcz_store.cc:276] 0709 13:15:48.743015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.503341 (+2760326us) service_pool.cc:224] Handling call
0709 13:15:51.503596 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.504242 (+   646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.504409 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.643446  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 928) took 4683 ms. Trace:
I20260709 13:15:51.644609  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:51.644800  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 599858us
W20260709 13:15:51.544871  6150 rpcz_store.cc:269] 0709 13:15:26.394805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.395058 (+   253us) service_pool.cc:224] Handling call
0709 13:15:51.537985 (+25142927us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:44.201517 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:44.202105 (+   588us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:44.202163 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:15:44.202176 (+    13us) tablet.cc:662] Decoding operations
0709 13:15:44.202892 (+   716us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:44.202983 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:44.203023 (+    40us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:15:44.203640 (+   617us) tablet.cc:701] Row locks acquired
0709 13:15:44.203698 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:15:44.203864 (+   166us) write_op.cc:270] Start()
0709 13:15:44.203981 (+   117us) write_op.cc:276] Timestamp: P: 1783602944203800 usec, L: 0
0709 13:15:44.204004 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:15:44.204721 (+   717us) log.cc:844] Serialized 2040 byte log entry
0709 13:15:44.541655 (+336934us) op_driver.cc:464] REPLICATION: finished
0709 13:15:44.747625 (+205970us) write_op.cc:301] APPLY: starting
0709 13:15:44.764689 (+ 17064us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:44.801758 (+ 37069us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:44.801887 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:44.802475 (+   588us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:44.802856 (+   381us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:15:44.802926 (+    70us) write_op.cc:312] APPLY: finished
0709 13:15:44.803278 (+   352us) log.cc:844] Serialized 47 byte log entry
0709 13:15:44.803500 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:44.803630 (+   130us) write_op.cc:454] Released schema lock
0709 13:15:44.803703 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:44.804178 (+   475us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:44.804218 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":570578,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":134998,"apply.run_cpu_time_us":3395,"apply.run_wall_time_us":74780,"num_ops":5,"prepare.queue_time_us":148858,"prepare.run_cpu_time_us":25851,"prepare.run_wall_time_us":59408,"raft.queue_time_us":86394,"raft.run_cpu_time_us":40254,"raft.run_wall_time_us":63190,"replication_time_us":337506,"thread_start_us":196199,"threads_started":4,"wal-append.queue_time_us":248053,"wal-append.run_cpu_time_us":7117,"wal-append.run_wall_time_us":1361662}]]}
I20260709 13:15:51.537657 10572 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:51.650679  6222 connection.cc:256] RPC call timeout handler was delayed by -1.5336605510001391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2848s for a response
I20260709 13:15:51.571291  6153 catalog_manager.cc:5697] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 10 to 11, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 11 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.662178  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:51.663151  6399 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:51.572487  6250 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:51.521303 10549 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:51.611184  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 341384us
I20260709 13:15:51.537964 10552 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.616501  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:51.559034  6256 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
W20260709 13:15:51.672825  6256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2431) took 2924 ms (client timeout 2693 ms). Trace:
W20260709 13:15:51.673295  6256 rpcz_store.cc:269] 0709 13:15:48.748431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.184108 (+2435677us) service_pool.cc:224] Handling call
0709 13:15:51.672740 (+488632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.570787 10570 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.625658  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2772) took 2864 ms. Trace:
I20260709 13:15:51.669885  6250 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.645365  6402 raft_consensus.cc:2368] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8.
I20260709 13:15:51.675364  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:51.675921  6396 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:51.676664  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:51.674291  6325 rpcz_store.cc:276] 0709 13:15:48.761040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.191794 (+2430754us) service_pool.cc:224] Handling call
0709 13:15:51.192089 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:51.192402 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.192429 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:51.192893 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:15:51.357455 (+164562us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:51.357493 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.357566 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.625382 (+267816us) raft_consensus.cc:1685] finished
0709 13:15:51.625409 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.625581 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6196,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":4833,"thread_start_us":164185,"threads_started":1,"wal-append.queue_time_us":423835}
I20260709 13:15:51.644093  6330 rpcz_store.cc:276] 0709 13:15:46.959533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.967394 (+  7861us) service_pool.cc:224] Handling call
0709 13:15:46.969721 (+  2327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:51.195113 (+4225392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.195144 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:51.289351 (+ 94207us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b2c0002aad8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f45744dea11 00007f45744ee372 00007f4575c20a01 00007f4575be543a 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2
0709 13:15:51.303787 (+ 14436us) log.cc:844] Serialized 26 byte log entry
0709 13:15:51.539032 (+235245us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:51.539067 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.539126 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.643065 (+103939us) raft_consensus.cc:1685] finished
0709 13:15:51.643085 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.643339 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55925,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"spinlock_wait_cycles":201746304,"thread_start_us":4459918,"threads_started":2,"wal-append.queue_time_us":337491}
I20260709 13:15:51.646682  6219 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:51.666390  6399 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:51.583845  6253 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:15:51.669653  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:51.674775  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:51.678002 10589 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.670145 10574 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:51.641029 10529 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.670660 10572 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:51.681734  6252 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:51.681813 10552 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:51.718335 10552 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:15:51.682027 10570 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:51.720050 10460 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.689709  6398 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:51.687551  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:51.723063  6400 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:51.681933  6401 raft_consensus.cc:2376] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7. Re-sending same reply.
W20260709 13:15:51.694016  6297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.057s	sys 0.073s
I20260709 13:15:51.720839 10570 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:51.705904  6396 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
W20260709 13:15:51.710762  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 322796us
I20260709 13:15:51.682427  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:51.730973  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 356375us
I20260709 13:15:51.687240  6405 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:51.687925  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:51.724548  6297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.057s	sys 0.073s
W20260709 13:15:51.732492  6906 connection.cc:256] RPC call timeout handler was delayed by -1.403676601999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 13:15:51.732908  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 543807us
W20260709 13:15:51.733011  6906 connection.cc:256] RPC call timeout handler was delayed by -1.3299731619999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 13:15:51.682166  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:51.712072  6295 connection.cc:256] RPC call timeout handler was delayed by -3.9888898859999244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2842s for a response
I20260709 13:15:51.733901  6403 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:51.690809  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:51.703154  6219 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:51.685662  6153 catalog_manager.cc:5697] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.737378  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:51.737905  6399 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:51.731655  6296 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:51.733157  6404 raft_consensus.cc:2410] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:15:51.725232  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 273748us
W20260709 13:15:51.733644  6906 connection.cc:256] RPC call timeout handler was delayed by -1.3227731619999759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 13:15:51.741565  6221 leader_election.cc:336] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.931s (SENT)
I20260709 13:15:51.742703  6221 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:51.701939  6371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.026s	sys 0.050s
W20260709 13:15:51.743680  6371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.026s	sys 0.051s
W20260709 13:15:51.744112  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 549826us
I20260709 13:15:51.746016  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:51.746296  6297 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:51.745409  6906 connection.cc:256] RPC call timeout handler was delayed by -1.1623135469999397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:15:51.747524  6906 connection.cc:256] RPC call timeout handler was delayed by -1.1435389819998818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 13:15:51.747833  6906 connection.cc:256] RPC call timeout handler was delayed by -1.1291389819998585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260709 13:15:51.748103  6906 connection.cc:256] RPC call timeout handler was delayed by -1.0265191629998753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 13:15:51.748370  6906 connection.cc:256] RPC call timeout handler was delayed by -1.0103191629998491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
I20260709 13:15:51.678870  6250 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:51.751447 10591 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:51.752734  6296 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:51.689924 10415 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:51.757929  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:51.758905  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 937) took 2937 ms. Trace:
I20260709 13:15:51.762918  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:51.763506  6328 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:51.736418 10476 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.764192  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:51.774017  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:51.774080  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:51.774667  6401 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:51.774714  6397 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
W20260709 13:15:51.775650  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 105507us
I20260709 13:15:51.776398  6328 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:51.776297  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:51.777071  6396 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:51.772408  6403 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:51.781668  6404 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:51.774852  6400 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:51.770143  6329 rpcz_store.cc:276] 0709 13:15:48.821534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.252335 (+2430801us) service_pool.cc:224] Handling call
0709 13:15:51.266650 (+ 14315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.266890 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:51.298272 (+ 31382us) log.cc:844] Serialized 14 byte log entry
0709 13:15:51.757423 (+459151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.758610 (+  1187us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:51.758659 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.758718 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.758835 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14017,"prepare.queue_time_us":58849,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":826,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":64,"thread_start_us":458726,"threads_started":2,"wal-append.queue_time_us":394852}
I20260709 13:15:51.787091  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:51.789151  6329 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:51.790874  6403 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:51.776717 10415 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:51.837690  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 50710.4us
I20260709 13:15:51.682266 10549 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.839025  6399 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:51.835359  6330 raft_consensus.cc:1240] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:51.758637 10565 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:51.832788  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:51.922093  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 187848us
I20260709 13:15:51.922502  6329 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:15:51.697220 10339 consensus_queue.cc:1059] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.150s
W20260709 13:15:51.923028  6295 connection.cc:256] RPC call timeout handler was delayed by -3.7087559300000521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33s for a response
I20260709 13:15:51.898138  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:51.718345 10572 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:51.758317 10461 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:51.881059  6396 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:51.792853  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:51.969082  6325 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:51.792593  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:51.841569  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:51.702013 10574 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:51.896528 10570 consensus_queue.cc:1059] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:15:51.763648 10567 raft_consensus.cc:2764] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:15:51.977304 10570 consensus_queue.cc:1243] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer 8600a3fead0e48a7aa813822ec44d0fe log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:15:51.977488 10567 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:51.690526 10589 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:51.960356 10460 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:51.960453 10339 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:51.784998 10149 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.139s
I20260709 13:15:51.963209 10565 raft_consensus.cc:697] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:51.897295 10492 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.119s
I20260709 13:15:51.791066 10585 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.180s
I20260709 13:15:51.790261 10476 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:51.922223 10578 consensus_queue.cc:1059] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:15:51.955956 10549 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:51.764357 10563 consensus_queue.cc:1059] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 13:15:51.970575 10461 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.992015  6405 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:51.974514 10494 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.977896 10570 raft_consensus.cc:3055] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:51.990638 10590 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:51.978448 10290 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:15:52.019063  6401 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:52.015851 10566 raft_consensus.cc:2955] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 3 to 7, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:15:52.029791  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 280742us
I20260709 13:15:52.013537 10460 raft_consensus.cc:3055] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:51.991052 10334 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:15:51.990195 10567 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.045673 10461 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:52.044855 10578 consensus_queue.cc:1243] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer 8600a3fead0e48a7aa813822ec44d0fe log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:15:52.077827 10460 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:52.046346 10570 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:51.941664 10572 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:52.096185 10589 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:52.096895 10570 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.098171 10567 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:52.098364 10607 raft_consensus.cc:3055] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:52.098240 10570 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:52.085319 10565 consensus_queue.cc:237] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:52.099725 10597 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:15:52.098924 10607 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:52.079878 10590 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.085268 10613 consensus_queue.cc:1059] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:15:52.103096 10574 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:52.094945 10572 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.102905 10608 raft_consensus.cc:3055] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:52.104537 10608 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:15:52.102480 10599 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.087s	user 0.003s	sys 0.001s
I20260709 13:15:52.104795 10607 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:52.105558 10608 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.106365 10590 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:52.106487 10607 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:52.106783 10608 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:52.109763 10616 raft_consensus.cc:3055] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:52.110219 10616 raft_consensus.cc:740] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:52.111049 10616 consensus_queue.cc:260] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.112670 10616 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.141070  6153 catalog_manager.cc:5697] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.146111  6153 catalog_manager.cc:5697] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.151347  6153 catalog_manager.cc:5697] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 5 to 6, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 6 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:15:52.158834  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 412655us
I20260709 13:15:52.162274  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2425) took 3415 ms. Trace:
W20260709 13:15:52.163228  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 421497us
I20260709 13:15:52.162894  6251 rpcz_store.cc:276] 0709 13:15:48.746544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.505645 (+2759101us) service_pool.cc:224] Handling call
0709 13:15:51.506195 (+   550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:51.506557 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.506583 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:51.507447 (+   864us) log.cc:844] Serialized 548 byte log entry
0709 13:15:51.736290 (+228843us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:51.736325 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.736384 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:52.161455 (+425071us) raft_consensus.cc:1685] finished
0709 13:15:52.161534 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.161960 (+   426us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":204319,"threads_started":1,"wal-append.queue_time_us":410023}
I20260709 13:15:51.862766  6250 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:15:52.166078  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 776) took 1041 ms. Trace:
I20260709 13:15:52.166471  6250 rpcz_store.cc:276] 0709 13:15:51.124643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.542646 (+418003us) service_pool.cc:224] Handling call
0709 13:15:51.571697 (+ 29051us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.165477 (+593780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.165885 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:52.164624  6221 leader_election.cc:336] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.988s (SENT)
W20260709 13:15:51.923571  6295 connection.cc:256] RPC call timeout handler was delayed by -3.2162060390000988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 13:15:52.170480  6295 connection.cc:256] RPC call timeout handler was delayed by -3.1030613140001151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 13:15:52.170899  6295 connection.cc:256] RPC call timeout handler was delayed by -3.0805613140000787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260709 13:15:52.171319  6295 connection.cc:256] RPC call timeout handler was delayed by -3.0347837689998869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 13:15:52.171720  6295 connection.cc:256] RPC call timeout handler was delayed by -3.0338837689998854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 13:15:52.172132  6295 connection.cc:256] RPC call timeout handler was delayed by -2.9951837690000502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 13:15:52.172501  6295 connection.cc:256] RPC call timeout handler was delayed by -2.9852837690000342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 13:15:52.172838  6295 connection.cc:256] RPC call timeout handler was delayed by -2.93938376899996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260709 13:15:52.173336  6295 connection.cc:256] RPC call timeout handler was delayed by -2.9249837689999367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260709 13:15:52.173775  6295 connection.cc:256] RPC call timeout handler was delayed by -2.8790837689998625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 13:15:52.174175  6295 connection.cc:256] RPC call timeout handler was delayed by -2.7197837689998323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 13:15:52.174599  6295 connection.cc:256] RPC call timeout handler was delayed by -2.7104060389999631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 13:15:52.174984  6295 connection.cc:256] RPC call timeout handler was delayed by -2.6154949990000205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
W20260709 13:15:52.175346  6295 connection.cc:256] RPC call timeout handler was delayed by -2.6042703069999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
W20260709 13:15:52.175501  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.175800  6295 connection.cc:256] RPC call timeout handler was delayed by -2.5862703070001771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 13:15:52.186641  6295 connection.cc:256] RPC call timeout handler was delayed by -2.5571138510001674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:15:52.187150  6295 connection.cc:256] RPC call timeout handler was delayed by -2.4874909060001755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
I20260709 13:15:52.169265  6221 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:52.187595  6295 connection.cc:256] RPC call timeout handler was delayed by -2.4150696220001464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
W20260709 13:15:52.188050  6295 connection.cc:256] RPC call timeout handler was delayed by -2.3787898860000496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.46310000000000007s for a response
W20260709 13:15:52.188534  6295 connection.cc:256] RPC call timeout handler was delayed by -2.093261314000074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2649s for a response
W20260709 13:15:52.189006  6295 connection.cc:256] RPC call timeout handler was delayed by -2.0861837689999447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2651s for a response
W20260709 13:15:52.189461  6295 connection.cc:256] RPC call timeout handler was delayed by -1.6083336960000452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31110000000000004s for a response
I20260709 13:15:52.190181  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:52.191509  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.191934  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.193693  6250 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:15:52.193790  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.194185  6254 raft_consensus.cc:1275] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:15:52.191603  6295 leader_election.cc:336] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:15:52.195437  6251 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:52.196413  6252 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:15:52.196785  6295 leader_election.cc:336] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:15:52.198350  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:52.198909  6295 leader_election.cc:336] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:15:51.971933  6328 raft_consensus.cc:2393] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:52.203050  6323 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:52.203145  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.203737  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.204380  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.204622  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.205638  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.205791  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.205972  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:52.206619  6323 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:15:52.206900  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.207119  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.208402  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.209379  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.210027  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.210834  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.211429  6327 raft_consensus.cc:2410] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:15:52.212239  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:52.212499  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.208390  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:51.942016  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.214298  6326 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:52.214424  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.204934  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.215340  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.215852  6324 raft_consensus.cc:2393] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:52.216769  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.217113  6331 raft_consensus.cc:1240] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:51.966395  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.223616  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.224915  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.225275  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.226328  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.226809  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.227885  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.228446  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.229672  6322 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:52.215737  6327 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:15:52.215281  6328 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:52.216715  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:51.972965  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 197360us
I20260709 13:15:52.235858  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:52.236742  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:52.237761  6399 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:52.237905  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:52.078439  6400 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:52.238875  6403 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:52.239223 10476 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:52.237035  6401 raft_consensus.cc:2410] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:15:52.240113  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:52.241430  6404 raft_consensus.cc:2410] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:15:52.242681  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:52.243637  6396 raft_consensus.cc:2393] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:52.104511 10572 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:51.924969 10415 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:52.232026  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.250834  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.249660  6325 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:52.252557  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.259830  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.260685  6325 raft_consensus.cc:2410] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:15:52.263792  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.269479  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 347939us
I20260709 13:15:52.277084  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:52.278291  6941 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:52.279338  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:52.280207  6934 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:52.280624  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.283542 10549 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:51.941406  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:52.285552  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 49411.4us
I20260709 13:15:52.286137  6330 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:52.263833 10607 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:52.290791  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:15:51.945375  6426 debug-util.cc:398] Leaking SignalData structure 0x7b080031c920 after lost signal to thread 5115
I20260709 13:15:52.050196 10494 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:52.294221  6426 debug-util.cc:398] Leaking SignalData structure 0x7b080019b540 after lost signal to thread 6151
W20260709 13:15:52.294653  6426 debug-util.cc:398] Leaking SignalData structure 0x7b080013ba20 after lost signal to thread 6153
W20260709 13:15:52.295800  6426 debug-util.cc:398] Leaking SignalData structure 0x7b080030b7c0 after lost signal to thread 6188
I20260709 13:15:52.296511 10494 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:52.297827  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.279949  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.299437  6933 raft_consensus.cc:2410] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:15:52.301548  6324 raft_consensus.cc:2393] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:15:52.301723  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 513505us
I20260709 13:15:52.302083  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.297621  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.303766  6326 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:52.094332 10529 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:52.263814  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.310500  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.311210  6323 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:52.279949 10460 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:52.312496 10460 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:52.313539 10568 consensus_queue.cc:1059] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:52.314312  6322 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:52.317296  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.321342 10574 consensus_queue.cc:1059] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:52.323042 10608 consensus_queue.cc:1059] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:15:52.329975  6426 debug-util.cc:398] Leaking SignalData structure 0x7b0800092140 after lost signal to thread 6280
I20260709 13:15:52.334379  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:52.355822  6426 debug-util.cc:398] Leaking SignalData structure 0x7b080037cb20 after lost signal to thread 6281
I20260709 13:15:52.335136  6937 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:52.335929 10613 consensus_queue.cc:1059] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:52.336745  6933 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:52.338079 10476 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:52.339588  6905 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:52.340137  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 63558.7us
I20260709 13:15:52.340149  6940 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:52.340554  6941 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:15:52.341519  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.342733  6255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:52.343549  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.320951  6934 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
W20260709 13:15:52.343744  6371 connection.cc:256] RPC call timeout handler was delayed by -3.75842222700021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 13:15:52.343567  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 144803us
W20260709 13:15:52.356699  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 139154us
I20260709 13:15:52.371105  6255 raft_consensus.cc:606] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:52.371721  6371 connection.cc:256] RPC call timeout handler was delayed by -2.5974222270001519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29350000000000004s for a response
I20260709 13:15:52.376005  6255 raft_consensus.cc:614] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:52.381065  6329 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
W20260709 13:15:52.384443  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 45021.9us
I20260709 13:15:52.386343  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.389325  6940 raft_consensus.cc:2410] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:15:52.393376  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:52.397267 10290 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:52.397722 10290 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:52.398089 10290 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.403774  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:52.404381 10549 raft_consensus.cc:3055] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:52.404819 10549 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:52.407927  6401 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:52.409068  6403 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:15:52.412899  6906 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:52.414922  6906 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:52.409593  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:52.410398  6905 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:52.410661 10610 raft_consensus.cc:3055] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:52.411258 10590 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:52.411466  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:52.412240  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:52.409365  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:52.415671 10529 consensus_queue.cc:1059] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:52.416887 10334 raft_consensus.cc:3055] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:52.417865 10461 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.418500 10476 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:52.389590  6936 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:52.429009  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:52.429426  6404 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:52.382992 10574 consensus_queue.cc:1243] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:15:52.429865  6402 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:52.424503 10494 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:15:52.430778 10589 raft_consensus.cc:3055] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:52.431198 10589 raft_consensus.cc:740] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:52.432248 10589 consensus_queue.cc:260] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:52.454681  6323 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:15:52.455299 10589 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:52.437330 10339 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:15:52.455776  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:52.457330  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:52.458093  6322 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:52.438485  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:52.459138  6219 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:52.460294  6405 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:52.460592 10605 consensus_queue.cc:1059] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:52.461549 10563 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:52.461676 10605 raft_consensus.cc:3055] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:52.461997 10563 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.462167 10605 raft_consensus.cc:740] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:52.462419 10563 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.463164 10605 consensus_queue.cc:260] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:52.439253  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:52.439666 10529 raft_consensus.cc:3055] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:52.440575  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:52.441226  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.441730  6399 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:15:52.424748 10334 raft_consensus.cc:740] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:52.442392 10149 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:52.443930 10618 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:52.445370  6221 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:52.445237 10585 consensus_queue.cc:1059] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:52.422120 10610 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:52.468401  6396 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:52.450394 10396 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:52.428076 10476 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.453601  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.454023  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:15:52.433656  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08003151a0 after lost signal to thread 6355
I20260709 13:15:52.468911  6252 raft_consensus.cc:2393] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:15:52.468015  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 53222.6us
W20260709 13:15:52.470934  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 49116.1us
I20260709 13:15:52.449379  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:52.477559  6426 debug-util.cc:398] Leaking SignalData structure 0x7b0800374ba0 after lost signal to thread 6356
I20260709 13:15:52.479528 10610 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.477571  6940 raft_consensus.cc:2376] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13. Re-sending same reply.
I20260709 13:15:52.486150 10607 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:52.486781 10607 raft_consensus.cc:697] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:52.487291  6426 debug-util.cc:398] Leaking SignalData structure 0x7b080018eba0 after lost signal to thread 6429
W20260709 13:15:52.487655  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08003cda40 after lost signal to thread 6430
I20260709 13:15:52.487891 10607 consensus_queue.cc:237] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.477195 10476 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.467507 10529 raft_consensus.cc:740] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:52.438431 10461 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:52.489085  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08003db2a0 after lost signal to thread 6966
W20260709 13:15:52.492643  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08003edb00 after lost signal to thread 6967
I20260709 13:15:52.482405 10396 raft_consensus.cc:697] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:52.494498  6295 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:52.464462 10605 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:52.495565  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:52.496603 10610 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:52.501358  6221 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:52.496757  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.501683 10549 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:52.502509  6252 raft_consensus.cc:2393] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:52.498518 10396 consensus_queue.cc:237] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.503597  6327 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:52.505750 10591 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:52.506186  6331 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:52.507591 10549 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.508401  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:52.509029  6326 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:52.500701 10461 consensus_queue.cc:1059] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:52.508883  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.509471  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.499997  6295 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:52.501350 10149 consensus_queue.cc:1059] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:15:52.490307 10529 consensus_queue.cc:260] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.515434 10575 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:52.516366  6400 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:15:52.516779  6400 pending_rounds.cc:85] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 9
I20260709 13:15:52.517064  6400 pending_rounds.cc:107] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:15:52.518105  6405 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:52.518776  6221 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:52.523025  6400 raft_consensus.cc:2889] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:52.489742 10614 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:52.527027 10565 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.528115 10618 raft_consensus.cc:3055] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:52.528566  6255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:52.536441  6326 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:15:52.538116  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.516844 10529 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:52.550312  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.575263  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.538250 10339 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:52.532009 10614 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:52.539914 10618 raft_consensus.cc:740] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:52.602259  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.605400  6252 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:52.605912  6906 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:52.609335 10396 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:52.609812 10396 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:52.610265 10396 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.602447  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.611096  6331 raft_consensus.cc:2393] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:52.489500 10334 consensus_queue.cc:260] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.617447  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.617987 10334 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:52.618239  6251 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:52.596939 10614 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:52.597697 10290 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.622278  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.622390  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:52.605409  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 105535us
I20260709 13:15:52.624593  6295 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:52.625526  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:52.626178  6324 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:52.626284  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.603504  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:52.631942  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.637802 10290 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:52.634609  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.639921  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.643139  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:52.644369  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.633590 10149 consensus_queue.cc:1243] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer a13ffe92eb374309a5c8476d9fbbb2b8 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:52.654898  6322 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:15:52.656529  6325 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:52.645519  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.658598  6250 raft_consensus.cc:2410] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:52.659355  6324 raft_consensus.cc:1240] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:15:52.654306  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:52.662067  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.662771  6247 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:52.663007 10476 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.663699  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.665884  6252 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:52.668097  6295 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:52.663745  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.674106  6253 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:52.674322  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:52.674564  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.675452  6906 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:52.681552  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.682821 10526 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:52.683265 10526 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:52.683666 10526 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.684875 10585 raft_consensus.cc:3055] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:52.685319 10585 raft_consensus.cc:740] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:52.685320 10494 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:52.689707  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.662117  6254 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:15:52.673472  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:52.689208 10568 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.676910  6906 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:52.643193 10572 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:52.723564  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.709726  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.709206  6368 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:52.744113  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 212543us
W20260709 13:15:52.750075  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.752012  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.757234 10568 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:52.759599  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.759895 10568 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:52.702996  6907 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:52.760540  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:52.761005  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 125735us
I20260709 13:15:52.761390  6254 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:52.762694  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.704982 10415 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:52.763787  6907 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:52.764876  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.765206  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.765643  6250 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:15:52.766019 10290 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:52.766844  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.767418 10290 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:52.768565 10590 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:52.768983 10590 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:52.769454 10590 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.769778  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:52.766927  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 117400us
I20260709 13:15:52.772409  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.775830  6256 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:52.766273  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.765695 10415 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:52.782441  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.783206  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.786348  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.790409 10618 consensus_queue.cc:260] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:52.791766 10618 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.792307 10460 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:52.753382 10494 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:52.709084 10476 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:52.729094 10149 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.793874  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.795688  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.799638  6938 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:52.793916  6248 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:52.700163 10605 consensus_queue.cc:1059] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:15:52.801681  6255 raft_consensus.cc:606] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:52.802178  6255 raft_consensus.cc:614] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:52.778551 10339 raft_consensus.cc:697] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:52.813445  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 145451us
I20260709 13:15:52.806229  6369 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:52.805192  6939 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
W20260709 13:15:52.818656  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 141848us
I20260709 13:15:52.766245 10396 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.827077  6253 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:52.850864  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:52.830545  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:52.834249  6296 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:52.834452 10339 consensus_queue.cc:237] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.832939 10570 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:52.851792  6906 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:52.868745  6219 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:52.867673  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 321307us
I20260709 13:15:52.870947  6942 raft_consensus.cc:2393] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:52.872522  6369 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:52.870050  6371 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:52.875614  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.876327  6252 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
W20260709 13:15:52.878527  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 114807us
W20260709 13:15:52.879068  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 49200.7us
I20260709 13:15:52.880434  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.879756  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:52.865089 10610 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.881758  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:52.884518  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.885159  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:52.884311  6369 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:52.836694 10563 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.895262  6368 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:52.899685  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:52.883934 10476 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:52.905825  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 54498.5us
I20260709 13:15:52.909548  6369 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:52.886957 10605 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:52.910318  6371 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:52.877720 10494 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:15:52.891708 10568 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:52.913388 10567 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:52.913800 10568 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.914234 10568 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.914260 10589 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:52.914768 10605 raft_consensus.cc:697] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:52.915824 10605 consensus_queue.cc:237] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.917582  6371 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:52.918510 10552 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.918910  6371 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:52.919122  6251 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:52.919765 10552 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.920420  6371 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:52.921234 10552 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:52.925194  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 131580us
I20260709 13:15:52.926465 10594 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.930761  6936 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:52.931135  6369 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:52.932451  6296 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:52.934723  6250 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
W20260709 13:15:52.936053 10629 log.cc:927] Time spent T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.179s	user 0.000s	sys 0.002s
I20260709 13:15:52.936192 10611 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:52.937415 10634 consensus_queue.cc:1059] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:52.937463 10290 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:52.939544 10563 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:52.939566 10570 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:52.940013 10637 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:52.940680 10575 raft_consensus.cc:3055] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:52.910254 10476 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:52.912523 10610 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.940558 10636 raft_consensus.cc:3055] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:52.987200  6368 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:52.945683  6371 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:52.947078 10564 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:52.948845 10637 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:52.950345 10529 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:15:52.954730 10616 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:52.956614  6251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aba53315de954573854008b23574a90f"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:52.958177 10568 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:52.960450 10334 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:52.962926  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:52.964262 10614 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.967324  6940 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:52.969838 10396 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:52.943315 10572 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:52.907557 10415 consensus_queue.cc:1059] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:15:52.948068 10570 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:52.992981  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 43658.5us
I20260709 13:15:52.948766 10611 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:52.993011  6251 raft_consensus.cc:606] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:52.990995 10564 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:53.013020  6369 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:53.015852  6369 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:52.992375 10637 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:53.014583 10570 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:53.018684 10572 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:53.019117 10572 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.019438 10572 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:53.020964 10415 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:53.021562 10415 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.023685 10415 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:53.024188 10415 raft_consensus.cc:3055] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:53.028110 10633 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:52.949576 10575 raft_consensus.cc:740] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:53.034188  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 47098.6us
I20260709 13:15:53.035778  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:52.997546  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 52112.4us
I20260709 13:15:52.986282 10636 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:53.013989 10589 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:53.043629  6368 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:52.983886 10476 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:53.008653  6328 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.991950 10552 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:53.037863 10633 consensus_queue.cc:1059] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:53.038017 10642 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:53.038631 10149 consensus_queue.cc:1059] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:53.038822  6295 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:53.039331 10460 raft_consensus.cc:3055] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:15:53.048996  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 102641us
W20260709 13:15:53.040789  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 94696.7us
I20260709 13:15:53.009312 10610 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.013892 10611 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.029093  6222 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.017395 10564 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:53.029649 10549 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:53.031924 10415 raft_consensus.cc:740] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:53.061894 10589 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:53.063261 10566 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:53.063654 10585 consensus_queue.cc:260] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:53.066316 10568 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:53.056514 10611 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:53.069729 10636 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.071550 10636 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:53.072520 10614 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:53.073148 10585 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:53.076052 10590 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:52.996773 10641 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:15:53.049284 10552 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.077644 10552 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:53.080453  6328 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:53.049978 10461 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:53.033654 10563 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:53.081418  6935 raft_consensus.cc:2393] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:53.081185 10461 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.081598 10563 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.049464 10460 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:53.082790 10607 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:53.083180 10460 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.083448 10607 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.083734  6906 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.085083 10613 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:53.085491 10613 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:53.085636  6906 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.085731  6905 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:53.085922 10613 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:53.091924  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 146343us
I20260709 13:15:53.092543  6371 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:53.093595 10591 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:53.094575 10591 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:15:53.100338  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 84579.6us
I20260709 13:15:53.101275  6369 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.104256  6905 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:15:53.112150  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 68637.2us
I20260709 13:15:53.103766 10549 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:53.110944 10565 consensus_meta.cc:287] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.533s	user 0.006s	sys 0.006s
I20260709 13:15:53.108932 10396 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:53.130174  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 101154us
I20260709 13:15:53.137794  6906 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:53.103984 10526 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.109714 10566 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:15:53.135998  6222 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.145541  6369 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:53.145380 10415 consensus_queue.cc:260] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.127492 10396 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.127698 10589 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:53.112461 10567 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:15:53.153878 10590 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:53.154438 10612 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:15:53.155483 10575 consensus_queue.cc:260] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.157352 10649 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:53.182686  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.159650  6368 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.160291 10607 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:53.126533 10565 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.161316 10614 consensus_queue.cc:1059] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:53.163041 10637 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.213832 10614 raft_consensus.cc:3055] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:53.213882  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:53.214299 10614 raft_consensus.cc:740] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:53.215204 10614 consensus_queue.cc:260] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.215144 10637 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:53.216547 10614 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:53.220703 10626 log.cc:927] Time spent T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:15:53.125603 10641 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.173424  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:53.127731 10633 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:53.178615 10415 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:53.178973  6940 raft_consensus.cc:1240] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:53.179862 10552 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:53.181697  6936 raft_consensus.cc:1240] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:53.205178  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.206322  6938 raft_consensus.cc:1240] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:53.182992  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.182024 10494 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.175983 10594 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.209761 10649 raft_consensus.cc:697] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:53.209842  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:53.210568  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 79567.8us
I20260709 13:15:53.181102 10564 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.223052 10526 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:53.273175 10552 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:53.182821 10396 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:53.182300 10570 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:53.277452  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.249203 10568 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:53.278575  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.278891  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.224398 10575 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:53.279739  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.279858  6251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:53.280653  6251 raft_consensus.cc:606] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.281195  6251 raft_consensus.cc:614] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:53.286252  6222 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:53.287389  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.288836  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.280776  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.279852  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.226755 10476 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.236658 10460 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:53.237764 10461 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:53.166955 10563 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:53.181171  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:53.183468  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 126519us
W20260709 13:15:53.243315  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 59456.3us
W20260709 13:15:53.247260  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 153162us
I20260709 13:15:53.254678  6325 raft_consensus.cc:1240] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:53.207070 10636 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.308627  6369 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:53.261585  6249 raft_consensus.cc:2410] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:15:53.181772 10589 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.265821  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.267745 10654 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:15:53.268136  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 108602us
I20260709 13:15:53.269635 10564 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:53.322129  6935 raft_consensus.cc:1240] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:53.322525 10526 consensus_queue.cc:1059] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:53.323128  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.323640 10526 raft_consensus.cc:3055] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:53.270150  6327 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:53.323972 10568 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:53.324438 10568 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:53.323997 10526 raft_consensus.cc:740] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:53.324890 10568 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:53.308954  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.325719 10526 consensus_queue.cc:260] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.326952 10526 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:53.309927  6329 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:53.312318  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.278584 10570 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:53.332317  6297 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:53.333623  6297 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:53.334424 10566 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.334475 10659 consensus_queue.cc:1059] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:53.335232 10566 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.335713 10659 raft_consensus.cc:3055] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:53.335865  6368 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.336135 10659 raft_consensus.cc:740] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:53.337705  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:53.297395 10633 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:53.313584  6222 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.318835  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:53.349730  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:53.350494  6256 raft_consensus.cc:2393] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:53.321895 10654 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.339922  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:53.324450  6940 raft_consensus.cc:1240] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:53.346387  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.366137  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2795) took 1172 ms. Trace:
I20260709 13:15:53.353749 10654 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:53.369256  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:53.366753  6253 raft_consensus.cc:1240] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:15:53.366700  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.370481  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.367018  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.370922  6255 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:53.371548  6250 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:53.372134  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.372385  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:53.372949  6251 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:53.369771  6219 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:53.345671 10589 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:53.374612  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 161723us
I20260709 13:15:53.379905  6371 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.351068 10563 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:53.381029  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 67516.8us
I20260709 13:15:53.369081 10570 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.373168 10461 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.385388  6248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:15:53.392009  6248 raft_consensus.cc:606] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.392373  6248 raft_consensus.cc:614] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:53.393492  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.394119  6253 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:53.366573  6330 rpcz_store.cc:276] 0709 13:15:52.178149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.287252 (+109103us) service_pool.cc:224] Handling call
0709 13:15:52.287872 (+   620us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:52.312619 (+ 24747us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:52.384024 (+ 71405us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.549824 (+165800us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:52.625539 (+ 75715us) log.cc:844] Serialized 52 byte log entry
0709 13:15:52.625746 (+   207us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:52.625954 (+   208us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.626232 (+   278us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.970358 (+344126us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b1800441640. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f457578d4bc 00007f4572adb48b 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af5455 00007f4575bdd060 00007f4575bef716 00007f4575c00287
0709 13:15:52.970474 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.970611 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:53.038822 (+ 68211us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b1800441640. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:15:53.220218 (+181396us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b2400110be8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f457297e9c4 00007f457297cacb 00007f4572b37dc9 00007f4572b37a55 00007f4572b3709d 00007f457576910e 00007f457578088c 00007f457577fbb6 00007f457577f7d8 00007f4575789221
0709 13:15:53.350779 (+130561us) raft_consensus.cc:1685] finished
0709 13:15:53.350803 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:53.350944 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97315,"prepare.queue_time_us":177785,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":76702,"raft.run_cpu_time_us":659,"raft.run_wall_time_us":84211,"spinlock_wait_cycles":123891584,"thread_start_us":337722,"threads_started":3,"wal-append.queue_time_us":356689}
I20260709 13:15:53.375504 10633 raft_consensus.cc:697] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:53.399094  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 46444.2us
I20260709 13:15:53.409255 10563 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:53.410943  6936 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:53.411373 10660 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:53.411973 10660 raft_consensus.cc:697] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:53.412921 10660 consensus_queue.cc:237] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.379367 10476 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:53.270077 10649 consensus_queue.cc:237] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.400357  6297 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:53.416177  6256 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:53.417948  6250 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:53.419137  6253 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
W20260709 13:15:53.431420  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 51600.6us
I20260709 13:15:53.398499  6369 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:53.397852 10610 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.377316 10572 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:53.439944  6937 raft_consensus.cc:2410] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:15:53.372447 10611 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.385861 10396 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:53.454439  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 54175.9us
I20260709 13:15:53.380127 10613 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.462191  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.462939  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.437804 10612 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:53.464284  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.466064  6933 raft_consensus.cc:2393] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 6: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:53.467415  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:53.464439  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.469403  6935 raft_consensus.cc:2393] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:53.470293  6368 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:53.472056  6938 raft_consensus.cc:1240] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:53.473783  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:53.480497  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.475920  6939 raft_consensus.cc:2368] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8.
I20260709 13:15:53.461439 10570 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:53.414527 10659 consensus_queue.cc:260] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.509586  6250 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:53.534543  6941 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:53.533463 10659 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:53.541252  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 109022us
I20260709 13:15:53.533350 10676 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.542012 10676 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:53.542757  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 150951us
W20260709 13:15:53.543437  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 82746.3us
I20260709 13:15:53.548409  6297 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:53.546867  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:53.551910  6368 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.509436 10610 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:53.571297  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.579607  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:53.586544  6250 raft_consensus.cc:1275] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:53.586844  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.587123  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:53.587453  6256 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:53.587643  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:53.588323  6250 raft_consensus.cc:2393] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:53.588428  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:53.505505 10647 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:15:53.596568  6247 raft_consensus.cc:1275] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:53.589068  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.632236  6250 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:53.608312  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:53.605751  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:53.633730  6248 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:53.610764  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.634748  6255 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:53.594937  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:53.636047  6404 raft_consensus.cc:2393] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:53.589627  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:53.598155  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:53.608501  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:53.655191  6248 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:15:53.658527  6906 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.602645 10642 raft_consensus.cc:993] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
W20260709 13:15:53.597823 10665 log.cc:927] Time spent T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:15:53.661474  6254 raft_consensus.cc:2376] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10. Re-sending same reply.
I20260709 13:15:53.688139  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:53.691737  6251 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:53.596269 10563 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:53.693336  6369 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:53.610111 10396 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:53.591923 10549 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.606691 10613 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:53.591198 10611 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:53.577379 10610 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:53.579681 10612 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:53.701347  6906 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.704465  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:53.702250  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:53.708804  6906 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:53.712680  6906 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:53.714514  6906 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.716264  6250 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:15:53.699987 10149 raft_consensus.cc:1081] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:15:53.590374 10667 consensus_queue.cc:1059] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.239s
I20260709 13:15:53.718425  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.721499  6297 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:53.707684 10610 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:53.735746  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:53.595083 10648 consensus_queue.cc:1059] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.234s
I20260709 13:15:53.647179 10654 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:53.739877 10676 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:53.740072  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:53.743852  6937 raft_consensus.cc:2393] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:53.747188  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.750408  6250 raft_consensus.cc:2393] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:53.748286  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:53.736330 10549 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:53.751780 10549 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:53.752693  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.753275  6250 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:53.753870 10549 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:53.754400 10652 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.755966 10583 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:53.756387 10583 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:53.756752 10583 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:53.757586  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.758355  6254 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:53.759543 10673 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:53.759966 10673 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:53.760288 10673 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:53.761253  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 65433.6us
I20260709 13:15:53.761444  6250 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:15:53.762120 10567 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:53.762478  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.763055  6250 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:53.763965  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.763862 10678 consensus_queue.cc:1059] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:15:53.764564  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.765931 10670 log.cc:927] Time spent T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:15:53.769536 10594 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:53.770267 10594 raft_consensus.cc:697] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:53.771421 10594 consensus_queue.cc:237] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.721769 10611 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:53.735858 10396 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:53.719386 10339 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.775997  6906 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:53.742902 10590 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:53.793848  6250 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:15:53.604007 10633 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.809408  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:53.709216 10552 consensus_queue.cc:1059] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:15:53.803485  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:53.812085  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.795311  6295 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:53.810446  6329 raft_consensus.cc:2393] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:53.804181  6323 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:15:53.776604 10290 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.773357 10572 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:53.815999 10567 consensus_queue.cc:1048] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
W20260709 13:15:53.824189  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 272361us
I20260709 13:15:53.749872 10613 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:15:53.829092  6368 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.843540 10552 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:53.846764  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 153495us
I20260709 13:15:53.852644  6369 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:53.854458  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 59252.2us
I20260709 13:15:53.857582  6295 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:53.746268 10565 consensus_queue.cc:1059] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:15:53.818300 10476 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:53.817044 10396 raft_consensus.cc:697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:53.844038 10552 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.827891 10567 consensus_queue.cc:1243] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:15:53.827001 10590 raft_consensus.cc:697] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:53.844977 10566 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:53.855924 10568 consensus_meta.cc:287] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.530s	user 0.015s	sys 0.001s
I20260709 13:15:53.843981 10654 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:53.810696 10339 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.889335  6369 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:53.861040  6250 raft_consensus.cc:2955] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:53.884013 10657 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.869037 10668 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.869505 10552 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:53.912763  6249 consensus_meta.cc:287] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.000s
I20260709 13:15:53.917007  6249 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:15:53.917639  6256 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:53.918064  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.918877  6249 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:53.919142  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:53.864734 10564 consensus_queue.cc:1048] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:15:53.877203 10675 raft_consensus.cc:3055] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:53.874684  6323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aba53315de954573854008b23574a90f"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57230
I20260709 13:15:53.935420  6323 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:53.936162  6323 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:53.878013 10549 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:53.919049  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:53.942906  6256 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:53.878218  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 64300.5us
W20260709 13:15:53.927163  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 107945us
I20260709 13:15:53.878523  6295 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:53.932266  6254 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:53.907716 10676 raft_consensus.cc:3055] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:53.909493 10667 raft_consensus.cc:3055] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:53.946585  6369 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:53.915632 10611 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:53.876721 10568 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:53.922398 10654 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:53.950347  6906 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:53.959683  6906 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:53.960554  6906 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.963091  6249 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:15:53.964529  6369 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:53.965317  6368 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:53.965842  6371 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:15:53.967090  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 117277us
I20260709 13:15:53.935209 10675 raft_consensus.cc:740] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:53.974058  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:53.999693  6256 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:15:53.881582 10649 consensus_queue.cc:1059] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:15:53.948812 10676 raft_consensus.cc:740] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:54.000891  6369 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:53.950310 10667 raft_consensus.cc:740] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:54.017737  6404 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:53.965472 10476 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:54.100736 10683 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:54.018273 10396 consensus_queue.cc:237] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:54.164646 10570 consensus_meta.cc:287] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.619s	user 0.003s	sys 0.004s
W20260709 13:15:54.092070 10682 log.cc:927] Time spent T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:15:54.100289 10675 consensus_queue.cc:260] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.165431 10570 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:54.165508 10667 consensus_queue.cc:260] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.092577  6254 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:15:54.166850 10667 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:54.167593  6254 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:54.092793 10685 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:54.169359 10675 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:54.169689 10685 raft_consensus.cc:697] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:54.170689 10685 consensus_queue.cc:237] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:54.173494 10679 log.cc:927] Time spent T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 13:15:54.173712  6401 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
W20260709 13:15:54.147838  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.175338  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.175637 10689 log.cc:927] Time spent T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:15:54.001163 10549 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.177507  6222 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:54.177843 10549 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:54.151206  6221 leader_election.cc:336] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.631s (SENT)
I20260709 13:15:54.161008 10688 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:54.038163  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 231077us
I20260709 13:15:54.179883 10688 raft_consensus.cc:697] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:15:54.180146  6221 leader_election.cc:336] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.693s (SENT)
I20260709 13:15:54.180904 10688 consensus_queue.cc:237] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:54.149550  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 285861us
I20260709 13:15:54.182827  6937 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:54.184299  6941 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:15:54.092211 10687 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:54.184717  6941 pending_rounds.cc:85] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: Aborting all ops after (but not including) 8
I20260709 13:15:54.185096  6941 pending_rounds.cc:107] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:15:54.074970 10613 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:54.185403  6941 raft_consensus.cc:2889] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:54.185613  6940 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:15:54.185163  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:54.185942 10613 raft_consensus.cc:697] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:54.186594  6330 raft_consensus.cc:2410] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:15:54.186704  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:54.187572  6938 raft_consensus.cc:2410] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:15:54.186839 10613 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.188750 10585 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:15:54.042860  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 82393.1us
I20260709 13:15:54.190821 10564 consensus_queue.cc:1059] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:54.091807 10684 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:54.192999 10684 raft_consensus.cc:697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:54.190948  6905 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:54.193917 10684 consensus_queue.cc:237] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.091753 10686 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.191776 10698 raft_consensus.cc:3055] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:54.195255 10698 raft_consensus.cc:740] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:54.195000 10686 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.195793 10647 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:54.196166 10698 consensus_queue.cc:260] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.197568 10698 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:54.200848  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.001116 10654 raft_consensus.cc:697] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:54.202005 10654 consensus_queue.cc:237] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.001577 10611 raft_consensus.cc:697] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:54.203688 10611 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.000837 10648 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:54.073428  6249 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:15:54.208449  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 207639us
W20260709 13:15:54.212564  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.213454  6222 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:54.213797  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.139051  6248 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:15:54.216756  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:54.217501  6248 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:15:54.143576  6251 raft_consensus.cc:1240] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:54.146883  6252 raft_consensus.cc:1240] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:54.227523  6256 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:15:54.265079  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:54.225176  6369 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:54.191309 10585 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.972784 10565 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:15:54.115206 10677 log.cc:927] Time spent T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.339s	user 0.002s	sys 0.009s
I20260709 13:15:54.269629  6369 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:54.228173  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:54.118752 10690 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.150667 10680 log.cc:927] Time spent T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.408s	user 0.001s	sys 0.000s
I20260709 13:15:54.259464  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:54.224766  6323 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.018585 10590 consensus_queue.cc:237] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.257841 10648 raft_consensus.cc:697] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:54.281639  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:54.237411  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.228588 10687 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:54.230314 10618 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:54.147969 10612 raft_consensus.cc:3055] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:54.306413  6941 raft_consensus.cc:2368] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8.
I20260709 13:15:54.278097  6331 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:54.162087 10339 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:54.102771 10616 raft_consensus.cc:3055] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:54.310268  6323 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:54.161113 10568 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:54.273020 10683 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:54.228430 10636 consensus_queue.cc:1059] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
W20260709 13:15:54.290558 10589 consensus_meta.cc:287] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.900s	user 0.008s	sys 0.004s
W20260709 13:15:54.329401  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.335665  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.228523 10476 raft_consensus.cc:697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:54.273355 10415 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:15:54.310621 10678 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:54.204823 10610 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.329783 10616 raft_consensus.cc:740] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:54.159619 10673 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.342396  6297 leader_election.cc:400] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8.
I20260709 13:15:54.354400  6297 leader_election.cc:403] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:54.326913 10570 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.347324 10648 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.334576 10687 raft_consensus.cc:697] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:54.313694 10565 raft_consensus.cc:697] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:54.347996  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 389082us
I20260709 13:15:54.326556 10612 raft_consensus.cc:740] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:15:54.345872 10583 consensus_meta.cc:287] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.002s
I20260709 13:15:54.315155 10149 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:15:54.310385 10585 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.336624 10683 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:54.308177 10690 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.334513 10686 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:54.344763 10678 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:54.359609 10659 consensus_meta.cc:287] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.820s	user 0.008s	sys 0.004s
I20260709 13:15:54.341303 10589 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:54.369185  6403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.055s	sys 0.093s
I20260709 13:15:54.363200 10636 raft_consensus.cc:3055] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:15:54.381059  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 52866.3us
I20260709 13:15:54.367136 10564 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8.
I20260709 13:15:54.363574 10570 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.389320  6323 raft_consensus.cc:1240] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:54.335543 10676 consensus_queue.cc:260] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:54.393555  6403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.055s	sys 0.094s
W20260709 13:15:54.401054  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.376205 10683 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:54.407522 10636 raft_consensus.cc:740] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:54.413478 10476 consensus_queue.cc:237] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.415014 10585 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:54.373950 10583 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:54.420888  6329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.007s	sys 0.048s
I20260709 13:15:54.426618  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:54.426986  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 215170us
W20260709 13:15:54.416992 10566 consensus_meta.cc:287] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.541s	user 0.003s	sys 0.003s
W20260709 13:15:54.424466  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 195394us
W20260709 13:15:54.425803  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 48714.2us
W20260709 13:15:54.426895  6329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.007s	sys 0.048s
I20260709 13:15:54.384766 10678 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:54.427295  6331 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:54.371115 10687 consensus_queue.cc:237] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.432061  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:54.429765  6368 leader_election.cc:304] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:54.438166 10675 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:54.438617 10675 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.438987 10675 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:54.425305 10572 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:54.444381  6940 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:54.446050  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:54.446228  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:54.447551  6937 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:15:54.416684 10612 consensus_queue.cc:260] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.435947 10566 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:54.422883 10616 consensus_queue.cc:260] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.475520 10706 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.475816  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 603546us
I20260709 13:15:54.476117 10706 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.477070  6295 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:54.478312 10706 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:54.476975 10567 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:54.478662 10718 consensus_queue.cc:1059] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:15:54.492259  6322 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:54.496068  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 48653us
I20260709 13:15:54.492795 10718 consensus_queue.cc:1243] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:54.506091  6368 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:54.480350 10716 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:54.492906 10715 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.436482 10565 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.529824  6368 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:54.530911 10612 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:54.531044 10706 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:54.533550 10690 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:54.533749 10692 log.cc:927] Time spent T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:15:54.538722  6401 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:54.543246  6221 leader_election.cc:336] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.792s (SENT)
I20260709 13:15:54.543762  6221 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:54.543713  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.544330  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.544718  6401 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:54.546418  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.546690  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:54.547389  6401 raft_consensus.cc:2393] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:54.547435  6397 raft_consensus.cc:2376] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10. Re-sending same reply.
I20260709 13:15:54.492285 10566 consensus_queue.cc:1059] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:15:54.522925 10673 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:54.522336 10610 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:54.576725  6907 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:54.518591 10718 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.554531  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 76287.1us
I20260709 13:15:54.517838 10605 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:54.551688  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:54.557919 10589 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:54.479180 10636 consensus_queue.cc:260] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:54.559684 10552 consensus_meta.cc:287] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.004s
W20260709 13:15:54.592224 10709 log.cc:927] Time spent T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:15:54.560345  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:54.561241  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.561353  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:54.561594  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.562353  6400 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:54.564814  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.565109  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.572201 10713 consensus_queue.cc:1059] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:15:54.585428  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 78171.4us
I20260709 13:15:54.586644  6941 raft_consensus.cc:1240] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:54.535203 10685 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:54.592528 10552 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.598874  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.599980  6401 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:54.600826  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:54.603530  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:54.607183  6398 raft_consensus.cc:2376] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8. Re-sending same reply.
I20260709 13:15:54.594767 10613 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:54.592243 10636 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:54.613231  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:54.613669  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:54.613831  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.617385  6405 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:54.614359  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.614982  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.618697  6397 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:15:54.619251  6400 raft_consensus.cc:2393] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:54.616916  6404 raft_consensus.cc:2393] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:54.623027  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.623987  6397 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:54.625816  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.626538  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.628353  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:54.530438 10716 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.627192  6397 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
W20260709 13:15:54.629381  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 44788.9us
I20260709 13:15:54.630689  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:54.633746  6404 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:54.634562  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:54.635524  6405 raft_consensus.cc:2376] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9. Re-sending same reply.
I20260709 13:15:54.632748  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.642333  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.539150 10715 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.595551 10718 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.650502  6371 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:54.643352 10613 raft_consensus.cc:697] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:54.656028 10729 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:54.656723 10729 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.657083 10613 consensus_queue.cc:237] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.634541 10565 raft_consensus.cc:3055] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:54.658573 10673 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:54.662479 10552 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:15:54.663277 10717 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:15:54.663705 10722 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:15:54.664556 10610 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:54.662516 10726 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.670501 10583 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:54.726524  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.727031  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:54.727233  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:54.680532 10565 raft_consensus.cc:740] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:54.734386 10718 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:54.736562 10724 log.cc:927] Time spent T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.174s	user 0.002s	sys 0.000s
I20260709 13:15:54.737932 10731 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.738477 10731 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.739254 10697 raft_consensus.cc:3055] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:54.739692 10697 raft_consensus.cc:740] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:54.742717 10729 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:54.740550 10697 consensus_queue.cc:260] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.714733 10648 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.716063 10610 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:54.758857  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.714026 10673 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.755419 10731 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:54.760802 10648 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.759136 10610 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:54.797142  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:54.811734  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.821437  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 93719.2us
I20260709 13:15:54.722987 10726 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:54.836534  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.825755 10660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.005s	sys 0.015s
W20260709 13:15:54.828603 10698 consensus_meta.cc:287] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.000s
I20260709 13:15:54.857050  6935 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
W20260709 13:15:54.854604 10660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.005s	sys 0.015s
I20260709 13:15:54.853070 10731 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:54.898684  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.909669 10728 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.163s	user 0.002s	sys 0.005s
I20260709 13:15:54.908627 10716 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:54.914686 10739 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.923256  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.926185 10743 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.926774 10743 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.892485 10565 consensus_queue.cc:260] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.929493 10565 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:54.929957  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.931185  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:54.931716  6404 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:54.934854  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.936015  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.936070 10684 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.936712 10684 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.937480 10675 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:54.938853 10684 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:54.938994 10570 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:54.939585 10675 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:54.928934 10743 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:54.940896  6397 raft_consensus.cc:2393] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:54.940622 10739 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:54.942703  6397 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:15:54.943959  6397 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:54.945256 10739 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:54.946130 10726 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:54.946532  6405 raft_consensus.cc:1240] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:15:54.948457  6405 raft_consensus.cc:1240] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:15:54.950995 10673 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:54.954119 10648 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:54.954871  6403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 854) took 1374 ms. Trace:
I20260709 13:15:54.945089  6397 raft_consensus.cc:1275] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:54.954916  6404 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:54.969666  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:54.971341  6404 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:15:54.958223  6403 rpcz_store.cc:276] 0709 13:15:53.580365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.580479 (+   114us) service_pool.cc:224] Handling call
0709 13:15:53.597458 (+ 16979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:53.778678 (+181220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:53.778712 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.796392 (+ 17680us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.421401 (+625009us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:54.421454 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.954468 (+533014us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b5400183654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:54.954517 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.954556 (+    39us) raft_consensus.cc:1685] finished
0709 13:15:54.954569 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.954781 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47183,"raft.queue_time_us":122315,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":16344,"spinlock_wait_cycles":89685760,"thread_start_us":711846,"threads_started":2,"wal-append.queue_time_us":627180}
I20260709 13:15:55.011638  6405 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:15:55.014140 10718 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:55.034137 10567 raft_consensus.cc:3055] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:55.032725 10610 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:55.044576  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 501324us
I20260709 13:15:55.017575  6404 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:15:55.045706  6221 leader_election.cc:336] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.831s (SENT)
I20260709 13:15:55.046149  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:55.046468 10721 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:55.035436 10685 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:55.047313  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:54.897608 10731 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.047539  6396 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:15:54.958447 10726 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.046176  6221 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.048774 10605 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:15:55.040478  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 606243us
W20260709 13:15:55.039485  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 615895us
W20260709 13:15:55.021104 10683 consensus_meta.cc:287] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.004s
I20260709 13:15:55.049554  6222 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:55.049613 10683 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.050938 10731 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:55.051244 10563 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:55.051653 10683 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:55.030726  6403 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:55.051680  6401 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 12: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:55.044520 10567 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:55.053005  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:55.041095 10711 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:55.053828  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:55.054080  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:55.050949  6219 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:55.054891  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:55.055030  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:55.056411  6402 raft_consensus.cc:2393] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:55.056674 10618 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:55.057078 10618 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.057229 10605 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.057484 10618 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:55.057680  6939 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:15:55.019526  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:55.057631  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.051899 10563 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.053494 10567 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.048501 10726 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.039929 10585 consensus_queue.cc:1059] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:15:55.059301  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:55.070611  6402 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:55.046638 10610 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:55.020512  6397 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:55.061995  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.063213  6404 raft_consensus.cc:2393] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:55.062969 10563 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.058641  6400 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
W20260709 13:15:55.016063 10667 consensus_meta.cc:287] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.849s	user 0.006s	sys 0.016s
W20260709 13:15:55.037861 10748 log.cc:927] Time spent T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:15:55.087729  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.090924  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.091002  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:55.070034 10567 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:55.097777  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:55.057758 10605 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.069653 10415 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:55.104650  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:55.105165 10415 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:55.072141 10494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.014s	sys 0.018s
I20260709 13:15:55.100863  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:55.106729  6403 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:55.104390 10605 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:55.108160  6400 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 9. Current term is 10. Ops: []
W20260709 13:15:55.111393  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 62313us
I20260709 13:15:55.112128  6397 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:55.111004 10494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.014s	sys 0.019s
I20260709 13:15:55.085471 10718 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.117511  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.117511  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:55.119859  6402 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 5.
I20260709 13:15:55.106340 10633 raft_consensus.cc:3055] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:55.094991 10585 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
W20260709 13:15:55.122934  6221 leader_election.cc:336] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.899s (SENT)
I20260709 13:15:55.127485  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:55.128125  6933 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:55.129083  6297 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:55.135139  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:55.135926  6939 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:55.128965 10566 consensus_queue.cc:1059] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:15:55.131729 10721 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.138167 10726 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:55.139377  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:55.140870  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.142547  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.142894  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.143586  6325 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 12: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:55.144075  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:55.145303  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:55.146471  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:55.147852  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:55.148478  6328 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:55.123821 10633 raft_consensus.cc:740] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:55.130295 10731 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.155380  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:55.157552  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.159811  6324 raft_consensus.cc:2393] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:55.156730  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:55.158293  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.163597  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.155604 10594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.000s	sys 0.008s
W20260709 13:15:55.179396 10594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.112s	user 0.002s	sys 0.008s
I20260709 13:15:55.138442 10721 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.183166 10721 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:55.193712  6368 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:55.194624 10415 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:55.194932 10667 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:55.195209 10712 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.193878 10633 consensus_queue.cc:260] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.196873  6323 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:55.197579  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.197445  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.197517  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:55.200929  6327 raft_consensus.cc:2410] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:55.201635  6328 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:15:55.125834 10743 consensus_queue.cc:1059] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:15:55.203299  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:55.154044 10698 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:55.203541  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.202953  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:55.207836  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:55.209270  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:15:55.199985 10678 consensus_meta.cc:287] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.752s	user 0.009s	sys 0.013s
I20260709 13:15:55.212869  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.213277 10678 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.213581  6323 raft_consensus.cc:3055] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:55.214125  6323 raft_consensus.cc:740] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:55.214205 10720 consensus_queue.cc:1059] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:15:55.215236 10594 raft_consensus.cc:3055] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:55.215494 10678 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:55.215636 10594 raft_consensus.cc:740] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:55.216459  6399 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 11: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:55.216717 10594 consensus_queue.cc:260] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.217685 10563 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:55.218044 10594 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:55.211181  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.211687  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:55.213822  6326 raft_consensus.cc:2410] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:55.220093  6325 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 12: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:55.201331 10735 raft_consensus.cc:3055] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:15:55.224684  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.226199  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.212805 10633 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:55.195747 10712 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.222505  6402 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:55.208182 10698 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.231980  6296 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.222221 10735 raft_consensus.cc:740] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:55.234647 10718 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:55.236385  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:55.225772  6323 consensus_queue.cc:260] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.229573  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.240561 10642 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:55.245905  6325 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
W20260709 13:15:55.240942  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.201737 10731 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.251303  6219 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:55.238616  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:55.247344  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.247588  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:55.252230  6250 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:15:55.252382  6248 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:55.240841 10711 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.249091  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:55.244061 10636 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.249894  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:55.249933  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:55.256175  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.256520  6251 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:55.256667  6296 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.257932  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.258589  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:55.259192  6402 raft_consensus.cc:2410] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:15:55.239459  6221 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.237033 10415 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.243007 10698 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:55.248796  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.253311  6939 raft_consensus.cc:2393] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:55.262101  6249 raft_consensus.cc:1275] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:55.262424  6252 raft_consensus.cc:2410] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:55.253221  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:55.254703  6323 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:55.249153 10723 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:55.250797 10721 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:55.255868 10605 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:55.268743  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:55.268417 10339 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:55.264343 10642 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.266505 10636 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.317025  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.317730 10612 consensus_queue.cc:1059] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:55.318436 10636 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:55.313537 10567 consensus_queue.cc:1048] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:15:55.284956 10712 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:55.320253 10756 log.cc:927] Time spent T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:15:55.322770  6253 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:15:55.323269 10605 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.323678 10605 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:55.269115 10735 consensus_queue.cc:260] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.286242 10731 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:55.261830 10711 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.326332 10735 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:55.326803  6248 raft_consensus.cc:2410] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:55.328061 10711 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:55.328188 10715 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:55.260579 10743 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:55.328953 10743 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.331017 10743 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:55.288247  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.333384  6405 raft_consensus.cc:1240] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:55.264484 10415 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.334586 10618 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.336169 10415 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:55.294173 10614 consensus_queue.cc:1059] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:55.326824 10642 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:55.288269  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:55.260653 10720 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:55.250998 10718 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:55.340412 10718 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:55.298316  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.341320  6328 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:15:55.341493  6324 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:55.298661 10721 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.342783 10565 raft_consensus.cc:3055] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:55.343174 10565 raft_consensus.cc:740] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:55.343971 10565 consensus_queue.cc:260] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.344473 10721 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:55.305382  6256 raft_consensus.cc:2410] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:55.345300 10612 raft_consensus.cc:3055] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:55.345722 10612 raft_consensus.cc:740] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:55.346599 10612 consensus_queue.cc:260] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:55.305888  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 66518.8us
I20260709 13:15:55.347838  6325 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:55.348119 10612 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:55.348852  6221 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.350868  6221 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.351877  6221 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:55.353314  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.307137  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:55.354308  6936 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:55.353780 10642 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:55.355890 10642 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:55.356563 10642 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:55.357185 10642 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:55.357551 10642 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:55.357935 10642 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:55.309026  6251 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:55.309681  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:55.358464 10708 log.cc:927] Time spent T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.849s	user 0.004s	sys 0.000s
I20260709 13:15:55.359690  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2486) took 1802 ms. Trace:
I20260709 13:15:55.311604  6938 raft_consensus.cc:1240] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:55.314355  6296 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.360077  6247 rpcz_store.cc:276] 0709 13:15:53.558567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.137144 (+578577us) service_pool.cc:224] Handling call
0709 13:15:54.137517 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.153258 (+ 15741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.153288 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.153747 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.447666 (+293919us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:54.447704 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.447767 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.357893 (+910126us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:55.359357 (+  1464us) raft_consensus.cc:1685] finished
0709 13:15:55.359381 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.359607 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15268,"raft.queue_time_us":15509,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":24418688,"thread_start_us":293582,"threads_started":1,"wal-append.queue_time_us":291473}
W20260709 13:15:55.361937  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 47639.8us
I20260709 13:15:55.362524 10718 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:55.362860  6296 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.363077 10718 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:55.363799 10718 consensus_queue.cc:1059] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:55.364032  6296 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.269968  6250 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:15:55.364601 10564 raft_consensus.cc:3055] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:55.364923 10564 raft_consensus.cc:740] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:55.341673  6328 pending_rounds.cc:85] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 6
I20260709 13:15:55.365453  6328 pending_rounds.cc:107] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:15:55.365721  6328 raft_consensus.cc:2889] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:55.365861 10564 consensus_queue.cc:260] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.367096 10564 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:55.367129 10731 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:55.364053 10567 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:15:55.369760 10719 log.cc:927] Time spent T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.809s	user 0.005s	sys 0.002s
I20260709 13:15:55.370285  6296 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.316355 10723 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:15:55.372270  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:55.298885  6323 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:15:55.373591  6323 pending_rounds.cc:85] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 7
I20260709 13:15:55.373517  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:55.373961  6323 pending_rounds.cc:107] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:15:55.374221  6323 raft_consensus.cc:2889] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:55.375619  6254 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:15:55.376700 10565 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:55.371796 10594 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:55.379040 10698 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.380232  6329 raft_consensus.cc:2393] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 11: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:55.380472  6325 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:15:55.381551  6296 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.382073  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.382596 10702 raft_consensus.cc:3055] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:55.383018 10702 raft_consensus.cc:740] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:55.383065 10594 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:55.383939 10702 consensus_queue.cc:260] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.385078  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.385440 10702 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:55.385690  6327 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:55.386926  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:55.388021  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:55.388527  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:55.389140  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:55.390210  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:55.391237  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:55.391726  6934 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:55.392449  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:55.336807 10618 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:55.390199  6327 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:15:55.392966  6934 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:55.398151  6939 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:55.399204  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:55.385071  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.402040  6222 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:55.403219 10712 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:55.403723 10594 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:55.402611  6296 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.410343  6327 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:55.392282 10698 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:55.413839  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 61047.2us
I20260709 13:15:55.416074  6221 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.412639  6296 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.400748  6934 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
W20260709 13:15:55.420198  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.420840  6297 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:55.423135 10698 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:55.423856 10698 raft_consensus.cc:697] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:55.424542  6222 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:55.425338 10711 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:55.425948  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:55.427139  6221 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.427299 10636 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:55.427232 10618 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:55.428308 10712 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:55.429765  6221 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.427670 10633 raft_consensus.cc:2764] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:15:55.431463 10633 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:55.424834 10698 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.414016 10735 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:55.439530  6936 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
I20260709 13:15:55.440295  6937 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:15:55.441104  6371 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:55.461236  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 48647.7us
I20260709 13:15:55.462900  6296 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:55.469616  6221 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.472085  6250 pending_rounds.cc:85] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 4
I20260709 13:15:55.472385  6250 pending_rounds.cc:107] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:15:55.472231  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:55.472659  6250 raft_consensus.cc:2889] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:55.472738  6256 raft_consensus.cc:1240] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:15:55.474006  6368 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:55.476969  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:55.477792  6256 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:15:55.478248  6248 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:15:55.478333  6324 raft_consensus.cc:1275] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:15:55.478739  6324 pending_rounds.cc:85] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 3
I20260709 13:15:55.478531  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.479065  6324 pending_rounds.cc:107] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:15:55.479390  6324 raft_consensus.cc:2889] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:55.479441  6252 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:55.482362  6256 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:55.489249  6327 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:55.489483 10610 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:55.490338  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.491019  6249 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:15:55.491356  6247 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:15:55.492223  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:55.495152  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.456560 10735 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:55.500594 10676 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:55.481755  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.501977  6248 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:55.490483  6254 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:55.492673  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.505084  6247 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:55.493060  6249 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:55.508131  6251 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:55.503324  6941 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:55.515069  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.515952  6248 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:15:55.516566  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.502857 10589 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:55.517761 10667 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:55.518463  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:55.519049  6254 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:55.521904  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.523690  6247 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:15:55.525465  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:55.525676  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:55.526505  6405 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:15:55.529094  6398 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:15:55.517306  6255 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 12: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:55.529610  6398 pending_rounds.cc:85] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 6
I20260709 13:15:55.529891  6398 pending_rounds.cc:107] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:15:55.530105  6398 raft_consensus.cc:2889] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:55.530539  6248 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:55.526006  6249 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:55.536506  6296 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:55.538192  6256 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:55.468741 10594 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:55.546453  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.481685 10711 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:55.557315  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.559463  6254 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:55.558410  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.465497 10618 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:15:55.513062 10610 raft_consensus.cc:697] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:55.568770  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.543040 10564 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:55.469003 10712 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
W20260709 13:15:55.543355 10760 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:15:55.577019  6249 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:15:55.578790  6251 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:15:55.551151 10594 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:55.583277  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.565798 10743 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.543148 10667 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:15:55.569433 10659 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:55.542657 10735 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:15:55.604306  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.581007 10564 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:55.625478  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.586757 10594 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:55.594787  6327 raft_consensus.cc:1275] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:55.640066  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.641633  6253 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:15:55.626636 10564 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:55.654940 10725 log.cc:927] Time spent T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 1.089s	user 0.002s	sys 0.006s
I20260709 13:15:55.592288 10743 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.635555 10739 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:55.667577  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.663832  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:55.664388  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.671180  6247 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:15:55.648726 10713 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.664404 10678 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 13:15:55.691560  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.693781  6247 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:55.698532  6323 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:55.687000 10633 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:55.744009  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.745765  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.746567  6327 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:55.649101 10610 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:55.749361  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.676921 10739 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.758837  6402 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:55.759646  6247 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:55.763160  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2689) took 1196 ms. Trace:
W20260709 13:15:55.770305  6221 leader_election.cc:336] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 2.123s (SENT)
I20260709 13:15:55.705231 10711 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:55.689587 10713 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.763533  6396 rpcz_store.cc:276] 0709 13:15:54.562117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.564860 (+  2743us) service_pool.cc:224] Handling call
0709 13:15:55.758398 (+1193538us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b540002cbd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:55.758568 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041801984}
I20260709 13:15:55.781591  6906 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:55.783190  6906 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.785109  6295 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:55.785384  6906 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:55.787356  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.697454 10605 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.760430 10698 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.794564  6295 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:55.780951 10701 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:55.788244 10711 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.810164  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.815315  6295 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:55.815955  6327 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
W20260709 13:15:55.815091  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 44840.6us
I20260709 13:15:55.816630  6295 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.751855 10642 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:55.818069  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:55.788858 10649 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:55.779434 10742 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.817889  6295 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:55.794412 10715 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:15:55.792797 10415 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:55.794454 10668 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:55.793505 10614 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:55.793382 10648 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:55.778981 10583 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:15:55.788599 10737 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:15:55.837477  6295 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:55.819959 10723 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:55.806888 10567 consensus_queue.cc:1059] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:15:55.832672  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:55.759490 10633 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.797102 10396 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:15:55.826345 10718 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:55.849363  6254 raft_consensus.cc:1275] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:15:55.853152  6907 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:55.823746 10618 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.824092 10731 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:55.839888 10612 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:55.858757  6247 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:55.839299 10648 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.849228  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:55.858810 10770 log.cc:927] Time spent T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:15:55.812047 10698 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.861784  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:55.893761  6327 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:55.835014 10668 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:55.845206 10594 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.818058 10701 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.855729 10723 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:55.908370 10723 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:55.909003  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:55.910916 10768 log.cc:927] Time spent T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:15:55.912407  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2822) took 1715 ms. Trace:
W20260709 13:15:55.912695 10771 log.cc:927] Time spent T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:15:55.879256 10667 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:55.889272 10737 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:55.861370 10683 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.912751  6330 rpcz_store.cc:276] 0709 13:15:54.196912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.197172 (+   260us) service_pool.cc:224] Handling call
0709 13:15:54.197485 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.197870 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.197897 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:55.347208 (+1149311us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b2c0002aad8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f45744dea11 00007f45744ee372 00007f4575c20a01 00007f4575be543a 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2
0709 13:15:55.347611 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.567343 (+219732us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:55.567393 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.567497 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.912067 (+344570us) raft_consensus.cc:1685] finished
0709 13:15:55.912089 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.912345 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":393,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":26016512,"thread_start_us":219355,"threads_started":1,"wal-append.queue_time_us":352844}
W20260709 13:15:55.889969 10565 consensus_meta.cc:287] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.513s	user 0.006s	sys 0.004s
I20260709 13:15:55.858075 10614 raft_consensus.cc:697] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:55.886651 10731 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.894376  6369 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:15:55.937907  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 43624.8us
I20260709 13:15:55.938030  6249 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:15:55.918808 10737 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.851523 10755 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:15:55.906366 10743 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:55.916258  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2276) took 1344 ms. Trace:
I20260709 13:15:55.888412 10612 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:55.924736  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 87338us
I20260709 13:15:55.947643  6295 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:55.843945 10415 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.893008 10648 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:55.928122  6935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 822) took 1189 ms. Trace:
W20260709 13:15:55.928547  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 107784us
I20260709 13:15:55.903654 10668 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:55.835079 10742 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.889503 10618 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:55.939432  6369 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:55.935797  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:55.942556  6401 rpcz_store.cc:276] 0709 13:15:54.572070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.600615 (+ 28545us) service_pool.cc:224] Handling call
0709 13:15:55.916044 (+1315429us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54003764d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:55.916189 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035288320}
I20260709 13:15:55.939344 10737 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:55.948061 10565 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:55.941207 10731 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:55.937443 10721 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:15:55.966867  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:55.942631 10589 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:55.950847  6935 rpcz_store.cc:276] 0709 13:15:54.726563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.726716 (+   153us) service_pool.cc:224] Handling call
0709 13:15:55.915691 (+1188975us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540072a954. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:55.915870 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297317120}
I20260709 13:15:55.949100 10612 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:55.943490 10636 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.929774 10667 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.978627 10415 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:55.933925 10683 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:55.981400  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:55.983006 10589 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:55.974057 10773 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:15:55.973991 10769 log.cc:927] Time spent T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:15:55.984073  6322 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
W20260709 13:15:55.986347 10774 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 13:15:55.987859 10779 log.cc:927] Time spent T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:15:55.980114 10713 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:55.971791 10565 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:56.009706  6401 raft_consensus.cc:2393] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:56.031072  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:55.977326 10660 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:56.002166  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:56.019605 10776 log.cc:927] Time spent T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:15:56.031769  6252 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
W20260709 13:15:56.033252  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.036144  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:56.009323 10589 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:15:56.037643 10780 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:15:56.008366 10636 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.006716 10718 raft_consensus.cc:697] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:56.041301 10614 consensus_queue.cc:237] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.009804 10567 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:56.041981 10698 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:56.043447 10683 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:56.023970 10739 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:56.045722 10775 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.157s	user 0.002s	sys 0.000s
W20260709 13:15:56.047020 10777 log.cc:927] Time spent T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:15:56.053339  6401 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:56.070297  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:56.070863  6401 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:56.071585  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:56.072053  6401 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:56.073511  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:56.053735  6327 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:15:56.019421 10642 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:56.081720  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 111828us
I20260709 13:15:56.060807  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:56.082609  6252 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:56.044116 10612 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.066159  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:56.067233  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 93580.3us
I20260709 13:15:56.083652  6402 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:56.083963  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:56.068356  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:56.035166 10565 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:56.055838  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 116485us
I20260709 13:15:56.091365 10636 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:56.092212 10636 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:56.092592 10636 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.093631  6331 raft_consensus.cc:1240] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:56.056579 10633 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:56.084873  6219 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:56.054563 10589 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:56.092955 10636 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:56.083015  6371 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:15:56.084012 10676 consensus_meta.cc:287] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.004s
I20260709 13:15:56.096093  6905 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:56.056075 10706 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:15:56.109870  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:56.113828  6219 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:56.118615  6219 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:56.133894 10742 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:56.111763 10701 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:56.135056 10701 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:56.135480 10701 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.135895 10701 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:56.144511  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 48465.2us
I20260709 13:15:56.145527  6905 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:56.147074  6250 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:56.156340  6401 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
W20260709 13:15:56.162883  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 44470us
I20260709 13:15:56.114427 10642 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:56.230333  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:56.117902 10683 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.127912 10633 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:56.099872 10739 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:15:56.240962  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:56.240912  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:56.197296 10780 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:15:56.255350  6400 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: []
W20260709 13:15:56.255805  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 172853us
I20260709 13:15:56.165369 10713 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.239723 10722 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:56.229859 10649 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:56.141371 10718 consensus_queue.cc:237] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:56.307821 10792 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:56.255115 10633 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.239023 10794 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:56.331506 10792 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.251820 10396 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:15:56.239291 10564 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.275089 10683 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.240538 10784 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.128s
W20260709 13:15:56.339744  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 102129us
I20260709 13:15:56.316154 10618 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:56.358911 10697 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:56.365097  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 278529us
I20260709 13:15:56.377506  6369 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:56.367931 10605 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:56.327283 10633 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:56.324409 10610 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:56.380924  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 145104us
I20260709 13:15:56.383569  6403 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:56.385283  6324 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:56.310415 10713 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.390566 10794 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.391098 10794 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:56.395166 10794 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:56.401552 10667 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:56.320194 10642 consensus_queue.cc:1059] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:15:56.382458  6219 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:56.422029  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 169132us
W20260709 13:15:56.429963  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 52571.8us
I20260709 13:15:56.431694  6937 raft_consensus.cc:2393] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:56.387246 10805 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.438318  6369 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:15:56.447559  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 65176.5us
I20260709 13:15:56.465927  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:56.467159  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.387615 10610 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.469879  6369 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:56.439601 10618 raft_consensus.cc:3055] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:56.473776  6329 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:56.473031  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:56.503774  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:56.502537  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:56.462769 10605 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:15:56.478632 10723 consensus_meta.cc:287] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.004s
I20260709 13:15:56.463865 10526 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:15:56.547387  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:56.470038 10611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.004s	sys 0.021s
I20260709 13:15:56.473562 10618 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:15:56.582501  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 128263us
I20260709 13:15:56.475543 10800 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:56.591172  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 121192us
I20260709 13:15:56.691821  6369 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:56.642633  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:56.509842 10676 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:56.645213  6905 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.738s (SENT) [suppressed 61 similar messages]
I20260709 13:15:56.546337 10796 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:56.635275 10611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.220s	user 0.006s	sys 0.025s
W20260709 13:15:56.663547  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 118512us
I20260709 13:15:56.583190 10612 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:56.543838 10614 consensus_queue.cc:1059] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
W20260709 13:15:56.645393 10776 log.cc:927] Time spent T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 13:15:56.708372 10589 consensus_meta.cc:287] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.000s
I20260709 13:15:56.708581 10792 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:56.711134 10809 log.cc:927] Time spent T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:15:56.712160  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:56.712664 10614 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:56.712900  6322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 1000) took 1890 ms (client timeout 1738 ms). Trace:
W20260709 13:15:56.713330  6322 rpcz_store.cc:269] 0709 13:15:54.826097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.826223 (+   126us) service_pool.cc:224] Handling call
0709 13:15:55.663700 (+837477us) spinlock_profiling.cc:243] Waited 891 us on lock 0x7b5800002d98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0eee 0000000000375939 00007f457ab341e0 00007f457abfd0c4 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:15:56.712687 (+1048987us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400038254. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:56.712779 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618520320}
I20260709 13:15:56.713704 10614 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.715884 10594 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:56.717118 10802 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:15:56.718523  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:56.718777 10815 log.cc:927] Time spent T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:56.719637  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:56.721474  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:56.722038  6399 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:56.694424 10742 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.723965 10742 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:56.725710  6404 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:56.726172 10742 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:56.451326 10805 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.671674 10688 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:56.676913 10822 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:56.598376 10642 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.513002 10808 consensus_queue.cc:1059] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.164s
I20260709 13:15:56.544957 10813 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 13:15:56.693938  6369 leader_election.cc:304] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:56.663151 10605 raft_consensus.cc:697] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:56.582808 10723 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:56.684505 10668 consensus_meta.cc:287] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.713s	user 0.008s	sys 0.002s
I20260709 13:15:56.669477 10706 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:56.727701  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:56.754766  6933 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:15:56.729583  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.755421  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.728298 10792 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:56.680691 10564 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:56.699704 10737 consensus_meta.cc:287] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.001s
I20260709 13:15:56.737825  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:56.765913  6329 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:56.740713  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 46869.2us
I20260709 13:15:56.767732  6369 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:56.680130 10667 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:56.757922 10814 raft_consensus.cc:3055] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:56.708834 10589 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:56.733626 10800 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.783053 10589 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:56.783452 10800 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:56.770062  6328 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:15:56.763976 10742 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.772758 10610 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:56.766130 10706 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.787313 10742 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:56.774884 10648 consensus_meta.cc:287] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.809s	user 0.008s	sys 0.002s
I20260709 13:15:56.789577 10742 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:56.789382 10648 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.791419 10723 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:56.791587  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 1018) took 1211 ms. Trace:
I20260709 13:15:56.754352 10796 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:56.792147 10605 consensus_queue.cc:237] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:56.793675 10706 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:56.794394 10791 log.cc:927] Time spent T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.484s	user 0.001s	sys 0.000s
I20260709 13:15:56.796097  6403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2295) took 1758 ms. Trace:
I20260709 13:15:56.796273  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:56.796487 10614 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:56.737418 10642 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.800038 10642 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:56.800949 10667 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.803001 10667 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:56.803506 10772 log.cc:927] Time spent T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.905s	user 0.002s	sys 0.002s
I20260709 13:15:56.803977 10737 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.805053  6938 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:15:56.792227 10648 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:56.806046 10737 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:56.808107  6369 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:56.776451 10659 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.758702 10668 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.764695 10594 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.827826  6938 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 915) took 1421 ms. Trace:
I20260709 13:15:56.733796 10618 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.781191 10814 raft_consensus.cc:740] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:56.786774 10713 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:56.830215  6221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.009s	sys 0.015s
I20260709 13:15:56.796490  6403 rpcz_store.cc:276] 0709 13:15:55.037232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.116111 (+ 78879us) service_pool.cc:224] Handling call
0709 13:15:55.130912 (+ 14801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.384177 (+1253265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.795884 (+411707us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002f3854. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:56.796041 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2880230272}
W20260709 13:15:56.831106  6221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.009s	sys 0.015s
I20260709 13:15:56.776098  6399 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:15:56.791946  6324 rpcz_store.cc:276] 0709 13:15:55.580264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.581733 (+  1469us) service_pool.cc:224] Handling call
0709 13:15:55.582141 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.387031 (+804890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.791369 (+404338us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b54004376d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:56.791533 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1846434688}
I20260709 13:15:56.822664  6398 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:56.828249  6938 rpcz_store.cc:276] 0709 13:15:55.386266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.400200 (+ 13934us) service_pool.cc:224] Handling call
0709 13:15:55.915861 (+515661us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:56.805600 (+889739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.806559 (+   959us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b540072a954. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:56.807205 (+   646us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b540072a950. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:56.807320 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3229563008}
W20260709 13:15:56.833559  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 188358us
I20260709 13:15:56.836233  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2716) took 1080 ms. Trace:
I20260709 13:15:56.842270  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:56.842850  6327 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:56.827832 10676 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:56.822045 10567 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:56.848192  6369 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:56.821355 10589 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:15:56.836988  6402 rpcz_store.cc:276] 0709 13:15:55.755873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.116363 (+360490us) service_pool.cc:224] Handling call
0709 13:15:56.116764 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:56.119845 (+  3081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.119889 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:56.172636 (+ 52747us) log.cc:844] Serialized 26 byte log entry
0709 13:15:56.542999 (+370363us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:56.601072 (+ 58073us) log.cc:844] Serialized 14 byte log entry
0709 13:15:56.668933 (+ 67861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.669686 (+   753us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:56.834876 (+165190us) raft_consensus.cc:1685] finished
0709 13:15:56.834895 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.836170 (+  1275us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":100380,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":30,"raft.queue_time_us":125727,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":36498,"thread_start_us":198790,"threads_started":1,"wal-append.queue_time_us":440765}
I20260709 13:15:56.853343  6935 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:56.855123  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:56.738739 10822 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.856850  6331 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:56.853766  6369 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:56.843381 10618 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:56.856197 10821 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:56.862792  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:56.874715  6402 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:56.875317  6327 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:15:56.865056  6399 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:56.829771 10659 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:56.881171  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:56.852918 10792 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:56.884124  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:56.830780 10594 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:56.885035  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:56.886111  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:56.886698  6248 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:56.886796  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:56.882377  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:56.890380  6249 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:15:56.896915  6403 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:56.900988  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:56.901355  6251 raft_consensus.cc:1240] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:56.860255 10676 raft_consensus.cc:697] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:56.903707  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:56.877254 10813 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:56.874066 10564 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:56.905071  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:56.906952  6403 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:56.907713  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:56.859171 10706 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:15:56.910379  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:56.887543 10821 raft_consensus.cc:697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:56.858927 10667 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:15:56.912441  6249 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:15:56.883646 10612 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:56.858065 10567 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.895390 10742 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.902587 10792 raft_consensus.cc:697] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:56.862813 10633 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.932835  6399 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:56.934679  6398 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:56.940085  6254 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:56.942200 10659 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:56.953485  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:56.954171  6399 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:56.943249  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:56.945670 10792 consensus_queue.cc:237] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:56.921747 10723 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:56.948578 10636 consensus_meta.cc:287] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.832s	user 0.007s	sys 0.000s
I20260709 13:15:56.951310  6329 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:56.954795  6398 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:15:56.955214  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:56.926302 10790 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:56.963979  6401 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:56.964215  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:56.914487 10564 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:56.966712  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:56.967352  6398 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:15:56.969950  6398 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:56.962414  6256 raft_consensus.cc:2368] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11.
W20260709 13:15:56.959753 10731 consensus_meta.cc:287] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.978s	user 0.011s	sys 0.000s
I20260709 13:15:56.972378 10731 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.973459  6323 raft_consensus.cc:1240] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:15:56.974442 10731 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:56.978333 10676 consensus_queue.cc:237] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:56.982088 10633 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:56.931989 10718 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:56.984366 10718 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:56.993180  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.992827  6401 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:15:56.925376 10612 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:56.928095 10742 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:57.016045  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:56.966188 10805 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:57.033340  6296 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:57.034519 10612 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:57.034862 10683 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:57.035133 10612 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:57.035284  6221 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:57.035567 10612 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:57.036026 10612 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:56.966929 10636 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.037073  6221 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:57.041867 10831 log.cc:927] Time spent T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:15:57.044409 10833 log.cc:927] Time spent T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:15:56.967629 10723 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:57.052328  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:57.049163  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:57.044268  6221 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:57.021718 10668 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:57.066027  6938 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:57.067607 10807 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:57.070281 10565 consensus_meta.cc:287] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.972s	user 0.011s	sys 0.000s
I20260709 13:15:57.070789 10565 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.071898  6324 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:57.073475 10594 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:57.053017 10821 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:57.038131 10832 log.cc:927] Time spent T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:56.970283 10790 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.037094 10616 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:57.040269 10828 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:57.057637 10605 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:57.092794 10813 raft_consensus.cc:697] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:57.056584 10339 consensus_queue.cc:1059] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:15:57.091789 10822 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:57.120324  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 85554.3us
I20260709 13:15:57.125373  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:57.126036  6327 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
W20260709 13:15:57.123206 10730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.232s	user 0.008s	sys 0.019s
W20260709 13:15:57.131104 10759 log.cc:927] Time spent T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 1.596s	user 0.006s	sys 0.000s
I20260709 13:15:57.131587  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:57.131784 10790 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:57.132930 10742 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:57.133785 10564 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:57.136698  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:57.185675  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:57.186309  6396 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:57.186506  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:57.187083  6325 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 5.
I20260709 13:15:57.187844  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:57.188366  6325 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
W20260709 13:15:57.137548 10701 consensus_meta.cc:287] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 1.001s	user 0.014s	sys 0.000s
I20260709 13:15:57.195658 10701 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.138792  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:57.197420  6249 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:57.198279  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:57.199362  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:57.200331  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:57.204528 10565 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:57.205353  6397 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:15:57.207376  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2720) took 1438 ms. Trace:
I20260709 13:15:57.207700  6397 rpcz_store.cc:276] 0709 13:15:55.769214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.242481 (+473267us) service_pool.cc:224] Handling call
0709 13:15:56.242857 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.205774 (+962917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.207151 (+  1377us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b5400376ed4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:57.207319 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2212993280}
I20260709 13:15:57.139511  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:57.139765  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.139568  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:57.210704  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:57.211275  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:57.141199  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:57.142334  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:57.143878  6252 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:57.146929  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:57.151957  6296 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:57.152961 10723 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:57.153532 10813 consensus_queue.cc:237] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:57.129009 10567 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:57.156064  6322 raft_consensus.cc:3055] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:57.241485  6322 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:57.156739 10636 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:57.166111  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:57.242779  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 58202.7us
I20260709 13:15:57.243156  6248 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:57.177170  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:57.181620  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:57.189153  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:57.244378  6254 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:57.189261 10612 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:57.194628 10781 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 1.258s	user 0.002s	sys 0.002s
I20260709 13:15:57.218513  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:57.218802  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:57.221508  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:57.222766  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:15:57.169027 10730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.281s	user 0.009s	sys 0.019s
W20260709 13:15:57.230906  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 79013.8us
I20260709 13:15:57.232440  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:57.262217  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:57.239939  6937 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:15:57.262813  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:57.244609  6325 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
W20260709 13:15:57.248327  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 101481us
I20260709 13:15:57.271390  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:57.271410  6933 raft_consensus.cc:2368] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11.
I20260709 13:15:57.274678  6940 raft_consensus.cc:2393] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:57.275628  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:57.272071  6251 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:57.205114 10565 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:57.281914  6369 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:57.278038  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:57.280356  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:57.240322 10564 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:57.254737  6322 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:57.281934  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:57.282714  6297 leader_election.cc:400] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11.
I20260709 13:15:57.295074  6322 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:57.295310  6297 leader_election.cc:403] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:15:57.278226  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:57.285552  6368 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:57.286726 10794 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:57.287086 10835 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.287909 10415 consensus_queue.cc:1059] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:15:57.290069 10722 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:57.290612  6934 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
W20260709 13:15:57.291554 10839 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:15:57.296635  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:57.277918 10567 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:57.300756  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:57.315976  6368 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:57.279109 10822 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:57.316545  6369 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:57.277627 10583 consensus_queue.cc:1059] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:15:57.296643  6331 raft_consensus.cc:2393] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:57.324110  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:57.317919 10794 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.333556 10821 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:57.333807  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:57.332787 10822 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:57.324200 10836 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:57.335855  6369 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:57.322479 10835 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.380574 10835 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:57.380832  6251 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:15:57.381198 10822 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:57.340757  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2314) took 1710 ms. Trace:
I20260709 13:15:57.302914 10564 raft_consensus.cc:697] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:57.382069  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:57.382804 10564 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.381883  6405 rpcz_store.cc:276] 0709 13:15:55.630046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.630187 (+   141us) service_pool.cc:224] Handling call
0709 13:15:55.630506 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:55.630829 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.630868 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:55.631337 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.815154 (+183817us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:55.815192 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.815253 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.194084 (+1378831us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:57.330997 (+136913us) raft_consensus.cc:1685] finished
0709 13:15:57.331022 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.340693 (+  9671us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2465,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":9370496,"thread_start_us":183455,"threads_started":1,"wal-append.queue_time_us":257805}
I20260709 13:15:57.302274 10742 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11.
I20260709 13:15:57.319643 10700 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.385185 10700 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.281138 10590 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:15:57.382767  6398 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:57.350071  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:57.322821 10636 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:57.410076  6941 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 921) took 2022 ms (client timeout 1951 ms). Trace:
I20260709 13:15:57.354005 10706 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:57.324110 10611 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:57.356737  6400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2707) took 1603 ms. Trace:
W20260709 13:15:57.364126 10798 log.cc:927] Time spent T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.947s	user 0.001s	sys 0.000s
I20260709 13:15:57.381410  6251 pending_rounds.cc:85] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 11
I20260709 13:15:57.426512  6251 pending_rounds.cc:107] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:15:57.426818  6251 raft_consensus.cc:2889] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:57.351570 10667 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:57.292496 10723 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:15:57.296136 10614 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:15:57.408237  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:57.410643  6941 rpcz_store.cc:269] 0709 13:15:55.387915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.388306 (+   391us) service_pool.cc:224] Handling call
0709 13:15:57.409822 (+2021516us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54004f8154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:57.409982 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262601600}
I20260709 13:15:57.325383 10567 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.297672 10565 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.350871 10701 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:57.452427  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:57.453184  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:57.455024  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:57.455843  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:15:57.456382  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 175876us
I20260709 13:15:57.425346  6400 rpcz_store.cc:276] 0709 13:15:55.752960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.756024 (+  3064us) service_pool.cc:224] Handling call
0709 13:15:55.762179 (+  6155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.273341 (+511162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.356494 (+1083153us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b540007d354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:57.356679 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133747968}
I20260709 13:15:57.458380  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:57.456842  6906 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:57.459460  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:57.471063  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:57.423430 10835 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:57.431600  6254 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:15:57.425940 10706 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:57.446141 10775 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:15:57.477993  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:57.489159  6400 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:57.435791 10667 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.489886  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:57.490774  6402 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:57.490876  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:57.490957  6221 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:57.487697  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:57.442665 10742 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:57.491583  6251 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:57.446761 10567 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.425371 10636 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.496433  6369 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:57.497555  6405 raft_consensus.cc:2393] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:57.478243 10835 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.480393 10583 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:57.479965 10694 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:57.488376 10706 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:57.495442  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 209387us
I20260709 13:15:57.540694  6369 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:57.479781 10792 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:15:57.480225 10616 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:15:57.496719 10667 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:57.556823  6907 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:57.549280 10836 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:57.545785 10694 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.535135 10835 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:57.539199 10583 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.554275 10766 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:57.557212 10838 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.553860 10711 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:57.626607  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.555722 10701 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:57.646770 10783 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:57.647392 10783 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.647847 10783 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:57.653913 10847 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:15:57.580058 10694 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:57.642239 10766 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:57.658371 10846 log.cc:927] Time spent T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.309s	user 0.000s	sys 0.000s
I20260709 13:15:57.658516 10683 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:57.659283 10683 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:57.661571 10683 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:57.657665 10766 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:57.623677 10838 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:57.663869 10838 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:57.539701 10742 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.669255 10742 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:57.645304 10701 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.681684 10701 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:57.685655 10843 log.cc:927] Time spent T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.129s	user 0.000s	sys 0.002s
I20260709 13:15:57.618546 10836 raft_consensus.cc:697] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:57.693512 10836 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:57.703439 10822 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.619009 10828 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:57.705771 10828 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:57.713466 10839 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:15:57.715955 10636 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:57.724833  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 831) took 1752 ms. Trace:
I20260709 13:15:57.725387  6253 rpcz_store.cc:276] 0709 13:15:55.972693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.972830 (+   137us) service_pool.cc:224] Handling call
0709 13:15:55.986896 (+ 14066us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:57.195922 (+1209026us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b1800336220. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f457578d4bc 00007f4572adb48b 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af5455 00007f4575bdd060 00007f4575bddbfb 00007f4575be864b
0709 13:15:57.196093 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.196131 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:57.196840 (+   709us) log.cc:844] Serialized 52 byte log entry
0709 13:15:57.261203 (+ 64363us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:57.277493 (+ 16290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.286693 (+  9200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.724434 (+437741us) raft_consensus.cc:1685] finished
0709 13:15:57.724463 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.724756 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3243,"raft.queue_time_us":85731,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":3736,"spinlock_wait_cycles":8870784,"thread_start_us":149769,"threads_started":2,"wal-append.queue_time_us":101882}
I20260709 13:15:57.729240 10648 raft_consensus.cc:3055] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:57.729826 10648 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:57.730818 10648 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.732303 10648 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:57.590322 10583 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:57.742913 10796 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:57.590061 10618 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.743626 10796 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:57.744448 10618 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:57.747032 10618 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:57.774114  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 286213us
I20260709 13:15:57.776078  6906 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:57.787477  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 296575us
W20260709 13:15:57.768832 10786 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 13:15:57.771456 10781 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:15:57.790083  6221 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:57.793438  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:57.818274  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:57.823382  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:57.823707  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:57.823987  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 45912.5us
I20260709 13:15:57.824092  6937 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
I20260709 13:15:57.832726  6938 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:15:57.846876 10713 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:57.848836 10807 consensus_queue.cc:1059] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:57.852826  6253 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:15:57.728751 10766 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.818202 10565 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:57.858098  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 240846us
I20260709 13:15:57.836882 10848 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:57.848582 10567 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:57.836287 10618 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:57.867496  6907 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:57.840029 10683 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:57.868131  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:57.900569  6907 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:15:57.920183  6255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.014s	sys 0.006s
W20260709 13:15:57.920560  6255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.014s	sys 0.006s
I20260709 13:15:57.897507 10796 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:57.929724  6396 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:57.930789  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:57.935509  6942 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:15:57.911635 10822 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:57.938735  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:57.937837  6222 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:57.901363 10694 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:57.907951 10688 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:15:57.907702 10683 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:57.928583 10564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.002s	sys 0.022s
I20260709 13:15:57.922742 10713 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:15:57.933238 10828 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:57.939152 10618 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:57.964112  6941 raft_consensus.cc:2368] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11.
I20260709 13:15:57.966547  6253 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:15:57.953466 10564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.002s	sys 0.022s
I20260709 13:15:57.943236 10860 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:57.972209  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:57.972826  6940 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:57.975260  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:57.955442 10784 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:57.946401 10866 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:57.975723 10860 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:57.977908 10784 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:58.014848 10858 log.cc:927] Time spent T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:15:57.971699 10618 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.016477 10848 consensus_queue.cc:1059] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:57.978631  6222 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:58.016790 10814 consensus_queue.cc:260] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:58.028553  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.021647 10827 raft_consensus.cc:3055] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:15:58.039263  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 60720.3us
I20260709 13:15:58.042354  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:58.032021 10784 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:58.049970  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:58.050720  6253 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:15:58.029632 10860 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:58.035506 10766 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.057788 10694 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:58.088828 10149 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.096191 10667 consensus_meta.cc:287] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.000s
I20260709 13:15:58.105372  6253 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:15:58.107095  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:58.095633 10149 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:58.048884 10567 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:58.048581 10636 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.040865 10827 raft_consensus.cc:740] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:58.047847 10862 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:58.119421 10870 log.cc:927] Time spent T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:15:58.120388 10845 log.cc:927] Time spent T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:15:58.102322 10814 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:58.171849  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 64861.2us
I20260709 13:15:58.096913 10783 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.189683  6937 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:15:58.096647 10667 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.138876 10636 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:58.195887 10290 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:58.227828  6398 raft_consensus.cc:2368] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10.
I20260709 13:15:58.229899  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 1028) took 1759 ms. Trace:
I20260709 13:15:58.230490  6330 rpcz_store.cc:276] 0709 13:15:56.470821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.713091 (+242270us) service_pool.cc:224] Handling call
0709 13:15:56.728761 (+ 15670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:56.730649 (+  1888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.730684 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.190731 (+460047us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b2c0002aad8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f45744dea11 00007f45744ee372 00007f4575c20a01 00007f4575be543a 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2
0709 13:15:57.191078 (+   347us) log.cc:844] Serialized 26 byte log entry
0709 13:15:57.568961 (+377883us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:57.569004 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.569079 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.229477 (+660398us) raft_consensus.cc:1685] finished
0709 13:15:58.229529 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.229811 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1418,"raft.queue_time_us":1904,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":5588,"spinlock_wait_cycles":4498048,"thread_start_us":377530,"threads_started":1,"wal-append.queue_time_us":637427}
I20260709 13:15:58.245903 10567 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.246378 10864 log.cc:927] Time spent T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:15:58.246490 10567 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.249287 10567 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.255458  6934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 836) took 1371 ms. Trace:
I20260709 13:15:58.256031  6934 rpcz_store.cc:276] 0709 13:15:56.883783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.883896 (+   113us) service_pool.cc:224] Handling call
0709 13:15:58.255198 (+1371302us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5400537fd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:58.255377 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933384960}
I20260709 13:15:58.269520  6297 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:58.234951 10701 consensus_meta.cc:287] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.005s
I20260709 13:15:58.273032 10290 raft_consensus.cc:697] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:58.286659 10290 consensus_queue.cc:237] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.236181 10683 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.295703  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:58.296345  6254 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:15:58.297358  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:58.300738 10149 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:58.276835 10790 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:58.301537 10790 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.301826  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:58.302861  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:58.303381  6251 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:58.303553 10790 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:58.309581 10882 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:15:58.281076 10564 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:58.310292 10564 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:58.310691 10564 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:58.316569  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.320828  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.320171  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:58.322212  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:58.323770  6251 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:15:58.324770  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:58.322783  6250 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:58.325887  6295 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:58.327054  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:58.325884  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:58.327935  6254 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:15:58.208827 10827 consensus_queue.cc:260] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.330708  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:58.331977  6250 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:15:58.319481 10565 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.325889  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:58.333037  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:58.318101 10567 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.319468 10683 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.337271  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:58.337647  6251 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:15:58.335026  6250 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:58.285478 10701 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:58.330390 10883 log.cc:927] Time spent T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:15:58.328801  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:58.328346 10723 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:15:58.337172 10565 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:58.337320 10618 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.351776  6405 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:15:58.331275 10828 consensus_queue.cc:1059] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:15:58.362723  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2290) took 3407 ms. Trace:
I20260709 13:15:58.363132  6404 rpcz_store.cc:276] 0709 13:15:54.955700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.089824 (+134124us) service_pool.cc:224] Handling call
0709 13:15:55.090105 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.726128 (+1636023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.362446 (+1636318us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b5400183154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:58.362638 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3761120512}
I20260709 13:15:58.365875 10723 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:58.366246 10701 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.366406 10723 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:58.367920 10583 consensus_meta.cc:287] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.001s
I20260709 13:15:58.368017 10565 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:58.353683 10790 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:58.368499 10723 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:58.368431 10583 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.368902 10790 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:58.377985 10790 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:58.383092  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:58.383733 10706 consensus_meta.cc:287] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.828s	user 0.005s	sys 0.005s
I20260709 13:15:58.384209 10706 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.385387  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:58.385666  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:58.387431 10794 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:58.388113 10648 consensus_meta.cc:287] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.004s
I20260709 13:15:58.388942  6933 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:58.390125  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:15:58.390666  6935 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 931) took 2247 ms (client timeout 1766 ms). Trace:
W20260709 13:15:58.391099  6935 rpcz_store.cc:269] 0709 13:15:56.143671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.146468 (+  2797us) service_pool.cc:224] Handling call
0709 13:15:58.390476 (+2244008us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54005618d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:58.390574 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1403539712}
I20260709 13:15:58.384764 10583 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:58.392942  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 1030) took 1552 ms. Trace:
I20260709 13:15:58.393453  6324 rpcz_store.cc:276] 0709 13:15:56.840423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.842230 (+  1807us) service_pool.cc:224] Handling call
0709 13:15:56.844074 (+  1844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.072275 (+228201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.392667 (+1320392us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400292cd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:15:58.392872 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523526016}
I20260709 13:15:58.395377 10790 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:58.403065 10790 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:58.403311 10884 log.cc:927] Time spent T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.191s	user 0.002s	sys 0.000s
I20260709 13:15:58.411064 10860 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.350925 10667 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.413851 10790 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:58.414453 10790 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.415140 10783 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:58.370875 10636 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:58.374981 10784 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.376554 10612 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.416550 10790 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:58.416664 10890 log.cc:927] Time spent T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:15:58.417268  6403 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:58.418041 10784 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:58.418377 10854 log.cc:927] Time spent T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.600s	user 0.000s	sys 0.005s
W20260709 13:15:58.419737 10835 consensus_meta.cc:287] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.000s
I20260709 13:15:58.420172 10835 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.421311  6397 raft_consensus.cc:2368] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11.
I20260709 13:15:58.422080  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1750) took 1177 ms. Trace:
I20260709 13:15:58.422894 10835 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.341506 10683 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:58.422461  6248 rpcz_store.cc:276] 0709 13:15:57.245285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.246276 (+   991us) service_pool.cc:224] Handling call
0709 13:15:57.246710 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.259190 (+ 12480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.259236 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.283178 (+ 23942us) log.cc:844] Serialized 26 byte log entry
0709 13:15:57.550669 (+267491us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:57.863200 (+312531us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.864544 (+  1344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.864642 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.417867 (+553225us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:15:58.421799 (+  3932us) raft_consensus.cc:1685] finished
0709 13:15:58.421892 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.422020 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31654,"prepare.queue_time_us":424579,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":30222,"raft.queue_time_us":564,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":29409,"spinlock_wait_cycles":28642304,"thread_start_us":436202,"threads_started":2,"wal-append.queue_time_us":447743}
I20260709 13:15:58.338500 10567 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.426743 10567 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.427341 10683 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:58.428339 10860 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.429605  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:58.430169  6942 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:58.434998  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:58.435211  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:58.435854  6251 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:58.435940  6250 raft_consensus.cc:2393] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:15:58.436764  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:58.437629  6251 raft_consensus.cc:2410] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:58.437865 10783 consensus_queue.cc:1059] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:58.438891 10783 consensus_queue.cc:1059] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:58.439260 10648 consensus_queue.cc:1059] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:58.440032 10648 raft_consensus.cc:3055] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:58.440371 10648 raft_consensus.cc:740] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:58.441408 10494 raft_consensus.cc:3055] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:58.441787 10494 raft_consensus.cc:740] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:58.442023 10822 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.442373  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.442549 10822 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.443122 10790 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.443619 10790 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.444114 10612 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:58.444281 10567 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:58.444687 10612 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.446070 10790 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.442641 10494 consensus_queue.cc:260] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.447374 10494 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:58.447481 10612 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.449079  6324 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:58.453485  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:58.454152  6330 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:58.453917 10564 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.455154  6296 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:58.456050  6296 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:58.444780 10567 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.456773 10790 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:58.457172 10790 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.457502 10790 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:58.458662  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:58.457188 10648 consensus_queue.cc:260] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.460199 10567 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.462167 10706 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.463505  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:58.465817 10790 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:58.466135 10862 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:58.467128  6250 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:58.468920  6942 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:15:58.469592  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:58.471374  6247 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:58.515384  6254 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:15:58.470314 10564 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:58.477207 10863 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.009s	sys 0.021s
W20260709 13:15:58.481611  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 155783us
I20260709 13:15:58.488193  6328 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:58.488214 10731 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:58.488631  6296 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:58.520257  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:58.520429  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:58.495004  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:58.495877  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:58.500347  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:58.521049  6329 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:58.501833  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:58.503093  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:58.523562  6936 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:58.504077  6219 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:58.504642  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:58.505396  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:58.505682  6934 raft_consensus.cc:1240] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:58.506062  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:58.525754  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:58.509267  6323 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:58.504163 10633 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.509792  6222 leader_election.cc:400] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11.
I20260709 13:15:58.511476  6325 raft_consensus.cc:1240] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:58.517630  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:58.517889  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:58.521865  6324 raft_consensus.cc:2376] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9. Re-sending same reply.
I20260709 13:15:58.518581  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:58.522866  6939 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:15:58.507676  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:58.528395  6297 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:58.529096  6222 leader_election.cc:403] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:58.528448  6322 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:58.528699  6326 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:58.529014  6330 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:15:58.530079  6222 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:15:58.533943  6327 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:15:58.535905  6219 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:58.537503  6219 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:58.540832  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:58.541635  6256 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:58.542271  6251 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:15:58.538221  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:58.545383  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:58.523839 10863 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.009s	sys 0.021s
I20260709 13:15:58.548285  6328 raft_consensus.cc:2393] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 7: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:58.551280  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:58.552456  6254 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
W20260709 13:15:58.544597  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.543542  6219 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:58.548009  6250 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:15:58.551817  6328 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:15:58.516883 10290 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:58.556402  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:58.560366  6905 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:58.523860 10612 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:58.561280  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:58.569442  6328 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:58.549767 10636 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:58.544050 10633 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:58.565519  6295 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:58.538275 10723 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:58.541875 10860 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11.
I20260709 13:15:58.547168 10660 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:58.557255 10605 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:58.574941  6295 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:58.576575  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:58.585862  6219 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:58.571399  6326 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:58.523720 10894 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:15:58.587028  6329 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:15:58.560232 10862 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:58.592355  6328 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 12: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:58.596264  6295 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:58.594693 10807 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:58.556969 10814 consensus_queue.cc:1059] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:15:58.589314 10867 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:58.591255 10564 raft_consensus.cc:2764] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:15:58.629666 10867 raft_consensus.cc:697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:58.630642 10867 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.615386 10713 raft_consensus.cc:3055] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:58.632829 10713 raft_consensus.cc:740] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:58.609743 10723 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:15:58.576246 10859 consensus_queue.cc:1059] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:15:58.600414 10605 raft_consensus.cc:697] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:58.599436 10590 consensus_queue.cc:1059] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:15:58.625299 10633 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:58.575806 10290 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.592036 10697 consensus_queue.cc:1059] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:15:58.627089 10807 raft_consensus.cc:697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:58.627549 10711 raft_consensus.cc:3055] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:58.609658 10614 consensus_queue.cc:1059] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:15:58.647178  6219 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:58.640698  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:58.622454  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 94172.4us
W20260709 13:15:58.662720  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 66546.5us
I20260709 13:15:58.635735 10730 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:58.666669  6219 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:58.667171  6905 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:58.665628  6297 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:58.659578 10711 raft_consensus.cc:740] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:58.668416  6295 leader_election.cc:400] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11.
I20260709 13:15:58.669703  6219 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:58.677076  6219 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:58.656636  6256 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:15:58.678637  6295 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:58.619757 10902 consensus_queue.cc:1059] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:15:58.683561  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:58.679607  6905 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:58.652443 10860 consensus_queue.cc:1059] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:15:58.682991  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:58.686221  6221 leader_election.cc:400] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10.
I20260709 13:15:58.687228  6219 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:58.689397  6221 leader_election.cc:403] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:58.683279  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:58.682164  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:58.693583 10711 consensus_queue.cc:260] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.685714 10875 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:58.684471 10612 raft_consensus.cc:2764] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:15:58.683480 10633 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:58.689424  6328 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:15:58.679951 10616 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:15:58.731110  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:58.696064 10807 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:58.695436 10605 consensus_queue.cc:237] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.679847 10903 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:58.733407 10826 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.734313 10821 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:58.734992 10879 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:58.737741  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:58.738759 10706 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:58.739439  6398 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:15:58.740425  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:58.741508  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:58.742200  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:58.742570  6399 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:58.744944 10907 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:15:58.744979  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 65446.3us
I20260709 13:15:58.741544  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:58.677690 10583 raft_consensus.cc:3055] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:58.675681 10814 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:15:58.668813 10794 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:58.749609 10898 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.096s	user 0.000s	sys 0.003s
I20260709 13:15:58.750044 10712 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10.
W20260709 13:15:58.828936  6247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2508) took 1965 ms (client timeout 2222 ms). Trace:
W20260709 13:15:58.846761  6247 rpcz_store.cc:269] 0709 13:15:56.854678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.854833 (+   155us) service_pool.cc:224] Handling call
0709 13:15:58.819675 (+1964842us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400152054. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:58.819822 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3699984256}
W20260709 13:15:58.750813  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 63656.2us
I20260709 13:15:58.848167  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:58.750924 10618 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:58.849591  6404 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:58.851078  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:58.851096  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:58.852747  6934 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
W20260709 13:15:58.751328  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 65263.1us
W20260709 13:15:58.868541  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.869786 10903 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:58.751564 10339 raft_consensus.cc:3055] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:58.870741 10339 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:58.835778 10711 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:58.871699 10339 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:58.751329 10900 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.085s	user 0.003s	sys 0.000s
I20260709 13:15:58.857190 10712 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:58.873303  6250 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:15:58.873736 10712 raft_consensus.cc:697] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:15:58.872696 10880 raft_consensus.cc:2955] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Committing config change with OpId 8.7: config changed from index 3 to 7, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:58.874532  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:58.874603 10712 consensus_queue.cc:237] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.876068  6250 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:58.762169  6256 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:15:58.857370 10618 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.857918 10904 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:58.878158 10618 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.757473 10875 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.878291 10904 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:58.859509 10718 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:58.853624 10583 raft_consensus.cc:740] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:58.842006 10826 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:58.879990 10583 consensus_queue.cc:260] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.880589 10904 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:58.880993 10583 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:58.881335 10826 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:58.881520 10794 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:58.882117 10794 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:58.825493 10894 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:58.861931  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:58.904697  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:58.905036  6403 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:15:58.905396  6396 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:58.904735 10894 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.906912 10894 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:58.852882 10612 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:58.864820 10590 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.870395 10903 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:58.837716 10821 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:58.878765 10875 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:58.883719  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.920989  6940 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:58.860174  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:58.884037  6405 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:58.858217 10907 raft_consensus.cc:697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:15:58.895984  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:58.974416  6936 raft_consensus.cc:2393] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:58.904114  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:58.906435  6933 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:58.977372  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:58.756922 10290 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:58.863333  6938 raft_consensus.cc:2393] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:58.908342  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:58.916499  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:58.981586  6402 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:58.907337 10863 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:58.987715  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:58.760367 10633 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:58.990842  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:58.994479 10794 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:58.993899 10907 consensus_queue.cc:237] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:58.878258 10706 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:58.999635 10706 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:58.883109 10879 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.002761 10903 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:59.003185 10879 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:59.005645 10821 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:15:59.007817 10821 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:58.907130 10396 consensus_queue.cc:1059] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:15:59.008386 10821 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:58.907992 10909 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.113s	user 0.006s	sys 0.004s
I20260709 13:15:59.014019  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:59.015637  6400 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:58.747786  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:58.757332 10860 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:15:59.029955  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 282263us
I20260709 13:15:59.038388  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:59.039065  6247 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:15:59.043205  6404 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:15:59.047528  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:58.990779 10848 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.016372 10633 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:59.063315  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:59.066596  6247 raft_consensus.cc:2393] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:59.070358  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 849) took 1094 ms. Trace:
I20260709 13:15:59.048280 10706 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:59.080016 10835 consensus_queue.cc:1059] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:15:59.083433  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.070606  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:15:58.987929 10590 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.092154  6253 rpcz_store.cc:276] 0709 13:15:57.976390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.106408 (+130018us) service_pool.cc:224] Handling call
0709 13:15:58.106743 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.106970 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:58.125925 (+ 18955us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.472247 (+346322us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b1800375e80. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af8522 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:15:59.068892 (+596645us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b1800375e80. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572a72c0a 00007f457c1b2219 00007f4572afaa40 00007f4572af54e4 00007f4572af5455 00007f45795dd3c7 00007f4575bef9a7 00007f4575bff0bf 00007f4575bff038
0709 13:15:59.069249 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.069594 (+   345us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.069663 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:59.069727 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.070063 (+   336us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.070283 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":897225,"prepare.queue_time_us":968977,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":988,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":2043,"spinlock_wait_cycles":18334208}
I20260709 13:15:59.054157 10612 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:59.069932 10660 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:59.048147 10860 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:59.088786 10706 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:59.067022 10848 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.112495  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:59.105623  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 257553us
I20260709 13:15:59.109706 10706 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:59.127621  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 106239us
I20260709 13:15:59.131673  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:59.156669 10821 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:15:59.158041  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.159917  6941 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 6.
I20260709 13:15:59.106096 10612 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:59.135214 10903 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.158067 10821 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:59.166082  6297 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:15:59.162297  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 483738us
I20260709 13:15:59.168011  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 850) took 1191 ms. Trace:
I20260709 13:15:59.170198  6255 rpcz_store.cc:276] 0709 13:15:57.976798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.185726 (+208928us) service_pool.cc:224] Handling call
0709 13:15:58.206910 (+ 21184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.207170 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:59.072560 (+865390us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.167635 (+ 95075us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.167687 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:59.167739 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.167855 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.167956 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":869893,"prepare.queue_time_us":865784,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"thread_start_us":89895,"threads_started":1}
W20260709 13:15:59.194244  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 123741us
I20260709 13:15:59.198964  6295 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:59.200062  6295 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:59.168654 10636 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:59.206354 10590 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:59.208415  6397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2721) took 1756 ms (client timeout 1527 ms). Trace:
W20260709 13:15:59.208828  6397 rpcz_store.cc:269] 0709 13:15:57.451727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.452943 (+  1216us) service_pool.cc:224] Handling call
0709 13:15:59.203505 (+1750562us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b54001f3e54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:15:59.208322 (+  4817us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2224712576}
I20260709 13:15:59.210333 10700 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:59.218688 10612 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:59.221526  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:59.222157  6404 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:15:59.223021  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:15:59.223802 10912 log.cc:927] Time spent T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:15:59.224982  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:59.225546  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2728) took 1768 ms. Trace:
I20260709 13:15:59.225721  6399 raft_consensus.cc:2393] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 10: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:59.225920  6401 rpcz_store.cc:276] 0709 13:15:57.456950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.477813 (+ 20863us) service_pool.cc:224] Handling call
0709 13:15:57.478194 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.489372 (+ 11178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.489416 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:58.645983 (+1156567us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b2c000f15d8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f45744dea11 00007f45744ee372 00007f4575c20a01 00007f4575be543a 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2
0709 13:15:58.650694 (+  4711us) log.cc:844] Serialized 26 byte log entry
0709 13:15:58.943753 (+293059us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:59.012035 (+ 68282us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.012291 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.012385 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.225291 (+212906us) raft_consensus.cc:1685] finished
0709 13:15:59.225368 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.225494 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14328,"prepare.queue_time_us":68109,"raft.queue_time_us":11141,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":8158,"spinlock_wait_cycles":25781888,"thread_start_us":277405,"threads_started":1,"wal-append.queue_time_us":408822}
I20260709 13:15:59.228642  6401 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:15:59.229473  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:59.230156  6398 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:59.234077 10718 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:59.234747 10718 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:59.234200 10713 consensus_queue.cc:260] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.235215 10718 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:59.235657 10713 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:59.246728  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:59.246860  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:59.169844 10821 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:59.252276  6371 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:59.256723  6371 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:59.251617  6907 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:59.258828  6907 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:59.228464  6399 raft_consensus.cc:2955] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:15:59.263302  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:59.267141  6907 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:59.264074  6397 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:15:59.276998  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:59.282934 10835 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:59.284700  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:15:59.297502  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.297318  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:59.301245  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:59.195403 10903 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:59.306154  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:59.306958  6398 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:15:59.259848 10821 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:59.275470 10612 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:15:59.309190  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 109217us
I20260709 13:15:59.320220  6295 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:59.285836 10590 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:59.322288  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:59.286796 10583 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:59.295648 10863 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:59.327042  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 851) took 1350 ms. Trace:
I20260709 13:15:59.347354  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:59.319578 10835 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:59.355903  6933 raft_consensus.cc:2393] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:59.343802  6254 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:59.326946 10766 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:59.353650  6398 raft_consensus.cc:2393] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:15:59.323582 10590 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.352837  6295 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:59.299224 10894 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:15:59.343282 10901 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.013s	sys 0.028s
I20260709 13:15:59.363672  6295 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:59.364257  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:59.345098 10565 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:59.344878 10612 raft_consensus.cc:697] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:59.373279  6398 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:15:59.378175  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:59.343133 10917 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:59.358403 10835 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:59.379573  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:59.389261  6295 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:59.367179 10901 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.013s	sys 0.028s
I20260709 13:15:59.366804 10590 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:59.393599  6248 raft_consensus.cc:2410] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:15:59.400431  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:59.401055 10894 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:59.403260 10706 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.405922  6405 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:15:59.407035  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:59.407730  6405 raft_consensus.cc:2368] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11.
I20260709 13:15:59.408141 10903 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:59.408607  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:59.409447  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:59.409107 10706 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:59.413300 10612 consensus_queue.cc:237] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:59.401216  6396 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 12: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:59.416831  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:59.410212  6401 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:15:59.422554  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:15:59.424597  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:15:59.372391 10860 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:15:59.434769  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 45618.4us
I20260709 13:15:59.434738  6296 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:59.437460  6295 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:59.438606  6296 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:59.439026 10901 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:59.439741 10901 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:59.440173  6296 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:59.441445 10917 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:59.441504 10901 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:59.442205 10917 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:59.442947 10901 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:59.443372 10901 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:59.444697 10901 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:59.451123  6295 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:15:59.448690  6296 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:59.453642 10917 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:59.454218 10917 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.454707 10917 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:59.460990  6221 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:59.459587  6296 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:59.463881  6295 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:15:59.457607  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 198647us
I20260709 13:15:59.396358 10835 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:59.474009  6371 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:59.404670 10875 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.479029  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:15:59.480531  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.484113  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:59.484409  6328 raft_consensus.cc:1275] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:15:59.484826  6328 pending_rounds.cc:85] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 4
I20260709 13:15:59.484762  6326 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:15:59.485183  6328 pending_rounds.cc:107] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:15:59.485507  6328 raft_consensus.cc:2889] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:59.485744  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:59.486532  6326 raft_consensus.cc:2393] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 6: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:15:59.490203  6221 leader_election.cc:400] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11.
I20260709 13:15:59.491282  6221 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:15:59.429957 10848 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:59.430712 10565 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:59.433822 10894 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:59.490202  6326 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:59.496960  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:15:59.499682  6221 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:15:59.501111  6327 raft_consensus.cc:1275] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:15:59.501549  6327 pending_rounds.cc:85] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 5
I20260709 13:15:59.501762  6327 pending_rounds.cc:107] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:15:59.501971  6327 raft_consensus.cc:2889] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:59.503100  6328 raft_consensus.cc:3055] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:59.503473  6328 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:59.460386 10903 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:59.501014  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:59.458057 10934 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:59.508087  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:59.508587  6935 raft_consensus.cc:2393] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:15:59.504189  6328 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:59.509282  6252 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:15:59.566111  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:59.536468  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:59.510777  6934 raft_consensus.cc:2410] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:15:59.567066  6328 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:59.510342  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:59.512260  6326 pending_rounds.cc:85] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 5
I20260709 13:15:59.568241  6326 pending_rounds.cc:107] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:15:59.568639  6326 raft_consensus.cc:2889] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:59.502761 10915 log.cc:927] Time spent T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:15:59.569715  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:59.577797  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:59.568195  6253 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:59.572834  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:15:59.615471  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 114174us
I20260709 13:15:59.741503  6371 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:59.590839 10792 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:15:59.602555 10918 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:59.602283 10894 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:59.616935 10934 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:15:59.662659 10932 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
W20260709 13:15:59.618975  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.617057 10706 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:59.578622  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 197570us
I20260709 13:15:59.576279 10943 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:59.573614 10822 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:15:59.562777 10712 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:15:59.507036 10903 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.570784 10862 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:59.632406  6328 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:15:59.632382 10919 log.cc:927] Time spent T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.357s	user 0.001s	sys 0.001s
I20260709 13:15:59.504128 10565 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.625074  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:59.770967  6248 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:59.508234 10916 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:59.562870 10711 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:59.642182 10813 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.638358 10933 consensus_queue.cc:1059] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:15:59.500622 10807 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:15:59.566217 10697 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:59.748728  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:59.772408  6295 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:15:59.804931  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.805336  6295 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:59.763664  6941 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 6.
I20260709 13:15:59.697986 10944 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.782616  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:15:59.744863 10848 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:15:59.796927 10713 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.795773  6248 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:15:59.807010  6255 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:59.808167  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:59.761423 10903 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:59.789891 10618 consensus_meta.cc:287] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.911s	user 0.010s	sys 0.002s
I20260709 13:15:59.779510 10822 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.779142 10894 raft_consensus.cc:697] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:15:59.787856 10711 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.761950 10927 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:15:59.762017 10943 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:59.804445 10930 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:15:59.811134 10706 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:59.828655 10711 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:59.806340 10813 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:59.784660 10565 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:59.812611  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:15:59.817530  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 58082.1us
I20260709 13:15:59.800819 10807 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.843106  6247 raft_consensus.cc:2410] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:15:59.843146  6369 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:59.830148 10943 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:59.810279 10697 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.847585  6369 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:15:59.783267 10934 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.816741 10713 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.821750 10618 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:59.829440 10822 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.812877 10848 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.839109 10875 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:15:59.811733  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:15:59.833287 10927 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:15:59.847721 10955 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:59.872514  6248 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:15:59.902603  6371 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:59.858806  6255 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:15:59.813050 10944 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.693954 10901 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:59.860783 10918 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:59.890437  6256 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:15:59.891155  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 43665.1us
I20260709 13:15:59.836376 10930 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.914582  6369 leader_election.cc:304] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:15:59.921455  6255 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:59.927062 10796 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:59.927650 10796 raft_consensus.cc:697] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:59.928588 10796 consensus_queue.cc:237] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:15:59.937353  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:59.938921  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:15:59.939658  6328 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:15:59.858578 10894 consensus_queue.cc:237] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:59.943578  6328 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:59.947342  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:15:59.947981  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:15:59.919687 10706 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:59.974661 10970 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:59.963996  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 47246.8us
I20260709 13:16:00.003521 10880 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:15:59.951853 10821 consensus_meta.cc:287] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.004s
I20260709 13:16:00.003719  6369 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:00.004079 10880 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.005303 10706 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:00.006112 10706 raft_consensus.cc:697] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:15:59.919500 10937 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:59.915402 10917 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:15:59.933842 10633 consensus_meta.cc:287] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.846s	user 0.011s	sys 0.000s
I20260709 13:16:00.010334  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:00.050603  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.006946 10880 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:00.007966  6907 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:15:59.994946 10718 consensus_meta.cc:287] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.003s
W20260709 13:15:59.998201 10636 consensus_meta.cc:287] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.769s	user 0.009s	sys 0.002s
I20260709 13:16:00.004153 10970 consensus_queue.cc:1059] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:16:00.004447 10821 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.048153 10813 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:00.006999 10706 consensus_queue.cc:237] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.068797  6397 raft_consensus.cc:1240] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:00.076762  6219 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:00.062664  6403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2344) took 1319 ms. Trace:
W20260709 13:16:00.057847  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 49985.2us
I20260709 13:16:00.076948  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:00.129980  6403 rpcz_store.cc:276] 0709 13:15:58.743607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.905786 (+162179us) service_pool.cc:224] Handling call
0709 13:15:58.906075 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.000400 (+ 94325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.000431 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.000485 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:59.000516 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.062434 (+1061918us) spinlock_profiling.cc:243] Waited 94.1 ms on lock 0x7b54000253d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:00.062482 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.062607 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216511744}
W20260709 13:16:00.061614 10959 log.cc:927] Time spent T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:16:00.135135  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:00.080335  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:00.135987  6326 raft_consensus.cc:2393] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:16:00.136368  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 59688.3us
W20260709 13:16:00.081960  6400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2343) took 1338 ms (client timeout 1663 ms). Trace:
I20260709 13:16:00.137359  6219 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:00.137295  6400 rpcz_store.cc:269] 0709 13:15:58.743341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.907944 (+164603us) service_pool.cc:224] Handling call
0709 13:16:00.081687 (+1173743us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b5400401d54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:00.081884 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61992704}
I20260709 13:16:00.081238  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:00.086169  6330 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:00.075620  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1774) took 1192 ms. Trace:
I20260709 13:16:00.044193  6369 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:00.140908  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 96797.2us
I20260709 13:16:00.142016  6369 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:00.139751  6256 rpcz_store.cc:276] 0709 13:15:58.882751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.883747 (+   996us) service_pool.cc:224] Handling call
0709 13:16:00.075365 (+1191618us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54000e2ed4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:00.075542 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2084067712}
W20260709 13:16:00.078641 10835 consensus_meta.cc:287] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.000s
I20260709 13:16:00.084471 10636 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:00.147645  6369 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:00.148067 10712 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:00.053638 10828 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.058418 10963 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:00.153362  6326 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:00.160501  6326 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:16:00.055233 10925 log.cc:927] Time spent T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.201s	user 0.000s	sys 0.010s
W20260709 13:16:00.073838 10960 log.cc:927] Time spent T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:16:00.084244 10618 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.157505  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:00.158226  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:00.075287 10901 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.067137 10821 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:00.169816  6325 raft_consensus.cc:2393] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 12: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:00.164855  6326 raft_consensus.cc:1240] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:00.136720 10807 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.144994 10822 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.149098 10660 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:00.053875 10633 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.151629 10970 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:00.163132  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:00.148859 10934 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.154208 10712 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:16:00.171849  6402 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.020s	sys 0.085s
I20260709 13:16:00.154584 10835 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.166031 10828 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.155548 10937 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:00.177155 10944 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:00.177660 10966 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:16:00.178074 10931 consensus_queue.cc:1059] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:16:00.180375 10722 raft_consensus.cc:3055] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:00.188540 10970 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:00.190589 10813 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:00.223850  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 418562us
W20260709 13:16:00.190964  6402 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.020s	sys 0.086s
I20260709 13:16:00.061214 10718 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.079033 10973 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 13:16:00.166682 10848 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.171748 10963 raft_consensus.cc:697] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:00.172685 10927 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:16:00.202275  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.231284  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.231987  6401 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:00.219661  6403 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:00.187551  6331 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.192116 10712 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.076339 10711 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.198840 10972 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:00.078540 10565 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.226323  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 925) took 1008 ms. Trace:
I20260709 13:16:00.218644 10722 raft_consensus.cc:740] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:00.227722  6295 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:00.244724  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.245359  6295 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:00.186817 10618 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:16:00.223192 10970 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:00.249565  6295 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:00.218904 10878 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:00.242836  6322 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:00.244158  6402 rpcz_store.cc:276] 0709 13:15:59.218009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.231189 (+ 13180us) service_pool.cc:224] Handling call
0709 13:15:59.231560 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.231786 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:59.391203 (+159417us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.508435 (+117232us) log.cc:844] Serialized 14 byte log entry
0709 13:16:00.225989 (+717554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:00.226048 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:00.226089 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.226150 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.226263 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165760,"prepare.queue_time_us":213669,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":115,"raft.queue_time_us":224973,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":33257,"spinlock_wait_cycles":8145792,"thread_start_us":803747,"threads_started":3,"wal-append.queue_time_us":198959}
I20260709 13:16:00.261314  6329 raft_consensus.cc:1240] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:00.255092  6253 raft_consensus.cc:1240] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:16:00.254298  6403 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:00.264772  6401 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
W20260709 13:16:00.267711  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 69575.1us
I20260709 13:16:00.268070  6402 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:16:00.253870 10975 log.cc:927] Time spent T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:16:00.246559 10944 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:00.273535  6322 raft_consensus.cc:1240] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:16:00.227516 10943 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.227655 10813 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.254099 10934 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:00.275197 10982 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:00.277252 10982 raft_consensus.cc:697] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:00.278087 10982 consensus_queue.cc:237] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.276446  6295 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:00.287985  6295 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:00.291507 10612 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:00.292043 10612 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:00.292389 10648 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.292526 10612 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.295845  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2734) took 1002 ms. Trace:
I20260709 13:16:00.296249  6397 rpcz_store.cc:276] 0709 13:15:59.293695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.294681 (+   986us) service_pool.cc:224] Handling call
0709 13:15:59.295044 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:00.085165 (+790121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.295562 (+210397us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54003ad9d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:00.295778 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1778967296}
I20260709 13:16:00.311559 10711 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.313791 10718 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.276638 10934 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.317778 10934 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.318068  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 927) took 1099 ms. Trace:
I20260709 13:16:00.318476  6404 rpcz_store.cc:276] 0709 13:15:59.218526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.223753 (+  5227us) service_pool.cc:224] Handling call
0709 13:16:00.082957 (+859204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:00.083187 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:00.083222 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:00.083292 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:00.083337 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.083410 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.317898 (+234488us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b5400401d50. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:00.318010 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1975342336}
I20260709 13:16:00.323158  6322 raft_consensus.cc:1240] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:00.325938  6327 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:00.275944 10917 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.258591 10878 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.333079 10712 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.340174 10828 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.341670  6327 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:00.342605 10712 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.335361 10866 raft_consensus.cc:3055] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:00.337771 10879 raft_consensus.cc:3055] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:00.343219 10866 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:00.339792 10943 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.343276 10879 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:00.337157 10970 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:00.323532 10590 consensus_meta.cc:287] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.908s	user 0.008s	sys 0.004s
I20260709 13:16:00.322839 10944 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:00.346390  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 184816us
I20260709 13:16:00.350564 10835 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.285058 10722 consensus_queue.cc:260] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.358773 10722 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.320389 10963 consensus_queue.cc:237] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.351796 10970 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:00.389402  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1769) took 1926 ms. Trace:
I20260709 13:16:00.389875  6251 rpcz_store.cc:276] 0709 13:15:58.463136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.463266 (+   130us) service_pool.cc:224] Handling call
0709 13:16:00.389223 (+1925957us) spinlock_profiling.cc:243] Waited 78.1 ms on lock 0x7b5400336654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:00.389341 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179695872}
I20260709 13:16:00.391692  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:00.396785  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:00.397540  6323 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.402024 10813 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:00.344174 10866 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.356945 10814 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.344419 10879 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.374271 10633 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.410413 10565 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.352022 10590 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.356215 10944 raft_consensus.cc:697] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:00.439941 10565 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.440809 10565 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.410642 10965 raft_consensus.cc:3055] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:00.450518 10965 raft_consensus.cc:740] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:00.451495 10965 consensus_queue.cc:260] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.465397 10965 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:00.465956 10713 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.411461 10814 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:00.471144 10944 consensus_queue.cc:237] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:15:59.347451  6249 rpcz_store.cc:276] 0709 13:15:57.977115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.195252 (+218137us) service_pool.cc:224] Handling call
0709 13:15:58.195617 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.195821 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:15:59.072417 (+876596us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.326642 (+254225us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.326708 (+    66us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:59.326766 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.326866 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.326975 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":879021,"prepare.queue_time_us":876848,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":2647,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":8408,"thread_start_us":253496,"threads_started":1}
I20260709 13:16:00.468200  6941 raft_consensus.cc:2393] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:16:00.476356 10923 log.cc:927] Time spent T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.271s	user 0.004s	sys 0.000s
W20260709 13:16:00.462170 10903 consensus_meta.cc:287] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.634s	user 0.005s	sys 0.008s
W20260709 13:16:00.480083  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.480420  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.494884 10903 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.494987 10934 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.497736 10878 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.499166 10862 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:00.500942  6324 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:00.373605 10711 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:16:00.503894 10814 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.504176 10339 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.506765  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1610) took 1029 ms. Trace:
I20260709 13:16:00.507148  6324 rpcz_store.cc:276] 0709 13:15:59.477181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.480728 (+  3547us) service_pool.cc:224] Handling call
0709 13:15:59.484714 (+  3986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:00.505154 (+1020440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.506541 (+  1387us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001c1954. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:00.506707 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336527744}
I20260709 13:16:00.507885 10590 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.509837  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:16:00.510973 10945 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.850s	user 0.003s	sys 0.000s
I20260709 13:16:00.499874 10862 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.511338  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:00.514330  6324 raft_consensus.cc:2368] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8.
I20260709 13:16:00.516896  6323 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:00.519409  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:00.520560  6942 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:16:00.487741 10827 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.521750 10964 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.526273  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:00.518275 10862 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.529417  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:00.524533 10902 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.668s	user 0.044s	sys 0.067s
I20260709 13:16:00.531791  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:00.533322  6324 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:00.532900  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:00.535316 10934 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.499186 10612 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.547484 10612 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.527406 10964 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.548408 10633 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:00.536106 10903 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.549266 10814 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:00.549841 10814 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.542201 10565 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.551921  6331 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:00.556041  6327 raft_consensus.cc:1240] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:00.549007 10633 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.556705 10790 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.550976 10985 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:16:00.536919 10902 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.686s	user 0.044s	sys 0.067s
I20260709 13:16:00.554970 10828 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:00.553785  6323 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:00.578148  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 85431.9us
I20260709 13:16:00.580473 10814 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.579279 10828 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.569308 10985 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.584405 10828 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.585421 10985 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.591075 10633 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.591768 10697 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:00.601716 10964 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:00.604460 10931 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.605006 10931 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.614132  6934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 845) took 1698 ms. Trace:
I20260709 13:16:00.614603  6934 rpcz_store.cc:276] 0709 13:15:58.916132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.916256 (+   124us) service_pool.cc:224] Handling call
0709 13:16:00.613885 (+1697629us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54005d52d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:00.614064 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217075584}
I20260709 13:16:00.620260  6252 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:00.621479  6251 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:00.621978  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:00.624089  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:00.626158  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:00.627537  6368 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:00.629992  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.630195  6368 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:00.631071  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.633016  6255 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:00.620772 10712 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.639055  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:00.637883  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.638602  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.643530  6936 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:00.651376  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:00.657068  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:00.658020  6935 raft_consensus.cc:2393] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 6: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:00.662256  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:00.632544 10970 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:00.637156 10826 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.677922  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:00.680055  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:00.680924  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:00.689778  6939 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:00.693818  6368 leader_election.cc:400] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8.
I20260709 13:16:00.697391  6368 leader_election.cc:403] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:16:00.638041 10878 consensus_queue.cc:1048] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:16:00.681413 10963 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.678325 10700 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:00.706140  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:00.665446 10712 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.666903 10676 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:00.696357  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:00.658857 10947 consensus_queue.cc:1059] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:16:00.688521 10813 consensus_queue.cc:1048] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:16:00.718853  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.719494  6400 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:00.694844  6936 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:00.688520 10973 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:16:00.721168  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.698410 10970 consensus_queue.cc:1059] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:16:00.723907  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1772) took 2116 ms. Trace:
I20260709 13:16:00.726105  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.727519  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.710330 10706 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 7. Current term is 8.
I20260709 13:16:00.724503  6254 rpcz_store.cc:276] 0709 13:15:58.604410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.604524 (+   114us) service_pool.cc:224] Handling call
0709 13:15:58.604815 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.356702 (+751887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.720203 (+1363501us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b5400202e54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:00.720331 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699046272}
I20260709 13:16:00.729761  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.732302  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.733381 10970 raft_consensus.cc:3055] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:00.733754 10970 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:00.734525 10970 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.735605 10970 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:58.361822  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:00.719098 10977 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:00.739987 10977 raft_consensus.cc:697] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:00.740741  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1614) took 1262 ms. Trace:
I20260709 13:16:00.741174  6330 rpcz_store.cc:276] 0709 13:15:59.478350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.478744 (+   394us) service_pool.cc:224] Handling call
0709 13:16:00.740558 (+1261814us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400436cd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:00.740685 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335574912}
W20260709 13:16:00.739404  6153 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49212 (request call id 203) took 27648 ms (client timeout 15000 ms). Trace:
W20260709 13:16:00.744807 10926 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.385s	user 0.004s	sys 0.000s
I20260709 13:16:00.745282 10947 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:00.745852 10971 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.701s	user 0.000s	sys 0.002s
W20260709 13:16:00.742548  6153 rpcz_store.cc:269] 0709 13:15:33.091467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.091826 (+   359us) service_pool.cc:224] Handling call
0709 13:16:00.739273 (+27647447us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:52.686764 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:52.687697 (+   933us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:52.687773 (+    76us) write_op.cc:435] Acquired schema lock
0709 13:15:52.687815 (+    42us) tablet.cc:662] Decoding operations
0709 13:15:52.708892 (+ 21077us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:52.768859 (+ 59967us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:52.768897 (+    38us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:15:52.770066 (+  1169us) tablet.cc:701] Row locks acquired
0709 13:15:52.770116 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:15:52.770279 (+   163us) write_op.cc:270] Start()
0709 13:15:52.770444 (+   165us) write_op.cc:276] Timestamp: P: 1783602952770218 usec, L: 0
0709 13:15:52.770478 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:15:52.771161 (+   683us) log.cc:844] Serialized 4362 byte log entry
0709 13:15:53.166893 (+395732us) op_driver.cc:464] REPLICATION: finished
0709 13:15:53.334238 (+167345us) write_op.cc:301] APPLY: starting
0709 13:15:53.334354 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:54.136917 (+802563us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:54.137055 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:55.033617 (+896562us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:55.033966 (+   349us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:15:55.034027 (+    61us) write_op.cc:312] APPLY: finished
0709 13:15:55.034603 (+   576us) log.cc:844] Serialized 105 byte log entry
0709 13:15:55.122382 (+ 87779us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:55.131229 (+  8847us) write_op.cc:454] Released schema lock
0709 13:15:55.149419 (+ 18190us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:55.232347 (+ 82928us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:55.237878 (+  5531us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5401730,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":166995,"apply.run_cpu_time_us":41704,"apply.run_wall_time_us":1871146,"cfile_cache_hit":42,"cfile_cache_hit_bytes":44016,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6223,"cfile_init":2,"lbm_read_time_us":140469,"lbm_reads_10-100_ms":1,"lbm_reads_gt_100_ms":1,"lbm_reads_lt_1ms":10,"num_ops":11,"prepare.queue_time_us":343578,"prepare.run_cpu_time_us":38297,"prepare.run_wall_time_us":202642,"raft.queue_time_us":153569,"raft.run_cpu_time_us":16559,"raft.run_wall_time_us":123210,"replication_time_us":396266,"spinlock_wait_cycles":2432,"thread_start_us":560273,"threads_started":5,"wal-append.queue_time_us":253179,"wal-append.run_cpu_time_us":33346,"wal-append.run_wall_time_us":2394900}]]}
I20260709 13:16:00.748500  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2543) took 1187 ms. Trace:
I20260709 13:16:00.716416 10902 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:00.752496  6397 raft_consensus.cc:2393] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:00.748824  6247 rpcz_store.cc:276] 0709 13:15:59.561444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.848893 (+287449us) service_pool.cc:224] Handling call
0709 13:15:59.849267 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:59.849764 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.849789 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:59.854794 (+  5005us) log.cc:844] Serialized 52 byte log entry
0709 13:15:59.915551 (+ 60757us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:59.942167 (+ 26616us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.942535 (+   368us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.950535 (+  8000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.950606 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:00.177040 (+226434us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b18000f8260. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:16:00.745580 (+568540us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b2400435db8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f457297e9c4 00007f457297cacb 00007f4572b37dc9 00007f4572b37a55 00007f4572b3709d 00007f457576910e 00007f457578088c 00007f457577fbb6 00007f457577f7d8 00007f4575789221
0709 13:16:00.748301 (+  2721us) raft_consensus.cc:1685] finished
0709 13:16:00.748320 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.748445 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173,"prepare.queue_time_us":46933,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":4983,"raft.queue_time_us":16928,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":29606,"spinlock_wait_cycles":68888448,"thread_start_us":25744,"threads_started":1,"wal-append.queue_time_us":119154}
I20260709 13:16:00.721510 10835 raft_consensus.cc:3055] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:00.753336  6400 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:16:00.754902  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.756520  6936 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:00.756677  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.760883  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.707139 10963 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.763206  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:00.708539 10700 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.732160 10972 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:00.766350  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.768620  6400 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:00.751530 10903 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:00.767500  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.776016  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.777915  6401 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.762326 10711 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.781090  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.783849 10700 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:00.790171 10660 raft_consensus.cc:3055] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:00.790580  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:00.759416 10835 raft_consensus.cc:740] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:00.794744  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.807756  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.809691  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.810432  6400 raft_consensus.cc:2410] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:16:00.813908  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.816182  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 869) took 1803 ms. Trace:
I20260709 13:16:00.745820 10947 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.820418  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.794303 10660 raft_consensus.cc:740] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:00.765789 10902 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.811676 10564 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:00.816644  6250 rpcz_store.cc:276] 0709 13:15:59.012985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.013208 (+   223us) service_pool.cc:224] Handling call
0709 13:15:59.013616 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.014020 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.014062 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:59.040502 (+ 26440us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.195845 (+155343us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:59.195884 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.195954 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:00.070913 (+874959us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:16:00.744540 (+673627us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b2400435db8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f457297e9c4 00007f457297cacb 00007f4572b37dc9 00007f4572b37a55 00007f4572b3709d 00007f457576910e 00007f457578088c 00007f457577fbb6 00007f457577f7d8 00007f4575789221
0709 13:16:00.815978 (+ 71438us) raft_consensus.cc:1685] finished
0709 13:16:00.815999 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.816129 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1439,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8476,"spinlock_wait_cycles":68720256,"thread_start_us":108700,"threads_started":1,"wal-append.queue_time_us":248236}
I20260709 13:16:00.830035  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:00.814929  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.793119 10903 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.835642  6401 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:00.837028  6222 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:00.837215  6296 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:00.740828 10977 consensus_queue.cc:237] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.806679 10711 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.848534  6296 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:00.850155  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:00.850558  6942 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 847) took 1876 ms (client timeout 2087 ms). Trace:
I20260709 13:16:00.852262  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:00.851130  6942 rpcz_store.cc:269] 0709 13:15:58.974241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.977044 (+  2803us) service_pool.cc:224] Handling call
0709 13:16:00.850352 (+1873308us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540055c154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:00.850488 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3528269184}
I20260709 13:16:00.831790 10827 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.854312  6322 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:00.780856 10972 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.849953 10944 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:00.853029 10618 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:00.853574 10636 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:16:00.843470 10564 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:00.879498  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.875385 10994 log.cc:927] Time spent T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:16:00.870237 10904 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:00.890406 10998 log.cc:927] Time spent T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:16:00.902192 10908 consensus_queue.cc:1059] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:00.903304 10963 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:00.903450 10908 raft_consensus.cc:3055] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:00.887128 10973 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:00.904059 10908 raft_consensus.cc:740] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:00.904721 10973 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.840971 10835 consensus_queue.cc:260] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.887887  6296 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:00.905877  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1613) took 1427 ms. Trace:
I20260709 13:16:00.872458 10827 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.881651 10618 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:00.908540  6329 rpcz_store.cc:276] 0709 13:15:59.478093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.478586 (+   493us) service_pool.cc:224] Handling call
0709 13:15:59.500714 (+ 22128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:00.261709 (+760995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.891679 (+629970us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54003f3754. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:00.905818 (+ 14139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1748840320}
I20260709 13:16:00.911823  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.917860  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.918257  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:00.919245  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.912571  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:00.909432  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.920548  6942 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:00.922431  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.923322  6396 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:16:00.926669  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.927712  6400 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:00.929680  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:00.902211 10711 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.933723  6296 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:00.946620  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:00.955479  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:00.909889 10929 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:00.957742  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:00.964190  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:00.903901 10963 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:16:00.966688  6247 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:00.967314  6251 raft_consensus.cc:2410] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:00.915614 10633 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.923015 10904 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:00.915791 10992 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:00.968951  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:00.971390 10633 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:00.923283 10618 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.874656 10660 consensus_queue.cc:260] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.976421 10660 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:00.980037 10731 raft_consensus.cc:3055] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:00.980508 10731 raft_consensus.cc:740] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:00.946614 10339 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:00.954335 10835 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:00.924834 10908 consensus_queue.cc:260] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:00.985338 10908 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:00.986809 10947 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.988090 10973 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:00.960143  6296 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:00.949250 10944 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:00.931473 10814 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:00.915413 10985 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.997529  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:01.007390  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.014945  6325 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:16:01.007316  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:00.968335 10565 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:16:01.008623  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 48576.3us
I20260709 13:16:00.914701 10564 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.000801  6219 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:01.020334  6256 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:01.015561  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.027891  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:01.028498  6937 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:01.028658  6322 raft_consensus.cc:2393] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 14: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:00.970242 10929 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:01.016954  6324 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:16:01.018774  6296 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:01.006929 10339 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.033434  6326 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:01.033701  6330 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:16:01.034972 10339 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.010346 10904 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:01.035862 10904 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:01.036312 10904 raft_consensus.cc:697] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:01.037209 10904 consensus_queue.cc:237] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:01.039793 10636 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:01.022758 10985 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:01.041942 10827 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.040443 10636 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.042568 10633 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.042838 10972 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.025888 10903 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.014777 10814 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:01.044392 10636 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.044734 10814 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:01.046501 10985 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:01.046702  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 1047) took 1110 ms. Trace:
I20260709 13:16:01.047071  6328 rpcz_store.cc:276] 0709 13:15:59.936480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.181952 (+245472us) service_pool.cc:224] Handling call
0709 13:16:00.182237 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:00.331476 (+149239us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:00.331750 (+   274us) log.cc:844] Serialized 14 byte log entry
0709 13:16:00.559885 (+228135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:00.559934 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:00.559975 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.046479 (+486504us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400038c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:01.046528 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:01.046647 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5091,"prepare.queue_time_us":765,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":5229,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":2432,"spinlock_wait_cycles":342681984,"thread_start_us":222636,"threads_started":1,"wal-append.queue_time_us":284399}
I20260709 13:16:01.055537  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.056212  6323 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:00.974484 10992 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.057614  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:01.081754  6247 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:01.066406  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.082476  6323 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:16:01.067764  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.084019  6331 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 12: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:16:01.085592  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.071417  6219 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:01.072525  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:01.088475  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:01.089593  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:01.090149  6248 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:16:01.091065  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:01.072863  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.094197  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.094282  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.095546  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:01.095983  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:01.077798  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:01.078172  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.104151  6222 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:01.098438  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:01.105291  6253 raft_consensus.cc:2393] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 8: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:01.099941  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:01.107532  6221 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.107705  6369 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:01.076081  6401 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:01.112243  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:01.113639  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:01.114866  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:01.115540  6401 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:01.103842  6247 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:16:01.052265 10807 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:01.124850  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:01.126727  6369 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:01.128443  6369 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:01.098278 10828 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:01.101509 10944 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:01.122010  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:01.122913  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.088035 10633 consensus_queue.cc:1059] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:16:01.027539 10862 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 13:16:01.130511  6256 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:16:01.132136  6247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:01.158412  6247 raft_consensus.cc:606] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:01.158818  6247 raft_consensus.cc:614] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:01.120412  6401 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:01.104111  6248 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:01.053145 10731 consensus_queue.cc:260] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:01.136543 10828 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:01.171500  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 64044.4us
I20260709 13:16:01.148453 10965 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:01.138502 10878 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:01.166034 10660 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:01.153429 10706 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:01.175146  6369 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:01.175420  6221 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.186695  6369 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:01.186803  6221 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.172904 10807 raft_consensus.cc:697] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:01.160681 10944 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:01.198894 10944 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:01.199501 10712 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.202521  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:01.203399  6938 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:16:01.181334 10965 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.177075 10828 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:01.212622  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.213774  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.209614 10965 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:01.219673 10992 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.220665  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:01.222960  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:01.174700 10985 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:01.227607  6221 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:01.225566 10826 consensus_meta.cc:287] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 13:16:01.229061  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.230744  6221 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.231077  6219 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:01.233431  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.234072  6327 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:01.236620  6219 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:01.226475 10972 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:01.238584  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:01.238643  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.241118  6323 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:01.242439  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:01.243165  6247 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:01.227218 10706 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:01.227272 10862 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:01.323436  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:01.324545  6247 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:16:01.313500 11008 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:16:01.228722 10826 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:01.228989 10916 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:01.334731  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.231587 10339 consensus_queue.cc:1059] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:16:01.236133 10636 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:01.357577  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:01.236578 10992 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:01.355418  6250 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:01.237498 10985 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:01.362524  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:01.239696 10633 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:01.371573  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:01.365432  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:01.366070  6248 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:16:01.374150 11005 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:16:01.378844  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:01.384711  6248 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:01.387295  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 71905.7us
I20260709 13:16:01.365302 10636 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.362700 11020 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:01.400497  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:01.403489  6295 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:01.365147 10992 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:01.405355  6256 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:01.407052  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:01.408955  6295 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.413623  6295 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:01.420565  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.378811 10929 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:01.423944  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:01.436827 10944 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:01.436323  6151 catalog_manager.cc:5697] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 7 to 8, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 8 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:01.378748 11017 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:01.412371 10992 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:01.439280  6396 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 6.
I20260709 13:16:01.439631  6248 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:01.442408  6295 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.444056  6295 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.410833  6403 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:16:01.424062  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:01.447364  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:01.445793  6402 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:16:01.363698 10807 consensus_queue.cc:237] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:01.421710 10908 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:01.452432  6941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:47742
I20260709 13:16:01.453733  6907 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.405697 10636 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:01.454681  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:01.422525 11014 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:01.451839  6151 catalog_manager.cc:5697] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 11 to 12, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 12 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.449931 10564 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:01.458142 10944 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:16:01.462527 11012 log.cc:927] Time spent T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.268s	user 0.002s	sys 0.000s
I20260709 13:16:01.468479  6405 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:01.470898 10902 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.450219 10565 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:01.474056  6941 raft_consensus.cc:606] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:01.474263  6399 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:01.488576  6941 raft_consensus.cc:614] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:01.476765  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 290127us
I20260709 13:16:01.490115  6369 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:01.487793  6151 catalog_manager.cc:5697] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 7 to 8, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 8 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:01.456946  6295 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.450297 10904 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:01.493804  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:01.495479  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:01.496048  6255 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:01.473635 10908 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.496075  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:01.498123  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:01.498833  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:01.499609  6248 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:01.480911 10963 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:01.496541 10564 raft_consensus.cc:697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:01.502873 10934 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:01.507576 10934 raft_consensus.cc:697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:01.488312 10944 consensus_queue.cc:1243] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:01.511003  6151 catalog_manager.cc:5697] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.484948 10583 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:16:01.515086 10934 consensus_queue.cc:237] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:01.517434  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:01.520197  6253 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:01.520267  6295 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:01.520859  6403 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:01.503875 10908 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:01.450807 11017 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:01.528553  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:01.529876  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.490177 11014 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.505445 10564 consensus_queue.cc:237] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:01.518370  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:01.517467  6151 catalog_manager.cc:5697] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:16:01.509873 10618 consensus_meta.cc:287] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.004s
I20260709 13:16:01.508579 10954 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:01.530519 11023 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 13:16:01.586555  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 96768us
I20260709 13:16:01.534261  6396 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:16:01.603085  6397 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:16:01.545089 10636 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.546482 10965 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.509413 10565 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:01.531008 10879 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:01.556351  6255 pending_rounds.cc:85] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 5
I20260709 13:16:01.556396 10731 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:01.557296 10828 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.616242 10636 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.616921 10828 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.564632 10930 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.619202  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:01.619809  6939 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:01.533383 10904 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:16:01.625391  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:01.626863  6399 raft_consensus.cc:2393] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 10: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:01.631295 11014 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.533762 10902 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:01.566813  6250 raft_consensus.cc:3055] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:01.632776  6250 raft_consensus.cc:740] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:01.633675  6250 consensus_queue.cc:260] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:01.638983  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:01.570592 11010 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:16:01.572055  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:01.536276 10977 consensus_queue.cc:1059] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:01.607306  6907 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:01.651994  6402 raft_consensus.cc:2393] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:16:01.652125  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 44905.7us
I20260709 13:16:01.555613 11017 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:01.611330  6255 pending_rounds.cc:107] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:16:01.669327  6255 raft_consensus.cc:2889] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:01.670069  6221 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.671837  6296 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.586668 10944 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:01.675959  6252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2540) took 2118 ms (client timeout 1821 ms). Trace:
I20260709 13:16:01.605417 10618 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.643572  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:01.646241  6151 catalog_manager.cc:5697] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 8 to 9, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 9 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.636922 10965 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.649842  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:01.655969 10990 log.cc:927] Time spent T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.974s	user 0.000s	sys 0.008s
W20260709 13:16:01.657887 10921 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.819s	user 0.006s	sys 0.000s
I20260709 13:16:01.662998 10660 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.713064  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.714082  6329 raft_consensus.cc:2393] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:01.718101  6327 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:01.675383  6221 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:01.742151  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 66834.6us
I20260709 13:16:01.743134  6221 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.611652 10565 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:01.678385  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:01.676395  6252 rpcz_store.cc:269] 0709 13:15:59.545676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.572575 (+ 26899us) service_pool.cc:224] Handling call
0709 13:16:01.664308 (+2091733us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54001739d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:01.664434 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1918693120}
I20260709 13:16:01.757676  6330 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:16:01.681177  6248 raft_consensus.cc:2393] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:01.648085  6939 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:01.744637  6221 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.670841 10694 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:01.771221  6221 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:01.774399  6151 catalog_manager.cc:5697] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 7, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 7 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:01.776057  6221 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:01.681984 11017 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:01.782550 10931 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.778020  6221 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:01.773185 10636 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:01.783783 10636 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:01.784139 10636 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.784546 10636 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:01.784336  6221 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.773061 11018 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:01.773204 10930 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:01.786156 10930 raft_consensus.cc:697] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:01.786502  6221 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:01.772897 10828 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.787024 10930 consensus_queue.cc:237] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:01.787559 10828 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:01.788432 10862 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:01.788831 10862 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:01.789211 10862 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:01.789667 10828 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:01.680946 10902 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:01.758270 10290 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.792591 10290 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.795113  6219 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:01.795641  6256 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:01.778218  6249 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:01.780592 10985 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:01.781193 10633 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:01.683250 10944 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.685925 10904 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.773269 10565 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:01.780678 10694 raft_consensus.cc:697] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:01.796614  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:01.757682 10965 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:01.672693 10964 consensus_queue.cc:1059] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:16:01.757177 10660 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:01.692799  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.687577  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.797191  6151 catalog_manager.cc:5697] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 7 to 8, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 8 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:01.683017 11027 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.147s
I20260709 13:16:01.838357  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.718899 10963 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 13:16:01.821012 10807 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:01.878667  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:01.836599  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.798893 10633 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.836171 11017 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:01.879559  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:01.840653  6331 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:01.821311 10916 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:01.828212 11015 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:01.842206  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:01.882050  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:01.878822  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.892473  6400 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
W20260709 13:16:01.872609 11028 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:16:01.893267  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 213002us
I20260709 13:16:01.901369 10828 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:01.888620 10633 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:01.895596  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.918072 11037 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:01.893610  6151 catalog_manager.cc:5697] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 8, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 8 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:01.918531  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:01.919162  6331 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:01.918809 11037 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.873629  6326 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:16:01.920811  6151 catalog_manager.cc:5697] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 8 to 9, leader changed from <none> to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 9 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:01.921823  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.921764 11037 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:01.922924  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:01.922394 11044 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:01.924258  6326 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:01.923987 11044 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.840790 10766 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:01.925230 11037 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:01.925766 11037 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.898552  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:01.926631  6327 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:01.927852 11037 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:01.898120 10972 consensus_meta.cc:287] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.003s
I20260709 13:16:01.929461 10972 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:01.922435  6151 catalog_manager.cc:5697] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 10 to 11, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 11 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:01.888350 10731 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:01.836098 10904 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.826170 10970 consensus_queue.cc:1059] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:16:01.933112  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:01.933313  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:01.934762  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:01.943339  6327 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:01.975046  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:01.843745 10908 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.951383  6151 catalog_manager.cc:5697] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 12, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 12 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.953537  6331 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:01.873020 10965 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:01.883256 10807 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:01.976651  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:01.973546  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:01.914492 10828 raft_consensus.cc:697] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:01.979598  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:01.987059  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 85923.6us
I20260709 13:16:01.882308 10992 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.038800  6907 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:02.038964  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:02.037925  6935 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:01.917359 10944 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.066478  6328 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:02.070113  6222 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:02.071942  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:02.073411  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:02.040206  6322 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:16:02.066949  6937 raft_consensus.cc:2376] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9. Re-sending same reply.
I20260709 13:16:02.075516  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:02.076179  6256 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:02.076215  6253 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:02.077522  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:01.981045  6938 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:01.971524 10290 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:01.972186 10964 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:02.083737  6295 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:01.992908 10930 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:02.032682 10902 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:02.084372  6151 catalog_manager.cc:5697] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 4 to 6, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 6 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:01.976984 11027 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:02.084794  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:02.091617  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 880) took 1126 ms. Trace:
I20260709 13:16:02.101711  6254 rpcz_store.cc:276] 0709 13:16:00.965258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.965501 (+   243us) service_pool.cc:224] Handling call
0709 13:16:00.965839 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:01.119383 (+153544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:01.119429 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:01.119498 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:01.119552 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.091236 (+971684us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54003b24d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:02.091283 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.091407 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352521600}
I20260709 13:16:02.096432  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:02.039628 10970 consensus_queue.cc:1243] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:02.037607 10807 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:02.103691  6935 raft_consensus.cc:2410] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:16:02.106997  6141 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 19435892007a4e0a9b2b4d0b26ccd0c0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:16:02.107811  6141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 217944us
I20260709 13:16:02.108320 10618 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.108965 10907 raft_consensus.cc:3055] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:02.109383 10916 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:02.109495 10907 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:02.113005 10908 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.113770 10965 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.114609 11044 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.113421 10907 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:02.105572 11038 log.cc:927] Time spent T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:16:02.106647 10930 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.129012 10930 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.123970 10660 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.131690  6252 raft_consensus.cc:1240] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:16:02.133688 10660 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.105244 11018 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:02.110247 10828 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.137144  6906 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:02.139999  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:02.141158  6937 raft_consensus.cc:2393] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:02.143138  6255 raft_consensus.cc:1240] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:16:01.971441 10731 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.134635 11018 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.148923  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:02.149920  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:02.155058  6251 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:16:02.146234  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:02.155787  6937 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:02.087661 10992 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.154292  6255 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:02.155980  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:16:02.136193 11031 log.cc:927] Time spent T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:16:02.109951 10916 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:01.971689 10694 consensus_queue.cc:237] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.101346 10964 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.153697  6151 catalog_manager.cc:5697] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 4 to 5, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 5 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:02.140873 11027 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.175912  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:02.189080  6247 raft_consensus.cc:2410] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:16:02.103981 10934 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:02.100214 10957 consensus_queue.cc:1059] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:16:02.158308 11018 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:02.124795 10862 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.190706 10934 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.198823 10934 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:02.160758 10290 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:02.199604 10290 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.200008 10290 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:02.201218 10904 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.202118 10731 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.203130  6254 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:02.129756 10902 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.206215  6942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 972) took 1179 ms. Trace:
I20260709 13:16:02.206701  6942 rpcz_store.cc:276] 0709 13:16:01.026823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.026961 (+   138us) service_pool.cc:224] Handling call
0709 13:16:01.027270 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:01.027617 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:01.027643 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:01.030555 (+  2912us) log.cc:844] Serialized 26 byte log entry
0709 13:16:01.554246 (+523691us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b1800141340. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:16:01.680229 (+125983us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:01.680267 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.680334 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:02.192750 (+512416us) raft_consensus.cc:1685] finished
0709 13:16:02.192770 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.206144 (+ 13374us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":295,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":29512,"spinlock_wait_cycles":51807616,"thread_start_us":125812,"threads_started":1,"wal-append.queue_time_us":839869}
W20260709 13:16:02.163277  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 126160us
I20260709 13:16:02.211345  6247 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:02.097828 10944 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 13:16:02.189885  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 53068.6us
I20260709 13:16:02.191627 11054 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.172500 11042 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:16:02.196655 10964 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:02.197808  6933 raft_consensus.cc:2410] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:16:02.184280 11049 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:02.221517  6151 catalog_manager.cc:5697] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 10, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 10 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:02.216496 11036 raft_consensus.cc:3055] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:02.229957  6151 catalog_manager.cc:5697] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:16:02.231101  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 82130.3us
I20260709 13:16:02.234256  6906 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:02.224658 11045 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.206561 11051 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:16:02.236171  6906 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:02.240453  6151 catalog_manager.cc:5697] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 7, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 7 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
W20260709 13:16:02.233261 10879 consensus_meta.cc:287] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.001s
I20260709 13:16:02.242956  6151 catalog_manager.cc:5697] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 9, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 9 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:02.231982 11036 raft_consensus.cc:740] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:02.234514 10977 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:02.249651  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 210920us
I20260709 13:16:02.220149 11054 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.249788  6404 raft_consensus.cc:2410] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:02.268584  6907 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:02.277666  6151 catalog_manager.cc:5697] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 11, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:02.237033 11049 consensus_queue.cc:1059] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:16:02.278939  6906 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:02.264354 10583 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:02.286218  6151 catalog_manager.cc:5697] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 10 to 11, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:02.266104 10879 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:02.266415 10957 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:02.248301 10964 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:16:02.243227 11053 consensus_queue.cc:1059] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:16:02.290443  6937 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:02.280416 11017 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:02.241756 11045 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.288141  6151 catalog_manager.cc:5697] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 8, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 8 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:02.296849  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:02.312479  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:02.308175  6938 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:02.279711 10835 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.313160  6402 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:16:02.313158  6398 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:02.299728  6222 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:02.316817  6222 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:02.267751 10636 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.266578 10977 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.293402 10957 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.326874  6323 raft_consensus.cc:1275] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:02.333521  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:02.334056  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:02.329813  6255 raft_consensus.cc:1240] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:02.331359  6219 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:02.328884 11057 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:02.337867 11046 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:02.338071 11057 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.338467 11057 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.338989 10700 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.339493 10700 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.341532 10700 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:02.342803 11054 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.347093  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:02.349880  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:16:02.329171 11043 log.cc:927] Time spent T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:16:02.353609  6329 raft_consensus.cc:2393] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 12: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:02.324045 10660 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:02.336089 10957 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:02.299589 10879 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.354413  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:02.375646  6222 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.793s (SENT) [suppressed 10 similar messages]
W20260709 13:16:02.357456  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.330752 10583 raft_consensus.cc:3055] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:02.328940 11060 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:02.331727 10985 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:02.343670 10930 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.378203  6219 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:02.319526 10835 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:02.382025  6248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:02.384253  6248 raft_consensus.cc:606] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:02.384719  6248 raft_consensus.cc:614] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:02.390518 10636 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:02.394275  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 168762us
I20260709 13:16:02.290767 11036 consensus_queue.cc:260] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.402833 10985 raft_consensus.cc:697] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:02.407264 10879 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.380379 10902 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.409003  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:02.383620 10660 raft_consensus.cc:697] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:02.410198 10633 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.420943  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:02.425104  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:02.377781 10583 raft_consensus.cc:740] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:02.381980 11027 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:02.444330 10583 consensus_queue.cc:260] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.463522 10583 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.465098 10633 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.467265  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 881) took 1500 ms. Trace:
I20260709 13:16:02.467633  6249 rpcz_store.cc:276] 0709 13:16:00.966410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.971182 (+  4772us) service_pool.cc:224] Handling call
0709 13:16:00.971556 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:01.799877 (+828321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.467050 (+667173us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b54001b94d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:02.467208 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1843252608}
I20260709 13:16:02.468843 10934 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.444586 10660 consensus_queue.cc:237] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.470463 10866 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:02.471617 10934 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.442204  6905 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:02.446405  6219 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:02.412771 10957 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:02.454123 10565 consensus_meta.cc:287] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.000s
I20260709 13:16:02.454720  6404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2366) took 1641 ms. Trace:
I20260709 13:16:02.454968  6401 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:16:02.479779  6401 pending_rounds.cc:85] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 4
I20260709 13:16:02.480276  6401 pending_rounds.cc:107] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:16:02.479689  6404 rpcz_store.cc:276] 0709 13:16:00.813506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.813641 (+   135us) service_pool.cc:224] Handling call
0709 13:16:02.454441 (+1640800us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54003aded4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:02.454640 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3299627392}
I20260709 13:16:02.480723  6401 raft_consensus.cc:2889] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:02.456612 10907 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:02.458182 11045 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.410238 10290 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.393522 10930 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:02.483917 10290 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:02.484081 10930 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:02.416015 10977 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.461997 10807 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:02.486646 10807 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:02.417418 10992 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:02.469564  6251 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 12: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:02.475291  6219 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:02.488742  6219 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:02.448385 11018 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.477221  6905 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:02.405369 11060 raft_consensus.cc:697] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:02.444330 11036 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.509040  6371 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:02.510798  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.479413 10494 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:02.479178 10931 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:02.515177  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:02.515244  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:02.516242  6934 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:02.516431  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:02.514441  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:02.515442  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:02.415934 10916 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:02.498322 10930 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:02.513358  6371 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:02.495879 11066 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:16:02.532593  6371 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:02.532780  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:02.493481 10633 consensus_queue.cc:1048] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:16:02.512125 10290 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:02.517917 10977 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:02.534447  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 249030us
I20260709 13:16:02.498051 10828 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:02.495152 11060 consensus_queue.cc:237] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.496071 10565 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.523437 10931 raft_consensus.cc:697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:02.538404 10813 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:02.568385 11045 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:02.522912 10985 consensus_queue.cc:237] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.567798 10947 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:16:02.587981 11027 consensus_queue.cc:1059] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:16:02.694846 11018 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.696470 10916 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:02.660876 11045 raft_consensus.cc:697] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:02.708956 11045 consensus_queue.cc:237] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.688532 11057 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.713757 11057 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:02.714507 11057 raft_consensus.cc:3055] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:02.714929 11057 raft_consensus.cc:740] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:02.715899 11057 consensus_queue.cc:260] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.689400 10931 consensus_queue.cc:237] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.734380 10992 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:02.753537 11057 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:02.788970  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 413114us
I20260709 13:16:02.791898  6330 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:02.561631  6371 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:02.799513  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 332608us
I20260709 13:16:02.567919  6906 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
W20260709 13:16:02.802772  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 234799us
I20260709 13:16:02.806962  6936 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 14.
W20260709 13:16:02.808828  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.809643  6935 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:02.811803  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:02.814466  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:02.584627  6938 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:02.817329  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:02.820904  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:02.825688  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:02.826701  6403 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:02.836510  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:02.837797  6934 raft_consensus.cc:2393] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:02.838773 10290 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:02.839390 10290 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.839815 10290 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.840020  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:16:02.800843  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 239150us
W20260709 13:16:02.853180  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 49121.3us
I20260709 13:16:02.882889  6371 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:02.883816  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.884740  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.890375  6222 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:02.857046  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.904728 10565 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.919776  6398 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:02.924569 10633 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:02.931056 10633 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:02.940194 10633 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:02.953171 10636 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:03.049517 10826 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:03.050769 10826 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:03.051270 10826 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:03.051769 10826 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:03.052237 10879 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.054170  6403 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
W20260709 13:16:03.054791  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.052990 10879 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.058293 10879 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.062187 10807 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:03.063124 10807 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.064430  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.065585  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.066805  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.076301  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:03.080984  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 138185us
W20260709 13:16:03.087914  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 44392.4us
I20260709 13:16:03.091382  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.093158  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.090862 10807 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.096833  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:16:03.098407  6400 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.002s	sys 0.011s
W20260709 13:16:03.102612  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.103948  6400 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.002s	sys 0.012s
I20260709 13:16:03.097635 10290 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.105244  6937 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:03.105326  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.106365  6940 raft_consensus.cc:2393] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:03.109201  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:03.109268  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:03.110046  6403 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.109927  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.113533  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.114413  6939 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:03.115407  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:03.122009 10826 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.124135 10826 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.126282 10636 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:03.118043 10290 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:03.126616  6403 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:16:03.128952  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 1062) took 1303 ms. Trace:
I20260709 13:16:03.129428  6330 rpcz_store.cc:276] 0709 13:16:01.825833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.825943 (+   110us) service_pool.cc:224] Handling call
0709 13:16:01.826195 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.792801 (+966606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.128552 (+335751us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54002a4c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:03.128790 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219281664}
I20260709 13:16:03.130260  6937 raft_consensus.cc:1240] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:16:03.131333  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:03.133198  6940 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:03.131685  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.133733  6939 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
W20260709 13:16:03.138715  6322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 1067) took 1274 ms (client timeout 1535 ms). Trace:
W20260709 13:16:03.139235  6322 rpcz_store.cc:269] 0709 13:16:01.864540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.880639 (+ 16099us) service_pool.cc:224] Handling call
0709 13:16:03.138282 (+1257643us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54001c0a54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:03.138485 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322957184}
I20260709 13:16:03.145960 10826 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:16:03.145682 10612 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.149348 10862 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.151527  6940 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:03.152881 10612 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.157491 10565 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.158550 10970 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:03.158272 10565 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.159322 10970 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.161360 10934 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.162016 10934 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.166172 10957 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:03.168197 10612 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.168252 10835 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:03.170573 10564 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:03.168932 10612 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:03.163312 10565 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:03.185220  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:03.186692  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:03.187516 10862 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:03.187968  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:03.188813  6331 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:03.173194 10564 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.174656  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2369) took 2350 ms. Trace:
I20260709 13:16:03.177937 11054 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.178891 11024 raft_consensus.cc:3055] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:03.180153  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:03.180437  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:03.181411 10612 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.183055 10934 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.183583  6322 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:03.184226  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:03.188288 10862 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.199999 10565 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.200695  6330 raft_consensus.cc:2393] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:03.200814 10565 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.196748 11024 raft_consensus.cc:740] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:03.202216 10862 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:03.203372  6324 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:03.202942 11024 consensus_queue.cc:260] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.198717  6327 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:03.204198 11024 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.207168 10612 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:03.194969  6933 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 859) took 1262 ms (client timeout 1543 ms). Trace:
I20260709 13:16:03.194168 10706 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.195639  6405 rpcz_store.cc:276] 0709 13:16:00.824230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.825838 (+  1608us) service_pool.cc:224] Handling call
0709 13:16:00.826153 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:01.486324 (+660171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.174134 (+1687810us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54003769d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:03.174477 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1476383488}
I20260709 13:16:03.197492 11054 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.210070  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1805) took 1561 ms. Trace:
W20260709 13:16:03.209710  6933 rpcz_store.cc:269] 0709 13:16:01.932395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.932536 (+   141us) service_pool.cc:224] Handling call
0709 13:16:03.194508 (+1261972us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400691754. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:03.194766 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510092544}
I20260709 13:16:03.210592  6252 rpcz_store.cc:276] 0709 13:16:01.648130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.758260 (+110130us) service_pool.cc:224] Handling call
0709 13:16:01.758599 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.132145 (+373546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.209546 (+1077401us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400410ad4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:03.209871 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857463168}
I20260709 13:16:03.212097 11054 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:03.210109 10706 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.213994 10612 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:03.215303  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:03.215559 10706 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:03.215389 10676 consensus_queue.cc:1059] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:03.216709  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:03.217547  6371 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:03.217787  6326 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 6.
I20260709 13:16:03.190109  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:03.218611 10879 consensus_queue.cc:1059] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:03.218513 11045 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:03.219303 10934 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:03.219624 11045 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.220036 11045 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:03.203778  6297 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:03.216902 10676 raft_consensus.cc:3055] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:03.221033 10676 raft_consensus.cc:740] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:03.222744  6297 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:03.223999 11091 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:03.224900 11091 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:03.216709  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1810) took 1005 ms. Trace:
I20260709 13:16:03.218520  6371 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:03.225419  6255 rpcz_store.cc:276] 0709 13:16:02.211076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.211506 (+   430us) service_pool.cc:224] Handling call
0709 13:16:02.211753 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.346336 (+134583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.216217 (+869881us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54000e24d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:03.216546 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271080192}
W20260709 13:16:03.208263  6141 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 19435892007a4e0a9b2b4d0b26ccd0c0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:03.162261 10970 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:03.236141  6325 raft_consensus.cc:1240] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:16:03.237684  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:03.238538  6325 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.240613 11055 consensus_queue.cc:1059] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:16:03.242098 11057 raft_consensus.cc:3055] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:03.242473 11057 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:03.243666 11057 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.214712 10612 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.256074  6297 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:03.258062 11091 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:03.249830 10706 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:03.261648 10706 raft_consensus.cc:697] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:03.263062 10706 consensus_queue.cc:237] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.231588 10835 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.273665  6940 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:03.275975  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.276366  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.257658 11057 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:03.281999  6399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 946) took 1764 ms (client timeout 1660 ms). Trace:
W20260709 13:16:03.282600  6399 rpcz_store.cc:269] 0709 13:16:01.516949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.517084 (+   135us) service_pool.cc:224] Handling call
0709 13:16:03.281370 (+1764286us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001f3454. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:03.281658 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249642240}
I20260709 13:16:03.285290  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:16:03.286593  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.288028  6905 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:03.289003 10963 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:03.289469 10963 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:03.289894 10963 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:03.290997  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:16:03.292096  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.295754 11030 log.cc:927] Time spent T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 1.415s	user 0.006s	sys 0.012s
I20260709 13:16:03.289004  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2570) took 1133 ms. Trace:
I20260709 13:16:03.296952  6251 rpcz_store.cc:276] 0709 13:16:02.155645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.155752 (+   107us) service_pool.cc:224] Handling call
0709 13:16:03.288567 (+1132815us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54000f5854. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:03.288775 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711859584}
I20260709 13:16:03.298005  6399 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:03.298218  6939 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:16:03.298666  6939 pending_rounds.cc:85] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Aborting all ops after (but not including) 9
I20260709 13:16:03.298873  6939 pending_rounds.cc:107] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:16:03.299121  6939 raft_consensus.cc:2889] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:03.268036 10970 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:03.302083 10970 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.302971  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2757) took 2392 ms. Trace:
I20260709 13:16:03.303296  6222 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:03.305630 10612 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:03.305402 11020 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:03.307137  6371 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:03.308089 11045 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.305456 10963 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.303335  6401 rpcz_store.cc:276] 0709 13:16:00.910513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.159845 (+249332us) service_pool.cc:224] Handling call
0709 13:16:02.454610 (+1294765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.481408 (+ 26798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.302617 (+821209us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003aded0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:03.302792 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2976894848}
I20260709 13:16:03.291113  6937 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:03.280747  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:03.315317  6329 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:03.315742 10711 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:03.315380  6325 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:16:03.316932 10879 consensus_queue.cc:1059] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:16:03.321455 10879 raft_consensus.cc:3055] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:03.322080 10879 raft_consensus.cc:740] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:03.322220  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:03.322607 11017 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:16:03.323560  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:03.324112  6371 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:03.324514 10564 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.325052 10826 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:03.325163  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:03.321331  6937 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:03.325512 11024 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:03.325618 10826 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:03.326251 10826 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.326280  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1642) took 1647 ms. Trace:
I20260709 13:16:03.326838  6328 rpcz_store.cc:276] 0709 13:16:01.678755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.679100 (+   345us) service_pool.cc:224] Handling call
0709 13:16:01.679440 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.066980 (+387540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.325871 (+1258891us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54001c0f54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:03.326123 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889657600}
I20260709 13:16:03.328080  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:03.328863  6328 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 12: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:03.329113 10565 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.327090  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:03.321499 11023 raft_consensus.cc:3055] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:03.328104  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58276 (request call id 866) took 1345 ms. Trace:
W20260709 13:16:03.340934  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.341738  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.339570  6326 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:03.340705  6941 rpcz_store.cc:276] 0709 13:16:01.982232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.982615 (+   383us) service_pool.cc:224] Handling call
0709 13:16:01.982948 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.214494 (+231546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.214523 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:02.214561 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:02.214590 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.327639 (+1113049us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540072b354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:03.327697 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.327895 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532028800}
I20260709 13:16:03.340255 11023 raft_consensus.cc:740] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:03.352363 10929 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:03.352093 11023 consensus_queue.cc:260] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.353288 11023 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.353096 10929 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.354120  6219 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:03.355815 10929 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:03.349969 11017 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:16:03.343614 10835 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.358150  6368 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:03.359109 10835 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:03.359678  6326 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:03.359793 10835 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:03.362924 11016 consensus_queue.cc:1059] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:03.363854 11016 raft_consensus.cc:3055] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:03.364207 11016 raft_consensus.cc:740] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:03.365334 11051 consensus_queue.cc:1059] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:03.366209 11051 raft_consensus.cc:3055] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:03.366535 11051 raft_consensus.cc:740] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:03.366981  6322 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:03.367605 11051 consensus_queue.cc:260] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.342579 10970 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:03.350685  6329 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:03.375164  6219 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:03.375895  6368 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:03.377488  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 121583us
I20260709 13:16:03.378031 10878 consensus_queue.cc:1059] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:03.370380 10879 consensus_queue.cc:260] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.391002 10879 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:03.395412  6936 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 968) took 2632 ms (client timeout 1793 ms). Trace:
W20260709 13:16:03.395931  6936 rpcz_store.cc:269] 0709 13:16:00.762708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.762965 (+   257us) service_pool.cc:224] Handling call
0709 13:16:03.395141 (+2632176us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b54007a49d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:03.395317 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4697241984}
I20260709 13:16:03.399590  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:03.402069 10339 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:03.402868 10339 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:03.404232 11045 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.404158 10676 consensus_queue.cc:260] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.385447  6297 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:03.399359 10814 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:03.405382 10339 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:03.417855  6326 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:03.369084 11051 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.407099  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:03.419570  6322 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:03.407532 10878 raft_consensus.cc:3055] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:03.420611 10878 raft_consensus.cc:740] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:03.404151 10605 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:16:03.384289 11016 consensus_queue.cc:260] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.381421 11017 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:03.384274 10963 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:03.422549  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.433213  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 47945.5us
I20260709 13:16:03.435401  6905 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:03.435124  6219 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:03.429567 11017 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:03.431097 10929 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.446125 11014 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:03.446707 10929 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.446929 11014 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.439023 10711 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.438941 11045 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:03.454888  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.457512  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.462208  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:03.464558  6329 raft_consensus.cc:2410] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:16:03.464780  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:03.466336  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.466922  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.467702  6256 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:03.468232  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.469313  6256 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:03.469172  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.465044  6254 raft_consensus.cc:1240] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:03.469288 10878 consensus_queue.cc:260] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.469921  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:03.474215  6248 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:03.459331  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.437693 10934 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:03.467212  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.476028  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.448984 10929 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:03.479077  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.469801 11091 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:03.450297 10660 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:03.445462 11017 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:03.483775 10676 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:03.478223  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:03.491624  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 115912us
I20260709 13:16:03.487651  6940 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:03.471714 11057 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:03.494424 11057 raft_consensus.cc:697] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:03.449048 11014 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.498733  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:03.498219  6939 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:03.476531 10934 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:03.501411  6940 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:03.504273  6256 raft_consensus.cc:1275] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:03.490187 10660 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:03.509275 10660 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:03.511919 10835 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:03.485877 10826 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.508502 11092 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.502343 10934 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:03.513477 11092 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.508824 10878 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.514600 10826 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.499888 10565 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.502127 11016 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:03.529214 10826 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:03.489766 11062 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:16:03.540488  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.516538 11091 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.503995 10711 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.547809  6327 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:16:03.548528  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:03.549015  6322 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:03.550680  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:03.552405 10835 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.556075 10835 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.558137 10835 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:03.558638  6368 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:03.560890 11054 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:03.561177  6938 raft_consensus.cc:1240] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:03.561425 11054 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:03.561899 11054 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.562527  6295 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:03.563318  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 61472.2us
I20260709 13:16:03.564061  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:03.564559  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 94477.6us
I20260709 13:16:03.567358  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:03.568217  6247 raft_consensus.cc:2393] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:03.544142 10826 consensus_queue.cc:1059] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:16:03.569160  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:03.569877  6247 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:03.569943 11095 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:03.570235 10826 raft_consensus.cc:3055] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:03.585589  6251 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:16:03.589466  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.542061 10565 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:03.552513 10908 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:03.570703 10826 raft_consensus.cc:740] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:03.595466  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.605191 10908 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.630628  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:03.631323  6251 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.632014  6907 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:03.604413  6940 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:03.605247  6256 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:16:03.633493 10908 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:03.646121 10605 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:03.646533  6248 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
I20260709 13:16:03.648577  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:03.677706  6254 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 13. Current term is 15. Ops: []
I20260709 13:16:03.649585 10636 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:03.657743  6401 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:03.554914 11091 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.659914  6250 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:03.662786  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 53685.4us
W20260709 13:16:03.621763  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.617430  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:03.670506  6297 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:03.675004  6322 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:16:03.682708  6935 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
W20260709 13:16:03.723733  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 52404.6us
I20260709 13:16:03.726703  6322 raft_consensus.cc:1240] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:03.730567  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 82076.9us
W20260709 13:16:03.730897  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 46476.1us
I20260709 13:16:03.733503  6371 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:03.738976  6405 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:03.740252  6905 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:03.621017 10711 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:03.743675  6906 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:03.679335 11092 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:03.750772  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:03.748358  6371 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:03.751475  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 119561us
I20260709 13:16:03.722952 10908 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:03.751112  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.766631  6400 raft_consensus.cc:1240] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:03.769882 10835 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:03.773329  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.743450 11095 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:03.601883 11057 consensus_queue.cc:237] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:03.778436  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.780995  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:03.781050  6247 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:16:03.784768 11027 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:03.621665 10826 consensus_queue.cc:260] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.736204 10862 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:16:03.741384 10605 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.794296  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.772759  6331 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
I20260709 13:16:03.767026 10908 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.794981  6248 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:03.743861 10564 consensus_queue.cc:1059] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:16:03.774026 10339 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:03.792122  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:03.799940  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.800787  6906 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:03.789589 10835 raft_consensus.cc:697] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:03.746436 10636 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.814414  6247 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
W20260709 13:16:03.817281  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.799950 10908 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.822391  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:03.811414 11095 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.823884 10565 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:16:03.824103 11095 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.825169 10961 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
I20260709 13:16:03.811314 11092 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:03.826192 10961 raft_consensus.cc:3055] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:03.826642 11095 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:03.826399 11092 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.827302 11091 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.827592 10813 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.827889 10954 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:03.828450 10766 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:03.828233 10813 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:03.829018 10766 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.830399 10813 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:16:03.830941 10494 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:03.831638 10494 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:03.832033 10494 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:03.832597 11099 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.284s	user 0.002s	sys 0.000s
I20260709 13:16:03.819550  6400 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:03.799875 11027 raft_consensus.cc:697] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:03.847829 10964 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:03.824126 11102 log.cc:927] Time spent T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:16:03.835952 10711 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:03.849452  6405 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:03.850239 10711 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.851333 10954 raft_consensus.cc:697] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:03.852331 10954 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.852813 10711 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.849426 10813 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.862974  6399 raft_consensus.cc:2368] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 9. Current term is 10.
W20260709 13:16:03.865546  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 70495.2us
I20260709 13:16:03.817463 10612 consensus_queue.cc:1059] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:16:03.831189 10713 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:03.826665 10961 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:16:03.868347  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.886308  6248 raft_consensus.cc:1240] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:03.889904  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:03.897317 10766 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.897461 11107 raft_consensus.cc:3055] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:03.898052 11107 raft_consensus.cc:740] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:03.899026 11107 consensus_queue.cc:260] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:03.902720 11097 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.366s	user 0.000s	sys 0.002s
I20260709 13:16:03.902267 10835 consensus_queue.cc:237] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:03.908380 11100 log.cc:927] Time spent T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.379s	user 0.000s	sys 0.003s
I20260709 13:16:03.909952 11027 consensus_queue.cc:237] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.841053 10339 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:03.915441 10339 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:03.916823  6398 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:03.918022  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:03.919509  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:03.920233  6252 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:03.920615  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:03.921985  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:03.924786 10813 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.925803 10605 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.927263 10813 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.930604 10713 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:03.931075 10713 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.931783  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.877200 10963 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:03.934262 10963 raft_consensus.cc:697] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:03.909772 10961 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:03.890583  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.935607  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:03.916630  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:03.942880  6399 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.945660  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:03.947985 11045 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:03.948982  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:03.949285  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.949666  6405 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:03.950409  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.950578  6397 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:03.951490  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.951838  6401 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:03.950436  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:03.944972  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.958500  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:03.959492  6405 raft_consensus.cc:2410] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:03.960825  6252 raft_consensus.cc:2393] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:03.961715  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.962262  6397 raft_consensus.cc:1275] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:16:03.962814  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 186298us
I20260709 13:16:03.963717  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.959904  6255 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:03.966502  6402 raft_consensus.cc:1275] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:03.966830  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:03.927371 10636 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:03.967628  6400 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:03.967365  6398 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:03.971148  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:03.971326  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:03.971742  6403 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
W20260709 13:16:03.974836  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 180079us
I20260709 13:16:03.982946  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:03.983086  6251 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:16:03.983618  6937 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:03.986546  6297 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:16:03.988567  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 218973us
I20260709 13:16:03.990211  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:04.008883  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:03.952862 10934 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.011067  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:04.014200  6255 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:16:04.010279  6400 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:16:04.022225  6254 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:03.957682 11054 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.011284 10564 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:04.032621  6251 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:04.038061  6252 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:04.041056  6295 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:03.974574 10494 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:04.031728 10660 consensus_meta.cc:287] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 13:16:04.027882 10961 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:04.060698  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:16:04.061329  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 224350us
I20260709 13:16:04.066808  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:04.013698 11091 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:16:04.069077  6405 raft_consensus.cc:2393] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:04.069720  6907 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:04.071837  6255 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:04.074551 10494 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:04.077252  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.101210  6369 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:04.056895 10564 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.105804 10564 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:04.082336  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:04.109543  6403 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:04.010888 11017 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.112921 11017 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:04.085422  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:04.113847  6400 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.117504  6253 raft_consensus.cc:2393] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:04.087035  6402 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:04.087461 10660 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:04.089241 11095 raft_consensus.cc:3055] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:16:04.089582 11096 log.cc:927] Time spent T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.586s	user 0.001s	sys 0.003s
I20260709 13:16:04.118676 11095 raft_consensus.cc:740] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:04.119169  6256 raft_consensus.cc:2393] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 12: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:16:04.091943 11016 consensus_meta.cc:287] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.557s	user 0.003s	sys 0.006s
W20260709 13:16:04.095249  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.119674 11095 consensus_queue.cc:260] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:04.097700  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.974764 10963 consensus_queue.cc:237] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.120875 11095 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:04.102700  6401 raft_consensus.cc:2410] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:04.104741  6369 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:04.124671  6369 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:04.120008 10660 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:04.128121  6251 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:04.126559 10957 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:04.131398  6398 raft_consensus.cc:2410] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:16:04.132797  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:04.126616 11045 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:04.139261  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:04.141367  6398 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 10: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:16:04.135872 10878 consensus_meta.cc:287] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.002s
W20260709 13:16:04.147044  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 292476us
I20260709 13:16:04.129663 11016 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:04.145224  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 75565.7us
W20260709 13:16:04.146492  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 328989us
I20260709 13:16:04.148069  6907 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:04.149633  6250 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:04.149786  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:04.150591  6405 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:04.133656 10957 raft_consensus.cc:697] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:04.157778  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:04.166178  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:04.161499 10712 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:16:04.170852  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:04.157687 11062 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:04.176131  6399 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:04.174542  6405 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
W20260709 13:16:04.179492  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.183133  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:04.185061  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1802) took 2624 ms. Trace:
I20260709 13:16:04.150362 11016 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.187422  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:04.188642  6398 raft_consensus.cc:2410] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:16:04.189006  6368 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:04.152382 11027 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:04.185572  6250 rpcz_store.cc:276] 0709 13:16:01.552303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.566379 (+ 14076us) service_pool.cc:224] Handling call
0709 13:16:01.566679 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.177006 (+1610327us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b1800244920. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575c20646 00007f4575b5a58e 00007f4575bdbf9e 00007f4575bdd7de 00007f4575be7b49 00007f4575be8416 00007f4575be4d8f 00007f4575be483e 00007f457aba9419 00007f4574120bd4
0709 13:16:03.659257 (+482251us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b58006e84d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575b410aa 00007f4575bc3447 00007f4575bdbfe7 00007f4575bdd7de 00007f4575be7b49 00007f4575be8416 00007f4575be4d8f 00007f4575be483e 00007f457aba9419 00007f4574120bd4
0709 13:16:04.150090 (+490833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.176711 (+ 26621us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1045479552}
I20260709 13:16:04.197881  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:04.201391  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:04.203306  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:04.204001  6933 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:04.206244  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:04.209812  6399 raft_consensus.cc:1240] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:04.211436 10867 consensus_queue.cc:1059] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:04.211710  6399 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:04.212428 10867 raft_consensus.cc:3055] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:04.212831 10867 raft_consensus.cc:740] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:04.213651 10867 consensus_queue.cc:260] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.214130 11027 raft_consensus.cc:697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:04.214598 10867 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:04.215077 11027 consensus_queue.cc:237] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.218115 11114 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:04.218895 11114 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:04.219748 11115 consensus_queue.cc:1059] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:16:04.220732 11115 raft_consensus.cc:3055] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:04.221074 11115 raft_consensus.cc:740] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:04.221930 11115 consensus_queue.cc:260] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:04.223213 11115 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.223272 10826 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.184336 10618 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.237469 10618 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:04.240262 10618 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:04.180598 11092 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:04.242789 11054 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:04.243768 10494 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:04.245229 10934 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:04.186269 11091 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:16:04.196116 11016 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:04.259392  6400 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 7.
W20260709 13:16:04.265172  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 68719.6us
I20260709 13:16:04.268162  6221 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:04.263944 11054 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:04.264796 10618 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 13:16:04.285398  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 96537.7us
I20260709 13:16:04.249015 10713 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.302708  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:04.294626  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:04.267220 11051 consensus_queue.cc:1059] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:16:04.310825  6327 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:04.281515 11054 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:04.314994  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:04.287144 11091 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:04.325814  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.313062  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:04.276896 10862 consensus_queue.cc:1048] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:16:04.237488 10957 consensus_queue.cc:237] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.344452  6222 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
W20260709 13:16:04.355201  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 295750us
I20260709 13:16:04.356389  6295 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:04.341516 11054 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:04.363102 10934 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:04.363570  6295 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:04.363790 10934 raft_consensus.cc:697] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:04.364705  6295 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:04.365479 11092 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:04.365967 11092 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.366396 11092 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:04.374720  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 58110.9us
I20260709 13:16:04.373965  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:04.380630  6327 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:04.383394  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.365057 10934 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.430624  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:04.431205 10713 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:04.433086  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 370417us
I20260709 13:16:04.441426  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:04.444253  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:04.359218 10660 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:04.446419  6368 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:04.442200  6252 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
W20260709 13:16:04.448444  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 263255us
I20260709 13:16:04.346060 10908 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.444805 11095 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:04.445601 11016 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:04.359298 11091 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:04.513199 10878 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:04.513815 10908 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:04.515858  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 69539us
I20260709 13:16:04.572209  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:04.455960 11062 raft_consensus.cc:3055] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:04.572592  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:04.450306 10660 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:04.573916  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 297804us
I20260709 13:16:04.576274  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:04.567745  6327 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:04.608423  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:04.614609  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:04.615556  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:04.615614  6399 raft_consensus.cc:2410] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:04.618745  6938 raft_consensus.cc:2368] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
I20260709 13:16:04.529908 11095 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:04.634105  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:04.672082 11095 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:04.672351  6400 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:04.447206 10835 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.159s
I20260709 13:16:04.529183 10878 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:04.609241 10660 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:04.674969 10878 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:04.492020 10564 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.679016 10564 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:04.597064 10713 consensus_queue.cc:1059] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:16:04.609553 10676 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:04.680557 11016 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:04.683969 11121 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.684495 11121 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.687922 11091 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:04.601415 11046 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:04.581573 11062 raft_consensus.cc:740] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:16:04.704983 10961 consensus_meta.cc:287] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 13:16:04.718755 11046 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:04.739167  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 223724us
I20260709 13:16:04.689569 10878 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.708609 11092 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:04.770891 11046 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:04.734858 10564 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:16:04.794806  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.770071 11091 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:16:04.801628  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:04.803831  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:04.809314  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:04.810201  6400 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:16:04.812664  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:04.813153  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:04.810700  6400 pending_rounds.cc:85] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 9
W20260709 13:16:04.802552 10826 consensus_meta.cc:287] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.000s
I20260709 13:16:04.815340  6400 pending_rounds.cc:107] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:16:04.815622  6400 raft_consensus.cc:2889] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:04.824024  6396 raft_consensus.cc:2410] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:16:04.825423  6296 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:04.824345  6905 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:04.814761 10835 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.822106 11148 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:16:04.833992 11148 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:04.834475 11148 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.791924 11062 consensus_queue.cc:260] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.818287 11014 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:16:04.862722 11134 log.cc:927] Time spent T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:16:04.862973 10867 consensus_meta.cc:287] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.003s
I20260709 13:16:04.864574 11014 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:04.866633 11144 log.cc:927] Time spent T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:16:04.822499 11133 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:04.856353 11027 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:16:04.937580  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.955945  6322 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.019s	sys 0.002s
W20260709 13:16:04.873271 11126 log.cc:927] Time spent T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
W20260709 13:16:04.956401  6322 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.019s	sys 0.002s
W20260709 13:16:04.961786  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 136425us
I20260709 13:16:04.962815  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:04.876576 11062 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:04.850634 10835 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.877611 11121 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:04.956666 11016 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.956666 11120 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:04.980414 10564 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:04.970160 10867 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.994154 11016 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:04.994597 10867 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:04.996363 11016 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:04.841542 11057 consensus_queue.cc:1175] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" responder_term: 9 status { last_received { term: 9 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 9 index: 8 } }
I20260709 13:16:04.986651 11121 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:04.986908 11152 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:16:04.987884 11141 log.cc:927] Time spent T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:16:04.974152 11092 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:04.972775 11154 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:16:04.974413 10807 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:04.968590 11133 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:05.014391  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:16:05.015280  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.023900  6296 leader_election.cc:400] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 9. Current term is 10.
I20260709 13:16:05.024497  6296 leader_election.cc:403] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:05.025207 11156 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:05.027083  6941 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:05.027595 10835 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.007869 11121 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.030722 11121 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:05.010347 10807 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:05.033118 10807 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:05.033737  6935 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:05.035001  6937 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:05.008316 11152 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.037321  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:05.039042  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:05.039654  6935 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:16:05.040475 11152 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:05.044071 11095 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:05.046527 10867 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:05.017213 11014 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:04.993508 11120 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.055948 11120 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:05.057343 10813 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:05.009018 10878 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.058881 10878 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:05.070495 11054 consensus_meta.cc:287] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.003s
I20260709 13:16:05.070994 11054 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:05.073907 11149 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:05.076032 11133 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:05.086673  6253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2585) took 1637 ms (client timeout 2080 ms). Trace:
W20260709 13:16:05.087158  6253 rpcz_store.cc:269] 0709 13:16:03.448822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.466083 (+ 17261us) service_pool.cc:224] Handling call
0709 13:16:05.086416 (+1620333us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54001478d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:05.086604 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495713664}
I20260709 13:16:05.090212  6247 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:05.091807 11115 consensus_meta.cc:287] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.868s	user 0.007s	sys 0.003s
I20260709 13:16:05.092993  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:05.094578 11046 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:05.096060  6250 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:05.099823  6371 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:05.101001 11016 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:05.101419 11016 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.101783 11016 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:05.103681  6941 raft_consensus.cc:1240] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:05.105337 11054 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.052300 10660 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.107897 10660 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.108657 11156 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 9. Current term is 10.
W20260709 13:16:05.108853  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 99208.8us
I20260709 13:16:05.109157  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:05.109683 11154 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:05.110189 11154 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:05.112329 11154 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:05.112375 11121 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:05.109714  6296 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:05.113081 11121 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.114033 11133 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:05.114524 11133 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:05.115012 11133 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:05.117347 11121 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:05.118587 11095 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:05.114049  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:05.114302 11054 consensus_queue.cc:1059] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:05.122848  6296 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:05.137110  6297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.042s	sys 0.074s
W20260709 13:16:05.137614  6297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.042s	sys 0.074s
I20260709 13:16:05.121592 11046 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:05.138278 10807 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.143733 10807 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:05.145947 10807 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:05.135236 10612 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:05.147267  6296 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:05.150148  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.150723  6322 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:05.151319  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:05.151917  6941 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:05.139032 11115 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:16:05.154938  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.152024 10612 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:05.156369  6250 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:05.156639  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:05.155325  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:05.159569  6297 leader_election.cc:400] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
I20260709 13:16:05.160197  6297 leader_election.cc:403] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:16:05.161312  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.162194  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.162843  6938 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:05.156400 10612 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.153566 11154 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:16:05.182509 11107 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:05.179455 11133 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.327543  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2388) took 1411 ms. Trace:
I20260709 13:16:05.327953  6396 rpcz_store.cc:276] 0709 13:16:03.916013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.921652 (+  5639us) service_pool.cc:224] Handling call
0709 13:16:05.327297 (+1405645us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b540044f7d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:05.327475 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068987264}
I20260709 13:16:05.406616 11117 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.407426  6219 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:05.407253 11117 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.410913 11117 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.411628 11117 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:05.422341 11148 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.172806 10612 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:05.440701  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.441606  6325 raft_consensus.cc:2368] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12.
I20260709 13:16:05.448518 10612 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:05.450838 10612 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:16:05.459618 10612 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:05.460155 10612 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.462741 10612 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.465482  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:05.466048  6328 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:05.466658  6941 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:05.470683  6328 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:05.170253 11016 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.473060 10612 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:05.473431 11016 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.473709 10612 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.476805 10612 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.477439 10961 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.477897 10961 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.479805 10961 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:05.490962 11157 log.cc:927] Time spent T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.494s	user 0.000s	sys 0.003s
W20260709 13:16:05.497566  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.498242 10878 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.498728 10878 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.499481 11016 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:05.501381 11016 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.503482 10878 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.504935 11016 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.507606  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2944) took 1218 ms. Trace:
I20260709 13:16:05.507989  6324 rpcz_store.cc:276] 0709 13:16:04.289603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.340409 (+ 50806us) service_pool.cc:224] Handling call
0709 13:16:04.349257 (+  8848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.349441 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:04.615202 (+265761us) log.cc:844] Serialized 14 byte log entry
0709 13:16:05.507174 (+891972us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b18003220c0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f457578d4bc 00007f4572adb48b 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af5455 00007f4575bdd060 00007f4575bef716 00007f4575c00287
0709 13:16:05.507272 (+    98us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:05.507322 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:05.507364 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.507427 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:05.507513 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11748,"prepare.queue_time_us":459705,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":1881,"raft.queue_time_us":165025,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3471,"spinlock_wait_cycles":7394560,"thread_start_us":377587,"threads_started":2}
I20260709 13:16:05.511555 11117 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:05.512141 11117 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.514815 11117 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.512398  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2593) took 1134 ms. Trace:
I20260709 13:16:05.515318  6251 rpcz_store.cc:276] 0709 13:16:04.378073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.378177 (+   104us) service_pool.cc:224] Handling call
0709 13:16:04.445486 (+ 67309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:04.476488 (+ 31002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:04.476528 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:04.477045 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:16:04.817985 (+340940us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:04.818031 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.818536 (+   505us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:05.490394 (+671858us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:16:05.512085 (+ 21691us) raft_consensus.cc:1685] finished
0709 13:16:05.512099 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:05.512335 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120373,"raft.queue_time_us":9099,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":14608,"spinlock_wait_cycles":5197568,"thread_start_us":206955,"threads_started":1,"wal-append.queue_time_us":451701}
I20260709 13:16:05.606726 11153 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.607358 11153 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:05.608613  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.609014 10878 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.610241 10878 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:05.612855 10878 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:05.609447 11016 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.621608 11016 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.624653 11016 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.633526 11153 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:05.634419  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.635007 10676 raft_consensus.cc:3055] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:05.636315 10676 raft_consensus.cc:740] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:05.637976  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:05.638375 11117 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:05.638561 11133 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.638597  6938 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:05.639132 11117 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:05.639945  6933 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:05.639883 10676 consensus_queue.cc:260] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.640988 10676 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:05.641120 11117 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:05.642175  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:05.648648  6941 raft_consensus.cc:2393] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 15: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:05.642683  6937 raft_consensus.cc:1240] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:05.641942  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:05.650739 10676 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:05.642719  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:05.656200  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.660084  6938 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:05.663085  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:05.663658  6251 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:05.663800  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:05.666373  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.668123  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:05.673920  6256 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:05.674194  6255 raft_consensus.cc:1217] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Deduplicated request from leader. Original: 8.9->[10.10-10.10]   Dedup: 10.10->[]
I20260709 13:16:05.674700  6255 raft_consensus.cc:1240] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:16:05.668799  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:05.677453  6254 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:16:05.669518  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:05.680879  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:05.681504  6253 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:05.681584 10676 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.682200 10676 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.683869  6219 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:05.684943  6219 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:05.685158 10676 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.685703 10807 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:05.686045 11133 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:05.686352 10807 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:05.686851 10807 raft_consensus.cc:697] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:05.686538 11133 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.687739 10807 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:05.688656 11133 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.689316 11153 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.689857 11153 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.691949 11153 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.692432 11153 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.693519  6141 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 19435892007a4e0a9b2b4d0b26ccd0c0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8600a3fead0e48a7aa813822ec44d0fe is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:05.693616 11153 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:05.698804 10713 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.699362 10713 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.702443 10957 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:05.703001 10957 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.705078 10957 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:05.705281 10494 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:05.712414  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.713354 10494 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:05.714859  6935 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.005s	sys 0.000s
W20260709 13:16:05.715170  6935 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.006s	sys 0.000s
I20260709 13:16:05.717037  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 901) took 2149 ms. Trace:
I20260709 13:16:05.717509  6247 rpcz_store.cc:276] 0709 13:16:03.567713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.912445 (+344732us) service_pool.cc:224] Handling call
0709 13:16:05.090045 (+1177600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.090628 (+   583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.716802 (+626174us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54001478d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:05.716969 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2707331328}
I20260709 13:16:05.707552 10713 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:05.721275  6249 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:05.721763 11016 consensus_queue.cc:1059] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:05.722950 10878 raft_consensus.cc:3055] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:16:05.707685  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.723238 10711 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.723323 10878 raft_consensus.cc:740] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:05.724275 10813 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.723996 10711 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.724534 10878 consensus_queue.cc:260] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:05.724777 10813 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.725840 10878 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:05.726889 10813 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.728356 10711 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.729902  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.730669  6328 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:05.731319 10676 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:05.731840 10676 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.734562 10676 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.695799 11153 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:05.743240  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:05.743867  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:05.743925  6942 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:05.747143  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:16:05.747923 11107 consensus_meta.cc:287] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.565s	user 0.014s	sys 0.000s
I20260709 13:16:05.751346 11152 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:05.751958 11152 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.752900  6256 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:05.754212 11152 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:05.755751  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1826) took 1832 ms. Trace:
I20260709 13:16:05.756171  6255 rpcz_store.cc:276] 0709 13:16:03.923748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.094276 (+170528us) service_pool.cc:224] Handling call
0709 13:16:04.134817 (+ 40541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.674119 (+1539302us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b54004261a0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575b5cdc0 00007f4575be71c0 00007f4575be8231 00007f4575be4d8f 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c
0709 13:16:05.674994 (+   875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.755516 (+ 80522us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b5400410ad4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:05.755693 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085562368}
W20260709 13:16:05.757917  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 599184us
I20260709 13:16:05.760193 11114 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
I20260709 13:16:05.760892 11114 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.761343 11114 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:05.761881  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 67346.8us
I20260709 13:16:05.763324 11114 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:05.770812  6297 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:05.771631 11092 consensus_queue.cc:1059] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:05.772310  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:05.772675 11114 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:05.772922  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:05.771733  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:05.773932 10878 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:05.773969 11114 raft_consensus.cc:697] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:05.774112  6938 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:05.775259 11114 consensus_queue.cc:237] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.776521  6938 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:05.777572  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:05.778726  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:05.771889  6369 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:05.781221 11119 log.cc:927] Time spent T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 1.407s	user 0.004s	sys 0.010s
I20260709 13:16:05.781323 11153 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:05.781770 11153 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.782143 11153 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:05.715411 10494 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:05.773877 10908 raft_consensus.cc:3055] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:05.795495 10908 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:05.796413 10908 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.794099 10878 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.797628 10908 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:05.799626 10813 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:05.805044  6295 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:05.806461 11107 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:05.807889 11107 consensus_queue.cc:1059] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:05.808796  6295 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:05.809734  6369 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:05.813472  6369 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:05.813477  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:05.817327  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 55643.6us
I20260709 13:16:05.819308  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:05.823267  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:05.824191  6940 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:05.832193  6938 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:05.670302  6251 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
W20260709 13:16:05.809264  6221 connection.cc:256] RPC call timeout handler was delayed by -1.1106486090000089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
I20260709 13:16:05.843840  6933 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:05.845578  6906 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:05.846563 10807 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.847476 11143 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:05.868958  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.873310  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:05.869797  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:05.874017  6330 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:05.869517  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:05.874622  6401 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:16:05.874938  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:05.871344  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:05.873616  6327 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:05.876138  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:05.876694  6402 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:05.879105  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:05.875494  6396 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:05.883910  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:05.840946 10676 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:05.883561  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.888152  6222 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:05.889150 11183 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:05.891820  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:05.892423  6933 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:05.893334  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:05.856771 11148 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:05.888876 11114 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:05.896883  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.899152  6327 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:16:05.872529 11051 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:05.869454 11107 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:05.905090  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.906098  6328 raft_consensus.cc:2393] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 10: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:05.842515 10813 consensus_queue.cc:1059] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:16:05.873188 10711 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:05.909595 11148 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:05.912614  6323 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:05.894764 10676 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.913388  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.954420  6325 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:05.913679  6326 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:16:05.914217  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.918007  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:05.956470  6327 raft_consensus.cc:2368] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11.
I20260709 13:16:05.920439 11153 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:05.925757 10633 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:16:05.964243  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 94302.9us
I20260709 13:16:05.884514 11143 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.927464 10878 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:05.913266  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:05.871551  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 58141.8us
I20260709 13:16:05.972642  6331 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:05.880568 11177 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:05.947299  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:05.977720  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:05.978188  6401 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:05.978314  6326 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:05.946960 11107 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.895062 11183 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.948050  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:05.979408  6323 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:05.961781  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 270072us
I20260709 13:16:05.964717  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:05.980506  6251 raft_consensus.cc:2410] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:16:05.874141 11121 consensus_queue.cc:1059] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:16:05.986143  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:05.967803  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:05.987269  6249 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:05.987638  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:05.988348  6252 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:05.969626  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:05.989439  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.989535  6328 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:05.989974  6327 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:05.990549  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.991298  6328 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:05.992538  6328 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:05.970310  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:05.973493  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.973093  6369 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:05.993753  6329 raft_consensus.cc:2410] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:05.996380  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:05.987003  6404 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 8.
I20260709 13:16:05.997311  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:05.998368  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.996307  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:05.957650 10676 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:06.003818  6369 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:06.005864  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:06.006508  6327 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:06.009486  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:05.990773 11183 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:05.977460 10633 raft_consensus.cc:697] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:06.014038 10633 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:05.966301 10711 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:06.018677 10711 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:06.018740 11143 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:06.020725  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:06.020505 11177 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:06.022852 11177 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:06.024290  6253 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:06.024940  6254 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:06.025764  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:06.026896  6328 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:05.887378 10807 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.026314  6398 raft_consensus.cc:2376] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10. Re-sending same reply.
I20260709 13:16:06.035902  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.031383  6323 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:06.031977  6326 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:06.036613  6398 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:06.033511  6402 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:16:06.034147  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.038516  6331 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:06.038851  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.026069  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.040278  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.040927  6402 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:16:06.035672  6330 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:16:06.050657  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:06.051433  6251 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:06.052075  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.053609  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:05.977454 10494 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:06.067962  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.054006  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.054204  6326 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:06.054481  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.054895  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.049976  6402 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:06.072889  6323 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:06.074023  6402 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:06.082633  6325 raft_consensus.cc:1240] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:06.082865  6248 raft_consensus.cc:2393] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:06.072203  6250 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:16:06.071287  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.083998  6403 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:16:06.084529  6253 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
I20260709 13:16:06.068863  6328 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:16:06.087612  6249 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:06.089830  6252 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:05.969655 11148 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:06.101033  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.091363  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.102360  6252 raft_consensus.cc:2393] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 15: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:06.060922  6327 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:06.102500  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.103926  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.104696  6326 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:16:06.106195  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.107013  6323 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:06.113235  6221 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:06.115779  6331 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:06.119411  6328 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:16:06.119522  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 241895us
I20260709 13:16:06.121232  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.121372  6252 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:06.127267  6253 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:06.139844  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.121833  6249 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:16:06.151052  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.151839  6328 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
W20260709 13:16:06.144956  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 164492us
I20260709 13:16:06.086668 10813 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:06.147068  6327 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:06.155630  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.156638  6325 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:16:06.156720  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 43580.5us
I20260709 13:16:06.160655  6323 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:16:06.162801  6251 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:06.166611  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.167410  6404 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:06.170892  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.171986  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.173282  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.173606  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.174109  6323 raft_consensus.cc:2368] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12.
I20260709 13:16:06.141312 11176 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.171490  6253 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:06.175098  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.175009  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.089819 10494 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.173339  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.195307  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:06.207348  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.213369  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.214078  6323 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
W20260709 13:16:06.216461  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 48824.6us
I20260709 13:16:06.221617  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.222422  6327 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:06.174492 11188 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:06.229687  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.235095  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.236085  6323 raft_consensus.cc:2410] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:16:06.195883 10961 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:16:06.213783 11191 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:06.252594  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.239126  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.252456  6404 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:16:06.253346  6404 pending_rounds.cc:85] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 9
I20260709 13:16:06.253602  6404 pending_rounds.cc:107] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:16:06.253856  6404 raft_consensus.cc:2889] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:06.175091 10964 consensus_queue.cc:1059] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:16:06.253441  6251 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:06.226605 11177 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:06.262799  6905 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:06.266856  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.267453  6328 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:06.268160  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.270265  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.271124  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.271693  6251 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:06.272466  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:06.274371  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 54867.7us
I20260709 13:16:06.266382  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.278035  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:06.279063  6328 raft_consensus.cc:2368] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11.
I20260709 13:16:06.285722  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.290122  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.290343  6252 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:16:06.290673  6252 pending_rounds.cc:85] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 9
I20260709 13:16:06.290887  6252 pending_rounds.cc:107] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:16:06.291115  6252 raft_consensus.cc:2889] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:06.298951  6324 raft_consensus.cc:2393] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:06.204409 11176 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.236135 11121 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:16:06.303745  6405 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
W20260709 13:16:06.297760 11180 log.cc:927] Time spent T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 13:16:06.288553 11153 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:16:06.280444 10813 raft_consensus.cc:697] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:06.315958  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:06.319948  6185 debug-util.cc:398] Leaking SignalData structure 0x7b0800354ea0 after lost signal to thread 5115
W20260709 13:16:06.321095  6185 debug-util.cc:398] Leaking SignalData structure 0x7b08000f9d20 after lost signal to thread 6188
W20260709 13:16:06.322467  6185 debug-util.cc:398] Leaking SignalData structure 0x7b0800039960 after lost signal to thread 6280
W20260709 13:16:06.323604  6185 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad820 after lost signal to thread 6355
W20260709 13:16:06.324720  6185 debug-util.cc:398] Leaking SignalData structure 0x7b08003511c0 after lost signal to thread 6429
I20260709 13:16:06.326941  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:06.328393 11183 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:06.329689 11200 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:16:06.330508  6185 debug-util.cc:398] Leaking SignalData structure 0x7b080038b040 after lost signal to thread 6966
I20260709 13:16:06.331127 10807 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:06.335101 11107 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:06.335355 10494 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:06.265697 11191 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.314096 10964 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:06.303866 11177 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:16:06.342828 10957 raft_consensus.cc:3055] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:06.346611  6254 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:06.351482  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:06.352030  6185 debug-util.cc:398] Leaking SignalData structure 0x7b080035ed40 after lost signal to thread 6967
I20260709 13:16:06.409901  6326 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:16:06.367702  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 246943us
W20260709 13:16:06.368552  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 203436us
I20260709 13:16:06.370105 10612 raft_consensus.cc:3055] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:06.370801 10713 raft_consensus.cc:3055] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:16:06.369699  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 106997us
I20260709 13:16:06.384228 11187 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:06.410966 10713 raft_consensus.cc:740] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:06.411101  6221 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:06.411226 11187 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.411895 10713 consensus_queue.cc:260] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.412375 11184 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:06.412919 10713 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:06.413584 11187 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:06.386094 11148 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:06.386669 11107 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.414281  6221 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:06.414623 11107 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.415256 11184 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:06.415753 11184 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:06.416275 11184 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:06.420163 11187 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:06.387988 10878 raft_consensus.cc:3055] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:06.421414 10878 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:06.422613 10878 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:06.423859 10878 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:06.424302  6221 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:06.390412  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.425478  6331 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:06.391307 10862 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.427096 10862 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.427894 11216 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:06.430117 10862 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:06.416831 11107 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:06.431100  6905 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:06.437345  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:06.437939  6940 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
W20260709 13:16:06.440083 11206 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:16:06.400923 10964 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:16:06.440907  6185 debug-util.cc:398] Leaking SignalData structure 0x7b08003bc3c0 after lost signal to thread 10605
W20260709 13:16:06.441283  6185 debug-util.cc:398] Leaking SignalData structure 0x7b08003da8c0 after lost signal to thread 10618
I20260709 13:16:06.441591  6404 raft_consensus.cc:1240] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:06.441740  6185 debug-util.cc:398] Leaking SignalData structure 0x7b08002917c0 after lost signal to thread 10929
W20260709 13:16:06.442188  6185 debug-util.cc:398] Leaking SignalData structure 0x7b080034fc80 after lost signal to thread 11017
W20260709 13:16:06.442401  6185 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9760 after lost signal to thread 11019
I20260709 13:16:06.442620 10964 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:06.442767  6371 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:06.443243  6185 debug-util.cc:398] Leaking SignalData structure 0x7b08002c25a0 after lost signal to thread 11136
W20260709 13:16:06.444564  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.445489  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.446175 11207 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:06.446697 11207 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.447089 11207 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:06.449558  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:06.450287  6327 raft_consensus.cc:2376] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10. Re-sending same reply.
I20260709 13:16:06.408891 10957 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:16:06.454572 11226 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:06.401978  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:06.465027  6322 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:06.404505  6398 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:06.393504  6219 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:06.410342  6369 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:06.420688 11187 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.426395  6221 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:06.459367 10957 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.461366  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:06.474785  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 43749us
I20260709 13:16:06.475719  6905 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:06.476365  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 50027.5us
I20260709 13:16:06.462040  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.463923  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:06.454041 10813 consensus_queue.cc:237] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.477909  6221 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:06.478166  6404 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.466748  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.406656  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:06.467375  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 57098.6us
I20260709 13:16:06.461426  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.479038  6933 raft_consensus.cc:2410] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:06.479018  6369 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:06.479367  6331 raft_consensus.cc:2410] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:16:06.479761  6398 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:06.480897  6397 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:16:06.481559  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 88132.3us
I20260709 13:16:06.481748  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.481951  6250 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:06.481259  6369 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:06.484020  6905 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:06.486357  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.487905  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:06.489410  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:06.490025  6221 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:06.490670  6369 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:06.491322  6221 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:06.360782 11188 raft_consensus.cc:697] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:06.495122  6396 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:06.494495  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.500885  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.494184  6219 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:06.506884  6326 raft_consensus.cc:2376] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12. Re-sending same reply.
I20260709 13:16:06.500555 11218 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:06.503535 11120 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:06.503844  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:06.509645 11120 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.510006  6933 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:06.509361 11218 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:06.497550 10964 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.511282 11218 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:06.513239 10964 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:06.510084 11120 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:06.461621 10612 raft_consensus.cc:740] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:06.480404 11215 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:06.526368  6256 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:06.526324  6297 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:06.526580  6402 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:06.507071  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:06.530304  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.493005 11219 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.504524 11199 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:06.500877 10807 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:06.533018 10807 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:06.533468 10807 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:06.533802 10396 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:16:06.525835 11152 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:16:06.536325 10961 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:06.537226 10633 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:06.537766 10633 raft_consensus.cc:697] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:06.537858 11148 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:06.538355 11191 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:06.538374 11148 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.538945 11148 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:06.538702 10633 consensus_queue.cc:237] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:06.541496  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.541299 11207 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.544085 11207 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:06.506115 11016 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.546926 11183 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:06.525066 10957 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:06.533674  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:06.548765  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:06.549266  6396 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:06.554538 11187 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:06.555614  6398 raft_consensus.cc:2368] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
I20260709 13:16:06.556378  6404 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
W20260709 13:16:06.556926  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 62797.2us
I20260709 13:16:06.557852  6396 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:06.558355  6255 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:06.558849  6219 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:16:06.580905  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 43577.8us
I20260709 13:16:06.581297  6397 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:16:06.574097  6221 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:06.584105  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.586418 11176 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:06.586341 10807 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:06.523485 10494 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:06.590437  6221 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:06.527622 11216 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.480439 11184 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.493075 11221 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:06.599107 11221 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:06.599536 11221 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:06.587900  6905 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:06.555266 11215 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:06.569669 11114 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:06.571668 10862 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:06.604527  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:06.607378  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:06.590437  6296 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:06.609476  6256 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:06.611886  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:06.614676  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.616767  6330 raft_consensus.cc:1240] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:06.617228  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:06.617425  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:06.617769  6331 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:06.619849  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.622017  6399 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:06.597267 11117 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:06.589725 10494 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:06.597841 11107 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.641673 11107 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:06.615175  6397 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:06.597105 10711 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:06.627735  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.606678 11215 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:06.606760 10713 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:16:06.604889 10396 consensus_queue.cc:1059] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:16:06.609252 10862 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.624229 11057 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:06.625372  6219 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:06.645797  6935 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:06.651003  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.652706  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:06.654143  6331 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:06.734594  6327 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:06.654867  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.642546 10494 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:06.609570 11177 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:06.607889 11202 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:06.672205  6256 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:06.673543  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.628288 11117 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.674458  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.689284  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:06.593755 10963 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:16:06.629150 11189 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:06.717796  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 236972us
W20260709 13:16:06.721086  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 110833us
I20260709 13:16:06.605319 11188 consensus_queue.cc:237] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:06.722633  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:06.722992  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:06.727245  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:16:06.680194 11226 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:16:06.600841 11187 consensus_queue.cc:1059] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:16:06.738076  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 112781us
I20260709 13:16:06.739089  6368 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:06.753116  6327 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:06.613488 11114 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:06.826493  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.715235 11129 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.801597  6400 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:06.714970 10862 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:06.804935  6324 raft_consensus.cc:3060] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:06.807452  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:06.806376 11117 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:06.808844  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:06.740799 11057 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.813406  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:06.757962 11176 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:06.736562 11152 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:06.815760  6905 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:06.833109  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:06.827587 10964 consensus_queue.cc:1059] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:16:06.837996  6397 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:06.721398 11240 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:16:06.842736  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 187134us
I20260709 13:16:06.843838  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:06.690050 10612 consensus_queue.cc:260] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:06.868520  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 52826.4us
W20260709 13:16:06.870988  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.871310  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:06.889343  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:06.890132  6400 raft_consensus.cc:2393] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 11: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:06.877987  6296 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:06.891109  6403 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:06.924753  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.855672 11057 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:06.970033  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 162679us
I20260709 13:16:06.974922  6221 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:06.970454  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 123706us
I20260709 13:16:06.981868  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:06.893728 10676 consensus_meta.cc:287] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.841s	user 0.007s	sys 0.004s
W20260709 13:16:06.922363 11232 log.cc:927] Time spent T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
I20260709 13:16:06.985201  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:06.991364  6400 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 7.
W20260709 13:16:06.921893 11229 log.cc:927] Time spent T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:06.869237 11176 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.017580 11176 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:07.018844  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 209453us
I20260709 13:16:06.888903 10957 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:07.021435 10957 raft_consensus.cc:697] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:07.021328 10813 consensus_queue.cc:1059] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:07.022365 10813 raft_consensus.cc:3055] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:07.022775 10813 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:07.022456 10957 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.023612 10813 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.024785 10813 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:07.025266 10807 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:07.025816 11183 raft_consensus.cc:3055] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:07.026202 11183 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:16:07.026770  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 287729us
I20260709 13:16:07.027019 11183 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:07.027691 11120 consensus_meta.cc:287] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.000s
I20260709 13:16:07.000174 11177 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:16:06.984588 11224 log.cc:927] Time spent T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:16:06.978042 11202 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.027613  6368 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:06.994060  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 116910us
I20260709 13:16:07.068012  6296 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:06.890358 11152 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:07.029156 11246 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:07.021013  6371 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:07.015798 11239 log.cc:927] Time spent T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 13:16:07.042694  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 240649us
I20260709 13:16:06.986503 10612 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:06.983439 11092 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:07.084436  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 56938.9us
I20260709 13:16:07.101999  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:06.843288 11129 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:07.028234 11153 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:07.029801 11148 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.118711  6368 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:06.922091 11184 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:07.070098 11183 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.041867 11177 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:07.098135  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 77195.8us
I20260709 13:16:07.124822  6371 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:06.995311 10676 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:07.095459 11207 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:07.075270 11216 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:07.103495  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 127127us
I20260709 13:16:07.039932  6324 raft_consensus.cc:2468] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:07.082194 11189 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.095700  6296 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:07.041273 11120 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.100625 11107 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:07.128654  6368 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:07.139211  6368 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:07.140069 11219 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:07.140653 11219 raft_consensus.cc:697] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:07.140904 10961 raft_consensus.cc:3055] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:07.141360 10961 raft_consensus.cc:740] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:07.142271 10961 consensus_queue.cc:260] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.142306 11219 consensus_queue.cc:237] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.143903 10961 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:07.130613  6331 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:07.100889 11185 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:07.128927  6222 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:07.139326  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 43718.3us
I20260709 13:16:07.156711  6401 raft_consensus.cc:2368] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11.
I20260709 13:16:07.159281  6296 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:07.160306  6296 leader_election.cc:400] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
W20260709 13:16:07.131244  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 120535us
I20260709 13:16:07.130052 11231 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:07.162456  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:07.164922  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:07.131373 11216 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:07.162868  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1670) took 1243 ms. Trace:
I20260709 13:16:07.177888  6933 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 13:16:07.193858 11218 consensus_meta.cc:287] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.001s
I20260709 13:16:07.194366  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2807) took 1213 ms. Trace:
I20260709 13:16:07.194293 11218 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.194756  6401 rpcz_store.cc:276] 0709 13:16:05.980778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.980923 (+   145us) service_pool.cc:224] Handling call
0709 13:16:07.194151 (+1213228us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400385c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:07.194305 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2636358528}
I20260709 13:16:07.196385 11218 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:07.198184 10676 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:07.199147  6152 catalog_manager.cc:5697] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 8 to 10, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 10 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:06.800731  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:07.188791 11221 consensus_meta.cc:287] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 13:16:07.204378  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:07.207291  6397 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.188441  6329 rpcz_store.cc:276] 0709 13:16:05.919260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.029898 (+110638us) service_pool.cc:224] Handling call
0709 13:16:06.030292 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.030674 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.030712 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.051546 (+ 20834us) log.cc:844] Serialized 26 byte log entry
0709 13:16:06.566571 (+515025us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:06.566627 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.566714 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.162667 (+595953us) raft_consensus.cc:1685] finished
0709 13:16:07.162687 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.162812 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":57148,"thread_start_us":445211,"threads_started":1,"wal-append.queue_time_us":526016}
I20260709 13:16:07.205520 11221 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:07.205683 11191 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:07.211540 11191 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:07.172693  6296 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:07.211911 11191 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.212441 11133 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:07.212845 11133 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:07.213225 11133 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:07.213577 10494 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.215683 10494 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:07.200642 11120 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:07.138285 11092 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:07.133260 11188 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:07.218472 11129 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:07.221657 11247 log.cc:927] Time spent T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:16:07.206171  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:07.225508 10862 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:07.176676 10633 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:07.176914 11107 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:07.138362 10878 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:07.174431  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.231571  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 58970.3us
I20260709 13:16:07.229475  6252 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:07.220989 11133 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:07.265086  6397 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:07.231106 11114 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:07.229053 11117 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.167026 11207 consensus_queue.cc:1059] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 13:16:07.283492 10676 raft_consensus.cc:3055] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:07.283914 10676 raft_consensus.cc:740] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:07.284232 11152 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:07.286521  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 96138.3us
I20260709 13:16:07.221685 11216 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.290016  6368 leader_election.cc:400] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12.
I20260709 13:16:07.290443  6368 leader_election.cc:403] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:07.233211 11148 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:07.201800  6152 catalog_manager.cc:5697] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 8, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 8 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.301930  6368 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:07.167308 11227 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:07.189891 11231 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:07.229801 11107 raft_consensus.cc:697] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:07.232034 11177 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:07.307471 11223 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12.
I20260709 13:16:07.328297  6368 leader_election.cc:400] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11.
W20260709 13:16:07.333087  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 358226us
I20260709 13:16:07.335812  6221 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:07.307238 11207 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:16:07.328889 11231 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.324534 11227 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:07.340019  6368 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:07.325675  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 148102us
I20260709 13:16:07.337292  6221 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:07.330715 11188 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:07.347723  6368 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:07.350683  6368 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:07.339337 11202 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:07.355166  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:07.355769  6328 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:07.358564  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:07.359154  6330 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.359894  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:07.360839  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:07.361555  6322 raft_consensus.cc:2393] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 11: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:07.366581  6933 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:07.346905 11184 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:07.344856 11227 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:07.371464  6368 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:07.348083 11219 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.375650  6251 raft_consensus.cc:1240] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:07.382607  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:07.375240  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:07.385911  6256 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:07.392275  6252 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.398687 11188 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:07.387708 11114 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:07.401919 10862 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:07.401849 11114 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.372591 11199 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:07.404624 11199 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.380234 11177 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:07.451664  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:07.452082 11227 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.452683  6938 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:07.458513  6251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47628993693e4f69a935e61e4071de94"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:07.459266  6251 raft_consensus.cc:606] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:07.459637  6251 raft_consensus.cc:614] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:07.460480 11227 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:07.408380  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:07.367861 11153 raft_consensus.cc:2764] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:16:07.426393 11133 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:07.372948 11184 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:07.461715 11184 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:07.414641 11262 log.cc:927] Time spent T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:16:07.374141 11270 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:16:07.427130  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:07.426786  6328 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
W20260709 13:16:07.430176  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 86350.2us
I20260709 13:16:07.409827 11263 consensus_queue.cc:1059] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:07.432940  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:16:07.433346  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 62919.4us
I20260709 13:16:07.483294  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:07.483736  6368 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:07.434324 11221 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:07.434618 11114 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:07.494225 11218 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.435801 11117 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:07.381309 10676 consensus_queue.cc:260] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.494453 11176 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.437211  6331 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:07.494767 11218 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.496294  6331 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:07.438237 11148 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:07.496966 11218 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:07.497388 11148 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:07.498103 11191 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.499548 11148 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:07.439311  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.441005 11129 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:07.500313 11129 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.502316 11129 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:07.502863  6402 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:07.504156  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:07.504912  6933 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:07.505580 11191 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:07.513733  6322 raft_consensus.cc:2393] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:07.514556 11183 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:07.515229  6368 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:07.516443  6368 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:07.409418 11107 consensus_queue.cc:237] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:07.353922 11202 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:07.448287 11057 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.460309 10862 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:07.519439 11202 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.461776  6327 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:07.426113 11199 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.523331 11199 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:07.427719 11264 log.cc:927] Time spent T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:16:07.451087  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:07.525118 11199 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.527132  6941 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:16:07.376752  6295 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.769s (SENT) [suppressed 25 similar messages]
I20260709 13:16:07.530135 11057 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:07.527977  6937 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:47742
I20260709 13:16:07.530997  6937 raft_consensus.cc:606] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:07.481510  6221 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:07.532311  6937 raft_consensus.cc:614] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:07.482146  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:16:07.532774  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 51340us
W20260709 13:16:07.482357  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 55579.9us
I20260709 13:16:07.533562 11177 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:07.534132 11177 raft_consensus.cc:697] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:07.534240  6905 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:07.529601  6368 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:07.535276 11177 consensus_queue.cc:237] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:07.536309  6368 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:07.537026 11207 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:07.537499 11152 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:07.537561 11207 raft_consensus.cc:697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:07.537771  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:07.538230 10961 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.538648 11207 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.539084  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:07.538699 10961 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.539855  6935 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:07.537170  6937 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:07.541268 10961 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:07.541411  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:07.542310  6933 raft_consensus.cc:2393] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 15: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:07.539050  6256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:07.542984  6256 raft_consensus.cc:606] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:07.532819  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 156086us
I20260709 13:16:07.487465  6328 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:07.534327  6221 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:07.548653  6371 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:07.444730  6151 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55346 (request call id 393) took 22034 ms (client timeout 15000 ms). Trace:
I20260709 13:16:07.442054  6152 catalog_manager.cc:5697] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.507650 11263 raft_consensus.cc:3055] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:16:07.508016 11215 consensus_meta.cc:287] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.000s
I20260709 13:16:07.516530 11183 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.530911 10862 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:07.494475  6330 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:07.561285  6296 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:07.531571 11217 consensus_queue.cc:1059] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:16:07.481593  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.550721  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:07.572244  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:07.572898  6398 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:07.572924  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:07.573580  6325 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.575094  6323 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:16:07.543665 10813 consensus_meta.cc:287] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.005s
I20260709 13:16:07.551765  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:07.560765  6222 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:07.562983  6905 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:07.562884  6296 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:07.538976 11152 raft_consensus.cc:697] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:16:07.597803  6295 leader_election.cc:336] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.080s (SENT)
I20260709 13:16:07.599911  6295 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:07.600278  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:07.600867  6330 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.601118  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:07.490087  6252 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:07.601688  6933 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.530170 10494 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.597303  6331 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 15.
I20260709 13:16:07.558971 11148 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:07.626785  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:07.627241  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:07.627461  6152 catalog_manager.cc:5697] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.629138  6152 catalog_manager.cc:5697] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 5, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 5 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:07.630049  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:07.606655  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 72393.5us
I20260709 13:16:07.574261 11176 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:07.635456  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.634523  6330 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:07.560110 11199 raft_consensus.cc:2804] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:07.559033 11263 raft_consensus.cc:740] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:07.635278  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:07.640882  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:07.642107  6252 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:16:07.627907  6403 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:07.636382  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:07.579546 11219 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:07.601298  6296 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:07.650337  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 49110.4us
I20260709 13:16:07.650976  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:07.651542  6405 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:07.651450  6296 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:07.626127  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:07.652743  6329 raft_consensus.cc:2393] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 12: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:07.631193  6152 catalog_manager.cc:5697] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.577775  6404 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:07.569556 11114 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:07.646522  6221 leader_election.cc:400] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11.
I20260709 13:16:07.656163  6221 leader_election.cc:403] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:07.645402  6905 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:07.655532  6933 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:07.654177  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:07.662976  6402 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:16:07.656311  6369 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:07.666059 10963 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:07.666555 10963 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.666903 10963 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:07.639267 11143 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:07.670781 11152 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.671860 11143 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:07.672078  6330 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:07.673416 11188 consensus_queue.cc:1059] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:07.674572 11236 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11.
I20260709 13:16:07.565840 11221 consensus_queue.cc:1059] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:16:07.605933 10807 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.676957  6933 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:07.710546  6405 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:07.605647 11189 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.631778 11120 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:07.528724 11184 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.696295  6323 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:07.578406 11191 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:16:07.673504  6296 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:07.607985 11129 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:16:07.717171  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:07.740257  6325 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:07.675004 11092 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:07.636418 11240 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:16:07.721644  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 48226.8us
I20260709 13:16:07.726413 11120 raft_consensus.cc:697] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:07.728232 11189 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.729677  6252 raft_consensus.cc:1275] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:07.716074 11183 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.636658 11256 consensus_queue.cc:1059] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:16:07.695263  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:07.649024 11219 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.574119 11215 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.745553  6296 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:07.745719  6152 catalog_manager.cc:5697] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 1 to 7, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 7 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.733547 11231 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.749167  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:07.655686 11199 raft_consensus.cc:697] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:07.750944  6256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:07.777158  6256 raft_consensus.cc:606] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:07.737239 11185 raft_consensus.cc:3055] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:07.655922 11114 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:07.639072 11148 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.734448 11263 consensus_queue.cc:260] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.759624  6219 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:07.635381 10494 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.693856 10713 consensus_queue.cc:1059] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:16:07.749054 11176 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:07.775292  6152 catalog_manager.cc:5697] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 5 to 11, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.744663 11016 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:16:07.715641 10878 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:07.550033  6151 rpcz_store.cc:269] 0709 13:15:45.410303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.476908 (+ 66605us) service_pool.cc:224] Handling call
0709 13:16:07.444466 (+21967558us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:02.653465 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:02.697955 (+ 44490us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:02.698008 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:16:02.698025 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:02.700069 (+  2044us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:02.700134 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:02.700177 (+    43us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:16:02.742994 (+ 42817us) tablet.cc:701] Row locks acquired
0709 13:16:02.743019 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:16:02.743214 (+   195us) write_op.cc:270] Start()
0709 13:16:02.743340 (+   126us) write_op.cc:276] Timestamp: P: 1783602962743152 usec, L: 0
0709 13:16:02.743368 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:16:02.744276 (+   908us) log.cc:844] Serialized 8223 byte log entry
0709 13:16:03.053214 (+308938us) op_driver.cc:464] REPLICATION: finished
0709 13:16:03.127734 (+ 74520us) write_op.cc:301] APPLY: starting
0709 13:16:03.132349 (+  4615us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:03.258206 (+125857us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:03.258373 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:03.661970 (+403597us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:03.733060 (+ 71090us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:16:03.751961 (+ 18901us) write_op.cc:312] APPLY: finished
0709 13:16:03.825932 (+ 73971us) log.cc:844] Serialized 188 byte log entry
0709 13:16:03.826166 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:03.826513 (+   347us) write_op.cc:454] Released schema lock
0709 13:16:03.826584 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:03.827107 (+   523us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:03.827136 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4807734,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":49720,"apply.run_cpu_time_us":33882,"apply.run_wall_time_us":709074,"cfile_cache_hit":86,"cfile_cache_hit_bytes":92159,"num_ops":21,"prepare.queue_time_us":183479,"prepare.run_cpu_time_us":8365,"prepare.run_wall_time_us":116790,"raft.queue_time_us":769,"raft.run_cpu_time_us":8850,"raft.run_wall_time_us":332257,"replication_time_us":16205,"thread_start_us":719535,"threads_started":4,"wal-append.queue_time_us":9933,"wal-append.run_cpu_time_us":4929,"wal-append.run_wall_time_us":2098140}]]}
I20260709 13:16:07.784245  6399 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:07.769532 11219 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.785414  6400 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:07.788700 11148 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:07.775367  6141 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 19435892007a4e0a9b2b4d0b26ccd0c0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8600a3fead0e48a7aa813822ec44d0fe is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:07.789906 11217 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:07.790405 11241 consensus_queue.cc:1175] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8600a3fead0e48a7aa813822ec44d0fe" responder_term: 13 status { last_received { term: 12 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:07.806718 11217 raft_consensus.cc:697] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:07.807857  6256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:07.807675 11217 consensus_queue.cc:237] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.808485  6256 raft_consensus.cc:606] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:07.808859  6256 raft_consensus.cc:614] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:07.812077  6256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:07.812563  6256 raft_consensus.cc:606] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:07.812856  6256 raft_consensus.cc:614] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:07.791664 11121 raft_consensus.cc:3055] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:07.749465 11216 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:07.777541 11107 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:07.798931  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:07.783979 11114 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:07.779353 11185 raft_consensus.cc:740] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:07.769754 11183 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.820113  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:07.835831  6152 catalog_manager.cc:5697] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 10, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 10 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.832824  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:16:07.843086  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 59762.7us
I20260709 13:16:07.814363 10878 raft_consensus.cc:697] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:07.844844  6296 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:07.841665 11129 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.817525 11121 raft_consensus.cc:740] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:07.820437 11107 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:07.846803  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 200482us
I20260709 13:16:07.847725  6296 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:07.847675  6152 catalog_manager.cc:5697] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 8 to 9, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 9 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.828565 11243 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.798913 11176 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.854178  6295 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:07.859817  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:07.861893 11176 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:07.862555 11243 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.864720 11243 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:07.866149  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:07.867656  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:07.868465 11184 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:07.856055 11129 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.878170 10494 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:07.885612 11274 log.cc:927] Time spent T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:16:07.862926 11257 raft_consensus.cc:3055] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:07.862944  6152 catalog_manager.cc:5697] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:07.899695  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 52013.6us
I20260709 13:16:07.900602  6296 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:07.912411  6296 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:07.901157 10713 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:16:07.901525  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 47415.9us
W20260709 13:16:07.902212  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.914491  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:07.902129 10612 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:07.903605  6933 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:07.852223 11148 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:07.904457 11204 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:07.905514  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:07.909080 11057 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:07.910311  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:07.913446  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:07.931438  6401 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:07.903895 11212 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.856988 11107 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.828130 11202 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:07.890769 11257 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:07.833940 11199 consensus_queue.cc:237] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:07.903689 11092 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:07.925851  6152 catalog_manager.cc:5697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 7 to 9, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 9 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.924997 11189 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:07.924396 11148 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:16:07.982914  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.990026  6152 catalog_manager.cc:5697] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.993920  6251 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:07.995388  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:07.994861  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.002615  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:07.999792  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.008661  6248 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:08.008522  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:07.820564 11120 consensus_queue.cc:237] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.998287  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.014678  6255 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:08.015033  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.058750  6254 raft_consensus.cc:2368] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11.
I20260709 13:16:08.023128  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:08.061080  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 165813us
I20260709 13:16:07.925468 10713 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:08.069924  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 161271us
I20260709 13:16:07.978240 10807 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:08.071065  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:07.978327 10612 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:07.991968 11189 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:08.072486  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:16:07.998900 11280 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:16:08.080060  6937 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:08.081605  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:08.074352  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.001159 11148 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:07.987955 11184 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.085489  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:16:08.070394  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 157026us
I20260709 13:16:08.086058  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.087960  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.088325  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:08.080514  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:08.098021  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.094429  6251 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:08.103853  6253 raft_consensus.cc:2393] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 15: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:08.107002  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.110281  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.118161  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.119451  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:08.120239  6251 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:08.121181  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.121352  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.087301 11215 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:08.121963  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.121935  6251 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:07.997992 11283 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.179s
I20260709 13:16:07.974992 11121 consensus_queue.cc:260] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:07.975190 11212 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:08.148622  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:08.159339  6250 raft_consensus.cc:2376] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11. Re-sending same reply.
I20260709 13:16:08.148762  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.093943 11189 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:08.151196  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 49714us
I20260709 13:16:08.152014  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.163878  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:08.164467  6253 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:16:08.164644  6254 raft_consensus.cc:2376] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12. Re-sending same reply.
I20260709 13:16:08.152390  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:08.152809  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 47111.7us
I20260709 13:16:07.982587 10878 consensus_queue.cc:237] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:08.169775  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:08.173049  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:08.174373  6326 raft_consensus.cc:1275] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:08.088755 10807 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:08.150206 11202 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:08.149333 10612 raft_consensus.cc:697] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:08.182358 10612 consensus_queue.cc:237] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:08.186509  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:08.177903  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 82083.9us
I20260709 13:16:08.109237 11184 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:08.191488 11276 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 13:16:08.192162 10713 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:08.192574 11184 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:08.179829 11121 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:08.193650  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.194042 10963 consensus_meta.cc:287] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
W20260709 13:16:08.194298 11286 log.cc:927] Time spent T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:16:08.194434 10963 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:08.194880 11292 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
W20260709 13:16:08.196214 11273 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:16:08.197487 11285 log.cc:927] Time spent T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:16:08.176054 11270 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.188184  6250 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:08.180649  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:08.204865  6248 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
W20260709 13:16:08.171675 10494 consensus_queue.cc:1175] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" responder_term: 7 status { last_received { term: 7 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 7 index: 9 } }
I20260709 13:16:08.159740 11215 consensus_queue.cc:1048] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:16:08.213769 11280 log.cc:927] Time spent T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 13:16:08.217347 11223 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:08.088542 11257 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:08.235858  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.242449  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:08.243057  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:08.243076  6250 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:08.243667  6403 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:08.174407 11204 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:16:08.251367  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:08.247287 11223 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:08.253365  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:16:08.256304  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.209468 11129 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:08.263592  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:08.264173  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:08.265967  6396 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:08.269378  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:08.270133  6933 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:08.260300 11257 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:08.276506  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:08.290330  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:08.285432  6250 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:08.296162  6369 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:08.297469  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:08.298179  6396 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:08.316172  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 168383us
I20260709 13:16:08.220021 11270 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:08.273792 11129 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.317164  6403 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:08.317749  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:08.273370 11183 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:08.354053  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.445384 11303 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.417560  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:08.418401  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 245631us
I20260709 13:16:08.420923  6396 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:08.483722  6906 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:08.450834  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.452210  6402 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:08.316588 10963 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:08.469033  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:08.472213  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:08.489987  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:08.472442  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:08.470842  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:08.473511  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 201844us
I20260709 13:16:08.476171  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:08.492057  6326 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
W20260709 13:16:08.477777  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 181751us
W20260709 13:16:08.414572  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 97095.8us
I20260709 13:16:08.448171 11212 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:08.474402  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 197973us
I20260709 13:16:08.481360  6403 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:08.458871 10807 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:08.407037 11129 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:08.505069  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.494982  6368 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:08.496500  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:08.528214  6322 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:08.528801  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.497828  6402 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:08.492725  6906 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:08.484289  6331 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:16:08.538043  6368 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:08.539767  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 47108.3us
I20260709 13:16:08.502904 10396 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:08.542466  6906 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:08.542037  6369 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:08.541756  6323 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:08.501466 11183 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:08.544379  6906 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:08.547837  6906 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:08.530905 11184 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.503253 10713 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:16:08.549028  6295 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:08.567916  6295 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:08.558221  6322 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 16.
I20260709 13:16:08.474618 11294 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:16:08.541893 10963 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:08.607393 11114 consensus_meta.cc:287] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.000s
I20260709 13:16:08.607872 11114 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:08.608223 11016 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:08.612874  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.614507 11216 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:08.615942 11222 raft_consensus.cc:3055] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:08.616333 11222 raft_consensus.cc:740] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:08.619234  6248 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:08.620457  6248 raft_consensus.cc:1240] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:08.624256 11148 consensus_meta.cc:287] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.000s
I20260709 13:16:08.626434 11270 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:08.627275 11299 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:08.552203 11291 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:08.633961 11290 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:08.634724 11240 raft_consensus.cc:993] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:08.636090 11117 raft_consensus.cc:3055] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:08.636507 11117 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:08.608898 11016 consensus_queue.cc:1048] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:08.589408  6331 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:08.494866 11303 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:08.597541 11129 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:08.598558 11306 log.cc:927] Time spent T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:08.599452  6937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 1063) took 1055 ms. Trace:
I20260709 13:16:08.599905 11301 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:08.600656  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.601886  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.578073 11231 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:08.548115 11212 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:08.580861  6905 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:08.648082  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:08.725263  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 144470us
I20260709 13:16:08.641067  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:08.726197  6322 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:16:08.655405  6219 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:08.642263  6248 raft_consensus.cc:1240] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:08.657464 11309 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:08.733038 11243 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:08.657590  6330 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:16:08.741313  6330 pending_rounds.cc:85] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 4
I20260709 13:16:08.659241  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:08.741644  6330 pending_rounds.cc:107] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 8.5
W20260709 13:16:08.651961  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 84712us
I20260709 13:16:08.742034  6330 raft_consensus.cc:2889] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:08.658722  6937 rpcz_store.cc:276] 0709 13:16:07.543880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.544017 (+   137us) service_pool.cc:224] Handling call
0709 13:16:07.593156 (+ 49139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.097876 (+504720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.599219 (+501343us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54007a53d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:08.599393 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105874176}
I20260709 13:16:08.624745 11148 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:08.710652  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.744552  6933 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:08.728884  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:16:08.730615  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 75282.9us
I20260709 13:16:08.746178  6219 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:08.747061  6219 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:08.752108  6295 leader_election.cc:400] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11.
I20260709 13:16:08.754925  6295 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:08.648878 11183 raft_consensus.cc:697] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:08.654949 11227 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.653115 10813 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.597595 11315 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:08.764760  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 218836us
I20260709 13:16:08.765020  6253 raft_consensus.cc:1240] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:08.675928 10807 raft_consensus.cc:1081] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:08.572854 11184 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:08.768931  6905 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:08.660394 10612 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:08.777172  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:08.777622  6398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.027s	sys 0.018s
I20260709 13:16:08.725539 11217 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:08.802748  6402 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:08.760308 11243 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:08.741982 11301 raft_consensus.cc:697] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:16:08.826983  6398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.027s	sys 0.026s
I20260709 13:16:08.661072 11291 consensus_queue.cc:1059] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:16:08.833998  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:08.798012  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:08.653681 11117 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:08.765851 11308 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:08.769266 11309 raft_consensus.cc:697] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:08.782217 11241 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:16:08.775964 11219 consensus_meta.cc:287] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.961s	user 0.011s	sys 0.000s
I20260709 13:16:08.828837 11121 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:08.833355 11243 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:08.867918  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 90867.2us
I20260709 13:16:08.649391 11222 consensus_queue.cc:260] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:08.870400 11305 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:08.770349 10396 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:16:08.854265 11295 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:08.874955  6295 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:08.857904 11303 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:08.887856  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 140021us
W20260709 13:16:08.893383  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.891427  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.873694 11121 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.838742 11217 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:08.840651 11315 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 13:16:08.878019 11189 consensus_meta.cc:287] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.703s	user 0.010s	sys 0.000s
W20260709 13:16:08.913038  6401 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.000s	sys 0.025s
I20260709 13:16:08.877701 11243 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:08.918551  6401 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.000s	sys 0.026s
I20260709 13:16:08.918812  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:08.877481 11114 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:08.878306 11284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.004s	sys 0.018s
I20260709 13:16:08.766503 10813 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:08.876111 11308 raft_consensus.cc:697] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 16 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:08.868273 11216 consensus_queue.cc:1059] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:16:08.770557 11227 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:08.919508 11121 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:08.887426 11310 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:08.876039 11219 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:08.922254 11222 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:08.929451 11176 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.018s	sys 0.047s
I20260709 13:16:08.923609  6327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57230
I20260709 13:16:08.996771  6327 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:08.997184  6327 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:08.871256 11185 consensus_queue.cc:260] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.006824  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:09.028517  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.028682  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:09.029642  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.922672 11189 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:09.064780  6325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.028s	sys 0.065s
I20260709 13:16:09.029675  6331 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
W20260709 13:16:09.077355  6325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.028s	sys 0.065s
I20260709 13:16:08.892963 11183 consensus_queue.cc:237] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.078658  6219 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:16:08.923141 11284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.004s	sys 0.019s
W20260709 13:16:09.080839  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.000451 11176 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.018s	sys 0.047s
I20260709 13:16:09.082680  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:09.085775  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 196355us
I20260709 13:16:09.104060  6324 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:09.063055 10396 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.084090 11199 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.107420  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:09.108042  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:09.084786 11241 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:09.077826 11322 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:09.119079 11322 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:09.161955  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.935789 11301 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.105731 11148 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:09.106977 10612 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:16:09.258383  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 237532us
I20260709 13:16:09.122159  6327 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:09.260535  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 132479us
I20260709 13:16:09.273729  6401 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:09.117240 11241 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.112671 11312 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:09.123904 11184 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:09.292955  6327 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:09.276448 11240 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.276536 10807 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:09.283486 11241 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:09.112252 10396 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:08.999404 11309 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.260093 11322 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:09.117867 11199 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.294803 11320 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:09.277041 10612 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.332683 11148 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.113394 11308 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.289913 11312 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.335687 10807 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.375346  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:09.335378 11240 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.368651 11227 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:09.369004 11217 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:09.370360 11310 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.370924 11204 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:09.371527 10813 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:09.363401 11148 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.388055  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:09.377213 11328 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:09.379571 11219 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:09.393395  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.352767 11320 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.398252  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:09.398859  6933 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.399719 11227 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:16:09.401199 11324 log.cc:927] Time spent T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 13:16:09.403858 11321 log.cc:927] Time spent T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:16:09.399906 11189 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:09.390866 11204 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.417289  6327 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:09.393532 11329 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:09.420841  6933 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:09.422447  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:09.423125  6323 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:09.424116  6399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 1018) took 2004 ms. Trace:
I20260709 13:16:09.424520  6399 rpcz_store.cc:276] 0709 13:16:07.428062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.429864 (+  1802us) service_pool.cc:224] Handling call
0709 13:16:07.430155 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.798113 (+367958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.416276 (+1618163us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54001f3454. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:09.416453 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":813894400}
I20260709 13:16:09.423905 11329 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.426268 10396 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:09.403398 11319 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.409590 11114 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:09.461539 11114 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.462846 10807 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:09.464268  6906 leader_election.cc:336] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.769s (SENT)
I20260709 13:16:09.464556 11114 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:09.390755 11310 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.411679 11227 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.466624 11227 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:09.431645 11318 log.cc:927] Time spent T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:16:09.467000 11310 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:09.433558 11319 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:09.420279 11334 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:09.469861  6325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 1139) took 1300 ms. Trace:
I20260709 13:16:09.470232  6325 rpcz_store.cc:276] 0709 13:16:08.169429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.169776 (+   347us) service_pool.cc:224] Handling call
0709 13:16:08.178960 (+  9184us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:08.186205 (+  7245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.186235 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:08.201698 (+ 15463us) log.cc:844] Serialized 52 byte log entry
0709 13:16:09.077801 (+876103us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:09.077844 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.077919 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.469644 (+391725us) raft_consensus.cc:1685] finished
0709 13:16:09.469664 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.469800 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102106,"raft.queue_time_us":112838,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":16971,"thread_start_us":823477,"threads_started":1,"wal-append.queue_time_us":988938}
I20260709 13:16:09.444118 11347 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:09.472144 11347 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.474187 11347 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:09.469571 11319 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:16:09.475306 11117 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:09.477612 11185 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:09.478448  6906 leader_election.cc:336] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.004s (SENT)
I20260709 13:16:09.478878  6906 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:09.479522 11312 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:09.482301 11333 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:16:09.484212 11346 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:16:09.486398 10494 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:09.486678 11342 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:16:09.490392  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.446442  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:16:09.448074 11339 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:16:09.469563 11334 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:09.439896 11289 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 1.223s	user 0.000s	sys 0.013s
I20260709 13:16:09.496500  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:09.496766  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.501296  6324 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:09.502480  6219 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:16:09.509756  6906 leader_election.cc:336] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.058s (SENT)
I20260709 13:16:09.400179 11328 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:09.511099  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.509317 10711 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:09.476955 11257 consensus_meta.cc:287] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.184s	user 0.010s	sys 0.001s
I20260709 13:16:09.519452 10711 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:09.524502 10711 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:09.547750  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:09.548389  6906 leader_election.cc:336] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.786s (SENT)
I20260709 13:16:09.548879  6906 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:09.545548 11213 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.550045 11213 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.550787  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2817) took 1377 ms. Trace:
I20260709 13:16:09.552110 11213 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:09.551164  6398 rpcz_store.cc:276] 0709 13:16:08.179168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.179299 (+   131us) service_pool.cc:224] Handling call
0709 13:16:08.179580 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.835403 (+655823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.835445 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.847017 (+ 11572us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.076364 (+229347us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:09.110428 (+ 34064us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.110623 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.110691 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.550588 (+439897us) raft_consensus.cc:1685] finished
0709 13:16:09.550607 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.550731 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38093,"prepare.queue_time_us":39378,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":12215,"raft.queue_time_us":316934,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":118625,"thread_start_us":852055,"threads_started":2,"wal-append.queue_time_us":553320}
W20260709 13:16:09.553278 11345 log.cc:927] Time spent T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 13:16:09.554808 11341 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:16:09.507997 11107 consensus_meta.cc:287] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.525s	user 0.008s	sys 0.005s
I20260709 13:16:09.564940  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1867) took 1071 ms. Trace:
I20260709 13:16:09.565965 11231 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:09.566534 11231 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.504572 11221 consensus_queue.cc:1059] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:16:09.513231 11199 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:09.513818 11320 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:09.565512  6251 rpcz_store.cc:276] 0709 13:16:08.493345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.727405 (+234060us) service_pool.cc:224] Handling call
0709 13:16:08.727746 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.932915 (+205169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.932947 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.984424 (+ 51477us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.273986 (+289562us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:09.274020 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.274085 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.564672 (+290587us) raft_consensus.cc:1685] finished
0709 13:16:09.564702 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.564867 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3069,"raft.queue_time_us":5881,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":406711,"threads_started":2,"wal-append.queue_time_us":284842}
I20260709 13:16:09.569900 11107 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.572992 11302 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:09.574815 11107 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:09.575645  6328 raft_consensus.cc:1240] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:09.577093 11223 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:09.577947 11148 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:09.578460 11243 consensus_meta.cc:287] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.649s	user 0.011s	sys 0.000s
I20260709 13:16:09.578922 11243 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.582841  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:09.584605  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:09.585220  6331 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:09.585336  6398 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:09.584928  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:09.585929  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:09.586325  6323 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:09.564180  6255 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:09.520792 10612 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:09.590764  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:09.504164 11327 consensus_queue.cc:1059] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:16:09.592955  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:09.593699  6324 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:09.598191  6325 raft_consensus.cc:1240] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:09.599413 10612 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:09.600858 11185 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:09.601415  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:09.602538  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:09.602828 11121 consensus_meta.cc:287] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.003s
I20260709 13:16:09.603277  6403 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:09.604272  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:09.606079  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:09.606165  6941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 914) took 1804 ms. Trace:
W20260709 13:16:09.606835  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.602602 11327 raft_consensus.cc:3055] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:09.607324  6399 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:09.606698  6401 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:09.608176  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:09.616134  6403 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:09.616921  6404 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:09.606668  6941 rpcz_store.cc:276] 0709 13:16:07.801407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.801548 (+   141us) service_pool.cc:224] Handling call
0709 13:16:07.820638 (+ 19090us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.827946 (+  7308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.827977 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.846202 (+ 18225us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.056000 (+209798us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:08.056050 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.056124 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.439139 (+1383015us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:16:09.593353 (+154214us) raft_consensus.cc:1685] finished
0709 13:16:09.593385 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.606096 (+ 12711us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":315,"raft.queue_time_us":93,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8729,"spinlock_wait_cycles":44355456,"thread_start_us":133624,"threads_started":1,"wal-append.queue_time_us":295801}
I20260709 13:16:09.581162 10862 raft_consensus.cc:3055] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:09.623979 10862 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:09.624782 10862 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.625193  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:16:09.625849  6295 leader_election.cc:336] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.893s (SENT)
I20260709 13:16:09.603282 11121 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.626319  6295 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:09.627439 11092 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.592564 11148 raft_consensus.cc:2764] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:16:09.627898 11092 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.628749 11148 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:09.577301 11240 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:09.613709  6331 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:09.613659  6396 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:09.617643  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:09.581053 11243 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:09.620483  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:09.631882  6934 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:09.632418  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:09.632941  6396 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:09.622215  6939 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:09.622318  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:09.622789 11287 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.463s	user 0.000s	sys 0.009s
I20260709 13:16:09.596606 11310 consensus_queue.cc:1059] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:16:09.621212  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:09.648293  6401 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:09.621506  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:09.649189  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:09.649504  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:09.651373 11222 consensus_meta.cc:287] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.001s
I20260709 13:16:09.623996 11328 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:09.634667  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2994) took 1162 ms. Trace:
I20260709 13:16:09.653357  6330 rpcz_store.cc:276] 0709 13:16:08.472671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.473320 (+   649us) service_pool.cc:224] Handling call
0709 13:16:08.473639 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.742906 (+269267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.634452 (+891546us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54002431d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:09.634613 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421776256}
I20260709 13:16:09.655892  6222 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:09.637733  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:09.639465 11263 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:09.614363 11327 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:09.640070 11299 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:09.640386 11231 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:09.641407 10862 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:09.641031  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 2987) took 1172 ms. Trace:
I20260709 13:16:09.642145 11334 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:09.643079 10676 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.661460 11328 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:09.669672 11328 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:09.670045 11328 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:09.670302 11293 raft_consensus.cc:3055] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:09.670665 11293 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:09.643326 10711 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.671468 11293 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.672688 11293 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:09.672720 10711 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:09.661377 11176 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:16:09.646335 10964 raft_consensus.cc:3055] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:09.674466 10964 raft_consensus.cc:740] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:09.675237 10964 consensus_queue.cc:260] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.676316 10964 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.646728  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:09.641422 11329 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:09.632756  6219 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:09.677407  6399 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:09.677785  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 45137.6us
I20260709 13:16:09.635200  6935 raft_consensus.cc:2393] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 12: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:09.681363 10711 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:09.681932 10711 raft_consensus.cc:697] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:09.682904 10711 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.686138  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:09.661789  6222 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:09.686723  6331 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:09.687440  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:09.665588  6396 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:16:09.665692  6328 rpcz_store.cc:276] 0709 13:16:08.469027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.469207 (+   180us) service_pool.cc:224] Handling call
0709 13:16:08.469649 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.576053 (+1106404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.640801 (+ 64748us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003f3254. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:09.640975 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2542931712}
I20260709 13:16:09.646152 11092 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:09.691030  6295 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:09.691781  6399 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:09.692508  6295 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:09.695859  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:09.698108  6331 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:09.698109  6403 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:09.700410  6328 raft_consensus.cc:1275] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:09.701274  6331 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:16:09.701272  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:09.709559  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:09.702636  6330 raft_consensus.cc:2410] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:16:09.705310  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:09.709311  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:09.727732  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:09.724923  6328 raft_consensus.cc:1275] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:09.705749  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:09.727869  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:09.717659  6219 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:09.704759  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:09.728120  6327 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:09.731232  6399 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:09.730373  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:09.730275  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:09.729720  6403 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:09.733574  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:09.731036  6324 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:09.706964  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:09.730497  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:09.735972  6331 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:09.736255  6330 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 14: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:09.657756 11327 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.729768  6329 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:09.739773  6296 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:09.740653  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:09.741406  6400 raft_consensus.cc:2410] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:16:09.702553 11107 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:09.700158 11299 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:09.712486 11117 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:09.743525  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:09.711417 11153 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.742852  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:09.718428 11092 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:09.752522  6296 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:09.737447 10807 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:09.737792 11176 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.668933 11241 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.763633  6329 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:09.699894 10862 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:16:09.767773  6296 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:09.739643 11329 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:09.746773 10612 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:09.743570 11231 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:09.737531 11270 consensus_queue.cc:1059] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:16:09.740113 11310 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:16:09.761497 10807 raft_consensus.cc:697] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:09.781157 11270 raft_consensus.cc:3055] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:09.781586 11270 raft_consensus.cc:740] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:09.782375 11270 consensus_queue.cc:260] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.783538 11270 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:09.770650 11327 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.785820 11284 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:09.774432 10612 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.809321 11121 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:09.810449  6255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 932) took 1796 ms (client timeout 1748 ms). Trace:
I20260709 13:16:09.753306 11114 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:16:09.792517  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.807624  6404 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36164 (request call id 2823) took 1607 ms (client timeout 1728 ms). Trace:
I20260709 13:16:09.764462 11153 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.777736 11189 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:16:09.842469  6255 rpcz_store.cc:269] 0709 13:16:08.014265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.058340 (+ 44075us) service_pool.cc:224] Handling call
0709 13:16:09.810254 (+1751914us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54001739d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:09.810354 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3328184576}
W20260709 13:16:09.843845  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.770213 11176 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.776365 11107 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:09.846203  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:09.749692 11299 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.848253  6329 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:09.849790  6251 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:16:09.845675  6404 rpcz_store.cc:269] 0709 13:16:08.200226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.234394 (+ 34168us) service_pool.cc:224] Handling call
0709 13:16:09.446244 (+1211850us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b5800102f98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abab0a0 00007f457abaa984 00007f45741256d4 00007f4574125662
0709 13:16:09.807424 (+361180us) spinlock_profiling.cc:243] Waited 95.5 ms on lock 0x7b54003ad9d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:09.807560 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222369792}
I20260709 13:16:09.853155  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:09.859385  6221 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:09.786046 11300 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:09.777055 11329 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.861232  6397 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:09.778409 11117 consensus_queue.cc:1059] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:16:09.863456  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:09.864205  6252 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:09.848109 11240 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.835479 10612 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:09.866456  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:09.778877 11231 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.863531  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:09.873350  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:09.874111  6248 raft_consensus.cc:2368] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 13. Current term is 14.
I20260709 13:16:09.875115  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:09.871260  6247 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:09.877475  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:09.879276  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:09.857529 11257 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:09.882186  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:09.890586  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:09.891644  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:09.884450  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:09.886916  6371 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:09.895645  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:09.897821  6937 raft_consensus.cc:2410] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:09.842572 11284 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.902195  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:09.902220  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:16:09.903261  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 116701us
I20260709 13:16:09.904209  6252 raft_consensus.cc:3060] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.905231  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:09.905509  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:09.905784  6250 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 14: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:09.904568  6296 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:09.906291  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:09.909003  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:09.910437  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:09.910635  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:09.911149  6325 raft_consensus.cc:2393] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 12: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:09.911194  6941 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:09.915411  6251 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 12: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:09.917393  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:09.917675  6296 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:09.918332  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:09.919374  6250 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:09.920410  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:09.920755  6250 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:09.922370  6250 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:09.923640  6250 raft_consensus.cc:1240] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:09.925006  6250 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:09.881302 11121 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:09.930347  6905 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:09.928826  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:09.867416 11300 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.930029 11357 raft_consensus.cc:3055] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:09.987722 11153 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:09.988054  6252 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:09.990167  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:09.992615  6247 raft_consensus.cc:2410] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:16:09.993115  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 62879.4us
I20260709 13:16:09.939574  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:09.939282  6254 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:10.002156  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:10.002785  6254 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:09.995282  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:10.020331  6251 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:09.878539 11240 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:09.896714 11057 consensus_queue.cc:1059] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:16:09.912999 11334 raft_consensus.cc:2804] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:10.029682  6371 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:10.031796  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:09.903318 11257 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:10.019462 10494 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:10.054543  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:09.881906 10807 consensus_queue.cc:237] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:09.908152 11212 consensus_queue.cc:1059] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.120s
I20260709 13:16:10.081914 11212 raft_consensus.cc:3055] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:10.082341 11212 raft_consensus.cc:740] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:16:10.082551  6397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 1017) took 2713 ms (client timeout 1816 ms). Trace:
I20260709 13:16:10.058169  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:10.083361 11212 consensus_queue.cc:260] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.084021  6254 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:10.084690 11212 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:10.085597  6254 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:10.092777  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:10.094058 11284 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:10.094610 11284 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:10.095057 11284 raft_consensus.cc:697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:16:10.083104  6397 rpcz_store.cc:269] 0709 13:16:07.369238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.369360 (+   122us) service_pool.cc:224] Handling call
0709 13:16:10.082299 (+2712939us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b540002d0d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:10.082433 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5678947072}
I20260709 13:16:10.095966 11284 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:10.097872 11356 log.cc:927] Time spent T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 13:16:10.102283  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:10.103407  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:10.104163  6405 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:10.105516  6398 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:10.106779  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:10.107513  6400 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:10.061085 11334 raft_consensus.cc:697] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:10.055760  6941 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:09.930110 11204 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:09.980090 11310 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:10.063961  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:10.065666  6141 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 19435892007a4e0a9b2b4d0b26ccd0c0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8600a3fead0e48a7aa813822ec44d0fe is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:10.032603 11107 raft_consensus.cc:697] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:10.066421  6251 raft_consensus.cc:1275] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:10.068351 11240 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:10.070351 11301 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:10.070945 11298 raft_consensus.cc:3055] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:10.133498 11301 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.133610 11298 raft_consensus.cc:740] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:10.134037 11301 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:10.133868 11334 consensus_queue.cc:237] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.134790 11298 consensus_queue.cc:260] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.136270 11298 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:10.057080 10494 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:10.068840 11361 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.223s	user 0.000s	sys 0.004s
W20260709 13:16:10.137861  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.137496 11107 consensus_queue.cc:237] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:10.078068 11359 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:16:10.119120  6247 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:09.993743 11357 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:16:10.126386  6141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 65850.1us
I20260709 13:16:10.126746 11325 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:10.137375 10494 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:10.146586  6907 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:09.929580 11328 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.024181 11121 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.148967  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:10.153033  6251 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:09.927690 11360 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:10.162739  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:10.130786 11241 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:10.143416 11310 raft_consensus.cc:697] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:10.148298 10713 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.195760  6250 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:10.197685  6252 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:10.159600 11315 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.159976 11204 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:10.205227 10713 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.209937 10713 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:10.213613 10964 consensus_meta.cc:287] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.002s
I20260709 13:16:10.192291 11152 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 13:16:10.217597 11369 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:16:10.204031 11176 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:10.221585  6251 raft_consensus.cc:1240] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:10.143836 11189 raft_consensus.cc:697] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:16:10.237855  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 320233us
I20260709 13:16:10.234652  6249 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:10.192837 11365 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:10.161597 11325 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.243198  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:10.226388 11299 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:10.295307  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:10.296165  6254 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 12: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:16:10.272917  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.255374 11227 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:10.239210 11291 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:10.254436  6368 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:10.238066 11329 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:10.299535  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 45370.8us
I20260709 13:16:10.206923 11315 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:10.293623  6247 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:10.311221  6368 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:10.321079  6369 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:10.252470 10878 consensus_queue.cc:1048] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:16:10.321260  6368 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:10.324239  6369 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:10.301273 11365 raft_consensus.cc:697] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:10.252902 11207 consensus_queue.cc:1059] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:16:10.301981 11299 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:10.326097 11153 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:10.237915 11357 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:10.319041 11263 consensus_meta.cc:287] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.657s	user 0.006s	sys 0.005s
I20260709 13:16:10.327075  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:10.327296  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:10.329610 11188 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:10.330052 11296 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:10.331259 11299 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.323457 11227 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:10.335479  6256 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:10.337397 11227 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.337551 11192 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.337852 11227 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:10.338114 11192 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.337594 10878 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:10.336040 11296 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:10.341322 11299 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:10.341591 11296 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:10.302318 11291 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.346848 10494 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.300915 11310 consensus_queue.cc:237] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:10.336339 11207 raft_consensus.cc:3055] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:10.322152 11301 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.356596  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:10.357707  6939 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:10.349155 11357 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:10.350307 11300 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:10.364497 10494 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:10.373594  6329 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:10.333026 11189 consensus_queue.cc:237] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:10.355583 11328 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:10.379488  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:10.402633  6325 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 7.
I20260709 13:16:10.299932 11292 consensus_queue.cc:1048] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:16:10.380343  6404 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 14: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:10.357101 11207 raft_consensus.cc:740] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:10.359071 11121 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:10.363255 11270 consensus_meta.cc:287] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.550s	user 0.004s	sys 0.007s
I20260709 13:16:10.413483  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:10.414590  6329 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 14: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:10.415310  6248 raft_consensus.cc:2410] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:16:10.418147  6219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.010s	sys 0.015s
W20260709 13:16:10.418541  6219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.010s	sys 0.015s
W20260709 13:16:10.418897  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 560260us
I20260709 13:16:10.438076  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:16:10.440145  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 266562us
I20260709 13:16:10.406814 11257 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:10.407912 11300 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:10.444654  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:10.446182  6297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.010s	sys 0.003s
I20260709 13:16:10.445854  6905 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:16:10.417738 11353 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.009s	sys 0.016s
W20260709 13:16:10.449091  6297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.011s	sys 0.003s
I20260709 13:16:10.449632  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:10.461305  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:10.463303  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:10.463882  6331 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:10.464632  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:10.459874  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:10.458177  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 589515us
W20260709 13:16:10.525962  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.548210  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.548418  6323 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:16:10.548780  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.461913  6330 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:10.552147  6219 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:10.457989 11283 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.003s	sys 0.016s
I20260709 13:16:10.561219  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:10.561568  6327 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 15. Current term is 16. Ops: []
W20260709 13:16:10.550523 11318 log.cc:927] Time spent T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:16:10.557163  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.437479 11328 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 13:16:10.570241  6907 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:10.572147  6907 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:10.565577  6295 leader_election.cc:336] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.603s (SENT)
I20260709 13:16:10.558554  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:10.546473 11334 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:10.560788 11283 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.003s	sys 0.017s
W20260709 13:16:10.554345 11148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.009s	sys 0.036s
W20260709 13:16:10.457950 11353 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.009s	sys 0.016s
I20260709 13:16:10.572959  6295 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:10.465111 11325 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:10.568504  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 122896us
I20260709 13:16:10.554432 11315 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:10.460733 11152 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.115s
I20260709 13:16:10.566264 11298 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.460306 11300 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:10.584219 10711 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.011s	sys 0.016s
W20260709 13:16:10.584434 11148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.010s	sys 0.036s
I20260709 13:16:10.577345 11057 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:10.610080 11283 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:10.574844  6221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.010s	sys 0.039s
W20260709 13:16:10.656860  6221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.011s	sys 0.039s
W20260709 13:16:10.657461  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 798135us
I20260709 13:16:10.658252  6221 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:10.659754  6221 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:10.616616  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 51070us
I20260709 13:16:10.636927  6936 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:10.637032  6937 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 16 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:10.584890 11121 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:10.459681 11365 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:10.671325  6221 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:10.643649  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 322438us
I20260709 13:16:10.591396 11380 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:10.611302 10711 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.011s	sys 0.016s
I20260709 13:16:10.608117 11291 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:10.551072 11207 consensus_queue.cc:260] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:10.717166 11207 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:10.719138  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:10.720188  6937 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 14: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:10.721949  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:10.722503  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1724) took 1016 ms. Trace:
I20260709 13:16:10.722872  6328 rpcz_store.cc:276] 0709 13:16:09.705958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.730109 (+ 24151us) service_pool.cc:224] Handling call
0709 13:16:09.730433 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.735818 (+  5385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.735845 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.740431 (+  4586us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.891355 (+150924us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:10.144297 (+252942us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.722068 (+577771us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b5400156920. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575b60733 00007f4575be5dbf 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c
0709 13:16:10.722120 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.722197 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.722239 (+    42us) raft_consensus.cc:1685] finished
0709 13:16:10.722317 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.722448 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5006,"prepare.queue_time_us":300816,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":73503,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":3600,"spinlock_wait_cycles":34339072,"thread_start_us":597044,"threads_started":3,"wal-append.queue_time_us":456054}
I20260709 13:16:10.730734 10957 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:10.731316 10957 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:10.732525  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.734118  6371 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:10.735296 10676 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:10.735658 10676 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.735965 10676 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:10.691073  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.691439  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:10.738921  6324 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:10.738835  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:10.693194  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:10.694532  6221 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:10.696161 11372 log.cc:927] Time spent T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:16:10.607793 11381 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:10.590343 11334 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:10.701491 11293 consensus_meta.cc:287] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.001s	user 0.005s	sys 0.005s
I20260709 13:16:10.667414 11121 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:10.703650  6939 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:10.703869  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 1148) took 1717 ms. Trace:
I20260709 13:16:10.709560 10878 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:10.636080 11057 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.656633 11310 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:10.711066 11385 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:10.681826 10807 raft_consensus.cc:2764] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:10.708810 11188 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:10.681535 11360 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:10.712517 11231 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:10.672521 11283 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.715785 11153 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:10.715906  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:10.611850 11298 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.720803 11192 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:10.744597  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.760164  6940 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:10.760728  6222 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:10.759895  6322 rpcz_store.cc:276] 0709 13:16:08.986272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.986424 (+   152us) service_pool.cc:224] Handling call
0709 13:16:08.986882 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.987262 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.987289 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.988760 (+  1471us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.101734 (+1112974us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b18004b12a0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:16:10.422413 (+320679us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:10.422459 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.422518 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.703583 (+281065us) raft_consensus.cc:1685] finished
0709 13:16:10.703602 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.703814 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1532,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":3807,"spinlock_wait_cycles":9915648,"thread_start_us":320505,"threads_started":1,"wal-append.queue_time_us":1713225}
I20260709 13:16:10.763851  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:10.751845 11381 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:10.784839  6396 raft_consensus.cc:2393] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 8: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:10.764379  6398 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:10.763886  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:10.785689  6397 raft_consensus.cc:2393] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:10.765672  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:10.786703  6400 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:10.765036 11121 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:10.830272  6219 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:16:10.833166  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 261066us
W20260709 13:16:10.834270  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 498642us
I20260709 13:16:10.837450  6369 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:10.773952 10878 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:10.773986  6405 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:10.774456 11057 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:10.737103 11301 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:10.772228  6324 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
I20260709 13:16:10.737578 11380 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.799911  6297 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:10.890259  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 57939.6us
I20260709 13:16:10.893253  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:10.902678  6322 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 14: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:16:10.893473  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 63340.9us
W20260709 13:16:10.894029  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 59944.3us
W20260709 13:16:10.893407  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 198961us
I20260709 13:16:10.899740  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:10.908795  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:10.909580  6331 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:10.912150 11334 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:10.912941 11387 log.cc:927] Time spent T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:16:10.913594  6325 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:10.802235 11192 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:10.892475  6937 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:10.793794 11381 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:10.915328  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1870) took 1064 ms. Trace:
I20260709 13:16:10.917584  6221 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:10.914324 11357 consensus_meta.cc:287] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 13:16:10.920029  6255 rpcz_store.cc:276] 0709 13:16:09.850594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.850712 (+   118us) service_pool.cc:224] Handling call
0709 13:16:09.851132 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:09.858387 (+  7255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.858417 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:09.881692 (+ 23275us) log.cc:844] Serialized 52 byte log entry
0709 13:16:10.242287 (+360595us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:10.242335 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.242402 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.915126 (+672724us) raft_consensus.cc:1685] finished
0709 13:16:10.915145 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.915273 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17260,"raft.queue_time_us":16701,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":23483,"thread_start_us":311906,"threads_started":1,"wal-append.queue_time_us":529304}
I20260709 13:16:10.919078  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:10.914927  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 115073us
I20260709 13:16:10.925144 11392 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:10.925671  6256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2612) took 2950 ms (client timeout 2008 ms). Trace:
I20260709 13:16:10.925726 11392 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:10.926257  6256 rpcz_store.cc:269] 0709 13:16:07.975036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.977061 (+  2025us) service_pool.cc:224] Handling call
0709 13:16:10.925492 (+2948431us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b54001b94d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:10.925587 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5233868544}
I20260709 13:16:10.928736 11392 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:10.930410 11300 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:10.924072  6324 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:10.912062 11283 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:10.941319  6221 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:10.944521  6221 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:10.909030 11176 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:10.914531 11263 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:10.948871  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 281411us
I20260709 13:16:10.955826  6221 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:10.956915  6297 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:10.905726 11153 consensus_queue.cc:1059] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:16:10.902401 10878 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:10.939704 11231 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:10.962321  6906 leader_election.cc:336] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.201s (SENT)
I20260709 13:16:10.937330 11192 raft_consensus.cc:697] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:10.962837  6906 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:10.936209 11394 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:10.950359 11357 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:10.971347  6297 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:10.952277 11217 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:10.931417 10711 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:16:10.922534 11301 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:16:10.950721 11176 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:10.966566  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 301148us
W20260709 13:16:10.969202  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 203636us
I20260709 13:16:10.951341 10957 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:10.964329  6221 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:10.959775 11257 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:10.987846  6368 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:10.994314 10807 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:11.011843  6221 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:11.012426  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:11.015456  6396 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 11: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:11.015573 10807 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:11.012545  6405 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:11.013064  6400 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:11.013757  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:10.961903 11283 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:11.023903  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:11.024837  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:11.025624  6935 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:11.026714  6297 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:11.028333  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:11.029227  6322 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 7.
I20260709 13:16:11.028529  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:11.034431  6296 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:11.034788  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 101367us
I20260709 13:16:11.037806  6324 raft_consensus.cc:1275] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:10.970700 11308 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:10.979867 11328 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:16:11.038697  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 201136us
I20260709 13:16:11.035138  6221 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:10.979972 11153 consensus_queue.cc:1243] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer 8600a3fead0e48a7aa813822ec44d0fe log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:16:10.987447 11176 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:11.043457  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 252413us
I20260709 13:16:11.052677  6369 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:11.040998 11241 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:11.022897 11393 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:11.061492  6221 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:11.038952 11389 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:11.043149 11309 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:11.032163 11188 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 13:16:11.063014 11227 consensus_meta.cc:287] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.001s
I20260709 13:16:11.056917 11153 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:11.042346 10807 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:16:11.057363 11404 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:11.043298 11284 consensus_queue.cc:1059] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:16:11.062358 11217 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.042822 11092 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:11.063248 11328 raft_consensus.cc:697] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:11.056951 11392 consensus_queue.cc:1059] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:16:11.063750 11389 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:11.137167  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 124331us
I20260709 13:16:11.066790 11309 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:11.199892  6906 leader_election.cc:336] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.748s (SENT)
I20260709 13:16:11.073453 11334 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:11.071259 11411 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:11.134251 10711 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:11.118599 11298 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:11.254052  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:11.273676  6323 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:11.271394  6935 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:11.243120 11309 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:11.100327 11227 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:11.284178  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:11.290426  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:11.242527 11389 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.135790 11153 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.253085 11302 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:11.214381 11217 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:11.253723 11409 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:11.280665 11263 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.302299 11411 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.320007 11057 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.322873 11153 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.118383 11192 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:11.327622 11296 consensus_meta.cc:287] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.986s	user 0.008s	sys 0.000s
I20260709 13:16:11.302560 11376 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:11.347795  6402 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:11.380141  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 318748us
I20260709 13:16:11.381232  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:11.329288 11302 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:11.351670  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 286456us
I20260709 13:16:11.382843  6369 leader_election.cc:304] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:11.303238 11384 log.cc:927] Time spent T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260709 13:16:11.248629 11334 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:11.328691 10676 consensus_meta.cc:287] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.002s
I20260709 13:16:11.365197  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:11.301237 11188 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:11.334797 11217 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:11.354045 11382 log.cc:927] Time spent T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.394s	user 0.001s	sys 0.000s
I20260709 13:16:11.291286 11408 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:16:11.385946  6941 raft_consensus.cc:2368] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9.
I20260709 13:16:11.347416 11409 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:11.366305 10612 consensus_meta.cc:287] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.476s	user 0.007s	sys 0.006s
I20260709 13:16:11.406518  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:11.389293  6221 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:11.408047  6942 raft_consensus.cc:2410] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:16:11.395905  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.396778  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:11.302930 11416 consensus_queue.cc:1048] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:16:11.372341 11380 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.381269 10878 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.421510  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.390542 11257 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:11.430526  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:11.395385 11143 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:11.358186 11263 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.422192  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.406145 11423 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.395604 11153 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.379559 11296 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:11.411607 11284 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.438771  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.417843 11092 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:16:11.437238 11299 consensus_meta.cc:287] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 1.095s	user 0.012s	sys 0.000s
I20260709 13:16:11.471066  6251 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:16:11.427590 11207 consensus_meta.cc:287] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.002s
I20260709 13:16:11.413571 11409 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.372731 11411 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.438668 11428 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:16:11.430876 11421 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:11.357585 11328 consensus_queue.cc:237] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:11.471829  6248 raft_consensus.cc:1240] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:11.417421 11107 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:16:11.400691 10676 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.388211 11376 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.419322 10612 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:11.490940  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 94263.8us
I20260709 13:16:11.460132 10878 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:11.499140  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 116415us
I20260709 13:16:11.406982 11188 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.508193 10612 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:11.486893 11292 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:11.500610 11421 raft_consensus.cc:697] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:11.505522  6329 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:16:11.484022 11217 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.505625  6256 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:11.503196  6369 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:11.515758  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 106175us
I20260709 13:16:11.521634  6296 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:11.514298 11212 consensus_meta.cc:287] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 1.429s	user 0.012s	sys 0.004s
I20260709 13:16:11.459517 11153 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:11.518168  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:11.460541 11423 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:11.504873 11418 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:16:11.484318 11092 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.482275 11284 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:11.485505 11299 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:11.527118  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:11.439574 11143 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.528680  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:11.532066  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.532255 11334 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:11.522755 11401 log.cc:927] Time spent T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.235s	user 0.001s	sys 0.001s
I20260709 13:16:11.505995 10878 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.516649 11292 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:16:11.656113 11415 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:16:11.547137  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:11.666504  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:11.558630  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.557942  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:11.668403  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 165282us
I20260709 13:16:11.664310  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:11.564162  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:16:11.661271  6222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.002s	sys 0.009s
I20260709 13:16:11.669543  6369 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:11.671681  6222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.002s	sys 0.009s
W20260709 13:16:11.517549 11414 log.cc:927] Time spent T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:16:11.516640 11227 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:11.676779  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.558621  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:11.544993 11409 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.677026  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.692803  6254 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:11.692885 11296 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:11.693856  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:11.656652 11176 consensus_meta.cc:287] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
I20260709 13:16:11.695164 11176 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:11.696645 11299 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:16:11.671109 11292 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:11.680241 10878 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:11.553295 11188 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.689368 11421 consensus_queue.cc:237] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:11.690027 11284 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:11.559742 11263 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.548645 11411 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.562202 11325 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.162s
I20260709 13:16:11.562887 11395 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.546334 11376 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.691918  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.670354  6251 raft_consensus.cc:2376] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12. Re-sending same reply.
W20260709 13:16:11.697088 11121 consensus_meta.cc:287] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.807s	user 0.008s	sys 0.001s
I20260709 13:16:11.530979 11217 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:11.693917 11409 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.686520 11057 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:11.698266  6254 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:11.530272 11394 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:11.740809  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:11.668615  6324 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:11.710987  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.711270  6247 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:11.710443  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:11.717635  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.681708  6369 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:11.736397 11143 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.709880  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.676991 11432 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:11.705771 11422 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.705607 11270 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.698915 11334 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:11.555070 11231 raft_consensus.cc:3055] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:11.744935  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:11.747107  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 65503.2us
I20260709 13:16:11.753643  6369 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:11.738445 11381 consensus_meta.cc:287] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.800s	user 0.010s	sys 0.001s
I20260709 13:16:11.711030 11263 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.755791 11263 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:11.744529 11309 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.762395 11092 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.762636 11309 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.763262  6322 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:11.763463 10676 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.763520 11188 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:11.765050  6369 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:11.709331 11437 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:11.767028  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 133178us
I20260709 13:16:11.770951  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.771541  6254 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:11.772322  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:11.775202  6254 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 14: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:11.776629  6324 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:16:11.752821 11227 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:11.776039  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:11.763278 11409 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:16:11.733951 11121 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.710593 11395 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.778481  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.752615 11231 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:11.768026 11381 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.779770 11302 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:11.784480  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:11.749601 11432 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:11.782964  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:11.783563  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:11.783800  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:11.784193  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.785347  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:11.773483 10676 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:11.801862  6254 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:11.766206 11270 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.802711 10676 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:11.828322 10676 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:11.829563 11270 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.830442 11188 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.830958 11188 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:11.835224 11386 log.cc:927] Time spent T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 1.070s	user 0.000s	sys 0.006s
I20260709 13:16:11.838192 11292 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:11.809340 11231 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.816164 11389 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.774770 11437 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.816845  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.783804 11416 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.821400  6939 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:11.822186 11153 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:11.823839  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.863277  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:11.824044 11121 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:11.778350 11207 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:11.798954 11417 log.cc:927] Time spent T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.518s	user 0.000s	sys 0.001s
I20260709 13:16:11.824939  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:11.893232  6327 raft_consensus.cc:2393] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 11: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:11.889750 10676 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:11.893839  6251 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:11.753015 11422 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:11.895547 10676 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:11.896484 11422 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:11.782612 11334 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.897605 11292 leader_election.cc:290] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:11.897477 11334 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.865304 11231 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:11.899595 11334 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.825946 11381 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:11.844161  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:11.864490  6906 leader_election.cc:336] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.043s (SENT)
I20260709 13:16:11.900996  6906 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:11.902132  6906 leader_election.cc:336] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.988s (SENT)
I20260709 13:16:11.902482  6906 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:11.865813  6397 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:11.840245 11217 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:11.904359 11227 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:11.865518 11188 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:11.909457 11302 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:11.910154 11302 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:11.910705 11302 consensus_queue.cc:1059] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:11.911456 10878 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.911912 11057 raft_consensus.cc:3055] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:11.913359 11057 raft_consensus.cc:740] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:11.914391 11057 consensus_queue.cc:260] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.915778 11057 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:11.918008  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:11.803925 11432 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:11.890470 11207 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:11.918335  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:11.892474 11437 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:11.896673  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:11.918958  6248 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
W20260709 13:16:11.919452  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.924110 10612 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:11.924259  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:11.924604 10612 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:11.924952  6906 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:11.925082  6252 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:11.927753  6906 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:11.929003  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:11.933983 10612 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:11.934345  6252 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:11.934710  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:11.935174  6252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:11.935782  6252 raft_consensus.cc:606] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:11.935757  6397 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:11.936671  6252 raft_consensus.cc:614] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:11.935490  6403 raft_consensus.cc:2393] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:11.930828 10957 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:11.940532  6906 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:11.944283  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:11.927704 11212 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:16:11.937963 11340 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:11.947008  6252 raft_consensus.cc:1275] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:11.950546  6252 raft_consensus.cc:1240] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:16:11.926338 11121 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:16:11.996963  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:12.017984  6398 raft_consensus.cc:2368] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12.
I20260709 13:16:11.999542  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:12.001987  6369 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:11.865316 11416 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:12.007666 11423 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:12.007943 10957 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.009851 11389 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:12.015441  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:12.024591  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:12.025120  6254 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:12.021095  6252 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:16:12.025885  6369 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:12.026486  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:12.027419  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:12.028712  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:12.029830  6397 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:11.953101 11340 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:11.952333 11381 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:12.038259  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:16:12.033524 11436 log.cc:927] Time spent T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:16:12.086524  6254 raft_consensus.cc:2468] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:12.034252 11423 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:12.042193 11340 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:12.160951  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2459) took 1398 ms. Trace:
I20260709 13:16:12.043579 11360 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.042510 11381 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.201264  6402 rpcz_store.cc:276] 0709 13:16:10.762466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.762604 (+   138us) service_pool.cc:224] Handling call
0709 13:16:10.762969 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.384128 (+621159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.160716 (+776588us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b5400401854. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:12.160887 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331700096}
I20260709 13:16:12.045187 11308 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:12.033610 10957 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:12.249826  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 211629us
I20260709 13:16:12.152069  6397 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:12.179901 11423 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.272358  6940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 921) took 1714 ms. Trace:
I20260709 13:16:12.279050  6940 rpcz_store.cc:276] 0709 13:16:10.557825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.558638 (+   813us) service_pool.cc:224] Handling call
0709 13:16:10.759925 (+201287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.794818 (+ 34893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.272068 (+1477250us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540069f350. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:12.272275 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462200192}
W20260709 13:16:12.295147  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 354681us
I20260709 13:16:12.296103  6906 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:12.216184 11381 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:12.261214 11409 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:12.261399 11212 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:12.272969 11421 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:12.282410 11423 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.289893 10964 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:12.310547 11421 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.232062 11360 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:12.315498  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 191834us
I20260709 13:16:12.281400 11217 consensus_queue.cc:1048] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:16:12.304349 11207 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:12.304616 10878 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:12.262109 11308 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:12.324079 11445 log.cc:927] Time spent T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:16:12.317611 10964 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:12.334414  6941 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 922) took 1776 ms (client timeout 1598 ms). Trace:
W20260709 13:16:12.334879  6941 rpcz_store.cc:269] 0709 13:16:10.558194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.558308 (+   114us) service_pool.cc:224] Handling call
0709 13:16:12.334184 (+1775876us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b5400289bd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:12.334340 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1867214592}
I20260709 13:16:12.313238 11212 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:12.337886  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 3015) took 1917 ms. Trace:
I20260709 13:16:12.338431 11212 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:12.317651 11421 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:12.341897 11308 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:12.342491 11308 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:12.338265  6329 rpcz_store.cc:276] 0709 13:16:10.420414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.420656 (+   242us) service_pool.cc:224] Handling call
0709 13:16:10.421040 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.517453 (+1096413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.337645 (+820192us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002431d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:12.337826 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2493500672}
I20260709 13:16:12.338495 11416 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:12.353495  6250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:12.354116  6250 raft_consensus.cc:606] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:12.354465  6250 raft_consensus.cc:614] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:12.360541 10957 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:12.362390 11360 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:12.362852 11432 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:12.363312 10964 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:12.364987 11432 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:12.404917 11231 consensus_meta.cc:287] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.004s
I20260709 13:16:12.400341 11381 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:12.414201  6401 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:16:12.414634  6401 pending_rounds.cc:85] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 12
I20260709 13:16:12.414970  6401 pending_rounds.cc:107] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 15.13
W20260709 13:16:12.414690  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 118657us
I20260709 13:16:12.415349  6401 raft_consensus.cc:2889] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:12.416615  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:12.417735  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 110914us
I20260709 13:16:12.421900  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:12.424541  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:12.425463  6941 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:16:12.427356  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:12.429529  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:12.433482 11366 raft_consensus.cc:3055] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:12.434091 11366 raft_consensus.cc:740] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:16:12.447180  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 148020us
I20260709 13:16:12.447270  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:12.448262  6249 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:12.450457  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:12.450380  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:12.451123  6256 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:12.455789  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:12.456915  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:12.457288  6905 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:12.462781  6331 raft_consensus.cc:3055] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:12.463164  6331 raft_consensus.cc:740] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:12.464896  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:12.460155  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:12.466054  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:12.468032  6940 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:12.469746 11451 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:12.453615 11421 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:12.463835  6331 consensus_queue.cc:260] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:12.470969  6323 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:12.436370 11340 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:12.476023  6331 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.477209 11451 raft_consensus.cc:697] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:12.480052 11451 consensus_queue.cc:237] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:12.483992 11383 log.cc:927] Time spent T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 1.561s	user 0.007s	sys 0.012s
I20260709 13:16:12.485663  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2639) took 2631 ms. Trace:
I20260709 13:16:12.485997  6253 rpcz_store.cc:276] 0709 13:16:09.854154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.854287 (+   133us) service_pool.cc:224] Handling call
0709 13:16:09.854554 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.069113 (+214559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.069165 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.196114 (+126949us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b2c000014c8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f45744dea11 00007f45744ee372 00007f4575c20a01 00007f4575be543a 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2
0709 13:16:10.206665 (+ 10551us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.573963 (+367298us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:10.891583 (+317620us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.040822 (+149239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.296816 (+255994us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400356e54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:11.296871 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:11.834273 (+537402us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b1800267d00. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:16:12.483445 (+649172us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:16:12.485475 (+  2030us) raft_consensus.cc:1685] finished
0709 13:16:12.485494 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.485611 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51141,"prepare.queue_time_us":459725,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":6625,"raft.queue_time_us":59493,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":171,"spinlock_wait_cycles":612977920,"thread_start_us":741864,"threads_started":3,"wal-append.queue_time_us":563793}
W20260709 13:16:12.490703  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.493367 11458 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:12.494107  6940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:47742
I20260709 13:16:12.494656  6940 raft_consensus.cc:606] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:12.494987  6940 raft_consensus.cc:614] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:12.499343  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.500190  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:12.503659 11381 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:12.506318  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:12.507061  6329 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:16:12.507632  6906 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:12.509318  6937 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 1096) took 1772 ms (client timeout 2215 ms). Trace:
W20260709 13:16:12.509721  6937 rpcz_store.cc:269] 0709 13:16:10.737215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.738539 (+  1324us) service_pool.cc:224] Handling call
0709 13:16:12.503067 (+1764528us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400663ad4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:12.509261 (+  6194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350958464}
I20260709 13:16:12.500921  6297 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:12.512249  6907 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:12.524470  6249 raft_consensus.cc:2393] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 14: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:12.526409  6331 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:16:12.528087  6906 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:12.525350 11377 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:12.466837 11457 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:12.531194  6404 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:12.531440  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:12.532941  6397 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:12.530815  6297 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:12.535527  6297 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:12.539199  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:12.539875  6404 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:12.472440 11360 consensus_queue.cc:1059] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:16:12.541056  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:12.529409 11377 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:12.548022  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:12.529594 11381 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:12.453506 11366 consensus_queue.cc:260] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:12.548323  6397 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:12.523505 11176 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:12.556633  6906 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:12.530345 10957 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:12.566679  6906 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:12.569823  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.538676 11389 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:12.595247  6329 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:12.573549  6397 raft_consensus.cc:1240] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:12.562712 11377 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:12.539615 11328 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:16:12.582451 11057 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:12.604281 11057 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:12.604732 11057 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:12.584677  6253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aba53315de954573854008b23574a90f"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:12.605480  6253 raft_consensus.cc:606] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:12.605866  6253 raft_consensus.cc:614] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:12.587605 11152 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:12.589869 11421 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:12.590718  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.592952  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:12.546465 11283 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:12.595266  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:12.561722 10964 consensus_queue.cc:1059] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:16:12.538888 11457 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:12.564689 11450 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:12.600888  6398 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:12.555505 11204 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:12.599406 11231 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.606830  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:12.611565  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:12.614861  6905 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:12.630976  6254 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:12.657262  6397 raft_consensus.cc:2393] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 11: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:12.657368  6396 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 11: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:12.638988  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:12.641111  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:12.658063  6906 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:12.658463  6326 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:16:12.645675  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:12.658856  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:12.562932 11423 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:12.605711 11389 raft_consensus.cc:697] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:12.649690  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:12.661729  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:12.662948  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 48185.9us
I20260709 13:16:12.664623  6296 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:12.665992  6404 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:12.620924  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:12.633967 11366 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:12.675760  6403 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:16:12.701994  6329 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 14: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:12.704033  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:12.660305 11204 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:12.714148  6399 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 14: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:12.667183 11308 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.650671 11293 consensus_queue.cc:1059] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:16:12.723537  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:12.729677  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:12.731371  6399 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:12.658094 11450 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.670028 11107 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:12.676004 11152 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:12.722532 11204 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:12.655480 11310 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:16:12.701182 11301 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.667191 11114 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:12.799583 11114 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:12.800179 11114 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:12.793071 11293 raft_consensus.cc:3055] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:12.801450 11293 raft_consensus.cc:740] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:12.802423 11293 consensus_queue.cc:260] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:12.803647 11293 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:12.811930 11114 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:12.826193 11457 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:12.788867 11152 raft_consensus.cc:697] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:12.720629 11416 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.666908 11231 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:12.788594  6221 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:12.790548  6907 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.837s (SENT) [suppressed 25 similar messages]
I20260709 13:16:12.728073 11365 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:12.743513 11450 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:12.785732 11471 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:16:12.670311 10713 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:12.795936  6399 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:12.790880 11389 consensus_queue.cc:237] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:12.798409 11301 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:12.799183 11462 log.cc:927] Time spent T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:16:12.734364 11308 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:12.828315 11152 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:12.838428  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:16:12.841553  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 176997us
I20260709 13:16:12.844744  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:12.850359  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:12.851171  6325 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.845597  6399 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 14.
I20260709 13:16:12.853361  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:12.858235  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:12.859279  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:12.859794  6324 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:12.860556  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:12.861469  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:12.861487  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:12.862370  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:12.862720  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:12.863658  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:12.862669  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:12.866626  6368 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:12.869694  6296 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:12.871845  6328 raft_consensus.cc:2393] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:12.843396 10713 raft_consensus.cc:697] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:12.874300 11329 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:12.874850 10713 consensus_queue.cc:237] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:12.877424 11366 consensus_queue.cc:1059] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:12.878402 11366 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:12.878983 11366 consensus_queue.cc:1059] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:12.879845 11366 raft_consensus.cc:3055] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:12.880156 11366 raft_consensus.cc:740] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:12.880541 11308 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:12.881428 11293 raft_consensus.cc:3055] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:12.881866 11293 raft_consensus.cc:740] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:12.882772 11293 consensus_queue.cc:260] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:12.883925 11293 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:12.885826  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 1.48581e+06us
I20260709 13:16:12.880915 11366 consensus_queue.cc:260] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:12.886607 11366 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:12.890230  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 1043) took 1108 ms. Trace:
I20260709 13:16:12.890616  6401 rpcz_store.cc:276] 0709 13:16:11.782291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.782416 (+   125us) service_pool.cc:224] Handling call
0709 13:16:11.801675 (+ 19259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.415929 (+614254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.889995 (+474066us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b5400322654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:12.890167 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1403240192}
I20260709 13:16:12.891759  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:12.892345  6401 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:12.893716  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 1173) took 1644 ms. Trace:
I20260709 13:16:12.894105  6322 rpcz_store.cc:276] 0709 13:16:11.248842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.249015 (+   173us) service_pool.cc:224] Handling call
0709 13:16:11.249411 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.763668 (+514257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.893506 (+1129838us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54003930d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:12.893661 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181325056}
I20260709 13:16:12.871996  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:12.896152  6329 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.898216  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:12.898614  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:12.900202  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:12.903102  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:12.905818  6935 raft_consensus.cc:1217] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 16 LEADER]: Deduplicated request from leader. Original: 14.12->[15.13-15.13]   Dedup: 15.13->[]
I20260709 13:16:12.906658  6935 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 16 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:16:12.840276 11365 raft_consensus.cc:697] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:12.908218  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:12.918818  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:12.919251  6371 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:12.919927  6935 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:12.921770  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:12.925932  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:12.926898  6934 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:16:12.928088  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:12.928956  6935 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:16:12.949890  6325 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:12.952280  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:12.952905  6935 raft_consensus.cc:3060] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.954751  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:12.955412  6401 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:12.910394  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:12.899827 11404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.621s	user 0.009s	sys 0.044s
I20260709 13:16:12.931169  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:12.834825 11416 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:12.965173 11416 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:12.965723 11473 log.cc:927] Time spent T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:16:12.969655 11470 log.cc:927] Time spent T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:16:12.971342  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:12.972555  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:12.950645 11423 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:12.960196 11404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.695s	user 0.012s	sys 0.044s
I20260709 13:16:12.974581 11404 raft_consensus.cc:697] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:12.975467 11404 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:12.922374 11392 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.959336  6936 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:12.979197  6329 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:12.980408  6933 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:16:12.982187  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:12.982797  6933 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:12.988471  6401 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:12.907972 11310 consensus_queue.cc:1059] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:16:12.999604  6942 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 961) took 1710 ms (client timeout 2172 ms). Trace:
W20260709 13:16:13.000075  6942 rpcz_store.cc:269] 0709 13:16:11.289803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.290130 (+   327us) service_pool.cc:224] Handling call
0709 13:16:12.999383 (+1709253us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54003980d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:12.999543 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268146560}
I20260709 13:16:13.001325 11450 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.004011 11057 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.005002 11450 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:12.831779 11114 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:13.005389 11392 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.007583 11392 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:13.009366 11365 consensus_queue.cc:237] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:13.010367 11217 raft_consensus.cc:3055] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:13.010800 11217 raft_consensus.cc:740] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:13.011628 11217 consensus_queue.cc:260] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:13.013192  6935 raft_consensus.cc:2468] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:13.014379  6941 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 14. Current term is 15. Ops: []
W20260709 13:16:13.014557  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.015065  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.012872 11217 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:13.027643  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:13.034189  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:13.041821  6404 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:13.045953  6295 connection.cc:256] RPC call timeout handler was delayed by -1.8502321339999526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 13:16:13.046357  6295 connection.cc:256] RPC call timeout handler was delayed by -1.8274545199999466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
I20260709 13:16:13.009011 11301 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:13.017314 11416 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:13.047639  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:13.049000  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:13.023391 11329 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:13.088457  6401 raft_consensus.cc:1275] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:13.043848 11478 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:13.104038  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 55054.4us
W20260709 13:16:13.106412  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.104108  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 193680us
W20260709 13:16:13.107577  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 188431us
I20260709 13:16:13.108235  6401 raft_consensus.cc:1240] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:13.108883  6371 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:13.088124 11329 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.117707  6404 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:13.117985  6371 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:13.116081  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 64935.8us
W20260709 13:16:13.118758  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.102154 11478 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.120146  6371 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:13.133483  6295 connection.cc:256] RPC call timeout handler was delayed by -1.4920450989998244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
I20260709 13:16:13.133687 11107 raft_consensus.cc:3055] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:16:13.133941  6295 connection.cc:256] RPC call timeout handler was delayed by -1.4090563760000805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
I20260709 13:16:13.134198 11107 raft_consensus.cc:740] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:16:13.134359  6295 connection.cc:256] RPC call timeout handler was delayed by -1.1813030569999228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2405s for a response
I20260709 13:16:13.135175 11107 consensus_queue.cc:260] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:13.136063  6295 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:13.136586 11107 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.137033 11293 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:13.137601 11293 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.141011 11310 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.141294 11283 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:13.141541 11310 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.141916 11283 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.143671 11310 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:13.144088 11283 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:13.144251 11310 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:13.144693 11283 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:13.145869 11293 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:13.149209 11395 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:13.152151 11263 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:13.154296  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:13.155248 11466 log.cc:927] Time spent T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.484s	user 0.001s	sys 0.000s
I20260709 13:16:13.155530  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:13.156140  6940 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:13.156965  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:13.158979  6297 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:13.160013 11483 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:13.160387 11483 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.160745 11483 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:13.164110  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 1047) took 1380 ms. Trace:
I20260709 13:16:13.164502  6405 rpcz_store.cc:276] 0709 13:16:11.783487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.783595 (+   108us) service_pool.cc:224] Handling call
0709 13:16:13.163928 (+1380333us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400183654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:13.164055 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3035063552}
I20260709 13:16:13.044183 11204 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.034798 11377 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:13.179195  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 59724.6us
I20260709 13:16:13.192335  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:13.198078  6371 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:13.120600 11329 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.199667  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:13.119859 11301 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:13.203480  6369 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:13.165539 11057 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:13.129527 11477 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:13.212337 11377 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:13.213694  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:13.214933 11204 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:13.215726  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:13.200443 10878 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:13.218525 11478 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:13.221410  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:13.222596  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 86601.1us
W20260709 13:16:13.244426  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 453840us
I20260709 13:16:13.190246  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:13.247155  6405 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
W20260709 13:16:13.248855  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 45495.8us
I20260709 13:16:13.250351  6939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 1097) took 2445 ms. Trace:
I20260709 13:16:13.250360  6369 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:13.250545  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 953) took 1813 ms. Trace:
I20260709 13:16:13.251109  6255 rpcz_store.cc:276] 0709 13:16:11.437544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.437869 (+   325us) service_pool.cc:224] Handling call
0709 13:16:11.438253 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.517626 (+ 79373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.517671 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.517731 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:11.517784 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.250308 (+1732524us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b54003b24d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:13.250361 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.250491 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182075264}
I20260709 13:16:13.252064  6295 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:13.253737  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 683370us
W20260709 13:16:13.254606  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 56609.3us
I20260709 13:16:13.259734  6371 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:13.261389  6369 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:13.260517  6368 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:13.250919  6939 rpcz_store.cc:276] 0709 13:16:10.798705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.799185 (+   480us) service_pool.cc:224] Handling call
0709 13:16:10.799493 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.857632 (+1058139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.243872 (+1386240us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400530cd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:13.244063 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2349678464}
I20260709 13:16:13.267201  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:13.267804  6254 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.268044  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:13.268589  6247 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.268750  6295 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:13.247957 10878 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:13.271263  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 482731us
I20260709 13:16:13.266764  6400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 1046) took 1483 ms. Trace:
I20260709 13:16:13.269912  6371 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:13.273977  6369 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:13.275170  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:13.276091  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:13.276423  6295 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:13.276659  6255 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
W20260709 13:16:13.275266  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 426784us
I20260709 13:16:13.271934  6400 rpcz_store.cc:276] 0709 13:16:11.783203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.783321 (+   118us) service_pool.cc:224] Handling call
0709 13:16:11.785288 (+  1967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.937235 (+151947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.937279 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.937334 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:11.937384 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.266562 (+1329178us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54001f4d54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:13.266602 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.266712 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348858112}
I20260709 13:16:13.277418  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:13.279441  6907 leader_election.cc:400] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12.
I20260709 13:16:13.280076  6907 leader_election.cc:403] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:16:13.248982 11057 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:13.252851 11299 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:13.283660  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:13.286130  6254 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:13.286427  6251 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:13.294353  6256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:13.294775  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:13.295024 11152 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12.
I20260709 13:16:13.295675  6252 raft_consensus.cc:2410] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:16:13.284184 11423 raft_consensus.cc:2804] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:13.284843 11490 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:13.297685 11490 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.298043 11490 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.300715  6247 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:13.275933 11360 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.279973 11241 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:13.301599 11409 consensus_queue.cc:1048] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:13.301647 11360 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:13.282704 11366 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:13.280882 11483 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.303845 11360 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:13.280611 11392 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:13.305299 11483 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:13.306612 11057 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.274534 11390 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:13.305311 10964 raft_consensus.cc:3055] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:13.262300 11377 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:13.262550 11477 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:13.310319 11207 consensus_queue.cc:1059] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:13.279789 11458 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.311106 11458 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:13.311403 11489 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:13.312198 11489 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:13.312271 11477 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:13.312608 11489 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:13.313040 11489 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:13.312870 11477 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.314889 11340 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:13.315044 11477 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:13.259734 11478 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:16:13.316255 11465 log.cc:927] Time spent T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.647s	user 0.000s	sys 0.002s
I20260709 13:16:13.282892 11365 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:16:13.308936 10964 raft_consensus.cc:740] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:13.317523  6253 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:13.295038  6256 raft_consensus.cc:606] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:13.321439  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 57394.9us
I20260709 13:16:13.418836 11423 raft_consensus.cc:697] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:13.696082  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:16:13.534845  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 260951us
I20260709 13:16:13.278196 10878 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.369544 11057 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:13.315174 11231 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:13.281045 11283 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:13.822007 11498 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:13.822826 11498 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.358570 11329 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:13.826507 11498 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:13.827320 11377 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.827558 11329 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:13.828238 11377 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:13.448735  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 185162us
I20260709 13:16:13.833240 11377 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:13.835695  6369 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:13.523221  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 253329us
I20260709 13:16:13.837167 11231 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:13.837947  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:13.838377  6369 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:13.328424 11458 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:13.839471 11231 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:13.711560 11340 consensus_queue.cc:1059] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:16:13.841797 11340 raft_consensus.cc:3055] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:13.842344 11340 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:16:13.713868 11468 log.cc:927] Time spent T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.988s	user 0.000s	sys 0.003s
W20260709 13:16:13.724730 11485 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.461s	user 0.000s	sys 0.000s
I20260709 13:16:13.842005 11504 consensus_queue.cc:1059] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:16:13.843878 11340 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.844736 11504 raft_consensus.cc:3055] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:13.845301 11504 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:13.846853 11504 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.848518  6369 leader_election.cc:304] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:13.727248 11477 raft_consensus.cc:3055] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:13.751165 11263 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:16:13.774863  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.776225  6256 raft_consensus.cc:614] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:13.777000  6907 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:13.798733  6941 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:13.799425  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 3043) took 1336 ms. Trace:
I20260709 13:16:13.800709 11483 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.820824 11217 consensus_meta.cc:287] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.764s	user 0.007s	sys 0.012s
I20260709 13:16:13.848740 11504 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:13.726616  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.812945 11392 raft_consensus.cc:697] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:13.851277 11477 raft_consensus.cc:740] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:13.856120 11263 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:13.857616 11477 consensus_queue.cc:260] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:13.859925 11263 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:13.862996 11483 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.853008  6327 rpcz_store.cc:276] 0709 13:16:12.462907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.464330 (+  1423us) service_pool.cc:224] Handling call
0709 13:16:12.464638 (+   308us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:12.464974 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.465002 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:12.465533 (+   531us) log.cc:844] Serialized 52 byte log entry
0709 13:16:12.543007 (+ 77474us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:12.543044 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.543105 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.315661 (+772556us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:16:13.798600 (+482939us) raft_consensus.cc:1685] finished
0709 13:16:13.798648 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.799121 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":9167,"spinlock_wait_cycles":60328704,"thread_start_us":54631,"threads_started":1,"wal-append.queue_time_us":148207}
I20260709 13:16:13.860590 11477 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.867311  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:13.868165  6330 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:13.869930  6247 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:16:13.870493  6247 pending_rounds.cc:85] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 4
I20260709 13:16:13.870867  6247 pending_rounds.cc:107] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:16:13.870769  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:13.865160  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:13.871483  6247 raft_consensus.cc:2889] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:13.872097  6250 raft_consensus.cc:2410] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:13.873442 11263 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:13.873607  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:13.874221  6251 raft_consensus.cc:1240] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:13.874420 11263 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.875785  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:13.885527  6941 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
I20260709 13:16:13.906275  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:13.911197  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:13.888978 11217 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:16:13.886394  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 44558.4us
W20260709 13:16:13.914356  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 49583.9us
W20260709 13:16:13.917802 11496 log.cc:927] Time spent T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:16:13.917881  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 69627.1us
I20260709 13:16:13.917603 11423 consensus_queue.cc:237] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.920502  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2847) took 1187 ms. Trace:
I20260709 13:16:13.921481 11501 raft_consensus.cc:2804] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:13.922547 11501 raft_consensus.cc:697] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:13.925611 11204 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:13.928239  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:13.929641  6937 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:13.931012  6938 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:13.936739 11263 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:13.937875 11204 raft_consensus.cc:697] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:16:13.940883  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.940367 11437 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.966296  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:13.935254 11340 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:13.973169  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:13.985479  6330 raft_consensus.cc:2393] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 14: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:13.986864  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:13.987332  6222 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:13.987584  6331 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:13.990916 11360 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:13.991667  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:13.992266  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:13.993440 11490 consensus_meta.cc:287] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.695s	user 0.016s	sys 0.018s
I20260709 13:16:13.993767  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:13.993956 11490 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:13.994375  6331 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:13.924455 11501 consensus_queue.cc:237] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:13.921018  6402 rpcz_store.cc:276] 0709 13:16:12.732752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.973427 (+240675us) service_pool.cc:224] Handling call
0709 13:16:12.973761 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:13.020827 (+ 47066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.020869 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:13.021362 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:16:13.249773 (+228411us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:13.249811 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.249874 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.912911 (+663037us) raft_consensus.cc:1685] finished
0709 13:16:13.914460 (+  1549us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.920286 (+  5826us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42394,"raft.queue_time_us":46774,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":8517,"thread_start_us":157509,"threads_started":1,"wal-append.queue_time_us":679339}
I20260709 13:16:13.964394 11217 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.001845  6250 raft_consensus.cc:1240] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:16:14.003345  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:14.003590 11217 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:14.004148  6250 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
W20260709 13:16:14.004774  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 84441.8us
I20260709 13:16:14.005414  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:14.005637  6369 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:14.006465 11514 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:14.006879  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:14.007747  6254 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:16:14.008680  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:14.009968 11490 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.010092  6255 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:14.007252 11514 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.011921  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:14.007174  6938 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:14.014365  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:14.014809  6369 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:14.015836 11506 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:14.016310 11506 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:14.016686 11506 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:14.017418  6252 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:14.018599  6252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:14.019436  6252 raft_consensus.cc:606] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:14.019874  6252 raft_consensus.cc:614] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:14.021037 11514 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.020942 11404 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:14.021899 11508 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:14.022615 11508 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.029695 11483 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.017431 10964 consensus_queue.cc:260] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.031329 10964 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:14.033494 11509 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:14.034322 11509 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.035324  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:14.029542 11310 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:16:13.999465  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 222903us
I20260709 13:16:14.054975  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:14.072032  6254 raft_consensus.cc:2368] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 13. Current term is 14.
W20260709 13:16:14.033509 11505 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:16:14.075500  6248 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:14.076023  6250 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:16:14.075783 11204 consensus_queue.cc:237] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.077538  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:14.086788  6247 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:14.067778 11437 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.089279 10878 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.092218 11437 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:14.092630 10878 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.093153 11490 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.093969 11490 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.096685 11490 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:14.097293 11329 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.097990 11329 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.099439  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:14.100414 11329 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.083258  6222 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:14.101656  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 104731us
I20260709 13:16:14.102701  6222 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:14.036908 11392 consensus_queue.cc:237] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:14.105381  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:14.106459 11217 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:14.107260 11217 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:14.104221  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:14.107591 11217 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:14.100359 11283 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:14.061360 11508 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.036904 11509 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:14.134523  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:14.134883  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:14.136071  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:14.136487  6331 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:16:14.136771  6938 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:14.137975  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:14.138576  6326 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:14.138757  6327 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:14.139089 11437 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:14.137938  6331 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:16:14.142031  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 223940us
W20260709 13:16:14.126849 11489 consensus_meta.cc:287] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.783s	user 0.020s	sys 0.000s
I20260709 13:16:14.144039  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:14.127851 11217 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:14.298406  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 168522us
I20260709 13:16:14.312453  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:14.315776  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:14.318166  6331 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:14.319410  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:14.320581  6249 raft_consensus.cc:2410] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
W20260709 13:16:14.323125 11107 consensus_meta.cc:287] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.186s	user 0.014s	sys 0.010s
I20260709 13:16:14.323745  6322 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:14.328830  6255 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:14.329996  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:14.331257  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:14.332015  6328 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
W20260709 13:16:14.341596  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 237713us
I20260709 13:16:14.346231 11360 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:14.347970 11360 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:16:14.353691 11484 log.cc:927] Time spent T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.591s	user 0.004s	sys 0.002s
I20260709 13:16:14.357173  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:14.356446  6330 raft_consensus.cc:1240] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:14.366134  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 351462us
I20260709 13:16:14.366550 11517 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.367291 11509 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:14.367123 11517 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.367859 11509 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.369364 11340 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:14.369977 11340 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.370481  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:14.372042 11340 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:14.367146  6369 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:14.373616 11500 log.cc:927] Time spent T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6: Append to log took a long time: real 0.603s	user 0.006s	sys 0.001s
W20260709 13:16:14.374825 11477 consensus_meta.cc:287] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.005s
I20260709 13:16:14.375734  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:14.377002  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:14.377995  6219 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:14.380103 11357 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:14.380501 11357 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.380836 11357 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:14.381863  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:14.382781  6247 raft_consensus.cc:2468] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:14.382822 11437 consensus_queue.cc:1059] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:14.386049  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1916) took 1118 ms. Trace:
I20260709 13:16:14.386591  6253 rpcz_store.cc:276] 0709 13:16:13.267176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.274939 (+  7763us) service_pool.cc:224] Handling call
0709 13:16:14.385653 (+1110714us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b54001473d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:14.385824 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78653312}
I20260709 13:16:14.377038  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:14.437714  6255 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:14.443231  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:14.302891 11489 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.452886  6253 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:14.462589  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:14.465854 11521 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:16:14.466192  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 99220us
I20260709 13:16:14.466737 11521 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.467224  6369 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:14.479554 11477 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:14.437110 11340 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.485737 11340 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.488601 11340 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:14.489281  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:14.490381  6325 raft_consensus.cc:2393] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 15: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:14.493106  6369 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:14.494962  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:14.495520 11502 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:14.496089 11502 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.496491 11508 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:14.496817 11404 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:14.496567  6297 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:14.497287 11152 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:16:14.498051 11490 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:14.498742  6297 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:14.502908  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:14.504453  6255 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
W20260709 13:16:14.512876  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.496462 11502 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:14.477756 11517 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:14.522024  6251 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:14.525521  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:14.526304  6325 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:14.537276  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:14.537602 11501 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.537770 11107 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:14.538955  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:14.538378 11501 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.537431 11512 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:16:14.497377 11508 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.537305 11520 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:14.565876  6402 raft_consensus.cc:2410] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:14.548878  6255 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:16:14.567596  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 187019us
I20260709 13:16:14.558557  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:14.574205  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.515331 11340 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:14.575351  6251 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 15.
I20260709 13:16:14.521186 11498 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:14.541165 11107 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:16:14.561966 11506 consensus_meta.cc:287] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
I20260709 13:16:14.592423  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:14.593070  6322 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:14.549211 11152 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:14.556540 11521 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:14.574278 11509 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:14.588752  6255 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:16:14.565030 11357 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.596817  6397 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:14.606262  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:14.594419 11107 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:14.565910 11520 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.616103  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:14.617007  6219 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:14.603823 11498 raft_consensus.cc:697] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:14.649739  6219 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:14.610831 11423 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:14.587486 11310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.050s	sys 0.060s
I20260709 13:16:14.596100 11340 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.661044  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:14.600976 11506 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.661756  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:14.646546 11509 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:14.676363 11509 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.677965 11498 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.679587 11509 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:14.681092 11521 consensus_queue.cc:1059] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:14.681639 11506 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.682027 11521 consensus_queue.cc:1059] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:14.682529 11357 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:14.682909 11114 raft_consensus.cc:3055] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:14.683399 11114 raft_consensus.cc:740] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:14.684315 11114 consensus_queue.cc:260] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.658574 11423 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.685573 11423 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:14.687516 11512 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.682854 11521 raft_consensus.cc:3055] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:14.688930 11521 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:14.660570  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:14.689779  6398 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:16:14.666715 11519 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.667336 11241 consensus_queue.cc:1059] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:14.690294  6219 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:14.690534 11519 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.690912 11478 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:14.691226 11241 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:14.691756 11478 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.692977 11241 raft_consensus.cc:3055] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:14.693235 11504 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:14.693545 11241 raft_consensus.cc:740] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:14.694119 11504 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.694737  6368 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:14.694955 11241 consensus_queue.cc:260] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.668090 11385 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:14.670198 11508 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.673556 11489 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:14.697381 11385 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.697566 11503 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:14.696910 11241 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:14.697393 11519 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:14.666745  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:14.696779 11504 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:14.664435  6251 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:16:14.606935 11152 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.701603 11152 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:14.697983 11385 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:14.703333 11114 raft_consensus.cc:3060] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:14.705343  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.666711 11458 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:14.705235 11217 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.706027 11458 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:14.706421 11458 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:14.687633  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:14.709146 11107 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.699312 11357 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:14.710539 11357 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.710953 11357 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:14.711539 11107 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.690039 11521 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.713304 11521 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:14.720223 11520 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.721527  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:14.722119 11501 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:14.722123  6326 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:14.725819  6221 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:14.726310  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:14.726998  6325 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:14.728109  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:14.729110  6323 raft_consensus.cc:2410] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:16:14.729218  6221 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:14.729782 11217 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.730523 11217 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:14.730856  6323 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:14.731168  6221 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:14.673647  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:14.688364 11512 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:14.659471 11310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.051s	sys 0.061s
I20260709 13:16:14.744236  6326 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:16:14.732944  6221 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:14.716924 11522 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:14.755563  6368 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:14.746263 11437 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:14.741791 11310 raft_consensus.cc:697] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:14.731200 11217 consensus_queue.cc:1059] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:16:14.759760 10964 consensus_meta.cc:287] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.002s
I20260709 13:16:14.788733 11385 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.791567 11385 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:14.793674 11310 consensus_queue.cc:237] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.755820 11506 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:14.797612 11506 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.797729 11458 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.799929 11506 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.801163  6368 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:14.803472 11503 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:14.803926 11489 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:14.804288  6400 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:14.803947 11503 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.809741 11340 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:14.809931 11503 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:14.817824 11299 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.818570 11299 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.821041 11299 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:14.828328 11483 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.829038 11483 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.831465 11478 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.831683 11483 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.832299 11512 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:14.846990  6397 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:14.852981  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:14.853830  6398 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:14.848685 11503 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.855291  6402 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:14.856949  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:14.857801 11437 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:14.858278 11437 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.858673 11437 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:14.853255 11392 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:14.865136  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:14.867347  6397 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:14.867580 11535 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:14.834317 11241 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:14.868227 11535 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:14.863224 11392 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.869596 11392 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:14.868677 11241 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.870262 11241 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:14.869369  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:14.873471  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:14.866014  6402 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16.
I20260709 13:16:14.874320  6398 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
W20260709 13:16:14.862917  6222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.016s	sys 0.057s
W20260709 13:16:14.875099  6222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.016s	sys 0.057s
W20260709 13:16:14.875912  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 532249us
I20260709 13:16:14.880770  6400 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:16:14.892788  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:14.898039  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.892164  6222 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:14.901168  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:14.784665  6322 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
W20260709 13:16:14.925024  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 192245us
I20260709 13:16:14.799863 11458 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:14.931723  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 436885us
I20260709 13:16:14.932562  6398 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:14.935065  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:14.935446  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:14.937777  6907 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.016s	sys 0.040s
W20260709 13:16:14.938315  6907 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.016s	sys 0.041s
I20260709 13:16:14.964123  6397 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:14.970800  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:14.971875  6325 raft_consensus.cc:2410] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:16:14.716974 11423 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:14.976181  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:16:14.997522  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 105501us
I20260709 13:16:14.973914 11458 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:16:15.007781  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 428964us
I20260709 13:16:15.003953  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:15.010078  6330 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:14.985224 11404 raft_consensus.cc:697] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:15.031416  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:15.032164  6325 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:15.023449 11458 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:15.045740  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.016187 11477 raft_consensus.cc:697] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:15.053198  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:15.061280  6221 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:15.071857  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:15.073597 11423 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:15.074910  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:15.081198  6296 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:15.077080 11114 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:15.078281 11525 consensus_queue.cc:1059] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:15.103632  6247 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:15.104394  6296 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:15.106837 11535 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:15.109447  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:15.111001  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:15.111708  6940 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
I20260709 13:16:15.113703 11404 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.117581 11458 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.120584 11458 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:15.121701  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:15.128237  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:15.112838  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:15.047340  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:15.094580 11502 consensus_meta.cc:287] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.003s
I20260709 13:16:15.136693  6296 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:15.137776  6296 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:15.140722  6405 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:15.142987  6296 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:15.148167  6325 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:15.154368  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:15.155861  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.100279 11483 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:15.177598 11483 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.178123 11483 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:15.128715 11503 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:15.151880  6297 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:15.197911  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.203557  6247 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:15.144071 11377 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:15.209887  6327 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 14. Current term is 15. Ops: []
W20260709 13:16:15.212936  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 377065us
I20260709 13:16:15.144407 11114 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:15.215610  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:15.171656 11360 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:15.124902 11512 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:16:15.173666 11519 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:15.138963 11520 raft_consensus.cc:3055] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:15.125756 11478 consensus_queue.cc:1059] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:16:15.214182  6252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2678) took 1218 ms. Trace:
I20260709 13:16:15.141574 11204 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:15.100920 11533 consensus_queue.cc:1059] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.133s
I20260709 13:16:15.173514 11525 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:15.226260  6370 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.002s	sys 0.014s
W20260709 13:16:15.260107  6370 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.003s	sys 0.015s
I20260709 13:16:15.253495  6247 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:15.225469  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:15.261063  6326 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 12: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:15.258355  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.225392 11377 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.249707  6252 rpcz_store.cc:276] 0709 13:16:13.988778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.020776 (+ 31998us) service_pool.cc:224] Handling call
0709 13:16:14.049891 (+ 29115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.305701 (+255810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.305751 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:14.355542 (+ 49791us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.607072 (+251530us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:15.015638 (+408566us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.206528 (+190890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.206601 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.206641 (+    40us) raft_consensus.cc:1685] finished
0709 13:16:15.206655 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.206766 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39754,"prepare.queue_time_us":408817,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":122254,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":6904,"thread_start_us":806957,"threads_started":3,"wal-append.queue_time_us":515698}
I20260709 13:16:15.139537 11502 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.279567  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:15.225693 11114 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:15.285599  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 247948us
I20260709 13:16:15.286553  6221 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:15.251971 11520 raft_consensus.cc:740] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:15.249061 11519 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:15.259105 11423 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:15.293058  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:15.293422  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:15.266888 11540 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:15.296284  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 65946.7us
I20260709 13:16:15.296764 11537 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.278451 11377 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:15.297196 11366 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:15.217073 11357 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.288465 11114 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:15.300833 11263 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:15.301776 11531 log.cc:927] Time spent T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.291s	user 0.002s	sys 0.000s
I20260709 13:16:15.302590 11360 raft_consensus.cc:3055] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:15.302867  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.299564 11483 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.317334 11385 raft_consensus.cc:3055] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:15.317517 11504 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.258872 11541 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:15.265959 11525 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.342068  6397 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:15.345253  6219 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:15.280902 11498 raft_consensus.cc:3055] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:15.270936 11310 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.376718  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:15.377104  6249 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:15.377194 11310 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.380038 11310 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:15.340108 11519 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:15.365347 11385 raft_consensus.cc:740] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:15.267014 11204 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.383163 11204 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:15.384531  6397 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 15.
I20260709 13:16:15.318185 11477 consensus_queue.cc:237] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:15.356711  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 204912us
I20260709 13:16:15.389885  6400 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:15.365746  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:15.372987  6255 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:15.372125  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:15.373000  6247 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:16:15.375195  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 86723.6us
I20260709 13:16:15.372031 11498 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:15.377403 11537 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.379853 11536 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:15.350131  6934 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:15.405355 11498 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.406661 11498 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:15.408995  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:15.409325 11204 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:15.409652 11458 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:15.410439 11458 raft_consensus.cc:697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:15.374317 11525 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:15.410908 11204 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:15.411417 11458 consensus_queue.cc:237] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.356755 11360 raft_consensus.cc:740] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:15.350131 11366 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.354444 11423 raft_consensus.cc:697] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:15.399567 11519 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.401571  6405 raft_consensus.cc:1240] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:15.401450 11541 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.403092 11537 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:15.409719  6934 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
W20260709 13:16:15.370729  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 84331us
I20260709 13:16:15.425525  6330 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:15.426998  6940 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 14: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:15.428750  6222 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:15.368841 10878 raft_consensus.cc:3055] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:16:15.424400 11392 consensus_meta.cc:287] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.554s	user 0.002s	sys 0.010s
I20260709 13:16:15.440794  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.373839 11504 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.446514  6933 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:15.441047  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:15.451249  6255 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:15.448302  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:15.449671  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:15.427588 11366 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:15.465260  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:15.453866 11392 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.370304 11263 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.470834  6221 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:15.443109 10878 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:15.366657 11540 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.498791  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.478279 11553 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:15.478822 11535 raft_consensus.cc:3055] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:15.506655  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.507485  6397 raft_consensus.cc:2393] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:16:15.488597 11437 consensus_meta.cc:287] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.629s	user 0.015s	sys 0.000s
W20260709 13:16:15.517217  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 60831.1us
I20260709 13:16:15.525987  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:15.539672  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:15.541042  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:16:15.553028  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.555784  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.515023 11535 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:15.570447  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.490099 11520 consensus_queue.cc:260] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.551427 11557 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:15.584136  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.555136 11570 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:15.566685 11204 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.537876 11437 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.567162 11553 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:15.592780  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 138891us
I20260709 13:16:15.501502 11360 consensus_queue.cc:260] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.588371  6255 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
W20260709 13:16:15.598068  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 151022us
I20260709 13:16:15.600602  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:15.607937  6249 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
W20260709 13:16:15.602859 11558 log.cc:927] Time spent T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:16:15.571352 11114 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.617785 11263 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:15.618511  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.619346 11392 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:15.619835 11483 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:15.623222 11525 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.624145  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:15.625880  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:15.632524  6934 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:16:15.593870 11502 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:15.626870  6942 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:15.562469 11423 consensus_queue.cc:237] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.624809 11360 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:15.593089 11540 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:15.605829 11357 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:15.616510 11377 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.634836  6252 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:15.629890  6399 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:15.626185 11520 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:15.635296  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.639827  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:16:15.642562  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:15.647614  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.638878  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.601068 11204 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.655082  6934 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:15.679925 11204 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:15.680096 11561 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:16:15.681064  6255 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
W20260709 13:16:15.682313 11566 log.cc:927] Time spent T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:16:15.682854  6936 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
W20260709 13:16:15.683692 11562 log.cc:927] Time spent T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:16:15.685228  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:15.685403  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.686045  6942 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:15.686088  6403 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:15.687033  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:15.687692 11437 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:15.688911 11555 log.cc:927] Time spent T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:16:15.611074 11553 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.702342 11114 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:15.703584 11553 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:15.600204 10878 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.675477  6396 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:15.705180 11241 consensus_meta.cc:287] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.834s	user 0.012s	sys 0.000s
I20260709 13:16:15.673317 11519 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:15.707155 11575 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.115s	user 0.000s	sys 0.002s
I20260709 13:16:15.707362  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:15.708158 11572 log.cc:927] Time spent T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:16:15.708637  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 103680us
I20260709 13:16:15.723662  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.731043 11540 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.731601 11540 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.720263 11570 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.733511 11570 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:15.734021 11552 log.cc:927] Time spent T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.280s	user 0.002s	sys 0.000s
I20260709 13:16:15.734464 11423 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.735008 11423 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.735646 11570 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:15.736855 11385 consensus_queue.cc:260] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.722286 11241 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.733804 11540 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:15.738230 11385 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:15.745606 11541 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:15.712461 11535 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.747658 11535 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:15.737099 11423 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:15.749810 11270 consensus_queue.cc:1175] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" responder_term: 14 status { last_received { term: 12 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:15.743039  6256 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 15: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:15.733846 11217 consensus_queue.cc:1048] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:16:15.744385 11241 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:15.754542  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:15.754912  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:15.755264  6396 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:15.755829  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.756486  6398 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:16:15.725734 10964 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.757474  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:15.757809 10964 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.757548  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.759461  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.759549  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:15.760057 10964 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:15.760234  6402 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:15.761740 11377 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:15.764056 11525 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:15.732941  6221 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:15.766656  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.767498  6402 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 12: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:15.771350 11385 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:15.724346  6403 raft_consensus.cc:2376] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 15. Re-sending same reply.
W20260709 13:16:15.793396  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.736963  6404 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:15.777951  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.795406  6398 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 12: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:15.778208  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.791743  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.783093  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.784644  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:15.784897  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.786499  6401 raft_consensus.cc:1240] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:15.786865  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:15.786533  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.804494  6253 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:15.804888  6254 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:15.801896  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:15.804180  6255 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:15.766583 11504 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:15.805792  6398 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 12: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:15.789608  6933 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:16:15.790091  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.789726  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.792476  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.806634  6402 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:15.787861  6907 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:15.807935  6396 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:15.810803  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:15.788550 10964 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:16:15.814412  6369 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:15.818224  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.818554  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.820108  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:15.820264  6252 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:15.822724  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.819015  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:15.825160  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.826630  6250 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:15.828850  6403 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:15.815338  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.813772 11204 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:15.833894  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.835806  6252 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 9: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:15.809518 11437 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:15.788627 11366 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.838130  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.838768  6398 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 14.
I20260709 13:16:15.839939  6369 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:15.818259 11504 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:16:15.842360  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:15.843132  6398 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:15.843016  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:15.843509  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:15.844825 11404 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:15.845036  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:15.845230 11404 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.845585 11404 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:15.845616  6248 raft_consensus.cc:2376] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13. Re-sending same reply.
I20260709 13:16:15.846616  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.847702  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:15.848194  6248 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:15.849308 11503 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:15.812552 11392 consensus_queue.cc:1059] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:16:15.851763  6369 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:15.851909  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.853163  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:15.859381  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.862533  6404 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:15.836737 11537 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:15.864285  6402 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 12: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:15.864362  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:15.870887  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 54166.5us
I20260709 13:16:15.872107  6907 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:15.868031  6253 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:16:15.877213  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.914098  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:15.840926 11299 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:16:15.914250  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.870311 11502 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:15.874290 11537 raft_consensus.cc:697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:15.918655  6221 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:15.863979 11542 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:16:15.925966  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.917836 11536 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:15.925060  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.934470  6253 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:15.932780 11270 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:15.943991 11576 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
I20260709 13:16:15.944172 11458 consensus_queue.cc:1059] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:16:15.945003 11458 consensus_queue.cc:1243] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer b940f12ed61a49c4b3c11f13ef50fa92 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:15.945510 11270 raft_consensus.cc:3055] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:15.945861 11270 raft_consensus.cc:740] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:15.946372  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:15.946594  6369 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:15.947029  6906 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:15.947482  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.947861 11152 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:15.948089 10964 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:15.948515  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:15.946642 11270 consensus_queue.cc:260] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:15.876888 11437 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:15.926707 11204 consensus_queue.cc:1059] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:16:15.922406 11502 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.951965  6222 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:15.998109  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 46237.3us
I20260709 13:16:15.998566  6221 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:15.958449  6254 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:16:15.968170  6323 raft_consensus.cc:1240] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:16:15.968358  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 581682us
I20260709 13:16:15.969272  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:16.000669  6322 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:15.969427  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:15.969682  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:16.002619  6329 raft_consensus.cc:2410] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:16:15.949095  6249 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:15.969954  6331 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:16.004210  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.003944  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:15.971763  6328 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:16.001093  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:15.976879  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:16.006392  6940 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:16.006578  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:16:15.975224  6371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.978134  6933 raft_consensus.cc:1275] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:15.977041  6251 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
I20260709 13:16:15.971210  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:15.977483  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:15.997169  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:16.004837  6253 raft_consensus.cc:2376] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 15. Re-sending same reply.
I20260709 13:16:16.011039  6401 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:16.011253  6222 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:15.999490  6254 pending_rounds.cc:85] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 4
I20260709 13:16:15.993479  6248 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:16.011885  6254 pending_rounds.cc:107] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:16:16.012208  6254 raft_consensus.cc:2889] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:15.971664  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.984570  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:15.996855  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:16:16.013733  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:15.968358  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.968708  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:16:16.014765  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.015105  6330 raft_consensus.cc:2368] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 12. Current term is 13.
I20260709 13:16:15.969180  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:15.971987 11565 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:16.020469  6324 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:16:15.963624  6295 leader_election.cc:336] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.775s (SENT)
W20260709 13:16:16.016934  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 144923us
I20260709 13:16:16.017161  6368 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:16.018607  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:16.023452  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:16.014902  6297 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.019526  6371 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:15.993966 11568 log.cc:927] Time spent T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 13:16:15.952586 11270 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:15.949375 11299 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:16.030489  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:16.021224  6295 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:15.949232 11152 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:16.021273  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:16.029174  6329 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 15: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:15.993433 11502 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:15.965574 11512 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:15.979423 11437 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:16.040464  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:16.041246  6398 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:16.026342 11360 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:16.034727 11299 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:16.043210 11299 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:15.984931 11204 raft_consensus.cc:3055] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:16.044375 11204 raft_consensus.cc:740] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:15.973840 11366 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:16.045715 11366 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:16.045354 11204 consensus_queue.cc:260] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.046608 11204 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:16.046957 11565 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.048403  6401 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:16.049724  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:16.049844  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 86278us
I20260709 13:16:16.050328  6324 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 8.
W20260709 13:16:16.050657  6295 leader_election.cc:336] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.816s (SENT)
I20260709 13:16:16.051507 11107 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.052003 11107 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:16.057246  6907 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.058660  6907 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:16.061803  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:16.063032 11589 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:16.063689 11589 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:16.064209 11589 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:16.065063 11521 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:15.977555 11537 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:16.026968 11542 consensus_queue.cc:1059] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:16:15.960310 11404 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:16.069164  6402 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 15: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:16.069870  6326 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:16.073660 11263 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:16.074294 11525 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:16.074818 11525 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.078181  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:16.078378 10878 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:16.080767  6327 raft_consensus.cc:1240] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:16.081372 11512 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:16.083567 11512 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:16.084436  6252 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:16.046226 11366 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.093734 11542 consensus_queue.cc:1243] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer a13ffe92eb374309a5c8476d9fbbb2b8 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:16:16.095772 11504 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:16.096349 11504 raft_consensus.cc:697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:16.097236 11503 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:16.097584 11107 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:16:16.076916 11525 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:16.049937 11565 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:16.101643  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 86046.1us
W20260709 13:16:16.102221  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 87385us
I20260709 13:16:16.060822  6907 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:16.104573  6322 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:16.103749  6907 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:16.114290  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 115910us
I20260709 13:16:16.115052  6221 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.120289  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:16.126204  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.126641  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.124660  6295 leader_election.cc:336] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 2.143s (SENT)
I20260709 13:16:16.127615  6322 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:16.129675 11592 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:16:16.138438  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.130585  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 183609us
I20260709 13:16:16.130636  6247 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:16.139734  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:16.131675  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:16.131947  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:16.140558  6250 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:16.133200  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:16.141386  6906 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.114516 11152 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:16.146183  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.144924  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:16.150851  6247 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:16.147488  6256 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:16.147959 10964 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:16.116281 11498 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:16.148943  6255 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
W20260709 13:16:16.157884  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 138452us
I20260709 13:16:16.123103 11536 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:16.123291 11533 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:16.118569 11539 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:16.159257  6371 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:16.168007  6906 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:16.171103  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:16.125946 11241 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:16:16.171715  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 154654us
I20260709 13:16:16.173573  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:16.204210  6326 raft_consensus.cc:2393] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 9: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:16:16.174757  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 50148.8us
I20260709 13:16:16.200793  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:16.207664  6324 raft_consensus.cc:2393] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:16.214630  6327 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:16.156080 11152 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:16.155555 10964 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:16.161376 11498 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:16:16.227258  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 102398us
I20260709 13:16:16.206909 11517 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:16:16.175201 11533 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.202401 11377 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.202876 11539 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.216859 11392 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:16.234902  6369 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:16.228057 11498 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:16.250000  6369 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:15.561970  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:16.223385 11152 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:16.123553 11504 consensus_queue.cc:237] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:16.246502 11596 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:16.228106 10964 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:16.223664 11241 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:16.242843 11533 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:16.251503 11539 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:16.251724 11377 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:16.264151 11423 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:16.325927 11590 log.cc:927] Time spent T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:16.278028 11541 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:16.347281 11596 raft_consensus.cc:697] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:16.347590  6255 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:16:16.348853  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 189699us
I20260709 13:16:16.350078  6371 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:16.352242  6371 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:16:16.355862  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 149167us
I20260709 13:16:16.217512 11589 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.349234 11541 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.364077 11541 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:16.365455 11589 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:16.367345 11366 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:16.277360 11241 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.371742 11241 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:16.372447  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:16.373687 11593 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:16.374593  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:16.375195  6322 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:16.308274 11423 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.377007 11423 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:16.362699  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:16.387383  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:16.380481  6324 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:16.390504  6905 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:16.391784  6405 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:16.379710  6295 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:16.396221  6250 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:16.399035  6371 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:16.399596  6905 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:16.384902  6219 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.407693  6371 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:16.372699 11299 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:16.414376  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 184351us
I20260709 13:16:16.415154  6326 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:16:16.414310  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:16.419293  6327 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:16.419512  6296 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:16.418334  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:16.420073  6371 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:16.423763  6219 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.425333  6330 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:16:16.425390  6296 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.427006  6330 pending_rounds.cc:85] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 6
I20260709 13:16:16.427346  6330 pending_rounds.cc:107] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:16:16.427649  6330 raft_consensus.cc:2889] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:16.386044 11540 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:16.382160 11506 raft_consensus.cc:3055] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:16.417213 11589 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:16.435312  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:16.436399  6325 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:16.383955 11404 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:16.453529  6327 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:16.434592  6371 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:16.415916 11377 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:16.506394  6219 leader_election.cc:400] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 12. Current term is 13.
W20260709 13:16:16.454674  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 96289.1us
I20260709 13:16:16.512372  6219 leader_election.cc:403] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:16:16.420102 11503 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:16.348433 11596 consensus_queue.cc:237] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.429824 11329 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:16.403224 10878 consensus_queue.cc:1059] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 13:16:16.478931  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.433296 11508 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:16.436183 11553 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:16.440963 11521 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:16.438521 11540 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:16:16.546958  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 122127us
I20260709 13:16:16.562361  6219 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.563162  6255 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:16.549857  6398 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:16.551676  6325 raft_consensus.cc:1275] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:16:16.556617  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 306689us
W20260709 13:16:16.556895  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 131589us
I20260709 13:16:16.515688 11478 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:16.526412 11329 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.516253 11589 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:16.561615  6368 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:16.570027  6219 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.442070 11506 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:16.571373  6369 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:16.566443  6399 raft_consensus.cc:1275] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:16:16.573952  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 155371us
I20260709 13:16:16.558876 11404 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:16.581970  6219 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.584174  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:16.582134  6905 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:16.550971 11263 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 12. Current term is 13.
I20260709 13:16:16.590317  6219 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.566768 11540 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:16.594468  6325 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:16:16.596024  6905 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:16.592420  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 157914us
I20260709 13:16:16.603492  6371 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:16.560067 11508 raft_consensus.cc:697] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:16.600446  6219 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:16.580535 11329 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:16.580809 11553 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:16:16.616070  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 44786.5us
I20260709 13:16:16.607053  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:16.621966  6330 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 15: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:16.548451 11502 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:16.587276 11589 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:16.588392 11360 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:16.599249 11241 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:16.585027 11607 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:16.629379  6295 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:16.614707 11570 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:16.633440  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:16.586400 11536 consensus_queue.cc:1059] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:16:16.586753 11366 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:16:16.618165 11404 raft_consensus.cc:697] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:16.602279 11521 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:16:16.717975 11536 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:16.593585 11595 consensus_queue.cc:1059] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:16:16.728971 11512 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:16.728716 11616 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:16.635802 11614 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:16.728681 11612 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:16.651232 11377 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:16.635658 11556 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:16.748670  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 187598us
I20260709 13:16:16.778723  6368 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:16.733248 11392 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:16.739746 11503 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:16.739326 11536 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:16:16.791117  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 187729us
I20260709 13:16:16.632688 11607 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:16.790316 11299 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:16.793166 11563 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:16.746307 11570 raft_consensus.cc:697] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:16.746155 11612 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:16.795953  6906 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.000s	sys 0.013s
I20260709 13:16:16.741420 11606 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:16.822129  6906 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.000s	sys 0.014s
W20260709 13:16:16.827147  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 659155us
I20260709 13:16:16.798619 11607 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:16.828748  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 201462us
W20260709 13:16:16.836670  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 240739us
I20260709 13:16:16.832111  6906 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:16.840711  6905 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:16.824487  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 191090us
I20260709 13:16:16.791798 11553 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.762336 11508 consensus_queue.cc:237] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:16.823628 11612 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:16.746811 11506 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.799146 11536 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:16.851373  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.851892  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:16.857372  6250 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:16.852566  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:16.858489  6252 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:16.795548 11541 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:16.855078  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 76454.7us
I20260709 13:16:16.848112 11477 raft_consensus.cc:3055] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:16.865401 11477 raft_consensus.cc:740] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:16.848799 11299 consensus_queue.cc:1048] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:16:16.861680 11502 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:16.868431 11392 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:16.868181 11592 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:16.863998 11627 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:16.850462 11553 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.908915 11553 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:16.911058 11600 log.cc:927] Time spent T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:16:16.877208  6906 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.882858  6250 raft_consensus.cc:2468] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:16:16.845217 11404 consensus_queue.cc:237] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.919559 11542 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:16.920142 11542 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.884611 11609 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:16:16.884505 11477 consensus_queue.cc:260] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.885007 11299 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:16.922236 11542 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:16.923976 11601 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:16:16.884537 11624 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.877460 11506 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:16.925258 11624 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:16.894359 11541 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:16.895081 11563 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:16.881937 11622 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:16:16.926749 11563 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:16.895838  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 52569.9us
I20260709 13:16:16.895627 11540 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.929405  6402 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:16.930518 11603 log.cc:927] Time spent T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:16:16.877964 11606 consensus_queue.cc:1059] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:16:16.931994 11627 raft_consensus.cc:3055] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:16.932374 11627 raft_consensus.cc:740] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:16.933276 11627 consensus_queue.cc:260] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.934551 11627 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:16.882884 11570 consensus_queue.cc:237] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:16.937019 11540 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:16.866348 11604 raft_consensus.cc:3055] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:16.937882 11604 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:16.938792 11604 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.939942 11604 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:16.941812 11618 log.cc:927] Time spent T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.213s	user 0.001s	sys 0.002s
I20260709 13:16:16.943006  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:16.943054 11535 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.943959 11535 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:16.892997 11423 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:16.922503 11360 raft_consensus.cc:3055] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:16:16.892925 11533 consensus_meta.cc:287] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.612s	user 0.002s	sys 0.021s
I20260709 13:16:16.966909  6295 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:16.966605  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:16.985751  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 110669us
I20260709 13:16:16.989341  6906 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.999264 11553 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.000041 11553 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:16.971102 11619 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.126s	user 0.000s	sys 0.002s
I20260709 13:16:17.003041  6935 raft_consensus.cc:1240] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:17.003297  6252 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:17.014173  6295 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:16.977386 11360 raft_consensus.cc:740] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:16.988133 11606 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:17.027086  6295 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:17.048691  6295 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:17.049852  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 190031us
W20260709 13:16:17.029009 11539 consensus_meta.cc:287] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.746s	user 0.004s	sys 0.013s
I20260709 13:16:17.020236 11477 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:17.031172 11152 consensus_meta.cc:287] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.758s	user 0.019s	sys 0.001s
I20260709 13:16:16.991565 11533 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:17.045077 10964 consensus_meta.cc:287] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.005s
I20260709 13:16:17.016672 11628 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:17.028832 11377 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:17.051842 11593 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.008s	sys 0.008s
I20260709 13:16:17.055905  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:17.050824 11204 consensus_meta.cc:287] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 1.004s	user 0.004s	sys 0.020s
I20260709 13:16:17.015087 11629 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:17.045451 11535 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:17.069222 11617 log.cc:927] Time spent T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:16:17.016986 11263 consensus_queue.cc:1059] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:16:17.054744 11631 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:17.079639  6368 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:17.169085  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 89525.3us
I20260709 13:16:17.084095 11623 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:17.084744 10878 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:16:17.084985 11611 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:16:17.085492  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53902 (request call id 0) took 1120 ms. Trace:
I20260709 13:16:17.056563 11606 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:16:17.116168  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:17.118644  6323 raft_consensus.cc:1240] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:17.071758 11536 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.059425 11607 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.078945 11624 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:17.133531  6151 catalog_manager.cc:5697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 4 to 10, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 10 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:17.138064 11423 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:17.139838 11360 consensus_queue.cc:260] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:17.142087 11498 consensus_meta.cc:287] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.867s	user 0.009s	sys 0.003s
W20260709 13:16:17.143824  6152 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55326 (request call id 377) took 28435 ms (client timeout 15000 ms). Trace:
I20260709 13:16:17.146198 11533 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:17.146773  6251 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 15: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:17.075886 11539 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.161283  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:16:17.162292  6405 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41486 (request call id 1085) took 1398 ms (client timeout 1849 ms). Trace:
I20260709 13:16:17.163048  6219 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:17.163729  6402 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:16:17.164610  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 116022us
W20260709 13:16:17.225150  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 213458us
I20260709 13:16:17.166867  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:17.075009 11553 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:17.228760  6327 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 15: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:16:17.223532  6405 rpcz_store.cc:269] 0709 13:16:15.754519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.754647 (+   128us) service_pool.cc:224] Handling call
0709 13:16:17.152661 (+1398014us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b540006a754. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:17.152804 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1421190528}
I20260709 13:16:17.174239  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:17.229857  6401 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 14: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:17.175551  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:17.176227  6404 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 13:16:17.162209 11593 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.008s	sys 0.009s
I20260709 13:16:17.189281  6252 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:16:17.151707 11152 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.192054  6254 rpcz_store.cc:276] 0709 13:16:15.958070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.030151 (+ 72081us) service_pool.cc:224] Handling call
0709 13:16:17.069335 (+1039184us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54000f5854. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575beb735 00007f4575be39fa 00007f457abab4c9 00007f4574127c54 00007f4574127be2 00007f4574127b11 00007f4574127a8c 00007f4574126d42 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:17.078818 (+  9483us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1063452544}
I20260709 13:16:17.197023 11626 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:17.205830  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:17.243062  6249 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:17.243278  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:17.166904 11557 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:16:17.250782  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50006 (request call id 2696) took 1105 ms. Trace:
I20260709 13:16:17.251328  6251 rpcz_store.cc:276] 0709 13:16:16.145747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.146291 (+   544us) service_pool.cc:224] Handling call
0709 13:16:17.250543 (+1104252us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54001734d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:17.250710 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2169060096}
W20260709 13:16:17.216553  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 337273us
I20260709 13:16:17.167610 11404 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:17.168216 11628 raft_consensus.cc:697] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:17.226210  6399 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:17.227669  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:16:17.228998  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 66030.1us
I20260709 13:16:17.232262  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:17.232764  6403 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:17.233536  6936 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:17.225705  6295 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:17.231371  6151 catalog_manager.cc:5697] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:17.232944  6252 pending_rounds.cc:85] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 7
I20260709 13:16:17.162088 10964 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.175683 11299 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:16:17.216187 11589 consensus_meta.cc:287] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.003s
I20260709 13:16:17.257891  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:17.286340  6405 raft_consensus.cc:2368] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
I20260709 13:16:17.258610  6940 raft_consensus.cc:2368] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12.
I20260709 13:16:17.259725  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:17.261337  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:17.264762  6252 pending_rounds.cc:107] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:16:17.287473  6252 raft_consensus.cc:2889] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:17.282852  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:17.265110  6941 raft_consensus.cc:1240] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:17.266553  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:17.289359  6251 raft_consensus.cc:2410] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:16:17.242596 11263 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:17.252888 11563 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:17.292935  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:16:17.293479  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 54418.7us
I20260709 13:16:17.293532  6254 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:17.294576  6369 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:17.295532  6369 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:17.295369  6151 catalog_manager.cc:5697] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 9, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 9 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:17.294791  6247 raft_consensus.cc:1240] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:17.297885  6401 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:16:17.235596 11377 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:16:17.298276  6401 pending_rounds.cc:85] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 11
I20260709 13:16:17.298563  6401 pending_rounds.cc:107] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:16:17.264467 11634 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:17.298801  6401 raft_consensus.cc:2889] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:17.262182 11360 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:17.232209 11629 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
W20260709 13:16:17.306617  6907 leader_election.cc:336] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.849s (SENT)
I20260709 13:16:17.233665 11498 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.311146  6907 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:17.304455  6151 catalog_manager.cc:5697] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 9 to 10, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 10 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:17.312570  6222 leader_election.cc:400] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12.
I20260709 13:16:17.313100  6222 leader_election.cc:403] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:17.292343 11565 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:17.309399  6398 raft_consensus.cc:1240] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:17.270866 11535 raft_consensus.cc:3055] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:17.322839  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:17.324826  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:17.325536  6327 raft_consensus.cc:3060] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:16:17.340600  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:17.341240  6151 catalog_manager.cc:5697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 7 to 8, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 8 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:17.324186  6296 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:17.282186 11606 consensus_queue.cc:1059] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:16:17.343482  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 117843us
I20260709 13:16:17.344203  6295 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:17.346225  6296 leader_election.cc:400] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
I20260709 13:16:17.349713  6296 leader_election.cc:403] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:17.346954  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:17.348052  6329 raft_consensus.cc:1240] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:17.348573 11624 raft_consensus.cc:2804] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:17.344360 11637 raft_consensus.cc:2804] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:17.352298  6151 catalog_manager.cc:5697] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 7 to 10, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 10 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:17.354014  6151 catalog_manager.cc:5697] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 9 to 14, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 14 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:17.355108 11631 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:17.355495  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:17.356962 11632 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:16:17.360793  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 55786us
I20260709 13:16:17.363965 11506 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:17.364759 11366 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:17.366683 11366 raft_consensus.cc:697] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:16:17.368335 11616 consensus_meta.cc:287] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.586s	user 0.011s	sys 0.000s
I20260709 13:16:17.367868 11366 consensus_queue.cc:237] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.369306 11624 raft_consensus.cc:697] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:17.370430 11624 consensus_queue.cc:237] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:17.339244 11596 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:17.365244 11627 raft_consensus.cc:3055] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:17.373308 11627 raft_consensus.cc:740] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:17.378683 11533 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:17.379248 11533 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:17.381343 11533 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:17.292519 11589 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.386031 11589 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:17.336546 11565 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:17.386814 11565 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.387550 11498 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:17.389621  6933 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:17.391629  6247 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:16:17.391878  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 45819.7us
W20260709 13:16:17.392820  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 48697us
I20260709 13:16:17.393465  6295 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:17.352560 11628 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.388955 11539 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:17.404613  6254 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
W20260709 13:16:17.410292 11329 consensus_meta.cc:287] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.774s	user 0.001s	sys 0.011s
I20260709 13:16:17.410753 11329 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.413056  6400 raft_consensus.cc:2368] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12.
I20260709 13:16:17.348254 11595 consensus_queue.cc:1059] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:16:17.413506 11498 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:17.314369  6139 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 19435892007a4e0a9b2b4d0b26ccd0c0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2d6410349fdc47f5a98ba3c6f7d5510b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:17.414186 11498 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:17.414542  6139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 117717us
I20260709 13:16:17.414691 11498 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:17.344944 11553 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:16:17.416577 11329 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:17.417430 11594 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:17.336053 11563 raft_consensus.cc:3060] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:17.418926 11631 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:17.420679 11525 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.421161 11525 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:17.422413  6295 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:17.423110 11525 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:17.423655 11525 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:17.423741 11152 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:17.424073 11525 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:17.424551 11525 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:17.336843 11535 raft_consensus.cc:740] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:17.425313 11517 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:17.425968 11535 consensus_queue.cc:260] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.427351 11535 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:17.429603 11263 consensus_queue.cc:1059] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:17.432641  6151 catalog_manager.cc:5697] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 8, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 8 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:17.282755 11404 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:17.473546  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.387236 11533 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.482999  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:17.487948  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:17.368810 11616 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:17.490478  6401 raft_consensus.cc:2393] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 10: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:17.491593  6327 raft_consensus.cc:2468] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
W20260709 13:16:17.491905  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 58995us
I20260709 13:16:17.492693  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1788) took 1336 ms. Trace:
I20260709 13:16:17.401001 11637 raft_consensus.cc:697] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:17.493044  6329 rpcz_store.cc:276] 0709 13:16:16.156320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.156419 (+    99us) service_pool.cc:224] Handling call
0709 13:16:16.202103 (+ 45684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.351267 (+1149164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.492474 (+141207us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002a4254. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:17.492631 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2635007232}
I20260709 13:16:17.512665  6368 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:17.514297  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:17.514312  6151 catalog_manager.cc:5697] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 10, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 10 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:17.527901  6400 raft_consensus.cc:2393] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 12: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:17.442405 11152 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:17.311331 11634 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:17.561566  6403 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:17.581193  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:17.581993  6248 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 14: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:16:17.581928  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 69395.3us
I20260709 13:16:17.583321  6399 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:17.585693  6398 raft_consensus.cc:1240] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:17.585206  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:17.499259 11633 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.499198 11517 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.598423  6401 raft_consensus.cc:2393] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:17.600425  6151 catalog_manager.cc:5697] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 8 to 10, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 10 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:17.515692 11520 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
I20260709 13:16:17.557897 11609 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.615669  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:17.615696  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:17.622010  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:17.622711  6248 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
W20260709 13:16:17.222317  6152 rpcz_store.cc:269] 0709 13:15:48.708430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.708983 (+   553us) service_pool.cc:224] Handling call
0709 13:16:17.143542 (+28434559us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:08.874168 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:09.280836 (+406668us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:09.292348 (+ 11512us) write_op.cc:435] Acquired schema lock
0709 13:16:09.292366 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:09.512531 (+220165us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:09.546053 (+ 33522us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:09.557451 (+ 11398us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:16:09.575012 (+ 17561us) tablet.cc:701] Row locks acquired
0709 13:16:09.575067 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:16:09.575236 (+   169us) write_op.cc:270] Start()
0709 13:16:09.575382 (+   146us) write_op.cc:276] Timestamp: P: 1783602969575171 usec, L: 0
0709 13:16:09.575405 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:16:09.576086 (+   681us) log.cc:844] Serialized 5132 byte log entry
0709 13:16:10.705160 (+1129074us) op_driver.cc:464] REPLICATION: finished
0709 13:16:12.626163 (+1921003us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b18004b6d60. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:16:12.626338 (+   175us) write_op.cc:301] APPLY: starting
0709 13:16:12.626447 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:12.972415 (+345968us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:12.972441 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:13.164750 (+192309us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:13.165022 (+   272us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:16:13.165067 (+    45us) write_op.cc:312] APPLY: finished
0709 13:16:13.165401 (+   334us) log.cc:844] Serialized 121 byte log entry
0709 13:16:13.273842 (+108441us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:13.320855 (+ 47013us) write_op.cc:454] Released schema lock
0709 13:16:13.380363 (+ 59508us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:13.865529 (+485166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:13.891359 (+ 25830us) write_op.cc:454] Released schema lock
0709 13:16:14.372769 (+481410us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
Metrics: {"mutex_wait_us":3287021,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":284192,"apply.run_cpu_time_us":38265,"apply.run_wall_time_us":1192376,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58623,"num_ops":13,"prepare.queue_time_us":636074,"prepare.run_cpu_time_us":38614,"prepare.run_wall_time_us":852502,"raft.queue_time_us":893627,"raft.run_cpu_time_us":24624,"raft.run_wall_time_us":277139,"replication_time_us":1129546,"spinlock_wait_cycles":153737344,"thread_start_us":1378570,"threads_started":5,"wal-append.queue_time_us":349646,"wal-append.run_cpu_time_us":53076,"wal-append.run_wall_time_us":3896650}]]}
I20260709 13:16:17.501420 11533 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:17.599459 11616 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:17.628218  6151 catalog_manager.cc:5697] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 3 to 7, term changed from 8 to 10, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to <none>, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 10 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:17.632916  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:17.627084  6328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.000s	sys 0.028s
W20260709 13:16:17.634172  6328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.000s	sys 0.028s
I20260709 13:16:17.600278 11643 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.579557 11478 consensus_queue.cc:1059] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:16:17.609663 11607 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:17.627985  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 365474us
I20260709 13:16:17.587275 11553 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:17.641601  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:17.641799  6221 leader_election.cc:400] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12.
I20260709 13:16:17.667320  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:17.655716 11604 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:17.670953 11604 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.635375  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1798) took 1269 ms. Trace:
I20260709 13:16:17.674862  6254 raft_consensus.cc:2410] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:16:17.601464 11270 consensus_queue.cc:1059] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:16:17.676003  6151 catalog_manager.cc:5697] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 12 to 13, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 13 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:17.681342  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:17.601888 11152 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.676174  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:17.633433 11563 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12.
I20260709 13:16:17.685370  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:17.612695 11204 consensus_queue.cc:1059] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:16:17.687188  6937 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 14: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:17.689085  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:17.690228  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:17.629580 11595 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:17.694888  6938 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:17.616060 11517 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.699375  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:17.613258 11633 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:17.700016  6940 raft_consensus.cc:2410] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:16:17.702101  6933 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:17.636010 11241 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.703877  6249 raft_consensus.cc:2468] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:17.705503  6151 catalog_manager.cc:5697] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:17.626457 11609 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.725302  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:17.726634  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:17.733529  6937 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:17.686451 10964 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:17.737430  6297 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:17.739638  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:17.701954 11556 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:17.744457  6327 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:17.744987  6942 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 12: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:17.748852  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:17.706180 11508 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:17.753754  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 97443us
I20260709 13:16:17.756065  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:17.699018 11637 consensus_queue.cc:237] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:17.757827 11649 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.754876  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:17.767611  6398 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:17.765476  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:17.724335 11357 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.765476  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:17.769984  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:17.785674  6255 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:17.686318 11553 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.773799  6399 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 15.
I20260709 13:16:17.791842  6397 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 15: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:17.699254 11593 consensus_queue.cc:1059] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:16:17.795341  6151 catalog_manager.cc:5697] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:17.796149 11517 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:17.736913 11478 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:17.804812  6151 catalog_manager.cc:5697] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 9 to 11, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 11 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:17.801623  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:17.759670 11626 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:17.802510  6938 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16.
I20260709 13:16:17.807446  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:17.673571 11643 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.791649 11649 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.724735 11241 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:17.810775 11639 log.cc:927] Time spent T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:16:17.816190 11533 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:17.793061 11600 log.cc:927] Time spent T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:16:17.818553  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:17.845045  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:17.853070  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:17.858697  6405 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:17.858803  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:17.853361  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:17.859721  6248 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:16:17.860023  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:17.854691  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:17.861034  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:17.873446  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:17.874460  6940 raft_consensus.cc:1240] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:17.873826  6151 catalog_manager.cc:5697] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 9 to 11, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 11 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:17.875385  6151 catalog_manager.cc:5697] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 8 to 11, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 11 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:17.882555  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:17.884449  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:17.889426  6939 raft_consensus.cc:2393] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:17.894766  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:17.897642  6151 catalog_manager.cc:5697] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 11 to 13, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 13 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:17.717959 11595 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.786629 11508 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:17.856325 11642 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.796967 11357 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.952665  6254 raft_consensus.cc:2468] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:17.954651  6906 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:17.957535  6249 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:17.965773  6402 raft_consensus.cc:1240] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:17.841344 11478 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:17.967000  6252 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:17.970793  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:17.974093  6940 raft_consensus.cc:2393] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 12: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:17.876003 11377 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:16:17.979624  6255 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:17.983731  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:17.989666  6331 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:17.995564  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:17.996387  6402 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 14.
W20260709 13:16:18.002336  6322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.013s	sys 0.018s
W20260709 13:16:18.002707  6322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.013s	sys 0.018s
I20260709 13:16:17.971884 11594 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.003043 11535 consensus_meta.cc:287] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.003s
I20260709 13:16:18.022373  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:18.026993  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.027339  6329 raft_consensus.cc:2393] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 9: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:18.027796  6248 raft_consensus.cc:2368] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
I20260709 13:16:18.021510  6405 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:17.959774 11642 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:18.028717  6326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.013s	sys 0.041s
W20260709 13:16:18.037407  6326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.015s	sys 0.044s
I20260709 13:16:17.983397 11477 consensus_queue.cc:1059] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:16:18.043296  6905 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:18.018924 11607 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:18.049674 11643 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.047945  6151 catalog_manager.cc:5697] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 8, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 8 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:18.053869  6937 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:18.055004  6941 raft_consensus.cc:1240] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:18.042474 11646 log.cc:927] Time spent T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
W20260709 13:16:18.059548 11565 consensus_meta.cc:287] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.672s	user 0.004s	sys 0.004s
I20260709 13:16:18.060000 11565 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:18.061033  6325 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:18.063961 11650 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:18.064576 11627 consensus_queue.cc:260] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.054330  6151 catalog_manager.cc:5697] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:18.065589  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:18.023065 11594 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.066644 11595 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.067296 11604 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.067760 11241 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.068025 11594 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:18.069456 11647 log.cc:927] Time spent T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 13:16:18.071242  6250 raft_consensus.cc:1240] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:18.071621  6252 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:16:18.072402  6250 raft_consensus.cc:1240] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:16:18.072840 11609 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.076107 11536 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.076938  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:16:18.077483 11644 log.cc:927] Time spent T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:16:18.078142  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:18.078752  6327 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
W20260709 13:16:18.079926 11612 consensus_meta.cc:287] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 1.212s	user 0.011s	sys 0.000s
I20260709 13:16:18.080329 11612 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.081278 11671 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:18.081846 11671 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.035519 11392 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.083041 11392 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:18.083963 11671 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:18.078298 11654 log.cc:927] Time spent T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:16:18.086018  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:18.086745  6327 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.086117 11357 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.087708 11360 raft_consensus.cc:3055] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:16:18.088181 11666 log.cc:927] Time spent T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:16:18.088238 11360 raft_consensus.cc:740] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:18.089329 11633 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.089622  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:18.090780  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:18.091853  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:18.092335  6329 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:16:18.094027 11477 raft_consensus.cc:3055] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:18.094478 11477 raft_consensus.cc:740] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:18.095362 11477 consensus_queue.cc:260] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.096669 11477 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.098398 11631 raft_consensus.cc:3055] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:18.098831 11631 raft_consensus.cc:740] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:18.099807  6905 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:18.099645 11631 consensus_queue.cc:260] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:18.099948  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:18.100592 11631 raft_consensus.cc:3060] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.100718  6905 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:18.101635  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:18.098299  6371 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:18.115751  6403 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:18.116518  6371 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:18.102391 11392 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:18.102766 11536 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:18.117491  6253 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:18.104720  6936 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 17.
W20260709 13:16:18.106460 11645 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 13:16:18.107268 11508 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:18.107445 11661 log.cc:927] Time spent T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:16:18.110350 11533 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.110776 11563 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.111322  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.111991 11478 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.113386  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.130352 11563 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:18.113693 11498 consensus_meta.cc:287] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.698s	user 0.007s	sys 0.004s
I20260709 13:16:18.131632 11498 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.132009 11404 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.108880 11677 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:18.115511  6396 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:18.113417 11525 consensus_meta.cc:287] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.688s	user 0.006s	sys 0.005s
I20260709 13:16:18.128067 11609 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:18.066308  6249 raft_consensus.cc:2393] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 12: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:18.167960  6221 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:18.169440  6221 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:18.124246  6325 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
W20260709 13:16:18.158890 11659 log.cc:927] Time spent T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.095s	user 0.003s	sys 0.001s
I20260709 13:16:18.171301  6369 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:18.144402  6938 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:18.126686  6295 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:18.128264  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.129381 11533 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:18.125456  6255 raft_consensus.cc:1240] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:16:18.153005  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.162165  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:18.175467  6403 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:18.172396  6396 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16.
I20260709 13:16:18.166843  6327 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:16:18.176590 11107 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:18.177537 11508 consensus_queue.cc:1059] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:18.178787 11366 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:18.181274  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 54682.1us
I20260709 13:16:18.195438  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:18.205753  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:18.252558  6941 raft_consensus.cc:2368] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 15. Current term is 16.
W20260709 13:16:18.252722  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 81478.9us
I20260709 13:16:18.148353 11556 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:18.154165 11593 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.147513 11592 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:18.258662  6369 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:18.267429  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 485215us
W20260709 13:16:18.164589 11679 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
I20260709 13:16:18.148516 11612 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.150017 11553 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.156023 11626 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:18.256814  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:18.133074 11563 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.163192 11642 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.209607  6221 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:18.163713 11673 log.cc:927] Time spent T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:16:18.154544 11299 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:18.152729 11541 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 13:16:18.288380  6248 raft_consensus.cc:1240] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:18.248142 11624 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.247040  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.166899 11570 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:16:18.160220 11616 raft_consensus.cc:3055] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:18.147040 11565 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.271819  6327 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:18.159855 11634 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:18.272967  6295 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:18.286396 11594 raft_consensus.cc:2804] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:18.270406  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:18.205737 11385 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:18.206544 11107 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:18.251719 11357 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.245013 11263 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:16:18.285271  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 75796.8us
I20260709 13:16:18.261616 11504 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:18.153380 11525 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.287143  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.294190  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.267319 11592 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:17.674271  6328 rpcz_store.cc:276] 0709 13:16:16.365558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.377532 (+ 11974us) service_pool.cc:224] Handling call
0709 13:16:16.407205 (+ 29673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.407456 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:16.945391 (+537935us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b1800471460. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f457578d4bc 00007f4572adb48b 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af5455 00007f45795dd3c7 00007f4575bef9a7 00007f4575bff0bf
0709 13:16:16.945523 (+   132us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.634940 (+689417us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:17.635007 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:17.635069 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.635159 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.635295 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9853,"prepare.queue_time_us":148819,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":5205,"raft.queue_time_us":1253,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":35815,"spinlock_wait_cycles":12690304,"thread_start_us":837781,"threads_started":2}
I20260709 13:16:18.251719 11404 consensus_queue.cc:1059] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:16:18.312529  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:18.333990  6327 raft_consensus.cc:2368] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 15. Current term is 16.
I20260709 13:16:18.335093  6327 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:18.332813  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:18.338757  6368 leader_election.cc:400] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 15. Current term is 16.
I20260709 13:16:18.338677  6221 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:18.313597  6295 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:18.268258  6297 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:18.314672 11270 consensus_queue.cc:1059] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:16:18.286859 11553 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:18.344204  6327 raft_consensus.cc:1275] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:18.326716  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:18.325800  6255 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:18.345350  6329 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:18.332027 11592 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:18.339175  6368 leader_election.cc:403] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:16:18.321724 11385 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:18.340658  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 72468us
I20260709 13:16:18.266896 11360 consensus_queue.cc:260] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.319538 11626 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:18.277868 11593 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.133080 11677 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.300333 11616 raft_consensus.cc:740] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:18.421017  6328 raft_consensus.cc:1240] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:18.347955 11565 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:16:18.310145  6251 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.007s	sys 0.010s
W20260709 13:16:18.425412  6251 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.007s	sys 0.010s
I20260709 13:16:18.323321 11107 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.324856 11594 raft_consensus.cc:697] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:18.352842  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.351348  6331 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:18.333557 11563 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.308812 11624 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.405288 11299 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 15. Current term is 16.
I20260709 13:16:18.441365 11525 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.407797  6249 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:18.338347 11504 raft_consensus.cc:697] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:18.442564 11504 consensus_queue.cc:237] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:18.443588 11593 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.447716  6250 raft_consensus.cc:1275] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:18.449950  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.417680  6906 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:18.339659  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.354328 11385 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:18.404995 11595 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:18.406455  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 121441us
I20260709 13:16:18.351023 11689 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:18.327761 11357 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.410614  6297 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:18.435727 11563 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.438019 11624 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:18.440408 11674 log.cc:927] Time spent T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:16:18.441179 11681 log.cc:927] Time spent T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:16:18.409963 11533 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.456777 11594 consensus_queue.cc:237] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.465113 11595 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:18.494385 11595 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:18.457724 11614 consensus_queue.cc:1059] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:18.458047 11677 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.459973 11642 raft_consensus.cc:2804] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:18.496171  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1009) took 1269 ms. Trace:
I20260709 13:16:18.496560 11642 raft_consensus.cc:697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:16:18.461658  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 117251us
I20260709 13:16:18.497388  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1810) took 1173 ms. Trace:
I20260709 13:16:18.498411 11642 consensus_queue.cc:237] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.497828  6322 rpcz_store.cc:276] 0709 13:16:17.323880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.349889 (+ 26009us) service_pool.cc:224] Handling call
0709 13:16:17.350178 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.417902 (+ 67724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.417932 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.418390 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.003124 (+584734us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:18.003164 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.003230 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.497185 (+493955us) raft_consensus.cc:1685] finished
0709 13:16:18.497204 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.497334 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67323,"raft.queue_time_us":70033,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":584366,"threads_started":1,"wal-append.queue_time_us":838229}
I20260709 13:16:18.464625  6369 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:18.465386  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 54862.5us
I20260709 13:16:18.497838  6295 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:18.503057  6297 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:18.504015 11520 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:18.504225  6297 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:18.504768 11520 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:18.505261 11520 raft_consensus.cc:697] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:18.505402 11525 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:18.505765  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.505980 11525 raft_consensus.cc:697] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:18.506410 11520 consensus_queue.cc:237] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.507028  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.506824 11525 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.508103  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.502657  6369 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:18.466598  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1969) took 1092 ms. Trace:
I20260709 13:16:18.470217  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.516207  6942 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:16:18.516592  6942 pending_rounds.cc:85] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: Aborting all ops after (but not including) 9
I20260709 13:16:18.516532  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:18.516942  6942 pending_rounds.cc:107] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:16:18.517232  6942 raft_consensus.cc:2889] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:18.502429 11593 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:18.518815  6295 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:18.519673 11152 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.474399 11357 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.469910 11377 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:18.464301 11689 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:18.524618 11689 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:18.524848 11626 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:18.525272 11626 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:18.525635 11626 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.513967  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:18.514735  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:18.479892 11563 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.483268 11616 consensus_queue.cc:260] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.487226 11649 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.520623  6295 leader_election.cc:400] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
W20260709 13:16:18.539037  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.539166  6295 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:18.510766  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:18.539882  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.521088  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:18.509104  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.522039  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:18.510234  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.541253  6401 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:18.521354 11557 raft_consensus.cc:3055] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:18.547079 11695 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:18.532836 11366 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:18.548494 11366 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:18.548888 11695 consensus_queue.cc:1048] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:18.550640 11366 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.550686 11498 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.524619 11377 raft_consensus.cc:697] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:18.542616  6369 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:18.513713  6251 rpcz_store.cc:276] 0709 13:16:17.374240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.381214 (+  6974us) service_pool.cc:224] Handling call
0709 13:16:17.381513 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.381711 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:17.740887 (+359176us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.742166 (+  1279us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.059314 (+317148us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b180013af20. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af8522 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:16:18.426145 (+366831us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.462873 (+ 36728us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:18.462923 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:18.462958 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.463000 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.466533 (+  3533us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97051,"prepare.queue_time_us":700894,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":2320,"raft.queue_time_us":142483,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":15608,"spinlock_wait_cycles":135147136,"thread_start_us":930482,"threads_started":2}
W20260709 13:16:18.546715 11657 log.cc:927] Time spent T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.482s	user 0.000s	sys 0.003s
I20260709 13:16:18.547124 11557 raft_consensus.cc:740] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:18.522333 11506 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:18.541903  6398 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 14.
I20260709 13:16:18.565347  6401 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:18.496592  6256 rpcz_store.cc:276] 0709 13:16:17.227032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.227570 (+   538us) service_pool.cc:224] Handling call
0709 13:16:17.243194 (+ 15624us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.345040 (+101846us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:17.843768 (+498728us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.015624 (+171856us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.026672 (+ 11048us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.027077 (+   405us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:18.027154 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.163737 (+136583us) spinlock_profiling.cc:243] Waited 64.6 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:16:18.495884 (+332147us) spinlock_profiling.cc:243] Waited 95.6 ms on lock 0x7b54000f6c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:18.495935 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.495978 (+    43us) raft_consensus.cc:1685] finished
0709 13:16:18.495991 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.496115 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5842,"prepare.queue_time_us":360821,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":6154,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":7099,"spinlock_wait_cycles":368553600,"thread_start_us":549416,"threads_started":2,"wal-append.queue_time_us":194846}
I20260709 13:16:18.471704  6404 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:18.581218  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.584060  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:18.586920  6401 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 12: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:18.582365 11366 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:18.588716  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 49651.4us
I20260709 13:16:18.590099  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.592365  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.593427  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.564313 11477 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:18.596529  6907 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:18.589022 11366 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:18.574442 11152 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.601272  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.622850  6251 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:18.601922  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.623709  6256 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
I20260709 13:16:18.602780  6252 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:18.603163 11385 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.607722 11616 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:18.608932  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2527) took 1097 ms. Trace:
I20260709 13:16:18.630913  6405 rpcz_store.cc:276] 0709 13:16:17.511413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.041226 (+529813us) service_pool.cc:224] Handling call
0709 13:16:18.041719 (+   493us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:18.051589 (+  9870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.051625 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:18.052211 (+   586us) log.cc:844] Serialized 52 byte log entry
0709 13:16:18.324302 (+272091us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:18.324357 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.324795 (+   438us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.608692 (+283897us) raft_consensus.cc:1685] finished
0709 13:16:18.608716 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.608872 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8231,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":271667,"threads_started":1,"wal-append.queue_time_us":544388}
I20260709 13:16:18.610096 11626 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.610610  6398 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:18.627898 11498 consensus_queue.cc:1059] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:16:18.600611 11263 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.619659 11650 consensus_queue.cc:1059] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:16:18.634362  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.635061 11650 raft_consensus.cc:3055] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:18.578339 11204 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:18.635422 11650 raft_consensus.cc:740] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:18.635677 11204 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.623371 11366 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:18.637806 11204 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:18.638000 11626 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.596056 11631 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:16:18.641464  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:18.642105 11535 raft_consensus.cc:3055] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:18.642545 11535 raft_consensus.cc:740] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:18.636377 11650 consensus_queue.cc:260] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.643577 11650 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.643422 11535 consensus_queue.cc:260] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.644728 11535 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.644491 11107 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.642221  6295 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:18.633623  6330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1807) took 1310 ms. Trace:
I20260709 13:16:18.634195 11263 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:18.575666 11506 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.624719 11589 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:18.651311  6330 rpcz_store.cc:276] 0709 13:16:17.323021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.326617 (+  3596us) service_pool.cc:224] Handling call
0709 13:16:17.346528 (+ 19911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.365418 (+ 18890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.365450 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.365879 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.660809 (+294930us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:17.660866 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.660976 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.546198 (+885222us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:16:18.627588 (+ 81390us) raft_consensus.cc:1685] finished
0709 13:16:18.627621 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.633539 (+  5918us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18536,"raft.queue_time_us":19512,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":143356672,"thread_start_us":294502,"threads_started":1,"wal-append.queue_time_us":698855}
I20260709 13:16:18.660801  6907 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:18.656258  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.662268  6405 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:18.578445 11592 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.589485 11557 consensus_queue.cc:260] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.628182 11152 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.624370 11508 consensus_queue.cc:1059] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:16:18.633680 11498 raft_consensus.cc:3055] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:18.681567  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:18.664482  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.645563 11478 raft_consensus.cc:3055] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:18.655652 11520 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:18.696178  6369 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:18.658216 11556 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.656836 11626 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.710831  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:18.660661 11506 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:18.711653  6405 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:18.714052 11357 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:18.658224 11404 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.664047 11536 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:18.718014  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:18.722193  6401 raft_consensus.cc:2410] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:16:18.718601  6933 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:18.677352 11263 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.702749 11589 raft_consensus.cc:697] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:18.706713 11478 raft_consensus.cc:740] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:18.661185 11596 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:16:18.705780 11498 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:18.726655  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:18.668915 11107 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.710582 11508 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:18.674754 11689 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:18.674916 11377 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.715001 11593 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:18.789955  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.771370  6405 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 14.
I20260709 13:16:18.807821  6251 raft_consensus.cc:2368] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 11. Current term is 12.
I20260709 13:16:18.721843 11557 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:18.853229  6329 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:16:18.828428  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.790896 11589 consensus_queue.cc:237] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.835649 11152 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.808924 11593 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:18.837949  6325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1808) took 1514 ms (client timeout 1518 ms). Trace:
I20260709 13:16:18.839344 11689 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.840234 11498 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:18.841095 11508 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.779162 11366 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.842170  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.722891 11357 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:18.728098 11628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.021s	sys 0.015s
W20260709 13:16:18.777612 11691 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.351s	user 0.001s	sys 0.001s
I20260709 13:16:18.719615 11556 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.851836 11385 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:18.787698 11675 log.cc:927] Time spent T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.467s	user 0.001s	sys 0.000s
W20260709 13:16:18.857369  6325 rpcz_store.cc:269] 0709 13:16:17.323290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.326709 (+  3419us) service_pool.cc:224] Handling call
0709 13:16:18.837744 (+1511035us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b54002a3854. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:18.837859 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633479424}
I20260709 13:16:18.858700  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:16:18.855751  6368 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.2:39965 timed out after 1.518s (SENT) [suppressed 29 similar messages]
W20260709 13:16:18.867113 11628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.021s	sys 0.015s
I20260709 13:16:18.875316  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:18.791391 10964 raft_consensus.cc:3055] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:18.858119 11593 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:18.855448 11263 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:18.891726 11263 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.893092  6255 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:18.720748 11626 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.727510 11404 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:18.886817  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 237196us
I20260709 13:16:18.889989  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.894537 11263 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.919441  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:18.885386 11498 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:18.924045  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.888128 10964 raft_consensus.cc:740] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:18.934588  6295 leader_election.cc:400] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 11. Current term is 12.
I20260709 13:16:18.886761 11571 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:18.937294  6295 leader_election.cc:403] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:16:18.886389 11563 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:18.880967 11595 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:18.940133  6295 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:18.920260 11535 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.944005  6295 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:18.957885 11520 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:18.960853 11520 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:18.964149  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1975) took 1346 ms. Trace:
I20260709 13:16:18.964636  6254 rpcz_store.cc:276] 0709 13:16:17.617498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.069437 (+451939us) service_pool.cc:224] Handling call
0709 13:16:18.069763 (+   326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:18.167277 (+ 97514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.167320 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:18.447810 (+280490us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b18000eb0c0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572ac62a6 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f45744dea11 00007f45744ee372 00007f4575c20a01 00007f4575be543a
0709 13:16:18.448231 (+   421us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b2c000014c8. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f45744dea11 00007f45744ee372 00007f4575c20a01 00007f4575be543a 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2
0709 13:16:18.448837 (+   606us) log.cc:844] Serialized 52 byte log entry
0709 13:16:18.852936 (+404099us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:18.852972 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.853035 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.963888 (+110853us) raft_consensus.cc:1685] finished
0709 13:16:18.963912 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.964082 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136727,"raft.queue_time_us":97854,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":10727,"spinlock_wait_cycles":73145472,"thread_start_us":403693,"threads_started":1,"wal-append.queue_time_us":486462}
I20260709 13:16:18.966758  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.967378  6254 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:18.968271  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:18.970274  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:18.971740  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1809) took 1648 ms. Trace:
I20260709 13:16:18.972150  6326 rpcz_store.cc:276] 0709 13:16:17.323554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.346946 (+ 23392us) service_pool.cc:224] Handling call
0709 13:16:17.347221 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.377374 (+ 30153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.377418 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.377861 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.037914 (+660053us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:18.545804 (+507890us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.572424 (+ 26620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.572520 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.786929 (+214409us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:16:18.971449 (+184520us) raft_consensus.cc:1685] finished
0709 13:16:18.971559 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.971685 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49370,"prepare.queue_time_us":369609,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":59334,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":2316,"spinlock_wait_cycles":4685568,"thread_start_us":1031123,"threads_started":2,"wal-append.queue_time_us":884057}
I20260709 13:16:18.978338 11556 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.933842 11689 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:18.982036 11689 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:18.982467 11626 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:18.983237 11535 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.938439 11710 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:18.983404 10964 consensus_queue.cc:260] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:18.984112 11689 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:18.982553  6250 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:18.987044  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:18.988014  6255 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
W20260709 13:16:18.988672  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 132955us
I20260709 13:16:19.009610  6906 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:19.026618  6251 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:16:18.954792 11107 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 11. Current term is 12.
I20260709 13:16:19.038266  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:19.039681  6250 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:16:19.041810  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 97855.8us
I20260709 13:16:19.043079  6295 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:19.082724  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 73266.7us
I20260709 13:16:19.083526  6906 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:19.092694  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:18.890085 11478 consensus_queue.cc:260] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:18.985309 11217 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:19.025279 11556 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.991500 11592 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:19.094697  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:19.101213  6404 raft_consensus.cc:1240] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:16:19.101356  6405 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
W20260709 13:16:19.094398  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.093393  6939 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:19.095124  6906 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:18.985095 11563 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:19.083185 11377 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:19.102960  6907 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:19.107245  6297 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:19.107383  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:19.109648  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:19.111202  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:19.113067  6401 raft_consensus.cc:2393] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 12: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:19.113155  6907 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:19.116750  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:19.113942 11703 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:16:19.099025 10964 raft_consensus.cc:3060] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:18.988272 11571 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:18.984678 11710 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:19.095338 11715 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:19.117394  6251 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:19.093402 11716 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:19.132081  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:19.114302 11642 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:19.121207 11712 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:19.121302 11107 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:19.115701 11478 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:19.104497 11217 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:19.125777 11668 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:19.141734  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:19.107662 11556 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:19.137204 11714 log.cc:927] Time spent T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6: Append to log took a long time: real 0.153s	user 0.002s	sys 0.000s
I20260709 13:16:19.137508 11642 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.134495 11357 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:19.174407 11595 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:19.172008 11712 raft_consensus.cc:697] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:19.176400 11712 consensus_queue.cc:237] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:19.174886 11642 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:19.179623 11571 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:19.182562 11217 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:19.183924 11563 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:19.128314 11152 consensus_queue.cc:1059] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:16:19.173477  6404 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:19.186674 11366 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:19.188382 11686 log.cc:927] Time spent T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.868s	user 0.005s	sys 0.003s
I20260709 13:16:19.189385 11556 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:19.190410 11627 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:19.190999 11634 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:19.191519 11634 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:19.193162 11650 consensus_meta.cc:287] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.005s
I20260709 13:16:19.194094 11634 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:19.158936 11107 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:19.173094  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.168879 11668 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:19.133700 11715 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:19.197177  6221 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:19.208240  6221 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:19.158964 11535 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:19.196890  6296 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:19.201692  6906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.157403 11508 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:19.202991 11594 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.205299 11404 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:19.210397  6221 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:19.221825  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.218924  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.219511  6325 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:19.184448 11506 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:19.207170 11107 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:19.221731  6934 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:16:19.216996 11689 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:19.207418 11668 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:19.222684  6326 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
I20260709 13:16:19.209408 11553 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:19.232059  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:19.226238  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:19.228117  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:19.223425  6221 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:19.232885  6325 raft_consensus.cc:2376] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12. Re-sending same reply.
I20260709 13:16:19.231106  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.218021 11715 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:19.217612 11557 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:19.235015  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:19.235191 11723 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:19.236527  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.235363 11563 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:19.226733 11556 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:19.211216 11628 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:16:19.249305 11563 raft_consensus.cc:697] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:19.246290 11557 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:19.254705 11664 log.cc:927] Time spent T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 1.164s	user 0.011s	sys 0.000s
I20260709 13:16:19.254948 11557 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:19.232044 11553 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.255582 11553 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:19.256057  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1804) took 1933 ms. Trace:
I20260709 13:16:19.252125  6296 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:19.256426  6324 rpcz_store.cc:276] 0709 13:16:17.322179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.325999 (+  3820us) service_pool.cc:224] Handling call
0709 13:16:17.326363 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.339663 (+ 13300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.339701 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.400823 (+ 61122us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.753176 (+352353us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:17.753223 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.753298 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.254004 (+1500706us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:16:19.255751 (+  1747us) raft_consensus.cc:1685] finished
0709 13:16:19.255772 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.256000 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2356,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":16159,"spinlock_wait_cycles":88330624,"thread_start_us":225151,"threads_started":1,"wal-append.queue_time_us":643525}
I20260709 13:16:19.258379  6296 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:19.259665 11626 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:19.260303 11626 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:19.261970 11670 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 1.149s	user 0.002s	sys 0.000s
I20260709 13:16:19.263314  6403 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:19.265815  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1014) took 1537 ms. Trace:
I20260709 13:16:19.266309  6253 rpcz_store.cc:276] 0709 13:16:17.728168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.118113 (+389945us) service_pool.cc:224] Handling call
0709 13:16:18.118350 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.450918 (+332568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.450950 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:18.451001 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:18.451037 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.265530 (+814493us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54001739d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:19.265591 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.265737 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764400384}
I20260709 13:16:19.225008 11594 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:19.229681 11689 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.269569 11689 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:19.271082 11594 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:19.272081  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:19.272807  6256 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:19.271857 11204 consensus_queue.cc:1059] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:19.248296 11556 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.273834  6249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1980) took 1014 ms. Trace:
I20260709 13:16:19.253095 11723 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:16:19.277969  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.289003  6249 rpcz_store.cc:276] 0709 13:16:18.259282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.268856 (+  9574us) service_pool.cc:224] Handling call
0709 13:16:19.273653 (+1004797us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b54003129d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:19.273777 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68151040}
I20260709 13:16:19.300602  6324 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:19.300830  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.303112  6251 raft_consensus.cc:1240] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:19.305372  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.306162  6249 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:19.306516  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.306162  6326 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 12: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:19.282155 11634 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:19.309476 11508 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.240801 11642 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:19.310024 11508 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:19.311659 11710 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:19.312279 11508 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:19.313481 11360 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:19.314059  6404 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:19.316366  6402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2893) took 1806 ms. Trace:
I20260709 13:16:19.309675 11634 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:19.322173  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:19.316908  6402 rpcz_store.cc:276] 0709 13:16:17.510082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.013810 (+503728us) service_pool.cc:224] Handling call
0709 13:16:18.036854 (+ 23044us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.085560 (+ 48706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.085591 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.086050 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.177054 (+ 91004us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:18.177107 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.187813 (+1010706us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:16:19.315937 (+128124us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b5400024ed4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:19.316013 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.316073 (+    60us) raft_consensus.cc:1685] finished
0709 13:16:19.316094 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.316256 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5093,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":115389056,"thread_start_us":90622,"threads_started":1,"wal-append.queue_time_us":180960}
I20260709 13:16:19.326825  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.293157 11556 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:19.329828  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:19.332679  6330 raft_consensus.cc:2393] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:19.295385 11631 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:19.333884  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:19.296681 11535 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:19.335812  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.338917  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.345588  6327 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 14.
I20260709 13:16:19.331887  6249 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
I20260709 13:16:19.339344  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.340504  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.316593 11668 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:19.293433 11594 consensus_queue.cc:1048] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:16:19.348600  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.349359  6328 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:19.350453  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.320159 11593 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:19.348500 11535 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:19.416539 11557 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:19.419257 11536 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.440774  6331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 1218) took 1674 ms. Trace:
I20260709 13:16:19.444597  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:19.446573  6295 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:19.463073  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:19.419486 11556 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:19.419979  6935 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 1141) took 2373 ms (client timeout 2796 ms). Trace:
W20260709 13:16:19.542757  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 96272.5us
I20260709 13:16:19.254702 11563 consensus_queue.cc:237] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:19.421034 11506 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:19.347939 11404 consensus_queue.cc:1059] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:16:19.421504  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.571792  6329 raft_consensus.cc:2393] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 15: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:16:19.422060 11718 log.cc:927] Time spent T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.527s	user 0.005s	sys 0.000s
I20260709 13:16:19.421520 11634 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:19.422619  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.422986  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.423954  6939 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:19.424057 11678 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:19.424808  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:19.424906  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:19.424901 11715 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:19.578109  6328 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:19.426401  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:19.426627  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:19.427131  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.427747  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:19.428987  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:19.431296  6248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1017) took 1702 ms. Trace:
I20260709 13:16:19.345641 11498 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:19.435598  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:19.587380  6248 rpcz_store.cc:276] 0709 13:16:17.729101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.131003 (+401902us) service_pool.cc:224] Handling call
0709 13:16:18.131298 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.292659 (+161361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.371112 (+1078453us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400337554. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:19.431231 (+ 60119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360785664}
W20260709 13:16:19.488034  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.540673  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.441272  6331 rpcz_store.cc:276] 0709 13:16:17.766523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.108001 (+341478us) service_pool.cc:224] Handling call
0709 13:16:18.108353 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.428991 (+320638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.440577 (+1011586us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b5400039654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:19.440718 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558351616}
I20260709 13:16:19.586127  6941 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 14.
I20260709 13:16:19.541649  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2513) took 2270 ms. Trace:
I20260709 13:16:19.544437  6295 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:19.547560  6399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36172 (request call id 2539) took 1376 ms (client timeout 1753 ms). Trace:
W20260709 13:16:19.553916  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 124731us
W20260709 13:16:19.542989  6935 rpcz_store.cc:269] 0709 13:16:17.046201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.046364 (+   163us) service_pool.cc:224] Handling call
0709 13:16:19.367303 (+2320939us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54005302d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:19.419867 (+ 52564us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4045053312}
I20260709 13:16:19.554118  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:19.557214 11616 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:19.558918 11556 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:19.560118  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:19.555691 11594 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:16:19.563923 11702 log.cc:927] Time spent T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.668s	user 0.002s	sys 0.000s
I20260709 13:16:19.596056  6396 rpcz_store.cc:276] 0709 13:16:17.170016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.170146 (+   130us) service_pool.cc:224] Handling call
0709 13:16:19.440554 (+2270408us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54003755d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:19.440650 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035376000}
W20260709 13:16:19.568014  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.566068  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:19.572937  6327 raft_consensus.cc:2410] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:16:19.568533  6371 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:19.580900  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:19.578097  6324 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:16:19.579391  6942 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
W20260709 13:16:19.586104  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 250022us
W20260709 13:16:19.596230  6399 rpcz_store.cc:269] 0709 13:16:18.172547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.317391 (+144844us) service_pool.cc:224] Handling call
0709 13:16:19.547292 (+1229901us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54002f3854. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:19.547481 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":981260672}
I20260709 13:16:19.421898 11642 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:19.619647  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 75265.6us
W20260709 13:16:19.581332 11637 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.519s	user 0.060s	sys 0.073s
W20260709 13:16:19.581595 11720 log.cc:927] Time spent T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.445s	user 0.001s	sys 0.006s
W20260709 13:16:19.618461  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 50018.7us
I20260709 13:16:19.617708  6297 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:19.552919 11668 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:19.632339  6371 leader_election.cc:400] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 15. Current term is 16.
I20260709 13:16:19.627193  6905 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:19.634117  6936 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:19.571283 11204 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:19.576817 11508 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:19.554836 11377 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:16:19.577066 11539 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:19.688314 11478 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:19.833076  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:19.572460 11423 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.139s
I20260709 13:16:19.554986 11536 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:19.607424 11649 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:19.782011  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 133798us
I20260709 13:16:19.616832 11716 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:19.638396  6295 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:16:20.048604  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 410257us
W20260709 13:16:19.630633 11637 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.565s	user 0.061s	sys 0.073s
W20260709 13:16:19.771531  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 144403us
I20260709 13:16:20.060032 10964 consensus_queue.cc:1059] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:19.714028  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:20.061138 10964 raft_consensus.cc:3055] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:20.061510  6248 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:20.061655 10964 raft_consensus.cc:740] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:19.640250 11589 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:20.062918 10964 consensus_queue.cc:260] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:19.585453 11366 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:16:19.636866 11723 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:16:19.990020  6322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.082s	sys 0.205s
W20260709 13:16:20.064602  6322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.082s	sys 0.205s
W20260709 13:16:20.044072  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 455586us
I20260709 13:16:19.607964 11678 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.064623 11723 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:20.065922  6940 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:19.828341 11712 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:19.625705 11107 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.067438  6326 raft_consensus.cc:2393] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 10: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:20.068234 11723 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:20.068580 11107 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:20.062999 11589 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.069561 11712 raft_consensus.cc:697] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:20.071175 11589 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:20.064915 10964 raft_consensus.cc:3060] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:19.933640 11299 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.018s	sys 0.022s
I20260709 13:16:20.071966 11712 consensus_queue.cc:237] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:19.640054 11710 raft_consensus.cc:2804] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:20.060552  6905 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:20.199682  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 139229us
I20260709 13:16:19.630429 11594 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:19.787566 11204 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:19.637050 11498 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.088747  6400 raft_consensus.cc:1240] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:20.083742 11299 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.018s	sys 0.022s
I20260709 13:16:20.266604 11627 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.267246 11627 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:20.268437 11729 log.cc:927] Time spent T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
I20260709 13:16:20.084359 11525 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:16:20.290179  6219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.007s	sys 0.028s
W20260709 13:16:20.290611  6219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.007s	sys 0.028s
W20260709 13:16:20.290917  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 693595us
W20260709 13:16:20.295776  6296 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.003s	sys 0.033s
W20260709 13:16:20.296262  6296 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.003s	sys 0.033s
W20260709 13:16:20.296698  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 665270us
W20260709 13:16:20.332433  6369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.012s	sys 0.029s
W20260709 13:16:20.335474  6369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.012s	sys 0.029s
W20260709 13:16:20.335816  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 750536us
W20260709 13:16:20.140285  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 475238us
I20260709 13:16:20.073834 11716 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:20.146260 11689 consensus_meta.cc:287] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.876s	user 0.002s	sys 0.009s
I20260709 13:16:20.083295 11732 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:20.358714 11715 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:20.359362  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 3114) took 1022 ms. Trace:
W20260709 13:16:20.150698 11728 log.cc:927] Time spent T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.436s	user 0.000s	sys 0.000s
W20260709 13:16:20.359951 11730 log.cc:927] Time spent T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:20.074275 11649 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.277153 11710 raft_consensus.cc:697] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:20.361485  6397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 1114) took 1103 ms. Trace:
W20260709 13:16:20.158771 11553 consensus_meta.cc:287] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.903s	user 0.011s	sys 0.001s
I20260709 13:16:19.993340 11539 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.240695 11637 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 13:16:20.184409  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.217905  6248 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:16:19.938475 11508 consensus_queue.cc:1059] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.146s
W20260709 13:16:20.351239  6906 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.019s	sys 0.024s
I20260709 13:16:20.361830  6397 rpcz_store.cc:276] 0709 13:16:19.258238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.258400 (+   162us) service_pool.cc:224] Handling call
0709 13:16:19.258697 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:19.259456 (+   759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:19.259486 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:19.259950 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.345494 (+ 85544us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:19.345533 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.345622 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:20.361276 (+1015654us) raft_consensus.cc:1685] finished
0709 13:16:20.361296 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.361426 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":417,"raft.queue_time_us":1494,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":85213,"threads_started":1,"wal-append.queue_time_us":294716}
W20260709 13:16:20.433709  6906 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.020s	sys 0.024s
W20260709 13:16:20.434199  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 811209us
W20260709 13:16:20.355278  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.357975 11731 log.cc:927] Time spent T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:16:20.278131 11525 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.359795  6322 rpcz_store.cc:276] 0709 13:16:19.336978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.337182 (+   204us) service_pool.cc:224] Handling call
0709 13:16:19.337608 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:19.344760 (+  7152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:19.344803 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:19.346980 (+  2177us) log.cc:844] Serialized 26 byte log entry
0709 13:16:20.065020 (+718040us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:20.065062 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.065144 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:20.359103 (+293959us) raft_consensus.cc:1685] finished
0709 13:16:20.359137 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.359286 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6665,"raft.queue_time_us":8967,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":4515,"thread_start_us":644502,"threads_started":1,"wal-append.queue_time_us":934249}
I20260709 13:16:20.372102  6369 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:20.304000 11651 log.cc:927] Time spent T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 2.185s	user 0.011s	sys 0.004s
W20260709 13:16:20.376509  6297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.019s	sys 0.035s
I20260709 13:16:20.455085  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:20.463050  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:20.463567 11716 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:20.463901  6322 raft_consensus.cc:2393] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 13: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:20.385239 11557 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:20.465381  6297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.020s	sys 0.040s
W20260709 13:16:20.465672  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 847977us
I20260709 13:16:20.455715 11107 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:20.464795  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:20.467914  6322 raft_consensus.cc:2410] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:16:20.385567 11627 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:20.469888  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 178226us
I20260709 13:16:20.473816  6219 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:20.473907  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 3124) took 1045 ms. Trace:
I20260709 13:16:20.474767  6322 rpcz_store.cc:276] 0709 13:16:19.428233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.464540 (+1036307us) service_pool.cc:224] Handling call
0709 13:16:20.473681 (+  9141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:20.476114  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:20.385654 11553 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.374410 11593 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:20.479800  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.479269 11520 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:20.466214 11525 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:20.487540  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 115553us
I20260709 13:16:20.465998 11204 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:20.421330 11535 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:20.481043 11478 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:20.491495 11616 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.487727 11746 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:16:20.492118 11616 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.490739 11637 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:20.493600 11637 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.493952 11539 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:20.496012 11637 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:20.487236 11738 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.497272  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1031) took 1537 ms. Trace:
I20260709 13:16:20.497095 11738 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.498060 11498 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:20.498224 11737 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:20.498960 11737 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:20.499792 11738 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:20.479472 11723 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:20.478258 11107 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.487902 11520 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:20.501698 11723 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.503513 11107 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:20.503796 11520 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:20.487212 11299 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.507975  6247 raft_consensus.cc:1240] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:20.508723  6219 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:20.497709  6256 rpcz_store.cc:276] 0709 13:16:18.959764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.292055 (+332291us) service_pool.cc:224] Handling call
0709 13:16:19.298326 (+  6271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.573982 (+275656us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:16:19.587600 (+ 13618us) log.cc:844] Serialized 14 byte log entry
0709 13:16:20.010329 (+422729us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:20.010400 (+    71us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:20.010461 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.496996 (+486535us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54000f6c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:20.497045 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.497208 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9997,"prepare.queue_time_us":3239,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":444949,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"spinlock_wait_cycles":633297152,"thread_start_us":412228,"threads_started":1,"wal-append.queue_time_us":878917}
I20260709 13:16:20.514909  6369 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:20.516520  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1831) took 1081 ms. Trace:
I20260709 13:16:20.517076  6329 rpcz_store.cc:276] 0709 13:16:19.434746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.515633 (+1080887us) service_pool.cc:224] Handling call
0709 13:16:20.515958 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.516140 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.516166 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:20.516210 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:20.516255 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.516317 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.516451 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:20.375151 11689 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.504835 11299 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.500993 11738 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:20.521482  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 324970us
W20260709 13:16:20.524199  6937 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.096s	user 0.014s	sys 0.026s
W20260709 13:16:20.526026  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.541479  6937 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.015s	sys 0.026s
I20260709 13:16:20.503844 11723 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:20.527251  6219 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:20.539157  6936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 1158) took 1070 ms. Trace:
I20260709 13:16:20.523322 11737 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:20.529505  6329 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:20.554427  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:20.549086  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:20.556453  6248 raft_consensus.cc:2368] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13.
I20260709 13:16:20.525404 11539 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.540383  6328 raft_consensus.cc:2368] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13.
I20260709 13:16:20.544550  6936 rpcz_store.cc:276] 0709 13:16:19.461666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.462666 (+  1000us) service_pool.cc:224] Handling call
0709 13:16:20.532045 (+1069379us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540069f354. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:20.532161 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390956800}
I20260709 13:16:20.525040 11204 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.524680 11746 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:20.531999 11520 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.523659 11736 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:20.560444 11755 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.561272 11751 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.561492  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:20.561760 11751 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:20.527895 11557 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.537881 11637 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.534794 11366 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.560165 11539 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.574047  6249 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:20.564670  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:20.522554 11650 raft_consensus.cc:3055] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:20.522890 11478 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.540449 11616 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:20.564316  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:20.564277  6219 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:20.543637 11589 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:20.597277 11539 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:20.569891  6251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1024) took 1922 ms. Trace:
I20260709 13:16:20.570452  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:20.598156 11595 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:20.598485  6254 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:16:20.598644  6219 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:20.570829  6252 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:20.564316 11736 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.557762 11723 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:20.598641 11595 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.601630 11736 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:20.602025 11595 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:20.601799 11723 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:20.603399 11715 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:20.604120 11723 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:20.603942 11715 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.604761 11723 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:20.581565  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:20.575573  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:16:20.605232  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.597909  6251 rpcz_store.cc:276] 0709 13:16:18.647314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.148732 (+501418us) service_pool.cc:224] Handling call
0709 13:16:19.302930 (+154198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.303521 (+   591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.569640 (+1266119us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54001b94d0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be48ad 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:20.569811 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353659264}
I20260709 13:16:20.605306 11723 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:20.596072 11751 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:20.607751 11751 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:20.608142 11751 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.608357  6252 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:20.559341 11746 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:20.609511 11746 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:20.609658  6329 raft_consensus.cc:2393] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 13: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:20.610723  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:20.611424  6329 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 14.
I20260709 13:16:20.608999 11723 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:20.608518 11751 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:20.613533  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:20.615135  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:20.662220  6248 raft_consensus.cc:1275] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:20.568531 11593 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:20.617935  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:20.668748 11739 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:16:20.669801 11715 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:20.643098  6329 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:20.566493 11204 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.673251  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:20.566632 11520 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.670996  6934 raft_consensus.cc:2468] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 15.
I20260709 13:16:20.680408 11520 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:20.573915 11557 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.674705 11204 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:20.683329  6329 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 14: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:20.686822  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:20.694275 11299 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:20.699224  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:20.712755  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:20.665753  6906 leader_election.cc:400] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13.
I20260709 13:16:20.714208  6936 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
I20260709 13:16:20.714388  6906 leader_election.cc:403] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:20.700766  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:20.594296 11508 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:20.717772  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 58872.8us
I20260709 13:16:20.592808 11594 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:20.535773 11710 consensus_queue.cc:237] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.722352  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:20.591562 11650 raft_consensus.cc:740] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:20.723940  6906 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:20.576503 11737 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.593104 11366 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:20.740015  6253 raft_consensus.cc:1240] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 LEADER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:20.740213  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:20.752630  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 236527us
I20260709 13:16:20.722229 11740 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:16:20.586738 11637 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.757328  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:20.760304  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:20.739238 10964 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:20.762887  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:20.764134  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:16:20.764791  6368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.030s	sys 0.038s
I20260709 13:16:20.764935  6250 raft_consensus.cc:2393] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:16:20.766479  6368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.030s	sys 0.038s
I20260709 13:16:20.766393  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:20.767334  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 718298us
I20260709 13:16:20.767614  6256 raft_consensus.cc:2393] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 15: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:20.768249  6368 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:20.759406  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 224787us
I20260709 13:16:20.721547 11593 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:20.754678 11563 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:20.756135 11478 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:20.730997 11508 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.798398  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:20.751986 11737 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:20.811023 10878 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:20.731462 11204 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:16:20.796643  6248 raft_consensus.cc:1240] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:20.770996 10964 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.751806 11715 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:16:20.811796 10878 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:20.863095  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 46856.7us
I20260709 13:16:20.795257 11299 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:20.869159  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:20.803316 11563 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:20.887639 10878 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:20.815696 11594 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:20.875587  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.853545 11520 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.858656 11616 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.821483 11478 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:20.852867 11750 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.791247 11650 consensus_queue.cc:260] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.890956 11563 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:20.853214 10964 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:20.853065 11761 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.890302 11299 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.915100  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:20.915678  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:20.919505  6405 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:20.897362 11477 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.943439  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:20.892004 11404 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:20.936213  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:20.918430 11750 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:20.941465  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:20.949723  6402 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.947472  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:20.919701 11759 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.974272  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:20.926000 11767 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:20.976608 11565 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:20.977728 11595 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.974767  6248 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:20.980387  6399 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:20.943511 11299 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:20.944885 11650 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:20.914749 11520 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.917304 11478 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:20.964764 11755 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:20.985168  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:20.906607 11594 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.913333 11616 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.993935  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:21.011798  6933 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:21.012362  6933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 1163) took 1018 ms. Trace:
I20260709 13:16:20.954916 11760 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:20.994410  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:20.999847 11763 log.cc:927] Time spent T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:16:21.005936  6329 raft_consensus.cc:2393] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:20.943162 11761 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:21.018641 11758 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:16:21.019263 11761 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:20.994772 11775 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:21.020115 11775 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.021517 11772 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.022236 11775 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:21.022024 11772 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:20.965811 11404 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.022578 11520 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.024135 11404 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:20.982106 11733 consensus_queue.cc:1059] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:16:21.025293 11760 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.027719 11760 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:20.986076 11767 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:21.029678 11752 log.cc:927] Time spent T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:16:21.030838 11767 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.032148 11774 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:21.032707 11774 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.033567  6937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 976) took 2518 ms. Trace:
W20260709 13:16:21.034497 11776 log.cc:927] Time spent T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:21.034932 11774 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:20.974190 11204 consensus_queue.cc:1048] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:16:21.054984  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.034026  6937 rpcz_store.cc:276] 0709 13:16:18.514677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.514813 (+   136us) service_pool.cc:224] Handling call
0709 13:16:18.515141 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.515480 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.515519 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.516015 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.428142 (+912127us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b18001388e0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572adae07 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af7c02 00007f457577f20b 00007f4575784d23 00007f45757850d1 00007f4575ba0a0f
0709 13:16:20.542590 (+1114448us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:20.542629 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.546137 (+  3508us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.033214 (+487077us) raft_consensus.cc:1685] finished
0709 13:16:21.033237 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.033479 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":71,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":16441728,"thread_start_us":1114237,"threads_started":1,"wal-append.queue_time_us":2236400}
I20260709 13:16:20.956051 11477 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.012741  6933 rpcz_store.cc:276] 0709 13:16:19.994218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.981298 (+987080us) service_pool.cc:224] Handling call
0709 13:16:21.012289 (+ 30991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.059089  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:16:21.062458  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 68193.7us
W20260709 13:16:21.066447  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 131489us
I20260709 13:16:21.065840  6222 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:21.077486  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:21.078213  6933 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:21.084290  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 98386.2us
I20260709 13:16:21.085743  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:21.086694  6937 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:21.087168  6396 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:20.993709 11565 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.024137 11772 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.090186  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.117448  6399 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:16:21.085073 11767 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.092749 11508 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.097175 11761 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:21.098104 11740 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13.
I20260709 13:16:21.140524  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:21.098544  6296 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:21.101738 11616 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.101966  6937 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:21.144826  6937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 988) took 1526 ms. Trace:
I20260709 13:16:21.145262  6937 rpcz_store.cc:276] 0709 13:16:19.618283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.101212 (+1482929us) service_pool.cc:224] Handling call
0709 13:16:21.101538 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.144569 (+ 43031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.144768 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.147616  6937 raft_consensus.cc:1240] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:21.103478 11595 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.103531  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.106446 11478 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:21.062004 11755 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:21.108419 11736 consensus_meta.cc:287] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:16:21.108095 11563 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.064471 11775 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:21.086061 11404 raft_consensus.cc:3055] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:16:21.111635 11525 consensus_meta.cc:287] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.600s	user 0.000s	sys 0.008s
I20260709 13:16:21.077028 11593 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:21.120110  6402 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:21.120635  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.173184  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:21.173740  6402 raft_consensus.cc:2376] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16. Re-sending same reply.
I20260709 13:16:21.126639  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:20.982419 11759 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.141305  6399 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:21.150349  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 52367.3us
I20260709 13:16:21.150602  6937 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:21.157810  6933 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:21.142997 11508 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:21.175158  6296 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:21.151305 11737 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:21.178627  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.180114  6248 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:21.179365  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.129761 11733 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:16:21.180516  6256 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:21.181087  6398 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:16:21.165901 11478 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:21.183781  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.184499  6250 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:21.201604  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.138729 11767 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.130980 11299 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.171000 11404 raft_consensus.cc:740] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:21.205165 11789 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:21.225297  6397 raft_consensus.cc:1240] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:21.226375 11563 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:21.226869 11594 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:21.230851 11751 consensus_meta.cc:287] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.000s
I20260709 13:16:21.231370 11751 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.232609  6252 raft_consensus.cc:2368] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 13. Current term is 14.
I20260709 13:16:21.234265 11477 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.175698 11775 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.237341 11775 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:21.168613 11755 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.240005 11755 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.242741 11404 consensus_queue.cc:260] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.244434 11404 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:21.244182 10964 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.177718 11525 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.245728  6936 raft_consensus.cc:2393] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:21.247442 11525 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:21.248504  6322 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 16: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:21.169895 11736 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.249923  6405 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 16: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:21.251048 11736 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:21.253477 11767 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.248389 11751 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:21.240752 11746 consensus_meta.cc:287] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.003s
I20260709 13:16:21.255116 11746 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.257543  6403 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:21.182147 11508 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.262905  6399 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:21.216466 11759 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:21.269567  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.270973  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.272006  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.272626 11746 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:21.274209 11508 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:21.275498  6934 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 1162) took 1557 ms (client timeout 1859 ms). Trace:
W20260709 13:16:21.276070  6934 rpcz_store.cc:269] 0709 13:16:19.717850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.561112 (+843262us) service_pool.cc:224] Handling call
0709 13:16:21.275327 (+714215us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400663ad4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:21.275441 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250417920}
I20260709 13:16:21.277170 11744 raft_consensus.cc:3055] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:21.277680 11744 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:21.274871 10964 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:21.282580 11727 log.cc:927] Time spent T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 1.859s	user 0.030s	sys 0.021s
I20260709 13:16:21.273005  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.284459  6323 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 8.
I20260709 13:16:21.289608  6398 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:21.291195  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.278581 11744 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.295635 11744 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:21.301873  6940 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41298 (request call id 1159) took 1748 ms (client timeout 2102 ms). Trace:
W20260709 13:16:21.302448  6940 rpcz_store.cc:269] 0709 13:16:19.553619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.553815 (+   196us) service_pool.cc:224] Handling call
0709 13:16:21.301634 (+1747819us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54005618d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:21.301792 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077483264}
I20260709 13:16:21.287024 11628 raft_consensus.cc:3055] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:21.304168 11628 raft_consensus.cc:740] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:21.305263 11628 consensus_queue.cc:260] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.306114  6400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2534) took 3155 ms. Trace:
I20260709 13:16:21.306839 11628 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:21.306546  6400 rpcz_store.cc:276] 0709 13:16:18.150449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.514391 (+363942us) service_pool.cc:224] Handling call
0709 13:16:18.535250 (+ 20859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.261353 (+1726103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.305830 (+1044477us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54003750d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:21.306024 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3572081024}
I20260709 13:16:21.320218  6322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57226 (request call id 1832) took 1885 ms. Trace:
I20260709 13:16:21.320715  6322 rpcz_store.cc:276] 0709 13:16:19.434994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.475793 (+1040799us) service_pool.cc:224] Handling call
0709 13:16:21.320015 (+844222us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54001676d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:21.320153 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1774090112}
W20260709 13:16:21.323791  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 155651us
I20260709 13:16:21.317919 11565 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:21.327484  6369 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:21.328327  6369 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:21.332588  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.333264  6256 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:21.331120 11791 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:21.334482 11791 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.334870 11791 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:21.337457  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.338092  6256 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:21.338477 11536 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:21.338915  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:21.339511  6256 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:21.341567 11299 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.341816 11649 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:21.333086 11742 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:21.343596  6369 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:21.354025 11299 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:21.355485 11299 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.355904 11299 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:21.349023 11536 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.358714 11536 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.363539  6256 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:21.365186  6369 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:21.368065  6323 raft_consensus.cc:1240] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:16:21.350180 11742 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:21.383312  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:21.385057  6256 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 15: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:21.379392 11797 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:21.382884 11742 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:21.395668 11791 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.396445 11797 raft_consensus.cc:697] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:21.401361  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1025) took 2753 ms. Trace:
W20260709 13:16:21.402098  6328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41502 (request call id 1232) took 1850 ms (client timeout 1834 ms). Trace:
I20260709 13:16:21.389982  6398 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:16:21.412501  6328 rpcz_store.cc:269] 0709 13:16:19.551356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.688125 (+136769us) service_pool.cc:224] Handling call
0709 13:16:21.401839 (+1713714us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54002a5154. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:21.401992 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1259340672}
I20260709 13:16:21.413197  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:21.414115  6256 raft_consensus.cc:3060] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:21.411764  6247 rpcz_store.cc:276] 0709 13:16:18.647560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.257878 (+610318us) service_pool.cc:224] Handling call
0709 13:16:19.258199 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.508535 (+1250336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.401008 (+892473us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400356954. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:21.401252 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2873553664}
I20260709 13:16:21.418664  6247 raft_consensus.cc:1240] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:21.394745 11536 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:21.422567  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:21.423444  6256 raft_consensus.cc:2468] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 16.
I20260709 13:16:21.424911  6369 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:21.427037 11749 raft_consensus.cc:2804] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:21.427572 11749 raft_consensus.cc:697] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:21.430503  6253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1026) took 2782 ms. Trace:
I20260709 13:16:21.431041  6253 rpcz_store.cc:276] 0709 13:16:18.647808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.267662 (+619854us) service_pool.cc:224] Handling call
0709 13:16:19.268037 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.752874 (+1484837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.430199 (+677325us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000e29d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:21.430424 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3384798464}
I20260709 13:16:21.412220 11626 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.434844  6935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 1160) took 1817 ms. Trace:
I20260709 13:16:21.435226  6935 rpcz_store.cc:276] 0709 13:16:19.617178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.630593 (+ 13415us) service_pool.cc:224] Handling call
0709 13:16:19.769859 (+139266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.071899 (+302040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.071944 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:20.072003 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:20.072048 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.434610 (+1362562us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54005375d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:21.434652 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.434762 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":694016768}
I20260709 13:16:21.433625 11626 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.397069 11689 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.428493 11749 consensus_queue.cc:237] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.463157  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:21.463936  6251 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:21.466030 11689 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:21.474185 11791 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.472740 11366 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:21.485240  6251 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
W20260709 13:16:21.485978  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.486485  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.486776  6369 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:21.487643 11746 raft_consensus.cc:2804] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:21.488132 11746 raft_consensus.cc:697] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:21.488212 11678 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:21.489058 11746 consensus_queue.cc:237] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.496141 11606 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.496650 11606 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.498754 11606 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:21.501809 11744 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.502414 11744 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.506538 11744 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.507419 11637 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.508139 11742 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.509261  6250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:21.509912  6250 raft_consensus.cc:606] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:21.510224  6250 raft_consensus.cc:614] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:21.510427 11626 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:21.503134  6368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.513146 10878 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:21.513283  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.513645 10878 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.477588 11689 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.472633 11797 consensus_queue.cc:237] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.515974  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.516072  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.516913  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.517666 11689 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.517958  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.514186  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:21.519065  6250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:21.519613  6250 raft_consensus.cc:606] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:21.519937  6250 raft_consensus.cc:614] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:21.521425  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:21.522285  6400 raft_consensus.cc:2393] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:21.525501  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.528515 11392 raft_consensus.cc:3055] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:21.528930 10878 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:21.530673  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.515419 11477 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.514590 11634 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.542667  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:21.515303 11404 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:21.545571  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.545881  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.552409  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:21.553308  6405 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
I20260709 13:16:21.528939 11392 raft_consensus.cc:740] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:21.546727 11477 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.570688  6400 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:21.619185  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:21.564035  6326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 3110) took 2230 ms (client timeout 2071 ms). Trace:
I20260709 13:16:21.561213  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:21.645255  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.693796  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.643985  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:21.603580  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.707016  6325 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:21.691337  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:21.595590  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.708045  6323 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:21.568029  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57230 (request call id 3117) took 2220 ms. Trace:
I20260709 13:16:21.697196  6297 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:21.708145  6253 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:21.562546  6941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:47742
I20260709 13:16:21.710407  6405 raft_consensus.cc:2393] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 16: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:21.710388  6327 rpcz_store.cc:276] 0709 13:16:19.347616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.347763 (+   147us) service_pool.cc:224] Handling call
0709 13:16:21.567857 (+2220094us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54001c1954. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:21.567973 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359330048}
I20260709 13:16:21.711393  6330 raft_consensus.cc:2410] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:16:21.705899  6326 rpcz_store.cc:269] 0709 13:16:19.333644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.340175 (+  6531us) service_pool.cc:224] Handling call
0709 13:16:21.563738 (+2223563us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54003935d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:21.563916 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655718656}
I20260709 13:16:21.594798  6250 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:16:21.603010  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.595214  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.722868  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.723467  6941 raft_consensus.cc:606] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:21.723968  6941 raft_consensus.cc:614] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:21.725168  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.715078  6297 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:21.714833  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.727430  6331 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:21.728061  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:21.728099  6251 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
I20260709 13:16:21.728621  6328 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:21.729799  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.730077  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.731949  6251 raft_consensus.cc:2393] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 14: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:21.733381  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.736210  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.745543  6326 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:21.746474  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.744314  6325 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 14.
I20260709 13:16:21.735623  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.747685  6906 leader_election.cc:400] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 13. Current term is 14.
I20260709 13:16:21.643476 11786 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:21.756524  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.757819  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.758409  6250 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:21.758905  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.748065  6906 leader_election.cc:403] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:16:21.734724  6296 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:21.644891 11760 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.644330 11777 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:21.749707  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.750578  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.753342  6397 raft_consensus.cc:2393] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:21.643867 11769 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:21.755528  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.555814 11299 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.760138  6368 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:21.748260  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:21.768541 11744 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:21.581919 11750 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:21.644631 11790 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:21.549284 11634 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.708923 11478 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.736773  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:21.552546 11404 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.709357 11557 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.726888 11689 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:21.580864 11498 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.714042 11366 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:16:21.773371  6248 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 15: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:21.759176  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.935880  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.896696  6323 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 15.
I20260709 13:16:21.829768  6328 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:21.816816  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.770287  6251 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:21.768348 11628 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:21.931875  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2548) took 1024 ms. Trace:
W20260709 13:16:21.937707 11809 log.cc:927] Time spent T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:16:21.824059  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.824934  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:21.897852  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 832038us
I20260709 13:16:21.996042  6402 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:21.947703 11790 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.002835 11790 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:22.004321  6222 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.005482  6256 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 8.
I20260709 13:16:22.006456  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:22.007172  6256 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 16: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:21.776296 11777 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:21.938552  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 193187us
I20260709 13:16:22.007416  6222 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:21.772356 11760 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:21.945608 11744 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:21.780459 11769 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:22.086719 11747 log.cc:927] Time spent T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 1.524s	user 0.004s	sys 0.000s
I20260709 13:16:22.089622  6939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 987) took 2471 ms. Trace:
I20260709 13:16:22.090090  6939 rpcz_store.cc:276] 0709 13:16:19.618013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.630503 (+ 12490us) service_pool.cc:224] Handling call
0709 13:16:19.768864 (+138361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:19.803949 (+ 35085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:19.803994 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:19.804580 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 13:16:20.490396 (+685816us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:20.490439 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.490511 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.086079 (+1595568us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:16:22.089204 (+  3125us) raft_consensus.cc:1685] finished
0709 13:16:22.089232 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.089546 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34583,"raft.queue_time_us":37455,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":105870,"spinlock_wait_cycles":3225984,"thread_start_us":491461,"threads_started":1,"wal-append.queue_time_us":723150}
I20260709 13:16:22.093887  6402 raft_consensus.cc:2410] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:16:21.981220 11498 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.096292 11553 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:22.097826  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 2000) took 1333 ms. Trace:
I20260709 13:16:22.098235 11498 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:22.098199  6254 rpcz_store.cc:276] 0709 13:16:20.764084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.765476 (+  1392us) service_pool.cc:224] Handling call
0709 13:16:20.765881 (+   405us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:20.976583 (+210702us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:20.978030 (+  1447us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.690861 (+712831us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:21.691561 (+   700us) log.cc:844] Serialized 52 byte log entry
0709 13:16:21.691753 (+   192us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:21.709694 (+ 17941us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.830435 (+120741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.097446 (+267011us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400152054. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:22.097493 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.097625 (+   132us) raft_consensus.cc:1685] finished
0709 13:16:22.097641 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.097770 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1316038,"prepare.queue_time_us":722,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":12098,"raft.queue_time_us":832207,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":36340,"spinlock_wait_cycles":282135424,"thread_start_us":256990,"threads_started":2,"wal-append.queue_time_us":302303}
I20260709 13:16:22.101438  6401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 2550) took 1193 ms. Trace:
I20260709 13:16:22.101460  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:22.102243  6254 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:22.103232  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:21.806015 11742 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:21.755970 11710 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:21.896628 11299 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:21.735967 11565 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:16:21.831106 11764 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:21.944116  6331 raft_consensus.cc:2393] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 16: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:21.763368  6296 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:22.107460  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 344151us
I20260709 13:16:22.108150 11769 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:21.946376  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 186303us
I20260709 13:16:22.109151  6368 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:22.109715  6296 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:22.110478 11750 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:22.110838 11750 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:22.111194 11750 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:21.948506  6322 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:22.112360 11637 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:22.112756 11637 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:22.113107 11637 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:21.985159  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:22.114131  6255 raft_consensus.cc:2410] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:16:22.115109  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:21.986338  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:22.116853  6248 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 15: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:21.992368  6398 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:21.992091  6396 rpcz_store.cc:276] 0709 13:16:20.907330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.918824 (+ 11494us) service_pool.cc:224] Handling call
0709 13:16:20.919183 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.087621 (+168438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.931557 (+843936us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540044fcd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:21.931792 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":385381760}
I20260709 13:16:21.993582  6253 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:22.118158 11764 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:22.118695 11750 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.119961  6253 raft_consensus.cc:1240] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:22.120285 11764 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:22.120743 11750 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:21.994364  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:22.121362 11750 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:21.983817  6250 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
I20260709 13:16:22.121548 11710 raft_consensus.cc:697] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:22.121868 11750 raft_consensus.cc:697] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:22.122696  6250 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:22.105429  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1833) took 1125 ms. Trace:
I20260709 13:16:21.944679 11377 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:22.008460  6295 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:21.565701 11392 consensus_queue.cc:260] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:21.949813 11759 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:22.013839  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:22.128424  6255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
W20260709 13:16:21.896787  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 298709us
I20260709 13:16:22.046882  6222 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:21.994961  6221 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:21.951802 11689 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.982365 11477 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:22.131153 11689 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:22.063035 11785 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:22.064678 11107 consensus_queue.cc:1059] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:16:21.952768 11478 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.062595 11811 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:22.005378 11797 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:22.070082 11805 log.cc:927] Time spent T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:16:22.071048 11790 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.145628 11710 consensus_queue.cc:237] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.072764 11760 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:22.149830  6249 raft_consensus.cc:2393] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:16:22.077728 11806 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:16:22.078999 11744 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.141871 11785 raft_consensus.cc:2764] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:16:21.981576 11626 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.082415 11634 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:22.101974  6401 rpcz_store.cc:276] 0709 13:16:20.907994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.908723 (+   729us) service_pool.cc:224] Handling call
0709 13:16:20.936851 (+ 28128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.036359 (+ 99508us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:16:21.055110 (+ 18751us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.159508 (+104398us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:21.159586 (+    78us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:21.159656 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.101211 (+941555us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b5400183654. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:22.101261 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.101382 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20355,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":3818,"raft.queue_time_us":15927,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":3106,"spinlock_wait_cycles":228353408,"thread_start_us":85906,"threads_started":1,"wal-append.queue_time_us":178904}
W20260709 13:16:22.126457  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 118090us
I20260709 13:16:22.127236  6248 raft_consensus.cc:1240] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:16:22.129323  6253 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:22.166915  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:22.121493  6251 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:22.129922  6219 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.123762  6329 rpcz_store.cc:276] 0709 13:16:20.980011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.064135 (+ 84124us) service_pool.cc:224] Handling call
0709 13:16:21.064640 (+   505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.064885 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:21.114549 (+ 49664us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.004093 (+889544us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b18004ca8c0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:16:22.088987 (+ 84894us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b18004ca8c0. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f457578d4bc 00007f4572adb48b 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af5455 00007f4575bdd060 00007f4575bef716 00007f4575c00287
0709 13:16:22.104950 (+ 15963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.105032 (+    82us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:22.105094 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.105202 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.105348 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43763,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":13111,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":15983,"spinlock_wait_cycles":10984064,"thread_start_us":63988,"threads_started":2,"wal-append.queue_time_us":51371}
W20260709 13:16:22.140344  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 145453us
W20260709 13:16:22.133724  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 86969.9us
I20260709 13:16:22.171244  6219 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.144208 11769 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:22.174698  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.175554  6938 raft_consensus.cc:2410] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:16:22.175843  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.175911  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.176651  6940 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 15.
I20260709 13:16:22.159857 11811 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:22.133455 11749 consensus_queue.cc:1059] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:16:22.161279  6254 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:22.134176 11764 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:22.169551  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:22.177408 11811 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.191040  6255 raft_consensus.cc:606] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.182325  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:22.191484  6255 raft_consensus.cc:614] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:22.191891  6941 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:22.194589  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.128141 11377 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:22.197533 11571 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:22.205983 11571 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.206454 11571 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:22.195541  6295 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:22.210737  6295 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:22.190923 11786 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:22.198705  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.220285  6940 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:22.198954  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.200335  6933 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:16:22.222164  6933 pending_rounds.cc:85] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Aborting all ops after (but not including) 10
I20260709 13:16:22.222434  6933 pending_rounds.cc:107] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:16:22.222673  6933 raft_consensus.cc:2889] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:22.201512  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:22.202696  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.212595  6295 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.227272  6942 raft_consensus.cc:2410] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:16:22.227401  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:22.227756  6295 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.229554  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:22.230708 11631 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:22.232959  6253 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:16:22.181264  6219 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.216440  6906 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:22.182734  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.236025  6936 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:22.230692  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.236909  6939 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 9.
W20260709 13:16:22.237075 11810 log.cc:927] Time spent T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:16:22.238828  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.239969  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.241353 11589 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:22.241900 11589 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.242015  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.242398 11589 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:22.242787 11637 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.240309  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.244060  6939 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 12: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:22.244747  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:22.245486  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.245770  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:22.246336  6939 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.247088  6937 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:22.248587  6937 raft_consensus.cc:1275] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:16:22.253436 11107 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:22.254766  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 73628.2us
I20260709 13:16:22.255247 11775 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:22.255586  6219 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:22.243103  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.230119  6295 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:22.259582  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.191413 11366 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:22.180610 11760 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:22.258165  6295 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:22.150363 11797 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.262900 11723 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:22.225790 11815 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:22.268568  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:22.268826  6939 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:22.291100  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:22.292148  6939 raft_consensus.cc:2410] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:16:22.263841 11366 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:22.225612 11764 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:22.244940 11637 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:22.279943  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 170271us
I20260709 13:16:22.280342  6219 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.122839 11750 consensus_queue.cc:237] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.281572 11723 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.313511  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:22.314262  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:22.285010 11107 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:22.370600  6329 raft_consensus.cc:1240] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:22.169478 11626 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:22.289983  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.268896  6941 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 15.
I20260709 13:16:22.293453  6295 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.313026  6322 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:22.287412 11767 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:22.315109  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:22.388970  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:22.304569 11565 raft_consensus.cc:3055] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:22.313858  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:22.394434  6323 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
W20260709 13:16:22.338881  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.213300  6222 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
W20260709 13:16:22.395695  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 182446us
I20260709 13:16:22.302286 11366 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:22.316009  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:22.398576  6323 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:22.376338  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 96098us
I20260709 13:16:22.399943  6219 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:22.380460  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 269535us
I20260709 13:16:22.381194  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:22.387324  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:22.302023 11628 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 13. Current term is 14.
I20260709 13:16:22.390651  6325 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:22.313516  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:22.321919 11777 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:22.349684 11723 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:22.326030 11764 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.311659  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:22.304340 11811 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:22.405985 11377 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:16:22.406111 11797 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:22.304047 11712 consensus_queue.cc:1059] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:16:22.394101 11565 raft_consensus.cc:740] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:22.422904  6323 raft_consensus.cc:1275] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:22.417227  6368 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:22.454123  6938 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 14.
I20260709 13:16:22.455101  6368 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:22.389334 11760 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:22.387838 11767 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:22.370201 11107 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.406477 11404 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:22.441643  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:22.441852  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.407981  6322 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 15: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:22.440928  6219 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:22.506184  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.444553  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:16:22.506613  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 65767.7us
I20260709 13:16:22.507196  6937 raft_consensus.cc:2393] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 10: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:22.508198  6219 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:22.386896 11631 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:16:22.407670 11785 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:22.463280  6222 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:22.428771 11790 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:22.458323 11781 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:22.523413 11790 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:22.523599 11634 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:22.523936 11790 raft_consensus.cc:697] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:22.524004 11634 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.524427 11634 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.435606 11764 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:22.442901 11553 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:22.514487  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 59453us
I20260709 13:16:22.535553  6368 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:22.535933 11743 consensus_queue.cc:1059] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:22.536883 11743 raft_consensus.cc:3055] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:22.536865 11818 consensus_queue.cc:1048] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:22.537415 11743 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:22.537722 11781 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:22.538305  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:22.538231 11743 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:22.539007  6398 raft_consensus.cc:2376] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12. Re-sending same reply.
I20260709 13:16:22.539435 11743 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.540704  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.542315  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.544080  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.544708  6398 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:22.545729  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.547305  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.548801  6402 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:22.524817 11790 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.550196 11777 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.554132 11689 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.459270 11377 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:22.555946 11478 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:22.556300 11689 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:22.454970 11520 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.557605  6327 raft_consensus.cc:2393] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 10: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:22.464763 11760 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.501513 11767 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:22.562250  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.504935 11107 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:22.563313  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:22.621850  6403 raft_consensus.cc:2393] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 9: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:22.563498  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.561444  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.623464  6396 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 16: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:22.624409  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.625268  6396 raft_consensus.cc:2368] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13.
I20260709 13:16:22.626106  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.626742  6396 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
W20260709 13:16:22.575421  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.564090  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.628628  6405 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 15: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:22.562486  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:22.619894  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:22.630611  6404 raft_consensus.cc:1240] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:16:22.631592  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.631747  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.632441  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.510766 11557 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:22.634449  6404 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:22.558696 11785 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:22.635695  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.606882 11760 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.635331  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.638615  6396 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:22.641634  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.651743  6405 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:22.651914  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.640211  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.646057  6221 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.652734  6400 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 9.
W20260709 13:16:22.637651  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 344263us
I20260709 13:16:22.638384  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.621008 11712 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:22.657029  6296 leader_election.cc:336] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Timed out: RequestConsensusVote RPC to 127.4.254.3:34111 timed out after 1.505s (SENT)
I20260709 13:16:22.660730  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:22.660982  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:22.662420  6330 raft_consensus.cc:1275] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:16:22.662909  6330 pending_rounds.cc:85] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 7
I20260709 13:16:22.663175  6330 pending_rounds.cc:107] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:16:22.663483  6330 raft_consensus.cc:2889] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:22.665056  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.666102  6403 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 15: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
W20260709 13:16:22.664897 11759 consensus_meta.cc:287] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:16:22.670311  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:22.671204  6402 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:22.565912 11520 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:22.690446  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:22.669590  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:22.697008  6399 raft_consensus.cc:3060] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:22.700052  6907 leader_election.cc:400] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13.
W20260709 13:16:22.665937 11744 consensus_meta.cc:287] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.000s
I20260709 13:16:22.672809  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:22.687830  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.702425  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:22.704981  6328 raft_consensus.cc:2393] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 9: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:22.671516  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:22.702522  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.677744  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:22.708001  6907 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.713306  6403 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:22.649430 11785 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:22.718976  6296 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.720438  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:22.720723  6296 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.715386  6399 raft_consensus.cc:2468] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:22.722810  6296 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:22.675242  6356 heartbeater.cc:646] Failed to heartbeat to 127.4.254.62:46653 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.254.62:46653 timed out after 15.000s (SENT)
I20260709 13:16:22.730769  6296 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.663632  6295 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:22.675541 11759 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:22.730825  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:22.754681  6253 raft_consensus.cc:3060] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:22.718951 11744 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:22.757460 11744 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:22.631843 11565 consensus_queue.cc:260] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:22.667284 11377 consensus_queue.cc:1059] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:16:22.667162 11557 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:22.758826 11565 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:22.675830 11589 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.760394 11626 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:22.760985  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.762266 11589 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:22.680590 11571 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.763161 11589 raft_consensus.cc:3055] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:22.763638 11589 raft_consensus.cc:740] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:22.666936 11775 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:16:22.769155  6253 raft_consensus.cc:2468] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 16.
I20260709 13:16:22.771953  6249 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:22.788138  6402 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:22.789561  6249 raft_consensus.cc:1275] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:16:22.790853  6250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.023s	sys 0.036s
I20260709 13:16:22.792932  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:22.792347  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:22.793366  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:22.794862  6249 raft_consensus.cc:2393] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:22.796170  6252 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 14: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:16:22.793116  6250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.024s	sys 0.036s
I20260709 13:16:22.765328 11571 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:22.670326 11712 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.780623 11744 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:22.732113 11817 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:16:22.801365  6369 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:22.764766 11589 consensus_queue.cc:260] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.818388 11478 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:22.831069 11589 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:22.802258  6942 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.007s	sys 0.018s
I20260709 13:16:22.829286 11634 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.784181 11626 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:22.820627  6371 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.002s	sys 0.025s
W20260709 13:16:22.833591  6371 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.002s	sys 0.025s
I20260709 13:16:22.833750  6401 raft_consensus.cc:2368] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
W20260709 13:16:22.833904  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 553242us
I20260709 13:16:22.836720 11634 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:22.837471  6942 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.007s	sys 0.018s
I20260709 13:16:22.825842 11404 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:22.852439 11746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.022s	sys 0.044s
I20260709 13:16:22.820324 11631 consensus_queue.cc:1059] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:16:22.854382 11478 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:22.855113 11829 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:22.902410  6905 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.013s	sys 0.013s
W20260709 13:16:22.865182 11746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.022s	sys 0.044s
W20260709 13:16:22.917668 11819 log.cc:927] Time spent T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:16:22.904906  6905 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.013s	sys 0.013s
I20260709 13:16:22.920195  6250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1048) took 1166 ms. Trace:
W20260709 13:16:22.932322  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 424130us
I20260709 13:16:22.936007  6219 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:16:22.938616  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 475404us
I20260709 13:16:22.939931  6398 raft_consensus.cc:1240] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:22.935014  6250 rpcz_store.cc:276] 0709 13:16:21.753929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.124778 (+370849us) service_pool.cc:224] Handling call
0709 13:16:22.125105 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.142971 (+ 17866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.143040 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.151366 (+  8326us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.804247 (+652881us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:22.804303 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.804395 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.919926 (+115531us) raft_consensus.cc:1685] finished
0709 13:16:22.919950 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.920122 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12788,"raft.queue_time_us":13672,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3619,"thread_start_us":611800,"threads_started":1,"wal-append.queue_time_us":746361}
I20260709 13:16:22.947265  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:22.943102  6222 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:22.952112  6222 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:22.955854  6222 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.906515 11829 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.960278  6222 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:22.961452  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:22.958894 11571 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:22.937810 11827 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.953269 11830 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.953435 11557 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:22.967141  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:16:22.951448  6905 connection.cc:256] RPC call timeout handler was delayed by -1.3963649639999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 13:16:22.971668  6905 connection.cc:256] RPC call timeout handler was delayed by -1.3684649639999407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 13:16:22.971865  6940 raft_consensus.cc:2393] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:16:22.972013  6905 connection.cc:256] RPC call timeout handler was delayed by -1.1398649640000258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
I20260709 13:16:22.955981 11780 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:22.960954 11217 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:22.980127  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:22.980919  6328 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:22.981858  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:22.982792 11557 raft_consensus.cc:697] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:22.963606 11829 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:22.978968  6905 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.965569 11571 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:22.967535 11775 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:22.983110  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:22.992334  6328 raft_consensus.cc:2393] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 9: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:16:22.991499  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 260818us
I20260709 13:16:22.975214 11780 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.964082 11811 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:16:22.999541  6296 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:23.000815  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 177370us
I20260709 13:16:22.990008 11571 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:23.017374  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 309438us
I20260709 13:16:22.973800 11827 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:22.984618 11835 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.973861 11828 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 13:16:23.018316  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 354761us
I20260709 13:16:23.021051  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:22.996798 11780 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.027873  6328 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:22.997988 11775 raft_consensus.cc:697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:23.021888  6369 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:23.026361  6296 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:23.030242  6371 leader_election.cc:336] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.947s (SENT)
W20260709 13:16:23.037202  6370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:23.022163  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.031657  6295 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:22.990864 11764 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:23.025463 11553 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:23.022472 11749 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:23.047147  6907 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.048688  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:23.049490  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.049685  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:23.050235  6404 raft_consensus.cc:3060] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:23.055848 11392 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:23.057224  6907 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:23.058295  6255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59284 (request call id 56) took 1196 ms. Trace:
I20260709 13:16:23.058642  6255 rpcz_store.cc:276] 0709 13:16:21.862174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.116113 (+253939us) service_pool.cc:224] Handling call
0709 13:16:23.058138 (+942025us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b5400337054. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575bdf853 00007f457abad60a 00007f45741337d4 00007f4574133762 00007f4574133691 00007f457413360c 00007f45741328c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:23.058241 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142687104}
I20260709 13:16:23.060474 11817 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:23.037202 11835 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.071543  6323 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 16: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:16:23.065009  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 86156.3us
W20260709 13:16:23.044030 11820 log.cc:927] Time spent T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:16:23.033473 11834 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:23.064539  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.036868 11404 raft_consensus.cc:2804] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:23.076844 11746 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.044627 11712 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:23.019876 11557 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:22.975485 11830 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:23.040856 11742 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:16:23.041996 11637 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:16:23.070950 11744 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:23.135170 11821 log.cc:927] Time spent T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:16:23.120704 11832 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:23.116062 11746 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.140028  6256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1050) took 1363 ms. Trace:
I20260709 13:16:23.140470  6256 rpcz_store.cc:276] 0709 13:16:21.777363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.128488 (+351125us) service_pool.cc:224] Handling call
0709 13:16:22.128761 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.129086 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.129115 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.141592 (+ 12477us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.509999 (+368407us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:22.510035 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.510122 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.139810 (+629688us) raft_consensus.cc:1685] finished
0709 13:16:23.139832 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.139966 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1706,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"thread_start_us":341071,"threads_started":1,"wal-append.queue_time_us":663036}
I20260709 13:16:23.136663 11832 raft_consensus.cc:2804] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:23.142971  6250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0c4567153664b518d2f6515e419da60"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
W20260709 13:16:23.135339 11777 consensus_meta.cc:287] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.000s
I20260709 13:16:23.143776  6250 raft_consensus.cc:606] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:23.147532  6250 raft_consensus.cc:614] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:23.063511 11749 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:23.141459  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:23.170764  6249 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:23.118106 11712 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:23.182840  6249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce99643832824368978841e0265f9d2d"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:23.183696  6249 raft_consensus.cc:606] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:23.184173  6249 raft_consensus.cc:614] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:23.185056  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 120571us
I20260709 13:16:23.079547 11835 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.168859 11777 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:23.204623  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:23.175535 11832 raft_consensus.cc:697] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:23.212150  6404 raft_consensus.cc:2468] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
W20260709 13:16:23.232915  6906 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.028s	sys 0.045s
W20260709 13:16:23.233439  6906 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.028s	sys 0.045s
W20260709 13:16:23.233680  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 934798us
I20260709 13:16:23.196362 11845 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:23.234561  6906 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.181880 11840 consensus_queue.cc:1059] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:16:23.223066 11744 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:23.259701  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 202542us
I20260709 13:16:23.255239 11746 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:23.278899  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 200891us
I20260709 13:16:23.279865  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.280520  6905 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.281621  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.282732  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.287160  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:23.287458  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.288193  6397 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 15: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:23.289742  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:23.291576  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.292758  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.292639  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.302213  6402 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:23.304294  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.319285  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.174695 11775 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.272645 11864 consensus_queue.cc:1059] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:16:23.271340 11404 raft_consensus.cc:697] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:23.330155 11404 consensus_queue.cc:237] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:23.314260  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.266752 11850 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:23.326051  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.327487  6296 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:23.320314 11754 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.336571  6400 raft_consensus.cc:2393] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:23.343461  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:23.344201  6401 raft_consensus.cc:2393] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:23.344501  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:23.345038  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.345045  6331 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.253005 11780 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.265856 11744 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:23.274060 11827 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:23.334167 11840 raft_consensus.cc:3055] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:23.318858 11815 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:23.348232  6296 leader_election.cc:400] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
I20260709 13:16:23.373769  6296 leader_election.cc:403] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:23.321488 11811 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:16:23.361891  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 90899.6us
I20260709 13:16:23.340803 11845 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:23.378894  6907 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:23.343720 11764 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:23.381001  6252 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:16:23.382434  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 44935us
I20260709 13:16:23.393565  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:23.399856  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 128764us
I20260709 13:16:23.397333  6397 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:23.357363 11840 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:16:23.407707  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 127259us
I20260709 13:16:23.409337  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:23.410382  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:23.410941  6938 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:23.411835  6905 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:23.403823 11864 raft_consensus.cc:2804] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:23.413748  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:23.414428  6940 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:23.400058 11712 raft_consensus.cc:3055] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:23.398365 11845 raft_consensus.cc:697] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:23.417835  6938 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:23.402923 11749 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:23.396163 11858 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:23.343742 11754 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.392478 11811 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:23.379769 11850 consensus_queue.cc:1059] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:16:23.425752 11853 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:16:23.426818 11852 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:16:23.332916 11832 consensus_queue.cc:237] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:23.431902 11723 consensus_meta.cc:287] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.994s	user 0.010s	sys 0.000s
I20260709 13:16:23.434590 11780 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:23.434882 11754 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:23.435844 11767 consensus_meta.cc:287] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.800s	user 0.004s	sys 0.004s
I20260709 13:16:23.438504  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:23.462620  6327 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:16:23.462469 11767 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.420688 11864 raft_consensus.cc:697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:23.464731 11767 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:23.465937  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:23.464488 11864 consensus_queue.cc:237] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.445102  6368 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:23.445477  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.446410  6396 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:23.449762  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:23.474448  6938 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.429061  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:16:23.455977  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 44240.5us
I20260709 13:16:23.457480  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:23.457589  6399 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:23.418740 11712 raft_consensus.cc:740] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:23.459842  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:23.477505  6905 leader_election.cc:400] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13.
I20260709 13:16:23.481428  6905 leader_election.cc:403] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:16:23.484755  6371 leader_election.cc:336] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 2.235s (SENT)
I20260709 13:16:23.479883 11862 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.490209 11862 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:23.490921 11811 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:23.491314 11392 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:23.491859  6403 raft_consensus.cc:2410] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:16:23.437072 11840 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.493032 11712 consensus_queue.cc:260] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:23.495534 11589 consensus_meta.cc:287] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.664s	user 0.005s	sys 0.006s
I20260709 13:16:23.495798 11712 raft_consensus.cc:3060] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.460795 11829 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:23.497572 11565 consensus_meta.cc:287] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.738s	user 0.008s	sys 0.004s
I20260709 13:16:23.497906 11829 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:23.479444 11870 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.499409 11520 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:23.499974  6942 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:23.499547  6325 raft_consensus.cc:2393] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 10: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
W20260709 13:16:23.481796 11107 consensus_meta.cc:287] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.847s	user 0.008s	sys 0.004s
I20260709 13:16:23.501768 11107 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.503677  6324 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 10. Ops: []
I20260709 13:16:23.503962 11107 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:23.505041  6330 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
I20260709 13:16:23.507539  6938 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:23.499835 11870 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.508909  6905 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:23.473562 11689 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:23.511751  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:16:23.488875 11366 consensus_meta.cc:287] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 1.060s	user 0.012s	sys 0.000s
I20260709 13:16:23.459357 11571 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.539840  6331 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:23.473234 11723 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:23.510557 11858 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:23.545428  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 57040.3us
I20260709 13:16:23.551616  6253 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:23.553323  6368 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:23.550321  6905 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.535842 11864 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13.
I20260709 13:16:23.542999 11855 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:23.550638 11749 consensus_queue.cc:1048] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:16:23.563066 11723 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:23.542543 11842 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13.
I20260709 13:16:23.566262 11571 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:23.543274 11689 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.567737  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:23.568316  6934 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:23.570062 11760 consensus_meta.cc:287] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.902s	user 0.011s	sys 0.000s
I20260709 13:16:23.543509 11366 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.574584 11818 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:23.575038 11366 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:23.575219 11818 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.575899 11818 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:23.535810 11845 consensus_queue.cc:237] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.570650 11760 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:23.550045 11744 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:23.584195  6326 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:23.585048  6247 raft_consensus.cc:1240] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:23.586577  6905 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.590229 11855 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:23.592150 11855 raft_consensus.cc:2764] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:16:23.592943 11822 log.cc:927] Time spent T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.770s	user 0.003s	sys 0.010s
I20260709 13:16:23.594868 11862 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:23.548719 11869 consensus_queue.cc:1059] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:16:23.567785 11785 consensus_meta.cc:287] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.815s	user 0.004s	sys 0.007s
I20260709 13:16:23.589753 11689 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:23.619513 11557 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:23.620296 11557 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:23.622969 11557 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:23.623728 11835 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:23.641968 11830 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:23.648896  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:23.607072 11785 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.649658  6249 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:23.649705  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:23.654496  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:23.655369  6297 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:23.658223 11478 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:23.659279  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:23.659654  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:23.660497  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:23.661202 11785 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:23.648933  6252 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:16:23.662120  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:23.666666  6941 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:23.604336 11760 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:23.662933  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.740492  6397 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 16.
I20260709 13:16:23.664484  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:23.662621  6297 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.676231 11840 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.756528  6907 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:23.685582  6329 raft_consensus.cc:3055] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:23.757287  6329 raft_consensus.cc:740] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:23.680470  6326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 1247) took 1368 ms. Trace:
I20260709 13:16:23.672870  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 1119) took 1052 ms. Trace:
I20260709 13:16:23.758050  6326 rpcz_store.cc:276] 0709 13:16:22.311879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.315240 (+  3361us) service_pool.cc:224] Handling call
0709 13:16:22.315531 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.584628 (+1269097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.680195 (+ 95567us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002a4c54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:23.680388 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2917226880}
I20260709 13:16:23.668834  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:16:23.705870  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.761574  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:23.762213  6325 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:23.763269  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:23.763581 11712 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:23.764137 11712 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.764806  6323 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:16:23.764919  6935 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:16:23.765071 11890 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:23.765838  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:23.726737  6250 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:23.766558  6330 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:23.767148  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.767354  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:23.767560  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:23.768018  6328 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 15: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:23.768333  6250 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
I20260709 13:16:23.769323  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:23.728361  6255 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 15. Current term is 16. Ops: []
W20260709 13:16:23.696053  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 138289us
I20260709 13:16:23.685767  6934 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:23.770812  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:23.771106  6221 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:23.742615  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 80166.2us
I20260709 13:16:23.771875  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:23.772609  6255 raft_consensus.cc:2393] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:23.772552  6297 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:23.729876  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:23.773528  6254 raft_consensus.cc:2393] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 16: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:23.773746 11738 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:23.774173  6221 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.774256  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:23.775152 11571 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:23.753209  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:23.775484  6221 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.775887  6256 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
I20260709 13:16:23.776175 11571 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:23.776669  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:23.777340  6256 raft_consensus.cc:2393] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 10: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:23.754534  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:23.741552  6248 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:23.681973  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 1245) took 1370 ms. Trace:
I20260709 13:16:23.765619 11890 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.770052  6250 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 15: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:23.771433 11712 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:23.770007  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 183548us
I20260709 13:16:23.779212  6297 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.745590  6295 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:23.789786  6905 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.789788  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:23.790903  6250 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:23.699774  6219 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:23.780365  6221 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.792538  6324 rpcz_store.cc:276] 0709 13:16:22.311364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.314398 (+  3034us) service_pool.cc:224] Handling call
0709 13:16:22.314705 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.504048 (+1189343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.681666 (+177618us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002418d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:23.681899 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2733924096}
I20260709 13:16:23.794474  6249 raft_consensus.cc:2410] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:16:23.758114  6398 rpcz_store.cc:276] 0709 13:16:22.620049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.629777 (+  9728us) service_pool.cc:224] Handling call
0709 13:16:22.630114 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.942196 (+312082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.672587 (+730391us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54003ad4d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:23.672792 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711949184}
I20260709 13:16:23.775321  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:23.796135  6254 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 16.
I20260709 13:16:23.797241  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:23.798157  6254 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:23.802335  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:23.790165  6368 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:23.807806  6905 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.811959  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:23.786852  6222 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:23.787998  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:16:23.806348 11748 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.017s	sys 0.039s
I20260709 13:16:23.777647 11754 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:16:23.801748  6326 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:23.801882  6248 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:16:23.806227  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 60750.2us
W20260709 13:16:23.816898 11748 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.018s	sys 0.039s
I20260709 13:16:23.821784  6295 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.809041  6369 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:23.823369  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 123644us
I20260709 13:16:23.824048  6219 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:23.825102  6219 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:23.800663  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:23.815578  6905 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.816483  6249 raft_consensus.cc:1240] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:23.816617  6221 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:23.777691 11845 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:23.817791  6329 consensus_queue.cc:260] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:23.778371 11834 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:23.850492  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:23.852126  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 65387.5us
I20260709 13:16:23.852751  6934 raft_consensus.cc:2393] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 17: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:23.788301 11850 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:23.814704 11830 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:23.859313  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:23.859717  6329 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.829641  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:23.830072  6255 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:23.853314  6219 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:23.815160 11626 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:23.817044 11864 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:23.856884  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 47923.1us
I20260709 13:16:23.865085 11891 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:23.865931 11811 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:23.867038 11886 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:23.876500 11886 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.850085 11888 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:23.876920 11886 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:23.867697 11754 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:23.877485 11754 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:23.877884 11754 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.871421  6935 raft_consensus.cc:2393] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:23.871886  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:23.777776 11858 consensus_queue.cc:1059] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:16:23.851079 11631 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:23.828464 11742 raft_consensus.cc:2764] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:23.814566 11710 consensus_queue.cc:1048] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:16:23.828413  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:23.831187 11767 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:23.821869 11712 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:16:23.856465 11850 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.873040  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:23.858338 11738 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:23.857918 11777 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:23.909519  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.910275  6401 raft_consensus.cc:2393] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 11: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:23.911053  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.911644  6401 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
I20260709 13:16:23.912407  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.899907  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:23.814947 11842 consensus_queue.cc:1059] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:16:23.871210 11626 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.886375  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:23.806006 11478 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:23.815459 11878 consensus_queue.cc:1059] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 13:16:23.921972 11477 raft_consensus.cc:3055] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:23.922325 11477 raft_consensus.cc:740] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:23.830971 11723 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:16:23.923102 11477 consensus_queue.cc:260] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.924248 11477 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.856043 11845 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.924705  6399 raft_consensus.cc:1240] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:23.894233  6934 raft_consensus.cc:2368] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10.
I20260709 13:16:23.926265 11845 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:23.926582  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:23.927399  6934 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:23.855136 11744 consensus_queue.cc:1059] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:16:23.936805  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:23.937915  6934 raft_consensus.cc:2393] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 17: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:23.827397 11760 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:23.895309 11850 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:23.907209 11818 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:23.907681 11870 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:23.908131 11738 raft_consensus.cc:697] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:23.918053 11890 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:23.854897 11764 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:16:23.941047  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:23.945899 11818 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:23.894125 11767 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:23.978278  6935 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:16:24.121502  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 246066us
I20260709 13:16:24.157371  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:23.856662  6250 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
W20260709 13:16:24.125533  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 308424us
I20260709 13:16:23.902062  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:24.169875  6401 raft_consensus.cc:2368] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11.
I20260709 13:16:23.900159  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:23.906550  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:24.169835 11738 consensus_queue.cc:237] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:24.171846  6400 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:24.172044 11780 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:23.918144  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:23.917516  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:24.173882  6403 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:16:24.173995  6402 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:23.901365  6404 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:23.934140 11626 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.928251  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:23.982879 11767 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:23.976404  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:24.052732 11863 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:16:24.181499  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 327264us
I20260709 13:16:24.059008 11886 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:24.182392  6934 raft_consensus.cc:2410] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:16:24.183394  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:24.165480  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.171706  6221 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:23.980058 11750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.006s	sys 0.017s
W20260709 13:16:24.187212 11750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.292s	user 0.006s	sys 0.017s
I20260709 13:16:24.189675 11886 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:24.190382 11780 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:24.201275  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:24.217592  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.226207 11840 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.226961 11840 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:24.229835  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.231372 11637 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.232244 11637 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:24.234354 11840 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:24.235602 11637 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:24.236482  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:24.219930  6371 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.829s (SENT) [suppressed 27 similar messages]
W20260709 13:16:24.243779  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 78902.2us
I20260709 13:16:24.245661 11750 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:24.246165 11750 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.246563 11750 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:24.247282  6294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.248677 11760 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:24.254751 11785 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.255631 11785 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:24.276495  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:24.277486  6255 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:24.279947  6329 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:16:24.280753 11377 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
W20260709 13:16:24.282712  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 88648.8us
I20260709 13:16:24.286803  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:24.289750  6938 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 15: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:24.293637  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:24.294023  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:24.296092  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.296703  6250 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:24.297570  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.298580  6938 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:24.299700  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:24.307492 11855 raft_consensus.cc:3055] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:24.308044 11855 raft_consensus.cc:740] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:24.308161 11785 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:24.310786 11845 raft_consensus.cc:3055] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:24.311445 11845 raft_consensus.cc:740] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:24.305919  6221 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:24.321398  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 63887.2us
I20260709 13:16:24.317528  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 1866) took 1656 ms. Trace:
I20260709 13:16:24.276577  6247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 2032) took 1586 ms. Trace:
I20260709 13:16:24.344427  6404 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:16:24.382390  6403 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
W20260709 13:16:24.313943 11906 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:16:24.268253 11626 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:24.348536  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.363329 11589 raft_consensus.cc:3055] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:24.396119 11589 raft_consensus.cc:740] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:24.361335  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.398739 11589 consensus_queue.cc:260] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:24.341421  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:24.347535 11855 consensus_queue.cc:260] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:24.313009 11777 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:24.399284  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.343679  6254 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:24.336654  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.314782 11478 raft_consensus.cc:3055] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:24.406109  6934 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 15: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:24.351594  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.408654  6253 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:24.409543  6252 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 10. Ops: []
I20260709 13:16:24.413637  6933 raft_consensus.cc:2368] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 9. Current term is 10.
I20260709 13:16:24.414283  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.415501 11626 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:24.416391  6219 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:24.400120 11780 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:24.417251  6398 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:24.435424  6404 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:24.437489  6397 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:24.438616  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:24.422349 11631 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.424249 11855 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:24.425536  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:24.426877  6255 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
W20260709 13:16:24.405781  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 186661us
I20260709 13:16:24.432626  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:24.432896  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:24.417759 11769 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:16:24.452173  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 44765.1us
I20260709 13:16:24.453979  6937 raft_consensus.cc:2410] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:16:24.440373  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.455986  6937 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:16:24.457032  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:24.457546  6933 raft_consensus.cc:1275] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:16:24.458019  6933 pending_rounds.cc:85] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: Aborting all ops after (but not including) 12
I20260709 13:16:24.458153  6401 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:24.446882 11745 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:24.442785  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.446839 11631 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:24.459780  6941 raft_consensus.cc:2410] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:16:24.447938 11780 consensus_queue.cc:1059] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:16:24.461345 11631 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:24.462093  6327 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
I20260709 13:16:24.462270 11780 raft_consensus.cc:3055] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:24.462780 11780 raft_consensus.cc:740] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:24.463939 11780 consensus_queue.cc:260] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:24.466020 11477 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:24.469199  6403 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:24.458300  6933 pending_rounds.cc:107] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:16:24.448871  6250 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:24.451378  6939 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:24.469296  6368 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:24.470476  6933 raft_consensus.cc:2889] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:24.427697 11478 raft_consensus.cc:740] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:24.480124  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:24.480906  6327 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:24.483903  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:24.484715  6330 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:24.485371  6325 raft_consensus.cc:1275] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:24.387946  6329 rpcz_store.cc:276] 0709 13:16:22.661269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.661557 (+   288us) service_pool.cc:224] Handling call
0709 13:16:22.661814 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.685449 (+1023635us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540030da20. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575b5cdc0 00007f4575be71c0 00007f4575be8231 00007f4575be4d8f 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c
0709 13:16:24.280396 (+594947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.317425 (+ 37029us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313697664}
I20260709 13:16:24.387485  6247 rpcz_store.cc:276] 0709 13:16:22.690351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.690522 (+   171us) service_pool.cc:224] Handling call
0709 13:16:22.690840 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.585793 (+894953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.275956 (+690163us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b540011fdd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:24.276337 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2055882496}
I20260709 13:16:24.312883 11845 consensus_queue.cc:260] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:24.494139  6937 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:24.476523  6938 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
W20260709 13:16:24.498116  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 192447us
I20260709 13:16:24.499943 11828 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:16:24.502558  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:24.503866  6324 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
W20260709 13:16:24.505688  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.509919 11780 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:24.513756  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 44797.7us
I20260709 13:16:24.515951 11873 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:24.516942  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:24.517547  6219 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:24.531176  6403 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:24.500557 11845 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:24.527966  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:24.499029 11767 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:24.545385  6296 leader_election.cc:400] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11.
I20260709 13:16:24.546381  6296 leader_election.cc:403] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:24.552615  6404 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:24.543419 11589 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:24.544832 11745 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:24.560420  6251 raft_consensus.cc:1240] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:24.562176  6327 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:24.563010 11377 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111) with higher term. Message: Invalid argument: T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11.
I20260709 13:16:24.564158  6941 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:16:24.565291  6221 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:24.549968 11760 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:24.606921  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.610967  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 44862us
I20260709 13:16:24.622982  6296 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:24.570374 11631 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 13:16:24.647279  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 174996us
I20260709 13:16:24.556659 11769 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.086s
W20260709 13:16:24.653255 11754 consensus_meta.cc:287] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 0.671s	user 0.016s	sys 0.001s
I20260709 13:16:24.636714 11745 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:24.660696 11850 consensus_meta.cc:287] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.006s
I20260709 13:16:24.661293 11710 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:24.661254 11850 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:24.662155 11710 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:24.663717 11850 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:24.664767 11710 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:24.668354  6907 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:24.672559 11565 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:24.652949 11377 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:24.677913  6330 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:24.678194  6935 raft_consensus.cc:2368] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 16. Current term is 17.
W20260709 13:16:24.683053  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 140894us
W20260709 13:16:24.687376  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 140362us
W20260709 13:16:24.696601  6908 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.708277  6403 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:24.699105 11850 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:24.692957 11377 raft_consensus.cc:697] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:24.674839 11754 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:24.729696  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:24.723937  6371 leader_election.cc:336] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.510s (SENT)
I20260709 13:16:24.650290 11478 consensus_queue.cc:260] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:24.739989  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 90770us
I20260709 13:16:24.746340  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:24.747133  6934 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:24.755155  6934 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:24.756448  6934 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:24.757560  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 56762.7us
I20260709 13:16:24.759418 11749 consensus_queue.cc:1048] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:24.759451 11637 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:24.760172  6368 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:24.761906 11748 raft_consensus.cc:2804] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:24.762638 11748 raft_consensus.cc:697] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:24.765969 11767 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:24.769517 11478 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:24.771453 11754 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:24.772650  6256 raft_consensus.cc:1240] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:24.774255 11750 consensus_meta.cc:287] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.004s
I20260709 13:16:24.774752 11750 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:24.780411 11855 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.781075 11855 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:24.783740 11855 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:24.746486 11911 log.cc:927] Time spent T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:16:24.726009 11850 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.785943 11850 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:24.740856  6371 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:24.789620 11634 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:24.789312 11565 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:24.791970  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.764110 11748 consensus_queue.cc:237] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:24.794545  6368 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:24.809029  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 47912.7us
W20260709 13:16:24.817683  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 76258.9us
I20260709 13:16:24.819017  6297 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:24.819768 11749 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:16:24.817857  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 99913.2us
I20260709 13:16:24.820658 11631 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:24.827373  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.827667  6330 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:16:24.828172  6371 leader_election.cc:336] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.541s (SENT)
I20260709 13:16:24.828683  6326 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:24.830044  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.830888  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.665841  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:24.834362 11377 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:24.836745  6149 catalog_manager.cc:5697] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 9 to 11, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:24.839993  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.842720  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 135915us
I20260709 13:16:24.843268  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.862391  6371 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:24.866014  6936 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:24.866266  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:24.843979  6939 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:24.858280 11631 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:24.878635  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:24.881572  6938 raft_consensus.cc:2368] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 16. Current term is 17.
I20260709 13:16:24.858980 11749 raft_consensus.cc:697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:24.879488  6934 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:24.879528  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:24.867743 11873 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:24.893833  6403 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:24.871254 11886 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:24.884291 11631 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:24.907505  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:24.908392  6405 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:24.890345 11565 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:24.901567 11767 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:16:24.930757  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:24.932863  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:24.934329 11769 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:24.935078 11557 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:24.939309 11749 consensus_queue.cc:237] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:24.940713  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:24.941282 11818 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:24.966799  6933 raft_consensus.cc:1275] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:16:24.967203  6933 pending_rounds.cc:85] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: Aborting all ops after (but not including) 10
I20260709 13:16:24.967489  6933 pending_rounds.cc:107] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:16:24.967746  6933 raft_consensus.cc:2889] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:24.949592 11631 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:24.876196 11780 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:24.959208  6326 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:24.960667  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 132571us
I20260709 13:16:24.983176  6326 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:24.984699  6219 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:24.903347 11873 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:24.984870  6371 leader_election.cc:336] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.581s (SENT)
I20260709 13:16:24.996048  6371 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:24.913301 11886 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:24.997165  6405 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 17.
I20260709 13:16:24.991071 11769 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:25.005604  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:25.006377  6327 raft_consensus.cc:1240] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:25.016211  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 129845us
I20260709 13:16:25.011761 11818 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:25.052423  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:25.015741 11769 raft_consensus.cc:697] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:25.059749 11845 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:25.071223  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:16:25.071218  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 250920us
W20260709 13:16:25.077575  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 92726.3us
I20260709 13:16:25.086267  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:25.101220  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 213902us
W20260709 13:16:25.100207  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 198047us
I20260709 13:16:25.085036 11565 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:16:25.112556  6221 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:25.106081 11855 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:16:25.113036 11589 consensus_meta.cc:287] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.007s
I20260709 13:16:25.110783 11631 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:25.101490 11845 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:25.128535  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:25.128101  6942 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 9.
I20260709 13:16:25.136152 11767 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:25.147450  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:25.148097  6941 raft_consensus.cc:3060] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:25.150981  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:25.152143  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:25.150563  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:25.157812  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:25.158039 11926 log.cc:927] Time spent T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:16:25.158697 11845 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:25.158928  6939 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:25.159786 11873 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:25.161532  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:25.145195 11855 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.164510 11855 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:25.165439  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:25.167728  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:25.169401  6324 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:25.169564  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:25.170627 11850 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.171103  6934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:25.171679  6221 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:25.171963  6934 raft_consensus.cc:2393] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:25.173379  6936 raft_consensus.cc:2368] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 13. Current term is 14.
I20260709 13:16:25.176587 11850 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:25.180336  6939 raft_consensus.cc:2468] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
W20260709 13:16:25.182274 11925 log.cc:927] Time spent T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:16:25.183894 11557 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:25.170674  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:25.184885 11557 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.171036  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:25.133574 11769 consensus_queue.cc:237] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:25.187086 11557 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:25.188541  6940 raft_consensus.cc:2410] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:16:25.188953 11828 consensus_queue.cc:1059] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:25.172951  6221 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:25.190575 11850 consensus_queue.cc:1059] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:25.191912  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:25.192808  6905 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:25.192936  6323 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:16:25.193971  6296 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:25.207595  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 104295us
I20260709 13:16:25.208755 11749 consensus_queue.cc:1059] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:25.209535 11631 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:25.209901 11748 raft_consensus.cc:3055] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:25.210153 11631 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:25.210835 11631 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:25.211433 11873 consensus_queue.cc:1059] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:25.212679 11931 raft_consensus.cc:3055] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:25.213095 11931 raft_consensus.cc:740] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:25.214152  6330 raft_consensus.cc:1240] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:25.210448 11748 raft_consensus.cc:740] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:25.173305 11780 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:25.215646  6296 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:25.217427  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:25.223475  6330 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:25.213312 11873 consensus_queue.cc:1059] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
W20260709 13:16:25.232328  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 120010us
I20260709 13:16:25.222002 11738 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:25.235358 11738 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.239650 11738 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:25.241559  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 68677.1us
I20260709 13:16:25.242380  6221 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:25.248169 11832 raft_consensus.cc:3055] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:25.248636 11832 raft_consensus.cc:740] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:16:25.256158  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.257364  6329 raft_consensus.cc:1240] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:25.258756  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 66141.5us
I20260709 13:16:25.260021  6905 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:25.235827  6371 leader_election.cc:336] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.716s (SENT)
I20260709 13:16:25.233799 11589 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:25.278394  6942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58276 (request call id 1023) took 1442 ms. Trace:
I20260709 13:16:25.280865  6941 raft_consensus.cc:2468] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
W20260709 13:16:25.286456  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 44157.1us
I20260709 13:16:25.286599  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:25.288524 11777 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:25.284047  6942 rpcz_store.cc:276] 0709 13:16:23.829523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.326111 (+496588us) service_pool.cc:224] Handling call
0709 13:16:25.271359 (+945248us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b5400537fd4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:25.271503 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604754688}
I20260709 13:16:25.275555 11850 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:25.306427  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 95588.8us
I20260709 13:16:25.311964  6221 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:25.286463 11767 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:25.317845  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 102276us
I20260709 13:16:25.305501 11873 raft_consensus.cc:3055] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:25.305101 11845 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:25.333498 11777 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:25.271039 11748 consensus_queue.cc:260] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:25.286652 11855 consensus_queue.cc:1059] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 13:16:25.345264  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 125717us
I20260709 13:16:25.306907 11780 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:16:25.346676  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:25.347946  6369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.351559  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:25.352258  6405 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:25.326869 11873 raft_consensus.cc:740] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
W20260709 13:16:25.359858  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.279631 11931 consensus_queue.cc:260] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:25.329743 11850 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.364758  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:25.369762  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.375285 11738 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.375888 11931 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:25.377228  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 147170us
W20260709 13:16:25.378230  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 80444.6us
I20260709 13:16:25.348688 11845 raft_consensus.cc:697] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:25.370376  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.388796  6405 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:25.389175  6252 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:25.393429  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:25.394948 11845 consensus_queue.cc:237] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.371381 11855 raft_consensus.cc:3055] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:25.405195  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:25.420439 11952 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:25.421177 11952 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.423345 11952 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:25.372978 11850 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:25.412917 11947 log.cc:927] Time spent T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:16:25.430299  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:25.407248 11855 raft_consensus.cc:740] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:25.356814 11832 consensus_queue.cc:260] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.430650  6907 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:25.457662  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 71953.6us
W20260709 13:16:25.459062  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 51979.5us
I20260709 13:16:25.460556  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:25.452709 11952 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:16:25.471573 11952 raft_consensus.cc:2804] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:25.472079 11952 raft_consensus.cc:697] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 17 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:25.461081 11478 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.439822 11873 consensus_queue.cc:260] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:25.464010 11749 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:25.473091 11832 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:25.538733  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 95280.1us
I20260709 13:16:25.540313  6907 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:25.500521 11749 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:25.503235 11941 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.562350 11941 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:25.564625 11941 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:25.473011 11952 consensus_queue.cc:237] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.494470 11478 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.547703 11749 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:25.545521 11745 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:25.553274 11873 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:25.573616 11745 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.575863 11745 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:25.495538 11855 consensus_queue.cc:260] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.577036 11855 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:25.577468  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:25.578060  6403 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:25.538094 11631 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:25.585736  6371 leader_election.cc:336] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Timed out: RequestConsensusVote RPC to 127.4.254.4:33105 timed out after 1.903s (SENT)
I20260709 13:16:25.592263  6403 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16.
I20260709 13:16:25.594787  6371 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:25.594069 11710 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.598541 11938 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.598845 11710 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.599042 11938 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:25.594095  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:25.600888 11938 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:25.622268  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:25.628420  6939 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:25.626658  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:25.629621  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:25.600978 11710 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:25.632764  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:25.642244  6331 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:25.646800 11478 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:25.647451  6326 raft_consensus.cc:2393] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:25.597864 11850 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:25.651036  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:25.651859  6936 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:25.616052 11964 raft_consensus.cc:2804] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:25.654455  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:25.655687  6400 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:25.656694  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:25.657265  6324 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:25.660056  6322 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:25.663646  6326 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:25.664227 11970 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:16:25.664568 11922 log.cc:927] Time spent T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.669s	user 0.006s	sys 0.003s
W20260709 13:16:25.665583  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 85691.8us
I20260709 13:16:25.663482 11964 raft_consensus.cc:697] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:25.660686 11710 consensus_queue.cc:1059] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:16:25.687059  6371 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:25.689765 11631 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:25.689033 11964 consensus_queue.cc:237] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.693339 11750 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:25.700278 11746 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:25.700660  6371 leader_election.cc:400] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 election: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 16. Current term is 17.
I20260709 13:16:25.701830 11938 consensus_queue.cc:1048] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:25.702137 11886 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:25.700991  6371 leader_election.cc:403] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:16:25.709081  6297 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:25.688027  6295 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:25.716416  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 176186us
I20260709 13:16:25.732364  6371 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:25.733742  6371 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:25.737317 11878 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 16. Current term is 17.
I20260709 13:16:25.743016  6371 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:25.745404 11938 consensus_queue.cc:1048] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:25.745769  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.746731 11769 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.746908 11938 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:25.747291 11769 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:25.749408  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.750573  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.750684  6371 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:25.752080  6371 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:25.745455  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:25.753539  6252 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:25.755054 11958 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:25.755781 11958 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:25.756392 11958 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:25.757345  6139 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 19435892007a4e0a9b2b4d0b26ccd0c0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:16:25.758245  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 49268.3us
I20260709 13:16:25.747607 11938 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:25.760852  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.761584  6250 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:25.763871 11626 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:25.764312 11626 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.764643 11626 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:25.765524  6371 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:25.765986 11828 raft_consensus.cc:3055] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:25.766273 11970 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:25.766523 11828 raft_consensus.cc:740] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:25.767742  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:25.768198  6371 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:25.769140  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.769614 11970 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:25.767776 11828 consensus_queue.cc:260] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.771051  6371 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:25.771607 11828 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:25.773183 11970 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:16:25.777233  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 91963.1us
I20260709 13:16:25.780802 11710 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:25.782328 11710 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:25.783077  6371 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:25.783923 11746 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:25.784268  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.785593  6295 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:25.786381  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:25.796911  6322 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 8. Current term is 10. Ops: []
I20260709 13:16:25.788795  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:25.797744 11834 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:25.798236 11834 raft_consensus.cc:697] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:25.799170 11834 consensus_queue.cc:237] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.801614 11777 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:25.802119 11777 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:25.802573  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:25.803171  6252 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:25.804167 11777 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:25.804385  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.795960  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:25.793462  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:25.798369  6327 raft_consensus.cc:2410] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:16:25.805662  6328 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:25.794607  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:25.824592  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 65746.4us
I20260709 13:16:25.826843  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.830808  6254 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:25.818151  6296 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:25.836074  6253 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:25.862746  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:25.862787  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:25.829749 11637 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:25.873574  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 55508.8us
I20260709 13:16:25.874132  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.826388 11749 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:25.877610  6250 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 15: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
W20260709 13:16:25.878507  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 95491.8us
I20260709 13:16:25.860327 11769 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:25.883911  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.886114  6936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:25.872907 11955 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:25.890407  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.891249  6249 raft_consensus.cc:2393] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 15: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:25.876372 11565 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:25.894820 11565 raft_consensus.cc:697] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:25.895000  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.895720  6250 raft_consensus.cc:2368] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11.
I20260709 13:16:25.886830  6936 raft_consensus.cc:2376] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11. Re-sending same reply.
I20260709 13:16:25.897351  6942 raft_consensus.cc:1275] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:25.899776  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.900381  6249 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:25.900627 11749 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:25.901402  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.902580  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:25.903605  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.895758 11565 consensus_queue.cc:237] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:25.909099 11955 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.911911  6251 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:25.913508  6249 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:25.905023  6368 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:25.915679  6254 raft_consensus.cc:2393] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 13: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:25.917943  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.918469  6255 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:25.918254  6368 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:25.919767 11637 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:25.920184 11749 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:25.920615 11749 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.924404 11861 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:25.925664 11626 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.933707  6296 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:25.934827 11943 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:25.935341  6250 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:25.935355 11943 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.936142 11943 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:25.920977 11749 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:25.941697  6371 leader_election.cc:400] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 13. Current term is 14.
I20260709 13:16:25.942497  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:25.943799  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:25.947490  6371 leader_election.cc:403] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:16:25.942518  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:25.944440  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:25.945253  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:25.946873  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:25.948745  6328 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:25.950953  6251 raft_consensus.cc:3060] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:25.952443  6402 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:25.954269  6404 raft_consensus.cc:2393] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 14: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:25.956396 11982 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:25.957158 11982 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:25.962924 11964 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:25.963315  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:25.963606  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:25.963482 11964 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.964104  6397 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:25.964262  6399 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:25.966233 11861 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 13. Current term is 14.
I20260709 13:16:25.966734 11738 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:25.966945  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:25.967459  6399 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:25.970521  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.970801  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:25.971114  6248 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:25.971645  6935 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:25.971972  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.978461  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:25.973834  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:25.973151  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.980203  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.981215  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:25.981827  6253 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:25.978319 11886 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:25.982522  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.983458 11964 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:25.984467  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.985049  6256 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:25.985489  6248 raft_consensus.cc:2393] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 10: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:25.985915  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:25.986423  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:25.987100  6248 raft_consensus.cc:3060] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:25.990371  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:25.992594 11748 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:25.993594  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 54689.5us
I20260709 13:16:25.996378 11941 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.996908 11941 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:25.998910 11941 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:26.000478  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:26.001215  6941 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:25.983486  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:26.002378  6297 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:26.003062 11834 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:26.003436  6253 raft_consensus.cc:1275] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:26.003482 11834 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.004132 11834 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:26.004774  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:26.006968  6219 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:26.014101  6403 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 14.
I20260709 13:16:26.016532  6401 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:26.004796  6253 raft_consensus.cc:1275] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:25.941234 11955 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:26.025568  6399 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:26.037773  6403 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:26.038292  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:26.048725  6942 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:26.026015 11557 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:16:26.054464 11991 log.cc:927] Time spent T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:16:26.049224 11777 consensus_queue.cc:1059] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:16:26.063107 11780 raft_consensus.cc:3055] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:26.063524 11780 raft_consensus.cc:740] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:26.063359  6251 raft_consensus.cc:2468] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 17.
I20260709 13:16:26.064368 11780 consensus_queue.cc:260] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.077505  6252 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16.
I20260709 13:16:26.042610  6253 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:26.039402  6401 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:26.080538  6368 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:26.085011  6296 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:26.088069  6296 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:26.088610 11377 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:26.089295 11377 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.089058 11845 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:26.089712 11377 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:26.090672 11845 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:26.091169 11845 raft_consensus.cc:697] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:26.091789  6248 raft_consensus.cc:2468] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:26.092051 11845 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:26.043588 11738 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:26.105351  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:26.105301  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:26.106766  6405 raft_consensus.cc:2393] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 14: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:26.107116  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:26.107821  6942 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:26.106103  6402 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 9.
I20260709 13:16:26.121048  6325 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:26.047155 11955 consensus_queue.cc:1059] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:16:26.105052 11738 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.093480 11626 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:26.106326 11931 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:26.127082 11565 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 13:16:26.191180  6907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.143841 11818 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.129058 11637 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:16:26.194229  6400 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:26.219125  6941 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:26.320703  6402 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:16:26.269997  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 60612us
W20260709 13:16:26.329540  6905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.336457 11746 consensus_queue.cc:1048] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:26.336824  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:26.342128  6905 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:16:26.343636 11995 log.cc:927] Time spent T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:16:26.343791  6905 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:26.344702 11855 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:26.345368 11738 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:26.345204 11855 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.346045  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:26.346663 11786 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:26.347258 11855 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:26.348369 11967 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:26.348851 11967 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.349218 11967 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:26.349802 11993 log.cc:927] Time spent T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:16:26.352677 11589 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:26.353513 11589 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.347805 11855 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:26.357729 11855 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.358086 11855 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:26.358193 11931 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:26.268440 11631 raft_consensus.cc:3055] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:26.371886  6401 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:16:26.373692  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 225892us
I20260709 13:16:26.376451  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:26.379673 11786 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:26.380098 11786 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:26.380455 11786 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:26.388074  6401 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:16:26.401173 11988 log.cc:927] Time spent T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:16:26.402212 11377 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.406654  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:26.370710 11631 raft_consensus.cc:740] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:26.417971  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:26.419029  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:26.420096  6398 raft_consensus.cc:2410] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:16:26.421607  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:26.422557  6253 raft_consensus.cc:2393] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 14: Already voted for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in this term.
I20260709 13:16:26.297598 11818 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.403592 11956 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.434000 11956 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.435367 11818 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:26.436252 11956 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:26.436990  6400 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:26.433581  6247 raft_consensus.cc:1240] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:26.437747  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:26.438529  6941 raft_consensus.cc:2410] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:26.440061  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:26.441112 11631 consensus_queue.cc:260] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.454537  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:26.455361  6248 raft_consensus.cc:3060] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:26.457918  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:26.368055 11749 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:26.464916  6249 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:26.442517 11631 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:26.454315 11589 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:26.488619  6248 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:26.466460 11956 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.445220 11834 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.472337 11982 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:26.501673  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 179198us
W20260709 13:16:26.522460  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 485377us
W20260709 13:16:26.531044  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.541805 11997 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.542309 11997 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.543304  6906 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:26.552017 11780 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:26.568131  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:26.538511  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:26.560003  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:26.572397  6398 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 15.
I20260709 13:16:26.572544  6324 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:26.561890  6322 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:26.563799  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:26.574488  6331 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 15.
I20260709 13:16:26.580090  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:26.581037  6941 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 15.
I20260709 13:16:26.582660  6222 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:26.583678 11955 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:26.584152 11955 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.584581 11955 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:26.557049 11941 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:26.594961  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:26.597697 11557 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:26.598170 11557 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.598577 11557 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:26.601348 11738 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:26.592587 11941 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.609154  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:26.609962  6398 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
I20260709 13:16:26.610375 11977 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:26.610426  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 67194.8us
I20260709 13:16:26.612095  6906 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:26.612287 11828 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:26.612996 11977 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:26.614801 11977 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:26.615866 11997 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:26.549024 11992 log.cc:927] Time spent T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:16:26.629426 11941 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:26.646010  6942 consensus_meta.cc:287] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 13:16:26.646502  6942 raft_consensus.cc:2468] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:26.498347 11956 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.511828 11982 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.132s
W20260709 13:16:26.663614  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 319870us
W20260709 13:16:26.671181 11999 log.cc:927] Time spent T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:16:26.671151  6905 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:26.684283  6149 catalog_manager.cc:5697] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 7, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 7 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:26.686359  6149 catalog_manager.cc:5697] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:26.689086  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:26.691500  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:26.692634 11377 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:26.638348 11786 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.695411 11786 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:26.639879 11855 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.695920  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:26.696619  6327 raft_consensus.cc:2393] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 13: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:26.698035  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:26.705644  6940 raft_consensus.cc:2368] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14.
I20260709 13:16:26.708689  6222 leader_election.cc:400] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14.
W20260709 13:16:26.710112  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.714543  6222 leader_election.cc:403] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:16:26.716413  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:26.716992  6396 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:26.717808 11855 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:26.723778  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:26.724411  6255 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:26.730402 11964 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.730969 11964 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:26.735003 11769 raft_consensus.cc:3055] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:26.735458 11769 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:26.736270 11769 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:26.723408  6151 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55346 (request call id 394) took 17989 ms (client timeout 15000 ms). Trace:
I20260709 13:16:26.704486 11589 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:26.710441 11943 consensus_meta.cc:287] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.002s
I20260709 13:16:26.741279  6396 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
W20260709 13:16:26.740350  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 405477us
W20260709 13:16:26.842133  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 133619us
I20260709 13:16:26.743911  6371 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:26.845952 11748 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:26.846760  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 104469us
W20260709 13:16:26.845945  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 102097us
I20260709 13:16:26.844707  6255 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:26.844590 11769 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:26.855115 11478 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:26.855674 11478 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:26.857735 11478 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:26.860456  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:26.888743  6221 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:26.892746  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:26.862097 11777 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:26.900306  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 476357us
W20260709 13:16:26.902112  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.886543 11749 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:26.905856  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 293856us
I20260709 13:16:26.904536  6295 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:26.907613  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 294975us
I20260709 13:16:26.909422  6295 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:26.911191  6295 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:26.896816 11769 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:26.842788 11943 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:26.898150 12007 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:26.918586 11478 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:26.907007 11964 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:26.935653  6907 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:26.916473 11750 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:26.919442 11377 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:26.920003  6295 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:26.688827  6149 catalog_manager.cc:5697] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 8 to 11, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:26.942974 11738 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:16:26.940871  6221 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:26.933560 11834 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:26.998099  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:27.002208  6942 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 10.
I20260709 13:16:27.003850  6222 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
W20260709 13:16:27.004071  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 72938.7us
I20260709 13:16:26.977397 11557 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.009711  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:27.011307  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 70530.8us
W20260709 13:16:27.013315  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 106775us
I20260709 13:16:27.014230  6906 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:27.000521 11956 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:27.002352 11982 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:27.027365  6221 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:27.028374 11738 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:27.029383 11557 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:27.029767 11738 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:27.032099 11943 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:27.033501  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:27.034106  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:27.034689  6942 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:27.035113  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:27.035688  6322 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:27.036870 12019 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:27.004985 11964 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:27.038034  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:26.993069 11955 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.047045  6905 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:27.047960  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:27.048749  6327 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:27.048913 12003 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:27.047967 11832 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:27.053894  6906 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:27.054731 11832 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:27.055151  6906 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:27.056020 11832 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:27.015362 12015 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:27.057116 12015 raft_consensus.cc:697] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:27.058344 12015 consensus_queue.cc:237] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:27.038733  6221 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:27.044457  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 131927us
I20260709 13:16:27.064735  6295 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:26.994153 12007 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.016731 11780 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:27.066812  6221 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:26.738260  6151 rpcz_store.cc:269] 0709 13:16:08.733607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.756666 (+ 23059us) service_pool.cc:224] Handling call
0709 13:16:26.723141 (+17966475us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:18.491853 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:18.492532 (+   679us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:18.492586 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:16:18.492608 (+    22us) tablet.cc:662] Decoding operations
0709 13:16:18.588895 (+ 96287us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:18.588988 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:18.589016 (+    28us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:16:18.682852 (+ 93836us) tablet.cc:701] Row locks acquired
0709 13:16:18.682912 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:16:18.683141 (+   229us) write_op.cc:270] Start()
0709 13:16:18.683334 (+   193us) write_op.cc:276] Timestamp: P: 1783602978683061 usec, L: 0
0709 13:16:18.683375 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:16:18.684262 (+   887us) log.cc:844] Serialized 7812 byte log entry
0709 13:16:19.419839 (+735577us) op_driver.cc:464] REPLICATION: finished
0709 13:16:20.147775 (+727936us) write_op.cc:301] APPLY: starting
0709 13:16:20.147888 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:20.600526 (+452638us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:20.600647 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:21.258503 (+657856us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:21.260422 (+  1919us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:16:21.260783 (+   361us) write_op.cc:312] APPLY: finished
0709 13:16:21.334819 (+ 74036us) log.cc:844] Serialized 180 byte log entry
0709 13:16:21.438328 (+103509us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:21.439397 (+  1069us) write_op.cc:454] Released schema lock
0709 13:16:21.439583 (+   186us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:21.440214 (+   631us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:21.440271 (+    57us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1821526,"reported_tablets":47,"spinlock_wait_cycles":1408,"child_traces":[["op",{"apply.queue_time_us":654064,"apply.run_cpu_time_us":55381,"apply.run_wall_time_us":1292369,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87967,"num_ops":20,"prepare.queue_time_us":417927,"prepare.run_cpu_time_us":29388,"prepare.run_wall_time_us":444893,"raft.queue_time_us":154259,"raft.run_cpu_time_us":65181,"raft.run_wall_time_us":268801,"replication_time_us":736261,"thread_start_us":904013,"threads_started":5,"wal-append.queue_time_us":384290,"wal-append.run_cpu_time_us":40186,"wal-append.run_wall_time_us":2385736}]]}
I20260709 13:16:27.069482  6942 raft_consensus.cc:2410] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:16:27.072645  6328 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.041s	sys 0.053s
W20260709 13:16:27.075019  6328 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.042s	sys 0.053s
I20260709 13:16:27.073025  6221 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:27.075834  6297 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:27.090056  6327 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:27.091957  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:27.069865 11780 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.072176 11738 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:27.075030 11769 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:27.091176 11967 consensus_meta.cc:287] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.001s
I20260709 13:16:27.108479 11941 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:27.109154 11941 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:27.109747 11631 consensus_meta.cc:287] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.000s
I20260709 13:16:27.089928 11557 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:27.070142 11832 consensus_queue.cc:1048] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:16:27.068418 12021 consensus_queue.cc:1048] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:16:27.097800 11478 raft_consensus.cc:2804] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:16:27.118495  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 53853.6us
I20260709 13:16:27.107857 11780 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:27.135885  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:27.126818 11943 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:27.130805 11956 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:27.162139 11956 raft_consensus.cc:697] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
W20260709 13:16:27.162649 12011 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.297s	user 0.003s	sys 0.000s
I20260709 13:16:27.163177 11956 consensus_queue.cc:237] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.130661 11478 raft_consensus.cc:697] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:27.165894 11478 consensus_queue.cc:237] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.168887  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:27.169025 12007 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:27.173300  6940 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:27.174311  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:27.174906  6942 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:27.177603 11941 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:27.178176 11941 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:27.178900 11941 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:27.179378 11941 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.181793  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:27.182529  6941 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:27.183089  6942 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:27.113092 11967 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.186480  6322 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:27.201814  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:27.204314  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 68538.5us
I20260709 13:16:27.205116  6295 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:27.188486 12007 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.138864 11943 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:27.194231 11982 raft_consensus.cc:2764] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:27.193704 11834 raft_consensus.cc:493] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:16:27.219940  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 128057us
I20260709 13:16:27.220759  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:27.233860  6941 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:27.234505  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:27.235265  6942 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:27.238570  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:27.239151  6322 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:27.252048  6942 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 16.
I20260709 13:16:27.258402  6149 catalog_manager.cc:5697] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:27.259061  6322 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 16.
I20260709 13:16:27.221144 12007 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:27.261400  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 56370.7us
I20260709 13:16:27.262300  6295 leader_election.cc:400] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11.
I20260709 13:16:27.263229 12007 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:27.254845  6222 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
W20260709 13:16:27.269937  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 179828us
I20260709 13:16:27.270346  6295 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:27.240202 11955 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:27.285979  6371 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:27.226539 11834 raft_consensus.cc:515] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:27.247203 11750 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:27.260416  6149 catalog_manager.cc:5697] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.297788  6295 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:27.300173  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:27.300778  6322 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:27.285698 11749 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.301096  6905 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:16:27.302095  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 96693.7us
I20260709 13:16:27.297991 11631 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:27.299332 11955 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.327936  6905 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:27.321791  6297 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:27.297658 12032 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:27.286559 11780 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:27.341571  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 43896us
I20260709 13:16:27.346140  6149 catalog_manager.cc:5697] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 8 to 11, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 11 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:27.333978 11750 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:27.308126 11749 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:27.333264 12007 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:27.324307 12033 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:27.356467  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:27.364360  6322 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:27.368932 12030 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.369822 11478 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:27.369740 12030 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.372344 12037 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:16:27.350335 11941 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:27.351032 12032 raft_consensus.cc:697] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:27.352190 11777 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14.
I20260709 13:16:27.379959  6322 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:27.382701  6905 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:27.366675 11769 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.340059 11955 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:27.389561  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 47213.4us
I20260709 13:16:27.389691  6400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36164 (request call id 2957) took 1027 ms. Trace:
I20260709 13:16:27.391968 11749 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:27.392364 12036 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:27.392769 11963 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:27.388397 11855 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:27.378193 11750 raft_consensus.cc:697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:27.406618 12030 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:27.407562  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:27.409837  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:27.408104  6400 rpcz_store.cc:276] 0709 13:16:26.362170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.362280 (+   110us) service_pool.cc:224] Handling call
0709 13:16:26.390693 (+ 28413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.437354 (+ 46661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.389412 (+952058us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b5400376ed4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:27.389630 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105664896}
I20260709 13:16:27.378726  6149 catalog_manager.cc:5697] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 7 to 9, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 9 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:27.417924  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:27.380184 11943 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:27.381168 12007 raft_consensus.cc:697] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:27.419308  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:27.419780  6330 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:27.407526 11967 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:27.386695 12042 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:27.423029  6399 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:27.415831 11631 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:27.415719 11963 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.434922 11963 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:27.433969 12042 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.437933 11750 consensus_queue.cc:237] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:27.439569 11780 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:27.440697 11955 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:27.443216  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:27.489388  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:27.545548  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 123850us
I20260709 13:16:27.434157 12007 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.547426  6935 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:27.418483 11769 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.559355  6399 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:27.561662  6330 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:27.514509 11777 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:27.544301 11834 leader_election.cc:290] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:27.513108 11939 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:27.572891 11939 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.572736 11777 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.555569 12032 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.513032 11967 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:27.493652 11855 raft_consensus.cc:697] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:27.552964 12036 raft_consensus.cc:697] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:27.586576 12042 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:27.587311  6149 catalog_manager.cc:5697] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 11 to 12, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 12 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:27.564772 12050 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:27.592106 11769 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:27.595625  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:27.595779  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:27.601679  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:27.603238  6369 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:27.605615 12040 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:16:27.606768  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 188230us
I20260709 13:16:27.613996  6296 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:27.607270 11939 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:27.612782 12021 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:27.616422 12050 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.631917 11958 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:27.632457 11958 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.633747 12050 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:27.634965  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:27.615808 12044 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:27.616818 11769 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:27.641029  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:27.643464  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:27.644059  6401 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:27.637837  6940 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 16.
I20260709 13:16:27.642561  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:27.621963 11749 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:27.645771  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:27.611616 11967 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.647629  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:27.651698  6397 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:27.652923  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:27.653729  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:27.656886  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:27.637256 11997 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:27.628331 12051 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:27.636194 11958 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:27.659286  6907 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:27.691766  6935 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:27.660630  6399 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:27.672046  6397 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 10.
I20260709 13:16:27.673439  6149 catalog_manager.cc:5697] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 7 to 8, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 8 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:27.651154 11769 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.675238 12048 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:27.675671 11855 consensus_queue.cc:237] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.677028 12036 consensus_queue.cc:237] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.677603  6401 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
I20260709 13:16:27.646387 12021 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.654590 11749 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:27.681015 12010 log.cc:927] Time spent T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.742s	user 0.003s	sys 0.000s
I20260709 13:16:27.681249 11967 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:27.656150 12044 raft_consensus.cc:697] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:27.742105 12044 consensus_queue.cc:237] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:27.744481 12045 log.cc:927] Time spent T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:16:27.704417  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:27.702283  6222 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:27.745461  6400 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
W20260709 13:16:27.745731  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 43523.8us
I20260709 13:16:27.660367 12053 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:27.746599 12053 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:27.688432 12050 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:27.719383  6250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:27.753948  6250 raft_consensus.cc:606] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:27.723474  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:27.698231 11997 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:27.627032 12040 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:27.698634 12051 raft_consensus.cc:697] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:27.736639  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:27.765053  6247 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:27.767002  6253 raft_consensus.cc:1275] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:27.769397  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:27.740743 11749 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:27.749261  6907 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:27.750180  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:27.770640  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:27.777434  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:27.778263  6252 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:27.780879  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:27.782467  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:27.783166  6256 raft_consensus.cc:2376] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 17. Re-sending same reply.
I20260709 13:16:27.784888  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:27.784790  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:27.787451  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:27.789566  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 379881us
I20260709 13:16:27.790278  6295 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:27.763288 11955 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:27.727258 11963 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.796387  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:27.808049  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:27.809105  6250 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:27.812359  6250 raft_consensus.cc:1275] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:16:27.733299 12048 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.816525  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:27.805698 11631 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:27.805382 11955 raft_consensus.cc:697] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:27.830418 12049 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:27.831058 12049 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:27.827019  6323 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:27.833076  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 3183) took 1274 ms. Trace:
I20260709 13:16:27.818483 11818 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.836030  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:27.844959  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:27.835719 12053 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:27.849944 11955 consensus_queue.cc:237] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.855141 11777 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:27.858296  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:27.859910 12046 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:16:27.842628 11818 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:27.831548 12049 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:27.840988  6254 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
W20260709 13:16:27.865651 12060 log.cc:927] Time spent T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:16:27.833516  6328 rpcz_store.cc:276] 0709 13:16:26.558638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.560096 (+  1458us) service_pool.cc:224] Handling call
0709 13:16:26.560462 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.560709 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:16:27.075462 (+514753us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.832754 (+757292us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b1800439f60. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f457578d4bc 00007f4572adb48b 00007f457b935ab9 00007f4572af769b 00007f4572af593f 00007f4572af5455 00007f4575bdd060 00007f4575bef716 00007f4575c00287
0709 13:16:27.832842 (+    88us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.832875 (+    33us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:27.832905 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.832949 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.833032 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1168,"prepare.queue_time_us":444265,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":1489,"raft.queue_time_us":54295,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6602,"spinlock_wait_cycles":8373888,"thread_start_us":713025,"threads_started":3,"wal-append.queue_time_us":218628}
I20260709 13:16:27.864913 12044 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.884660  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:27.771099 12051 consensus_queue.cc:237] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.865795 11997 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:27.863035 11769 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:27.799979  6149 catalog_manager.cc:5697] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:27.901667  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 641094us
I20260709 13:16:27.901388  6368 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:27.904166  6296 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:27.906049  6368 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:27.904352  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:27.907222  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:27.908409  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:16:27.910076 12059 log.cc:927] Time spent T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:16:27.910914 12065 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:27.911509 12065 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:27.885684 12044 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:27.913201 11939 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:27.937696 11941 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:27.941313 11777 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:27.942453 11932 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:27.942601 11997 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.948051  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:27.950248  6249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:28.003899 11955 raft_consensus.cc:993] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:27.953533  6296 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:27.943061 12046 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:28.009872 12048 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:28.008948  6397 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:16:28.002698  6254 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:28.004848  6149 catalog_manager.cc:5697] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 8 to 11, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:28.003278 12069 log.cc:927] Time spent T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:16:27.996475 12021 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:28.020869  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.024981  6330 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 16.
I20260709 13:16:28.025084  6249 raft_consensus.cc:606] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:28.029173  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 75730.2us
I20260709 13:16:28.018437 11631 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:27.952143 11939 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.025059 11861 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:28.025344 11749 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:28.033329 11626 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:28.038957  6219 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:28.036228 11955 raft_consensus.cc:1081] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:28.044957  6149 catalog_manager.cc:5697] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 6 to 11, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 11 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:28.038239  6249 raft_consensus.cc:614] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:28.070230  6149 catalog_manager.cc:5697] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 6 to 8, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 8 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.072981  6942 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:16:28.073341 12065 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:28.042358  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.044950 12050 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:28.044866 11861 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.080629 11861 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:28.037047 11963 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:28.081804  6327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57230
I20260709 13:16:28.082499  6327 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:28.082830  6327 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:28.085441 11818 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:28.086441 12072 log.cc:927] Time spent T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:28.045558 12021 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:28.089699 12021 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.092361 12021 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:28.097851 12044 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:28.099303 12049 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.100214 12050 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.102363 12050 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:28.040118 12040 leader_election.cc:290] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:28.103353  6330 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:28.105171  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.105870  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.106232  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:28.106649  6323 raft_consensus.cc:2393] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 12: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:28.106745  6330 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:28.028075 11997 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.071668  6941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:47742
I20260709 13:16:28.107746  6941 raft_consensus.cc:606] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:28.108124  6941 raft_consensus.cc:614] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:28.040599  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:28.051414 11749 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.039501 11932 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:28.109753 11932 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.110976 11749 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:28.111735 11932 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:28.035413  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.076952 12064 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:28.112337 12064 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.112720 12064 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:28.100476  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.059363  6939 raft_consensus.cc:1240] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:16:28.076318 11955 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:28.114944  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:28.075820  6219 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:28.043205 11939 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:28.128170  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 52432.5us
I20260709 13:16:28.115518  6327 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.131817  6330 raft_consensus.cc:2468] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:28.133996  6329 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:28.031678 11777 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.137107  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:28.140769  6252 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:28.145825  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:28.145764  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.148192  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:28.149009  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:28.149681  6941 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 10.
I20260709 13:16:28.152001  6905 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:28.147677  6323 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 16.
I20260709 13:16:28.127684 11626 raft_consensus.cc:697] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:28.130313 12040 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:28.163095  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:28.165940  6397 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
W20260709 13:16:28.164623  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 124097us
I20260709 13:16:28.174018  6327 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:28.137883 11769 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:16:28.186460 11777 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:28.187624 11557 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:28.190099 11626 consensus_queue.cc:237] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:28.194716  6905 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:28.194747  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:28.157704 12050 raft_consensus.cc:2804] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:28.196498 12007 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:28.196910 12007 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:28.197304 12007 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:28.197383  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.198030  6325 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:28.202677  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:28.195026 11997 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:28.203385  6941 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:28.203765  6219 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:28.206578  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.208338  6149 catalog_manager.cc:5697] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.209542 11834 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:28.173470 11749 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:28.202775  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.219661  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:28.219877  6149 catalog_manager.cc:5697] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 9 to 12, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 12 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:28.225541 12049 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:28.226662  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:28.227267  6401 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:28.231398  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:28.231603  6247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:28.232127  6250 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:28.232465  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.232187  6247 raft_consensus.cc:606] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:28.187635  6221 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:28.233153  6247 raft_consensus.cc:614] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:28.236356  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:28.236985  6250 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:28.238754  6907 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:28.239971 11977 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:28.240368 11977 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:28.240762 11977 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:28.241168 11939 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:28.243296 11939 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:28.248273  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 60711us
I20260709 13:16:28.251371  6221 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:28.224490  6149 catalog_manager.cc:5697] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.260880  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.264508  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:28.196501 12050 raft_consensus.cc:697] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:28.271777  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:28.272339  6941 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:28.274709  6401 raft_consensus.cc:2468] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:28.254568 11769 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:28.263578 11997 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:28.292369  6941 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16.
I20260709 13:16:28.300670  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:28.304834  6938 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:16:28.305419  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 56296.6us
I20260709 13:16:28.306144  6221 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:28.306355  6369 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:28.280961 11955 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:28.320259 11955 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:28.321648  6938 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:28.321828  6326 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:28.322480 11955 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:28.309113 12005 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:28.324906  6938 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:28.325816  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.314886  6371 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:28.312775 11861 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:28.317453 12050 consensus_queue.cc:237] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.342144 12064 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.344280 12064 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:28.317229  6149 catalog_manager.cc:5697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 3 to 10, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 10 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:28.349038 11855 consensus_queue.cc:1048] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:28.350051  6149 catalog_manager.cc:5697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.283591 12053 consensus_queue.cc:1059] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:16:28.283982 12015 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:28.318910 11777 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:28.345988 11997 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:16:28.286185 11769 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.351996 11769 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:28.351665 12015 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.352638  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:28.353683  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:28.329221  6906 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:28.354892  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:28.355268  6906 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:28.316154 11977 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.330255 12040 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:28.330389 11955 consensus_queue.cc:1059] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:16:28.284153 11557 consensus_queue.cc:1059] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:16:28.314021  6327 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:16:28.439419  6942 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:28.441232  6327 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:28.441814  6252 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:16:28.355432  6397 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:28.331094  6251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:28.442750  6251 raft_consensus.cc:606] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:28.443073  6251 raft_consensus.cc:614] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:28.358723  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:28.359619  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:28.361091  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
W20260709 13:16:28.361975  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 47163.5us
I20260709 13:16:28.444614  6371 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:28.362587  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 56341.8us
I20260709 13:16:28.363312  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:28.445763  6328 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:28.381302  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:28.382495  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:28.425230 11948 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:28.330454 11861 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.361543 11589 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:28.454910  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 90266.3us
I20260709 13:16:28.364171  6368 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:28.475206  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 111117us
I20260709 13:16:28.344660 12007 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.454066  6256 raft_consensus.cc:2368] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 16. Current term is 17.
I20260709 13:16:28.363529 11855 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:28.474077  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:28.427304 11749 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:28.365294 12049 consensus_queue.cc:1048] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 13:16:28.480963  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:28.481566  6255 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:28.482738  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:28.364866 11750 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 13:16:28.443507 11626 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:28.489307  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:28.490893  6397 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16.
I20260709 13:16:28.475445 11861 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:28.467118 11948 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:28.479089 11938 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:28.480400 11749 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:28.476464 11834 consensus_queue.cc:1059] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:16:28.523465  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:28.525220  6255 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:28.494549  6256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:28.527241  6256 raft_consensus.cc:606] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:28.527667  6256 raft_consensus.cc:614] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:28.494329  6252 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:28.525408  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:28.533787  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:28.492156  6941 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:28.476853 12040 raft_consensus.cc:3055] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:28.515463  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:28.514663 11938 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:28.518451  6326 raft_consensus.cc:3055] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:28.550155  6326 raft_consensus.cc:740] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:28.520136 12005 raft_consensus.cc:3055] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:28.520306 11977 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:28.537422 11557 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.485769 11970 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:28.541324  6249 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:28.511936 12007 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:28.491910 11932 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.658149 11932 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.665181  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4567153664b518d2f6515e419da60" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:28.666424  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:28.667269  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:28.667711  6251 raft_consensus.cc:1275] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:28.669662  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.672890 12019 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:28.561663 11745 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.128s
I20260709 13:16:28.539736 11834 consensus_queue.cc:1243] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:28.563390 12005 raft_consensus.cc:740] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:28.682518 12005 consensus_queue.cc:260] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.683429  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:28.684497 12005 raft_consensus.cc:3060] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:28.619334  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 58293.4us
I20260709 13:16:28.653234  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:28.656433  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:28.656692 12030 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.684738 11777 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:28.699254  6906 leader_election.cc:400] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 16. Current term is 17.
I20260709 13:16:28.562022 11941 consensus_queue.cc:1059] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.123s
I20260709 13:16:28.561852 11938 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:28.513036 11948 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:28.692577  6295 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:28.694883  6934 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:28.580458  6941 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 17.
I20260709 13:16:28.691424  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:28.715749  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:28.716473  6251 raft_consensus.cc:2368] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 16. Current term is 17.
W20260709 13:16:28.717490  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 241627us
I20260709 13:16:28.718966  6295 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:28.526623 11749 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:28.707756  6939 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:28.511469 11626 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:28.726147  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 247704us
I20260709 13:16:28.711123  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:28.696583 12064 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.721026  6295 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:28.724534  6940 raft_consensus.cc:1240] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:28.735836 12046 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:28.741446  6255 raft_consensus.cc:3055] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:28.741982  6255 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:28.742956  6255 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.744673  6255 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:28.748869 11932 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:28.787766  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.792869  6326 consensus_queue.cc:260] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.795084  6326 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:28.796569  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 60817.2us
I20260709 13:16:28.532990 12015 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:28.540982 12040 raft_consensus.cc:740] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:28.695684 11557 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.797322  6368 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:28.822999  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:28.796361 12064 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:28.706050 11750 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:16:28.801882 12088 log.cc:927] Time spent T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:16:28.797868  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 321068us
I20260709 13:16:28.828703  6249 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
I20260709 13:16:28.856050  6249 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:28.853886 11943 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:28.840677  6251 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:28.850782 11818 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:28.726528 12051 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:28.835143  6937 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
I20260709 13:16:28.706250 12030 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:28.824405  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 71848.4us
W20260709 13:16:28.845853  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 124914us
W20260709 13:16:28.847250  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 50028.7us
I20260709 13:16:28.868516  6907 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:28.864410  6247 raft_consensus.cc:1275] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:28.869469  6368 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:28.874888 11932 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:28.877853  6328 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 17.
I20260709 13:16:28.883307  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:28.884552  6907 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:28.884912  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:28.885608  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:28.885969  6396 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:28.891010  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:28.891650  6251 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:28.892064 12006 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:28.892588 12006 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.894646 12053 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:28.896613  6295 leader_election.cc:304] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:28.897712  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:28.897679 12036 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:28.899350 12040 consensus_queue.cc:260] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.897951 11834 raft_consensus.cc:2749] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:28.900486 12040 raft_consensus.cc:3060] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:28.696077  6149 catalog_manager.cc:5697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.905634 12046 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.906318 12046 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:28.876633 11977 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:28.909626  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:28.910609 11626 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:28.905565 11932 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:28.929302  6295 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:28.929783  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 45329.2us
I20260709 13:16:28.930423  6397 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:28.932253  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:28.935036  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:28.935411  6400 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:16:28.936506  6907 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:28.937600  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 58839.6us
I20260709 13:16:28.949569  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:28.954782  6255 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16.
I20260709 13:16:28.959240  6327 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:16:28.966712  6251 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
I20260709 13:16:28.968187  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:28.971069  6322 raft_consensus.cc:3060] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:28.973790  6396 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:28.974709  6398 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:28.867705 11861 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:28.979854  6322 raft_consensus.cc:2468] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
W20260709 13:16:28.978332  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 46044.4us
I20260709 13:16:28.980127  6327 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:28.981148  6222 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:28.941097 11977 raft_consensus.cc:2804] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:28.987125  6396 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:16:28.990442  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 44221.5us
I20260709 13:16:28.956131  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
W20260709 13:16:28.960580 12087 log.cc:927] Time spent T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.459s	user 0.000s	sys 0.004s
I20260709 13:16:29.010641  6255 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
W20260709 13:16:28.977416 11780 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:16:28.994153  6942 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:28.995502 11631 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:28.941980 11932 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:28.977344 12049 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:29.002804  6369 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:29.014219  6326 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:16:29.006552 11861 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:29.008440 12046 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:28.959079 11834 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:29.014678  6369 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:29.014693 12092 raft_consensus.cc:2804] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:28.904296  6149 catalog_manager.cc:5697] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:29.061046  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 46441.7us
I20260709 13:16:28.984881 12036 raft_consensus.cc:493] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:29.015625 11932 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:29.016479 11977 raft_consensus.cc:697] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:29.016479 12019 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:28.936076 12053 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:16:29.029310  6326 pending_rounds.cc:85] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 7
I20260709 13:16:29.078167  6326 pending_rounds.cc:107] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:16:29.078573  6326 raft_consensus.cc:2889] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:29.031525  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:29.005477  6402 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:29.059283 12030 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:29.025974 12005 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:29.060271  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:29.084825  6322 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 12.
I20260709 13:16:29.067237  6255 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:16:29.085062 11377 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:16:29.079039 12092 raft_consensus.cc:697] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:29.074856 12091 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:29.097227 12094 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:16:29.096849 12101 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.096829 12005 raft_consensus.cc:697] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:29.093330 11557 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:29.075155 12036 raft_consensus.cc:515] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:29.112576 12091 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.158685 12006 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:29.160146  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:29.127316 12064 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:29.170390  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:29.150206 12091 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:29.172709  6222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.122639 12101 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:29.194403  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 208523us
W20260709 13:16:29.196436  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 211709us
I20260709 13:16:29.197706  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:29.124266 11977 consensus_queue.cc:237] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:29.199316  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 207472us
I20260709 13:16:29.163527 11938 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:29.201380  6296 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:29.205224  6296 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:29.208849  6295 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:29.214540 12101 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:29.223685 12019 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:29.223763  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:29.228083  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:29.229465  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:29.230166  6255 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:29.233654 12102 log.cc:927] Time spent T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:16:29.249943 11478 raft_consensus.cc:3055] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:29.250407 11478 raft_consensus.cc:740] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:16:29.255865 12104 log.cc:927] Time spent T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:16:29.262308 12100 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:29.264133 12080 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:29.261456  6255 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
I20260709 13:16:29.180362 12005 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:29.209952 11941 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:29.171834 12092 consensus_queue.cc:237] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:29.326335 12080 raft_consensus.cc:697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:29.327502 12080 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:29.314132 11941 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:29.355962 12105 log.cc:927] Time spent T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:16:29.357946 11938 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:29.360647  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:29.329353 12036 leader_election.cc:290] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:29.366132  6219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.369385  6219 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:29.372017  6219 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:16:29.377606  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 168843us
W20260709 13:16:29.380441  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 170748us
I20260709 13:16:29.389478  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:29.423424  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:29.423741  6369 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:29.383001 11956 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:29.434510  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 108599us
I20260709 13:16:29.384508 12113 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:29.414496 11955 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:16:29.429510 11948 consensus_meta.cc:287] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.694s	user 0.008s	sys 0.007s
I20260709 13:16:29.445199 11932 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:29.452356 11834 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.452917 11834 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:29.455229 11834 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:29.438971 11749 consensus_meta.cc:287] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.644s	user 0.014s	sys 0.000s
I20260709 13:16:29.456537 11749 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:29.413880 11750 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:16:29.465042  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:29.438684 11956 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:29.430467 11780 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:16:29.472132  6396 raft_consensus.cc:1240] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:29.475056  6295 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:29.477010  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:29.477425  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:29.481748  6906 leader_election.cc:400] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 election: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 16. Current term is 17.
I20260709 13:16:29.497855  6906 leader_election.cc:403] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:16:29.472302  6221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.498039  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:29.476413  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:29.512010 12049 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) with higher term. Message: Invalid argument: T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 16. Current term is 17.
I20260709 13:16:29.512840 12050 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:16:29.472381 12107 log.cc:927] Time spent T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:16:29.471864 12117 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:16:29.471297 12118 log.cc:927] Time spent T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:16:29.520514  6249 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:16:29.521286  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:29.471650 11749 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:29.522570  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:29.523280  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:29.532998  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:29.540796  6249 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
W20260709 13:16:29.521564  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 77750us
I20260709 13:16:29.535100  6221 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:29.539763  6942 raft_consensus.cc:1240] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:29.496407 11956 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:29.542143  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 67224.4us
I20260709 13:16:29.544417 11943 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:29.459088 11955 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:29.558219  6221 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:29.575358  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69156f57197e4f1fbed9461749553d8d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:29.459671 11948 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:29.578014  6252 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:29.579560  6221 leader_election.cc:304] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:29.582891  6221 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:29.583881  6938 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:29.587160  6397 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:29.562264 12126 consensus_queue.cc:1059] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:16:29.566057 12064 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:16:29.594736  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 152563us
I20260709 13:16:29.584224 11745 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:29.603050  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.587852 12005 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:29.654163  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 56453.2us
W20260709 13:16:29.598384 11769 consensus_meta.cc:287] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b: Time spent flushing consensus metadata: real 1.235s	user 0.010s	sys 0.006s
I20260709 13:16:29.558660 12037 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:16:29.562059 11931 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:16:29.597021  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:29.686055  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 89112.9us
I20260709 13:16:29.574831 11956 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:29.674381  6221 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:29.681427  6906 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.254.1:43495 timed out after 1.565s (SENT) [suppressed 23 similar messages]
I20260709 13:16:29.566642 12098 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:16:29.690230  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:29.590691 11943 consensus_queue.cc:1059] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
W20260709 13:16:29.687634 12104 log.cc:927] Time spent T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:29.707995  6369 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:29.710891 12136 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:29.714167  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:29.721570 12114 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:29.721632 12048 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:29.724745 12048 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:29.725809 11948 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:29.687126 11769 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:29.702276 11938 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:29.728736  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:29.731588  6938 raft_consensus.cc:2393] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:29.729998  6250 raft_consensus.cc:2368] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13.
I20260709 13:16:29.737911  6327 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:16:29.742374  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 68092.2us
I20260709 13:16:29.743602 12095 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:29.743664 12050 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:16:29.744328 12119 log.cc:927] Time spent T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:16:29.745049 12110 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:16:29.745453 11769 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:29.746381 12137 log.cc:927] Time spent T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:16:29.748363  6221 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:29.754107  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 97061.6us
I20260709 13:16:29.737645 11938 raft_consensus.cc:697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:29.773192  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:29.774068  6935 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:16:29.802832  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 105206us
W20260709 13:16:29.804023  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 55794.2us
I20260709 13:16:29.770993 12126 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:29.809037  6247 raft_consensus.cc:1275] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:29.754725 12095 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:29.813844  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:29.803320 12030 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:29.809290 11749 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.817196 12063 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.817574 12115 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:29.817704 12063 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:29.743783 11478 consensus_queue.cc:260] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:29.820247  6295 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:29.823334  6935 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:29.824621  6222 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:29.827805  6295 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:29.830348  6295 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:29.831144 11478 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:29.831281 11769 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:16:29.862929 12091 consensus_meta.cc:287] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Time spent flushing consensus metadata: real 0.682s	user 0.012s	sys 0.000s
I20260709 13:16:29.832207 12048 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:29.891345 12080 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:29.896224 11956 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:29.826429 11749 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:29.905459 12148 log.cc:927] Time spent T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:16:29.906841 12095 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:29.907394 12046 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:29.893162 11873 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:29.832178 11834 consensus_queue.cc:1059] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:16:29.831182 12063 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:29.909960  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:29.812942 12126 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:29.942970 12126 leader_election.cc:290] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:29.829345 11977 consensus_queue.cc:1048] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:16:29.903823 11769 raft_consensus.cc:697] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:29.943631 11977 consensus_queue.cc:1243] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer 2d6410349fdc47f5a98ba3c6f7d5510b log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:29.944196 11769 consensus_queue.cc:237] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:29.915231 12111 consensus_queue.cc:1048] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 13:16:29.911682 12048 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
W20260709 13:16:29.935501 12142 log.cc:927] Time spent T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:16:29.937253 11951 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:29.949105 11951 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:29.917013 12158 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:29.950623 12158 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.951037 12158 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:29.951295 11951 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:29.950218  6324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57230 (request call id 3223) took 1044 ms. Trace:
I20260709 13:16:29.953118  6324 rpcz_store.cc:276] 0709 13:16:28.905424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.905640 (+   216us) service_pool.cc:224] Handling call
0709 13:16:29.557489 (+651849us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b5800002d98. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac0b71 00007f4572ac0a22 00007f457b9d9c09 00007f457ab33ee0 00007f457abfd0ab 00007f457abfd131 00007f457abbefc0 00007f457aba9929 00007f457aba93d2 00007f4574120bd4
0709 13:16:29.557662 (+   173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.559559 (+  1897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.559595 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.576197 (+ 16602us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.689468 (+113271us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:29.703967 (+ 14499us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.718546 (+ 14579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.718646 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.949932 (+231286us) raft_consensus.cc:1685] finished
0709 13:16:29.950032 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.950163 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15375,"prepare.queue_time_us":44832,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":1520,"raft.queue_time_us":25248,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":7401,"spinlock_wait_cycles":52688128,"thread_start_us":94847,"threads_started":1,"wal-append.queue_time_us":153226}
I20260709 13:16:29.902909 12091 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:29.956104 11749 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:29.894474 11938 consensus_queue.cc:237] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:29.932817 11873 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:29.956549  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:29.943305 12132 log.cc:927] Time spent T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
W20260709 13:16:29.932411 12139 log.cc:927] Time spent T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:16:29.916700 11478 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:16:29.996634  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 165192us
I20260709 13:16:29.998741  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:29.999418  6935 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:30.020350  6935 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
W20260709 13:16:30.083097  6220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.998793 12091 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:29.995360 11478 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:30.086864  6396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41486 (request call id 1192) took 1016 ms. Trace:
I20260709 13:16:30.088068  6396 rpcz_store.cc:276] 0709 13:16:29.070509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.070678 (+   169us) service_pool.cc:224] Handling call
0709 13:16:29.070999 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.501041 (+430042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.086636 (+585595us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b5400183b54. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:30.086814 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921999616}
I20260709 13:16:30.112242 12158 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:30.114305 12158 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:30.118603 11873 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:30.127741 11478 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:30.144404 12125 raft_consensus.cc:3055] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:30.144964 12125 raft_consensus.cc:740] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:30.151903  6935 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:16:30.156203 11557 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:30.166545  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:30.167169  6253 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:30.169220  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:30.171974  6942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41298 (request call id 1258) took 1148 ms. Trace:
I20260709 13:16:30.172340  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:30.173031  6247 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:30.172389  6942 rpcz_store.cc:276] 0709 13:16:29.023183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.023296 (+   113us) service_pool.cc:224] Handling call
0709 13:16:29.023573 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.544362 (+520789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.171717 (+627355us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b540072a954. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be5e01 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:30.171897 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1186679680}
W20260709 13:16:30.176033  6250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 1094) took 1816 ms (client timeout 1565 ms). Trace:
W20260709 13:16:30.176504  6250 rpcz_store.cc:269] 0709 13:16:28.359324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.359428 (+   104us) service_pool.cc:224] Handling call
0709 13:16:30.175793 (+1816365us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400202454. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:30.175927 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2951931264}
I20260709 13:16:30.180688  6322 raft_consensus.cc:1240] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:16:30.189365  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:30.184267 12167 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:30.185322 12035 consensus_queue.cc:1059] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:30.190869 12167 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:30.191622 12035 raft_consensus.cc:3055] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:30.191978 12035 raft_consensus.cc:740] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:30.192770 12035 consensus_queue.cc:260] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:30.193223 12167 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:30.194096 12035 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:30.194697  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:30.201436  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:30.202018  6326 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:30.208439 12125 consensus_queue.cc:260] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:30.209554 12125 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:30.209676 11977 consensus_queue.cc:1059] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:30.210777 11977 raft_consensus.cc:3055] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:30.211100 11977 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:30.211905 11977 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:30.212805 11977 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:30.219064 12114 raft_consensus.cc:493] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:30.219292  6254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:30.219662 12114 raft_consensus.cc:515] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:30.220041  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:30.221305  6250 raft_consensus.cc:1275] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:30.223568  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:30.224332  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:30.226491  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:30.227007  6253 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:30.227771  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:30.228616  6247 pending_rounds.cc:85] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting all ops after (but not including) 9
I20260709 13:16:30.228911  6247 pending_rounds.cc:107] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:16:30.229189  6247 raft_consensus.cc:2889] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:30.231209 12061 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:30.231325  6369 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:30.231678 12164 log.cc:927] Time spent T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.114s	user 0.000s	sys 0.003s
I20260709 13:16:30.232075 11861 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:30.231765 12061 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:30.233256 12064 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:30.233757 12064 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:30.239485  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:30.240998  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:30.245922  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:30.250635  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:30.251610  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:30.251865  6251 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:16:30.254830  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:30.255470  6327 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:30.255642  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:30.234990  6369 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:30.265453  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:30.265667  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3f5e2706b41929dff126f046ad839" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:30.261672  6326 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:30.268877  6369 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:30.272156  6254 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:30.274231  6322 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:16:30.284183  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:30.235651 12064 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:30.293560  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:30.296115  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:30.300453  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:30.301905  6939 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:16:30.256697 12114 leader_election.cc:290] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:30.287335  6219 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:30.306442  6327 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 13.
I20260709 13:16:30.308486  6404 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:16:30.309521  6250 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:16:30.310266  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:30.314404  6368 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:30.315323 11818 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:30.316533  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:30.270823 11886 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:30.324209  6906 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:30.324292  6941 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:30.285638 11958 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:30.330899  6398 raft_consensus.cc:1275] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:30.322521 11478 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:30.335366 11478 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:30.333498 11780 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:16:30.337920 12019 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:30.333431 12049 raft_consensus.cc:2749] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:30.287456 12044 consensus_queue.cc:1048] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:16:30.343529  6296 leader_election.cc:304] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:30.343783  6295 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:30.321717 11886 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.350446  6250 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:30.356212 11958 raft_consensus.cc:697] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:30.357312 11958 consensus_queue.cc:237] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:30.361963  6219 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:30.363617 11780 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:30.364114 11780 raft_consensus.cc:697] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:30.364915 11780 consensus_queue.cc:237] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:30.367470 12131 log.cc:927] Time spent T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.683s	user 0.005s	sys 0.006s
I20260709 13:16:30.332625 12149 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:30.372996  6297 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:30.371583  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:30.380105  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:30.388468  6328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 1279) took 1162 ms. Trace:
I20260709 13:16:30.351821 11886 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:30.380147  6249 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:16:30.442863  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 71350.7us
I20260709 13:16:30.372179 11478 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:16:30.347887 11626 consensus_queue.cc:1059] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:16:30.462471 12095 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.473629 12095 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:30.460933  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 108168us
I20260709 13:16:30.381695 11377 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:30.460491  6328 rpcz_store.cc:276] 0709 13:16:29.226276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.277833 (+ 51557us) service_pool.cc:224] Handling call
0709 13:16:29.288517 (+ 10684us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:29.292056 (+  3539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.292100 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:29.292783 (+   683us) log.cc:844] Serialized 52 byte log entry
0709 13:16:29.505723 (+212940us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:29.505766 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.506184 (+   418us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.366871 (+860687us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b4400022b4c. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572a1ec85 00007f4572a1f6a2 00007f45757911db 00007f457578caaf 00007f457578086e 00007f457577fbb6 00007f457577f7d8 00007f4575789221 00007f45757891d9 00007f4575789169
0709 13:16:30.371395 (+  4524us) raft_consensus.cc:1685] finished
0709 13:16:30.371416 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.388376 (+ 16960us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8425,"raft.queue_time_us":47281,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":32922,"spinlock_wait_cycles":13026048,"thread_start_us":212522,"threads_started":1,"wal-append.queue_time_us":275811}
I20260709 13:16:30.380829 12158 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:30.442961 12061 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:30.459055 11948 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:30.487113  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:30.460793 12007 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.382259 12019 consensus_queue.cc:1048] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:16:30.500324  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:30.483639 12136 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:30.508728 11886 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:30.516896 12036 raft_consensus.cc:2749] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:30.518220 12172 log.cc:927] Time spent T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:16:30.518554 12162 consensus_queue.cc:1059] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:16:30.522941  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 138102us
I20260709 13:16:30.524034 12053 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:30.524845 11626 raft_consensus.cc:3055] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:30.525315 11478 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:30.531909 11631 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.588058  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:30.535254  6322 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:30.546268 11955 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:30.592672  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:30.547271  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:30.552850  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:30.556741  6939 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:30.562353  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:30.595088  6398 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:16:30.574935  6221 leader_election.cc:304] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:30.596187  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:30.588322  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:30.593344  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 101213us
I20260709 13:16:30.600639  6296 leader_election.cc:304] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:30.610823  6397 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:30.494839 12007 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:30.612811  6399 raft_consensus.cc:1240] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:16:30.613729  6296 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:30.584721 11626 raft_consensus.cc:740] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:30.569842 12136 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:30.626291  6221 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:30.608731 12061 raft_consensus.cc:2749] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:30.615396 11557 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:30.639261  6296 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:30.587878 12053 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:30.645987 11886 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:30.614768 11818 consensus_queue.cc:1059] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:16:30.624166 12037 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:30.604946 11769 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:16:30.600131 11631 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:30.671324  6296 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:30.638617 12114 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:30.644896 12080 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:30.615762 12109 consensus_queue.cc:1059] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:16:30.658293 12110 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:30.700331 12053 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:30.702700 11631 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:30.703390 12178 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:16:30.649677 11557 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:30.738229  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:30.688511 12141 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:30.739163  6252 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 16.
I20260709 13:16:30.721681  6326 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:30.725234  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:30.633955 11834 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
W20260709 13:16:30.800993  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 72640.5us
W20260709 13:16:30.810074  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 138833us
I20260709 13:16:30.863737  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:30.894680  6328 raft_consensus.cc:1240] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:16:30.940375  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:30.940428  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:30.982017 12095 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:30.886209 12110 consensus_queue.cc:1059] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:16:30.994510 11557 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:31.001533 12187 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
W20260709 13:16:31.023298  6254 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.064s	sys 0.095s
W20260709 13:16:31.023707  6254 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.064s	sys 0.095s
I20260709 13:16:30.883562 11943 consensus_queue.cc:1059] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.128s
W20260709 13:16:31.011510 12035 consensus_meta.cc:287] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.817s	user 0.008s	sys 0.002s
I20260709 13:16:31.043526 12110 raft_consensus.cc:3055] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:31.049031 12110 raft_consensus.cc:740] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:30.894526 12109 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.137s
W20260709 13:16:31.050472 11977 consensus_meta.cc:287] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.000s
I20260709 13:16:31.055138  6940 raft_consensus.cc:2410] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:16:31.053776 12036 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:31.058373 12036 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:31.054056 11943 consensus_queue.cc:1243] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer b940f12ed61a49c4b3c11f13ef50fa92 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:31.060585 12036 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:31.002246 12187 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.067782 12110 consensus_queue.cc:260] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:31.069115 12110 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:31.070318 12187 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:31.086759  6328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:31.061456 12136 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:31.089809  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:31.093497  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.094043  6398 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:31.097908  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.102249  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.097946  6368 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:31.113763  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.155036  6368 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:31.161262  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:31.161928  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:31.161998  6939 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 16.
I20260709 13:16:31.162531  6368 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:31.163458  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:31.167363  6939 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:31.112442 12091 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:31.180811  6905 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:31.154949 12189 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.075914 11626 consensus_queue.cc:260] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.158891 12035 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.178489 12192 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:31.176026 12094 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:31.185665 12050 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:31.162846 12006 consensus_queue.cc:1059] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:16:31.201779  6295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.202406 12125 consensus_meta.cc:287] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: Time spent flushing consensus metadata: real 0.992s	user 0.009s	sys 0.003s
I20260709 13:16:31.192039 12189 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:31.207553  6327 raft_consensus.cc:1275] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:16:31.207981  6327 pending_rounds.cc:85] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 6
I20260709 13:16:31.208246  6327 pending_rounds.cc:107] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:16:31.208529  6327 raft_consensus.cc:2889] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:31.208685 12189 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:31.194917 12035 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.210875 12035 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:31.215226  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.215969  6398 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:31.219511  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:31.238435  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:31.239049  6941 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
W20260709 13:16:31.239192  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 58594.5us
I20260709 13:16:31.241417 12049 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:31.249671 12049 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.233717 12092 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:31.250767 12092 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.252424 12048 raft_consensus.cc:3055] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:31.252832 12048 raft_consensus.cc:740] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:31.253718 12048 consensus_queue.cc:260] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.254196 12049 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:31.275363  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.282182  6297 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:31.287662  6222 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:31.289981  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:31.290818  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:31.291400 11769 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:31.291977 11769 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:31.293093 12005 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.293241 12189 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:31.293720 12189 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.293599 12005 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:31.294203 12189 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.291395  6252 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 16.
I20260709 13:16:31.298113  6252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:31.301005  6251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:31.301339  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:31.307736  6254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50006 (request call id 2849) took 1031 ms. Trace:
I20260709 13:16:31.309303  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:31.304834  6368 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:31.308075  6254 rpcz_store.cc:276] 0709 13:16:30.278138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.278279 (+   141us) service_pool.cc:224] Handling call
0709 13:16:30.278665 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:30.312874 (+ 34209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.312904 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:30.313523 (+   619us) log.cc:844] Serialized 52 byte log entry
0709 13:16:30.454816 (+141293us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:31.024050 (+569234us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.255733 (+231683us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b1800499960. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f457b9c0de1 00007f457b9cd5b1 00007f4572af83f3 00007f4572afa7c1 00007f4572afa779 00007f4572afa709 00007f4572afa6d1 00007f4572af99cd 000000000038f354 000000000038f199 00007f4572adb83a
0709 13:16:31.295516 (+ 39783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.295595 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.295634 (+    39us) raft_consensus.cc:1685] finished
0709 13:16:31.307554 (+ 11920us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.307684 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":304997,"prepare.queue_time_us":114168,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":306310,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":3710720,"thread_start_us":689129,"threads_started":2,"wal-append.queue_time_us":295945}
I20260709 13:16:31.293682 12145 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:31.320796  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 279453us
I20260709 13:16:31.324877  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:31.329038  6330 raft_consensus.cc:1275] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:31.323576 11977 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:31.330623 11977 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.332681 11977 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:31.324254 12006 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:31.334393  6330 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:31.342772  6296 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:31.345017  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.348240  6296 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:31.341253 12006 raft_consensus.cc:697] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:31.354323 12114 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:31.354350 12006 consensus_queue.cc:237] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.358625  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:31.359653 12113 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:31.362138  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:31.362370 12167 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:31.391459 12189 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.351517 12036 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:31.404050  6249 raft_consensus.cc:1240] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:16:31.409623 12143 consensus_queue.cc:1059] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:31.415925 12007 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:31.416683 12152 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:31.419571  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:31.422760 12189 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:31.424532 12005 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:31.426590 12149 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:31.434150  6940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 1115) took 1211 ms. Trace:
I20260709 13:16:31.419571  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.437811  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:31.437938 11941 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.439033 11938 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.471042  6940 rpcz_store.cc:276] 0709 13:16:30.222615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.226285 (+  3670us) service_pool.cc:224] Handling call
0709 13:16:31.433949 (+1207664us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54007a53d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4e571 00007f4575be92fa 00007f457abaab17 00007f45741256d4 00007f4574125662 00007f4574125591 00007f457412550c 00007f45741247c2 00007f4573f2048c 00007f4573f1f8c6 00007f4573f1f26f
0709 13:16:31.434073 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903815424}
I20260709 13:16:31.444871  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:31.479548  6937 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:31.468827  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 120680us
I20260709 13:16:31.471349  6404 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 16.
I20260709 13:16:31.484015  6297 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:31.494386  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 91369.7us
I20260709 13:16:31.502363  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.506579  6404 raft_consensus.cc:3055] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:31.506922  6404 raft_consensus.cc:740] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:31.497478 11478 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:31.509379  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.512037  6401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:31.514266  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.507920  6404 consensus_queue.cc:260] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:31.516091  6404 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:31.481918 11941 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:31.524699 11941 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:31.525116  6404 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:31.482198 12149 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.527730 12149 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:31.528352  6937 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:31.485172 11938 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.530556 11938 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:31.532116  6325 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 14.
I20260709 13:16:31.470995 12152 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.534580  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:31.535094 12152 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:31.535392  6250 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:31.537665 12007 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.538141 12007 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.540010 12007 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:31.537040  6295 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:31.541293 12144 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:31.541641 12144 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.541944 12144 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:31.547611  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:31.548188  6249 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:31.548729  6297 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:31.549950 12111 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:31.550477 12111 raft_consensus.cc:697] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:31.551304 12111 consensus_queue.cc:237] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.552049  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:31.552868  6326 raft_consensus.cc:2393] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 15: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:31.562639  6906 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:31.563901 12180 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:31.564316 12180 raft_consensus.cc:493] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.564648 12180 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:31.589056 11951 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:16:31.589162  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:31.611292  6297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.613344 12092 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:31.614650  6250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53902
I20260709 13:16:31.616192  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:31.616217  6250 raft_consensus.cc:606] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Received request to transfer leadership
W20260709 13:16:31.620693  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 107060us
I20260709 13:16:31.623711  6250 raft_consensus.cc:614] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:31.624400  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:31.617405  6937 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 15.
I20260709 13:16:31.626715  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:31.642663  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:31.639788 12145 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:31.648451 12145 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:31.648862 12145 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:31.653661  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 147563us
I20260709 13:16:31.656374  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.656939  6404 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:31.657163 12091 consensus_queue.cc:1048] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:31.658499 12091 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:31.660199  6221 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:31.661639 12220 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:31.663667 12207 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:31.668478  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.669620  6404 raft_consensus.cc:2393] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 12: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:31.671450  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.677837  6296 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:31.679996 12126 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:31.683914 11626 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:31.691648  6219 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:31.696610  6371 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:31.697970 12201 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:31.698100  6371 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:31.698366 12201 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.698717 12201 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:31.699285 12202 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:31.700510 12040 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:31.700912 12040 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.701287 12040 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:31.702421 12202 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:31.710747  6256 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:31.711711  6907 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:31.717300 12180 raft_consensus.cc:515] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.719527 12180 leader_election.cc:290] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:31.721580  6935 raft_consensus.cc:2368] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 12. Current term is 13.
I20260709 13:16:31.722844 12219 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:31.723364 12219 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.724177  6222 leader_election.cc:400] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 12. Current term is 13.
I20260709 13:16:31.724485  6222 leader_election.cc:403] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:31.725466 12048 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:31.730413 12049 raft_consensus.cc:2764] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:16:31.738730  6907 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:31.740067  6907 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:31.741101  6907 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:31.767321  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:31.720818 11769 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:31.779001  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:31.806613  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:31.741355 12180 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:31.744163 12219 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:31.743873 12098 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:16:31.741776 12187 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:31.829416  6398 raft_consensus.cc:1240] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:31.806027 11749 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:31.804010 12049 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:31.814427 12113 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:31.840240  6369 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:31.803742 11873 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:16:31.839651 11749 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.868371 11749 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:31.870041  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:31.874276 12145 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.876601 12145 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:31.877840  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:31.889515  6940 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:31.891211  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:31.891956  6331 raft_consensus.cc:2393] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 15: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:31.893275  6941 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 15.
I20260709 13:16:31.895835  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:31.894771  6222 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:31.855446 12006 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:31.898553  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.846446 12113 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.898723  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.907423 12220 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:31.907922 12220 raft_consensus.cc:697] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:31.914808  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:31.915849  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc89cb8d0e64feba7a58705d738d699" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:31.916327  6403 raft_consensus.cc:3060] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:31.923579  6368 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:31.945061  6253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
W20260709 13:16:31.959335  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 53921.8us
I20260709 13:16:31.962425  6221 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:31.964167 12152 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:31.908263 11886 consensus_queue.cc:1059] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:16:31.966815 12113 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:31.969995  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:31.971648  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:31.977053  6330 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:16:31.977545  6330 pending_rounds.cc:85] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting all ops after (but not including) 9
I20260709 13:16:31.977882  6330 pending_rounds.cc:107] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:16:31.978166  6330 raft_consensus.cc:2889] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:31.902010 12201 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.978603 12220 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:31.979604  6402 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:16:31.983083 12144 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:31.984172  6325 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:16:31.963361 12040 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:31.986267  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:31.986665  6247 raft_consensus.cc:1240] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:31.954888 12095 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:31.988535  6403 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:31.989872  6907 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:31.990466  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:31.991569  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:31.991950  6256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:31.988044 12040 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:31.985065 12144 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:32.008502  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:32.009325 12198 raft_consensus.cc:2804] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:32.009943 12198 raft_consensus.cc:697] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:32.011073  6371 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:32.012163 11886 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:32.010792 12198 consensus_queue.cc:237] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:32.023315 12049 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:32.023787 12049 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:32.035897  6253 raft_consensus.cc:606] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:32.017268 12098 raft_consensus.cc:2749] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105) with higher term. Message: Invalid argument: T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 12. Current term is 13.
I20260709 13:16:32.041627  6248 raft_consensus.cc:2468] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:32.044495  6369 leader_election.cc:304] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:32.045681 12006 raft_consensus.cc:2764] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:16:32.074316  6938 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:32.018435 12201 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:32.054214 12202 consensus_queue.cc:1059] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:16:32.095604 12202 raft_consensus.cc:3055] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:32.096105 12202 raft_consensus.cc:740] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:32.097103 12202 consensus_queue.cc:260] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:32.098619 12202 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:32.102837 12222 log.cc:927] Time spent T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.249s	user 0.004s	sys 0.000s
I20260709 13:16:32.086427 12189 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:16:32.105618 12094 raft_consensus.cc:3055] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:32.106042 12094 raft_consensus.cc:740] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:32.106866 12094 consensus_queue.cc:260] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:32.108031 12094 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:32.053081 12049 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:32.122061 11377 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.133750 11377 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:32.135468  6296 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:32.137392 11377 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:32.137449 12190 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:32.137413  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:32.148613  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:32.151435  6221 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:32.153174  6938 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:32.156461  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:32.158726  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:32.161196  6324 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:32.164589 12049 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:32.165614  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:32.166385  6402 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 17: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:32.181478 12145 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:32.183188 12217 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:32.184963  6152 catalog_manager.cc:5697] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:32.186708  6152 catalog_manager.cc:5697] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 11 to 13, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 13 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.189316 12143 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:32.190032  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:32.190263  6221 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:32.190759  6330 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 15: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:32.193845 12143 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:32.194918  6248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:32.195495  6248 raft_consensus.cc:606] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:32.195814  6248 raft_consensus.cc:614] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:32.196563 12145 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:32.198084  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:32.200605  6248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:32.188290  6152 catalog_manager.cc:5697] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 13, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 13 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:32.205881  6295 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:32.207968  6398 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 13:16:32.208431  6398 pending_rounds.cc:85] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 11
I20260709 13:16:32.208715  6398 pending_rounds.cc:107] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:16:32.208993  6398 raft_consensus.cc:2889] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.210139  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:32.213101  6248 raft_consensus.cc:606] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:32.213760  6248 raft_consensus.cc:614] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:32.214298  6906 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:32.222101  6219 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:32.228205  6152 catalog_manager.cc:5697] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 9 to 11, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 11 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:32.229658  6152 catalog_manager.cc:5697] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 11 to 15, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 15 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:32.206714 12053 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:32.229036 11977 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:32.254803 12229 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:32.258677  6402 raft_consensus.cc:1240] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 13:16:32.261106 12234 log.cc:927] Time spent T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:16:32.261421  6248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:32.273979  6248 raft_consensus.cc:606] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:32.274789  6248 raft_consensus.cc:614] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:32.240140 11377 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:16:32.288264  6249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:59284
I20260709 13:16:32.288941  6249 raft_consensus.cc:606] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:32.289276  6249 raft_consensus.cc:614] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:32.262784 12196 consensus_queue.cc:1059] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:16:32.300499  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:16:32.303615  6202 auto_rebalancer.cc:893] Removing replace marker failed: Replica 2d6410349fdc47f5a98ba3c6f7d5510b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:16:32.304201  6202 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:16:32.304530  6202 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:16:32.319079  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:32.319363  6152 catalog_manager.cc:5697] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.320757  6152 catalog_manager.cc:5697] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:32.314623 12130 raft_consensus.cc:3055] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:32.370361 12130 raft_consensus.cc:740] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
W20260709 13:16:32.423148  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 49955us
I20260709 13:16:32.424799 12094 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.425410 12094 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:32.432210 12094 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:32.438505  6149 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55326 (request call id 378) took 22755 ms (client timeout 15000 ms). Trace:
I20260709 13:16:32.440973  6152 catalog_manager.cc:5697] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 8 to 12, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 12 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.442600  6152 catalog_manager.cc:5697] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:32.443994  6152 catalog_manager.cc:5697] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.449146  6152 catalog_manager.cc:5697] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 10 to 13, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 13 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.450642  6152 catalog_manager.cc:5697] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 7 to 16, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 16 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.410650 12130 consensus_queue.cc:260] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:32.454100  6152 catalog_manager.cc:5697] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 10 to 12, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 12 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.468374  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:32.468673  6152 catalog_manager.cc:5697] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 11 to 12, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 12 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.493607 12030 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:16:32.438983  6149 rpcz_store.cc:269] 0709 13:16:09.683447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.683607 (+   160us) service_pool.cc:224] Handling call
0709 13:16:10.712388 (+1028781us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b5400250490. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4572980db1 00007f4572ac1640 00007f457b998b76 00007f457baa2c3e 00007f4579f632a4 00007f4579f63232 00007f4579f63161 00007f4579f630dc 00007f4579f62392 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:32.438411 (+21726023us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:29.974015 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:30.106984 (+132969us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:30.107038 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:16:30.107060 (+    22us) tablet.cc:662] Decoding operations
0709 13:16:30.130016 (+ 22956us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:30.130115 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:30.130149 (+    34us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:16:30.131918 (+  1769us) tablet.cc:701] Row locks acquired
0709 13:16:30.131971 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:16:30.132161 (+   190us) write_op.cc:270] Start()
0709 13:16:30.132323 (+   162us) write_op.cc:276] Timestamp: P: 1783602990132093 usec, L: 0
0709 13:16:30.132360 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:16:30.133107 (+   747us) log.cc:844] Serialized 8178 byte log entry
0709 13:16:30.990207 (+857100us) op_driver.cc:464] REPLICATION: finished
0709 13:16:31.229316 (+239109us) write_op.cc:301] APPLY: starting
0709 13:16:31.229426 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:31.280293 (+ 50867us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:31.280410 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:31.399406 (+118996us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:31.399819 (+   413us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:16:31.399884 (+    65us) write_op.cc:312] APPLY: finished
0709 13:16:31.400379 (+   495us) log.cc:844] Serialized 188 byte log entry
0709 13:16:31.421762 (+ 21383us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:31.421928 (+   166us) write_op.cc:454] Released schema lock
0709 13:16:31.422134 (+   206us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:31.425333 (+  3199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:31.425375 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1923396,"reported_tablets":48,"spinlock_wait_cycles":65956096,"child_traces":[["op",{"apply.queue_time_us":224999,"apply.run_cpu_time_us":27306,"apply.run_wall_time_us":200850,"cfile_cache_hit":86,"cfile_cache_hit_bytes":92159,"num_ops":21,"prepare.queue_time_us":89859,"prepare.run_cpu_time_us":24246,"prepare.run_wall_time_us":410684,"raft.queue_time_us":438112,"raft.run_cpu_time_us":67662,"raft.run_wall_time_us":196056,"replication_time_us":857675,"thread_start_us":552075,"threads_started":4,"wal-append.queue_time_us":307351,"wal-append.run_cpu_time_us":74773,"wal-append.run_wall_time_us":1957939}]]}
I20260709 13:16:32.497709 12130 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:32.494310 12030 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:32.505859  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:32.507791  6152 catalog_manager.cc:5697] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 13 to 15, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 15 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.509696  6152 catalog_manager.cc:5697] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 4 to 11. New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:32.510933  6152 catalog_manager.cc:5697] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:32.523154  6253 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:32.524857  6152 catalog_manager.cc:5697] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 11 to 13, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 13 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.527052  6152 catalog_manager.cc:5697] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 5 to 10, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 10 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:32.528808  6152 catalog_manager.cc:5697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 8 to 10, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 10 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.531543  6152 catalog_manager.cc:5697] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 13, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 13 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:32.531977  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:32.506450  6325 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 17.
I20260709 13:16:32.532744  6331 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 16.
I20260709 13:16:32.534227  6219 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:32.537887  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:32.538589  6403 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 16: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:32.501403 12030 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:32.538650  6152 catalog_manager.cc:5697] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 10 to 13, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 13 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.554114  6152 catalog_manager.cc:5697] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 6 to 10, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 10 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:32.556170  6152 catalog_manager.cc:5697] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 13 to 16, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 16 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:32.563163  6152 catalog_manager.cc:5697] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 11 to 12, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 12 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:32.566254 12098 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:32.565929  6152 catalog_manager.cc:5697] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.566672 12098 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:32.567052 12098 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:32.567323  6152 catalog_manager.cc:5697] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 11 to 14, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 14 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:32.568843  6152 catalog_manager.cc:5697] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 7 to 9, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 9 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.570712  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:32.576859 12218 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:32.581269 12218 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.570757  6152 catalog_manager.cc:5697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 10 to 12, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 12 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:32.610312 12218 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:32.619571  6152 catalog_manager.cc:5697] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 13 to 16, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 16 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.661747 11977 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:16:32.682679 12218 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:32.692358 12098 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:32.716087  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 181935us
I20260709 13:16:32.733748  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:32.734490  6325 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:32.748875  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 190298us
I20260709 13:16:32.758819  6940 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:32.787523  6331 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:16:32.780412 12242 log.cc:927] Time spent T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:16:32.817392 12220 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:32.819790 12218 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:32.819722 12229 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:16:32.821671  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 53364.5us
I20260709 13:16:32.826331  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:32.831591  6402 raft_consensus.cc:1275] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:32.835646 11818 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.836118 11818 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:32.844583  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:32.851393 11818 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:32.853461  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:32.857959  6325 raft_consensus.cc:2468] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 18.
I20260709 13:16:32.859167  6368 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:32.863067 12218 raft_consensus.cc:2804] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:32.863574 12218 raft_consensus.cc:697] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:32.865780  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:32.866484  6402 raft_consensus.cc:2393] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 16: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:32.845605 12007 consensus_queue.cc:1048] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:16:32.881971  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:32.886111  6255 raft_consensus.cc:2410] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:16:32.864423 12098 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:32.892935 12218 consensus_queue.cc:237] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:32.907017  6369 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:32.913829 12006 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:32.958186  6331 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 16.
I20260709 13:16:32.959611  6219 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:16:32.974646  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 89800.2us
I20260709 13:16:32.972713 11557 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:32.988587 12114 raft_consensus.cc:993] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:32.989253 12245 raft_consensus.cc:1081] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:32.991003  6331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57230
I20260709 13:16:32.992161  6331 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.992568  6331 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:32.999221  6331 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:32.982748 11557 raft_consensus.cc:697] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:33.007627 11557 consensus_queue.cc:237] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:33.019222  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:33.019807  6247 raft_consensus.cc:3055] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:33.020119  6247 raft_consensus.cc:740] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:33.022939  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:33.023558  6941 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:33.026404  6247 consensus_queue.cc:260] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:33.027583  6331 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:33.029682  6247 raft_consensus.cc:3060] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:33.055835  6941 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16.
I20260709 13:16:33.061586  6297 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:33.062315 12129 raft_consensus.cc:2804] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:33.062836 12129 raft_consensus.cc:697] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:33.083323 12129 consensus_queue.cc:237] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:33.144429  6247 raft_consensus.cc:2468] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16.
I20260709 13:16:33.215579 12244 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:33.216122 12244 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:33.218116 12244 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:33.219432  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:33.220124  6330 raft_consensus.cc:2368] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 17. Current term is 18.
I20260709 13:16:33.221431  6905 leader_election.cc:400] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 17. Current term is 18.
I20260709 13:16:33.221715  6905 leader_election.cc:403] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:33.223184  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:33.226620 12244 raft_consensus.cc:3060] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:16:33.304546 12244 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965) with higher term. Message: Invalid argument: T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe for earlier term 17. Current term is 18.
I20260709 13:16:33.320183  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:33.341492  6937 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:16:33.343708 11749 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:33.355871  6330 raft_consensus.cc:1275] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:16:33.358305 11938 consensus_queue.cc:1048] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:33.427232  6330 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:33.430150 12233 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:33.432389  6153 catalog_manager.cc:5697] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 12 to 15, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 15 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.435609  6153 catalog_manager.cc:5697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 6 to 11, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 11 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.464901  6153 catalog_manager.cc:5697] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 8 to 10, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 10 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:33.461228  6396 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:33.443766  6152 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55346 (request call id 395) took 7300 ms. Trace:
I20260709 13:16:33.480623 12233 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:33.480141  6152 rpcz_store.cc:276] 0709 13:16:26.192150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.301852 (+109702us) service_pool.cc:224] Handling call
0709 13:16:33.443690 (+7141838us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:32.862479 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:32.862989 (+   510us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:32.863026 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:16:32.863043 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:32.905950 (+ 42907us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:32.906021 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:32.906047 (+    26us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:16:32.908266 (+  2219us) tablet.cc:701] Row locks acquired
0709 13:16:32.908280 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:16:32.908427 (+   147us) write_op.cc:270] Start()
0709 13:16:32.908539 (+   112us) write_op.cc:276] Timestamp: P: 1783602992908366 usec, L: 0
0709 13:16:32.908557 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:16:32.913593 (+  5036us) log.cc:844] Serialized 11525 byte log entry
0709 13:16:33.105770 (+192177us) op_driver.cc:464] REPLICATION: finished
0709 13:16:33.135795 (+ 30025us) write_op.cc:301] APPLY: starting
0709 13:16:33.135884 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:33.151978 (+ 16094us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:33.152065 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:33.191574 (+ 39509us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:33.191941 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 13:16:33.191986 (+    45us) write_op.cc:312] APPLY: finished
0709 13:16:33.192449 (+   463us) log.cc:844] Serialized 260 byte log entry
0709 13:16:33.192606 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:33.192817 (+   211us) write_op.cc:454] Released schema lock
0709 13:16:33.192877 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:33.193262 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:33.193301 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":477175,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":29057,"apply.run_cpu_time_us":32289,"apply.run_wall_time_us":57445,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129887,"num_ops":30,"prepare.queue_time_us":107995,"prepare.run_cpu_time_us":18540,"prepare.run_wall_time_us":137464,"raft.queue_time_us":79321,"raft.run_cpu_time_us":12725,"raft.run_wall_time_us":23657,"replication_time_us":197079,"thread_start_us":238740,"threads_started":4,"wal-append.queue_time_us":105827}]]}
I20260709 13:16:33.495126  6153 catalog_manager.cc:5697] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 10 to 9, leader changed from <none> to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 9 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:33.599181  6249 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:16:33.601064 12129 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:33.605700 12149 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:16:33.606534  6153 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55342 (request call id 351) took 26100 ms (client timeout 15000 ms). Trace:
I20260709 13:16:33.606231 12149 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:33.610675  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:33.610996  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:33.611469  6396 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 17: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:33.611774  6941 raft_consensus.cc:2393] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d6410349fdc47f5a98ba3c6f7d5510b in current term 17: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:33.612202 12149 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:33.614219  6221 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:33.616115  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:33.616655 12233 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:33.613183  6153 rpcz_store.cc:269] 0709 13:16:07.506365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.506590 (+   225us) service_pool.cc:224] Handling call
0709 13:16:33.606461 (+26099871us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:33.533550 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:33.534052 (+   502us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:33.534088 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:16:33.534104 (+    16us) tablet.cc:662] Decoding operations
0709 13:16:33.534677 (+   573us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:33.534732 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:33.534758 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:16:33.535141 (+   383us) tablet.cc:701] Row locks acquired
0709 13:16:33.535159 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:16:33.535306 (+   147us) write_op.cc:270] Start()
0709 13:16:33.535408 (+   102us) write_op.cc:276] Timestamp: P: 1783602993535259 usec, L: 0
0709 13:16:33.535428 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:16:33.536006 (+   578us) log.cc:844] Serialized 1728 byte log entry
0709 13:16:33.540012 (+  4006us) op_driver.cc:464] REPLICATION: finished
0709 13:16:33.540512 (+   500us) write_op.cc:301] APPLY: starting
0709 13:16:33.540593 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:33.543050 (+  2457us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:33.543146 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:33.546016 (+  2870us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:33.546247 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:16:33.546305 (+    58us) write_op.cc:312] APPLY: finished
0709 13:16:33.546554 (+   249us) log.cc:844] Serialized 49 byte log entry
0709 13:16:33.547359 (+   805us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:33.547468 (+   109us) write_op.cc:454] Released schema lock
0709 13:16:33.547520 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:33.547891 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:33.547925 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43160,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":289,"apply.run_cpu_time_us":6496,"apply.run_wall_time_us":7328,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16768,"num_ops":4,"prepare.queue_time_us":18637,"prepare.run_cpu_time_us":2708,"prepare.run_wall_time_us":2708,"replication_time_us":4436}]]}
I20260709 13:16:33.616694  6330 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 17.
I20260709 13:16:33.629240  6941 raft_consensus.cc:1275] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:16:33.630630 12143 consensus_queue.cc:1048] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:33.643221 12233 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:33.665612 12129 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.666195 12129 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:33.669629 12129 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:33.669835  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:33.670770  6396 raft_consensus.cc:2410] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:16:33.671635  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:33.672273  6247 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
I20260709 13:16:33.673540  6295 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:33.674528 12129 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:33.674870 12129 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.678828 12129 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:33.685431 12218 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.685951 12218 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:33.687884 12218 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:33.690855  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:33.695138 12129 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:33.696269  6330 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 16: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:33.700133  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:33.700785  6247 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:33.703843  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:33.705677 11749 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:33.706054 11749 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.706360 11749 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:33.708062  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:33.708624  6247 raft_consensus.cc:3060] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:33.717329 12129 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:33.717481  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:33.726939 11749 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:33.728030  6396 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 16: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:33.730612  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:33.731348  6331 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 16: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:33.728924 11749 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:33.735643  6247 raft_consensus.cc:2468] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16.
I20260709 13:16:33.735653  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:33.741278  6249 raft_consensus.cc:2393] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 16: Already voted for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in this term.
I20260709 13:16:33.741611  6295 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:33.742678 11377 raft_consensus.cc:2804] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:33.743209 11377 raft_consensus.cc:697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:33.744203 11377 consensus_queue.cc:237] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:33.757367  6153 catalog_manager.cc:5697] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:33.759044  6153 catalog_manager.cc:5697] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 14 to 17, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 17 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:33.760718  6153 catalog_manager.cc:5697] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:33.769186  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:33.764611  6153 catalog_manager.cc:5697] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 10 to 13, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 13 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:33.773914  6153 catalog_manager.cc:5697] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 8 to 12, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 12 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:33.774645 12218 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:16:33.776249  6139 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4bc84db94ed44cf9bab11e4626d2ba6e with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2d6410349fdc47f5a98ba3c6f7d5510b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:33.777253  6153 catalog_manager.cc:5697] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 10 to 14, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 14 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:33.780476  6153 catalog_manager.cc:5697] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.781947  6153 catalog_manager.cc:5697] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 9 to 13, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 13 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:33.783377  6153 catalog_manager.cc:5697] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 11 to 15, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 15 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:33.779636  6150 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49212 (request call id 204) took 41160 ms (client timeout 15000 ms). Trace:
W20260709 13:16:33.784610  6150 rpcz_store.cc:269] 0709 13:15:52.619795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.621304 (+  1509us) service_pool.cc:224] Handling call
0709 13:16:33.779424 (+41158120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27691,"reported_tablets":38}
I20260709 13:16:33.787213  6153 catalog_manager.cc:5697] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:33.788369  6153 catalog_manager.cc:5697] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:33.790138  6153 catalog_manager.cc:5697] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 16 to 18, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 18 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.792033  6153 catalog_manager.cc:5697] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 12 to 15, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 15 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:33.793440  6153 catalog_manager.cc:5697] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 10 to 12, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 12 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:33.795701  6153 catalog_manager.cc:5697] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 13 to 14, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 14 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:33.797340  6153 catalog_manager.cc:5697] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 8 to 11, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 11 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.799173  6153 catalog_manager.cc:5697] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:33.800330  6153 catalog_manager.cc:5697] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 8 to 10, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 10 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:33.801888  6153 catalog_manager.cc:5697] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 11 to 16, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 16 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:33.803093  6153 catalog_manager.cc:5697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 11 to 15, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 15 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:33.904531  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 73540.4us
I20260709 13:16:33.933310 12201 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.933913 12201 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:33.937470  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:33.938242  6330 raft_consensus.cc:2410] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:16:33.940757  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:33.941593  6247 raft_consensus.cc:2410] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:16:33.943725  6369 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:33.945606 12218 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:33.966414  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:33.967572  6404 consensus_queue.cc:237] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:33.970913  6937 raft_consensus.cc:2410] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:16:33.965922 12201 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:34.013300  6330 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:34.012892  6937 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:34.015619 12201 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:34.017279 12218 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:34.069792 11749 raft_consensus.cc:2955] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 7 to 11, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:34.097836  6937 raft_consensus.cc:2955] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 7 to 11, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:34.117476  6331 raft_consensus.cc:2955] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 7 to 11, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:34.161790  6404 raft_consensus.cc:1275] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 7. (term mismatch)
I20260709 13:16:34.162285  6404 pending_rounds.cc:85] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting all ops after (but not including) 6
I20260709 13:16:34.162583  6404 pending_rounds.cc:107] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:16:34.162889  6404 raft_consensus.cc:2889] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:34.173338 12268 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:34.189841  6140 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4bc84db94ed44cf9bab11e4626d2ba6e with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 4)
I20260709 13:16:34.200409  6153 catalog_manager.cc:5697] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 12 to 16, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 16 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } }
I20260709 13:16:34.181926  6148 catalog_manager.cc:5697] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 11 to 12, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 12 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.204668  6148 catalog_manager.cc:5697] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 12 to 14, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 14 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:34.203233  6154 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55342 (request call id 350) took 49668 ms (client timeout 15000 ms). Trace:
W20260709 13:16:34.214313  6154 rpcz_store.cc:269] 0709 13:15:44.534518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.534693 (+   175us) service_pool.cc:224] Handling call
0709 13:15:44.625433 (+ 90740us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b54002c15d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4f090 00007f4575bedf3a 00007f457b9a41cc 00007f457baa237e 00007f4579f632a4 00007f4579f63232 00007f4579f63161 00007f4579f630dc 00007f4579f62392 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:34.203049 (+49577616us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6251,"reported_tablets":48,"spinlock_wait_cycles":128482048}
I20260709 13:16:34.218667  6249 raft_consensus.cc:1275] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:16:34.224133 12268 consensus_queue.cc:1048] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:34.221989  6148 catalog_manager.cc:5697] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 13 to 14, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 14 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.247231  6148 catalog_manager.cc:5697] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 5 to 8, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 8 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.303645 12272 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.306162 12272 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:34.313923 12272 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:34.351758  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:34.353847  6404 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 17.
I20260709 13:16:34.355263  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:34.356215  6325 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 17.
I20260709 13:16:34.358698  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" is_pre_election: true
I20260709 13:16:34.359881  6249 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 17.
I20260709 13:16:34.363659  6906 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:34.350435  6153 catalog_manager.cc:5697] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 7 to 11, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 15 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.400257 12244 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:34.400887 12244 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.401397 12244 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:34.457319 12244 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:34.480037  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:34.480741  6325 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:34.485937  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:34.486606  6247 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:34.519691  6325 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 18.
W20260709 13:16:34.544018  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 111183us
I20260709 13:16:34.531939 12244 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 18 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:34.534606  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:34.546403  6405 raft_consensus.cc:3060] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:34.554874  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bc84db94ed44cf9bab11e4626d2ba6e with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:53902
I20260709 13:16:34.558858  6247 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 18.
I20260709 13:16:34.560281  6906 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:34.561322 12244 raft_consensus.cc:2804] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:34.562381 12244 raft_consensus.cc:697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 18 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:34.567013 12244 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:34.567025  6151 catalog_manager.cc:5697] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 14 to 15, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 15 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:34.597398  6405 raft_consensus.cc:2468] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 18.
I20260709 13:16:34.596352  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:34.602973  6151 catalog_manager.cc:5697] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 8 to 10, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 10 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:34.605782  6151 catalog_manager.cc:5697] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 10 to 12, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 12 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:34.601760  6148 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49212 (request call id 205) took 18872 ms (client timeout 15000 ms). Trace:
I20260709 13:16:34.608062  6151 catalog_manager.cc:5697] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 15 to 17, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 17 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.611748 12285 tablet_replica.cc:333] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:34.611581  6151 catalog_manager.cc:5697] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 8 to 11, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.633327 12285 raft_consensus.cc:2243] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:34.634270 12285 raft_consensus.cc:2272] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:34.639143  6151 catalog_manager.cc:5697] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 14 to 16, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 16 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.645864 12285 ts_tablet_manager.cc:1916] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:34.650102  6151 catalog_manager.cc:5697] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 11 to 14, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 14 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.653175  6151 catalog_manager.cc:5697] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.657760  6151 catalog_manager.cc:5697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.706580 12285 ts_tablet_manager.cc:1929] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:16:34.710351 12285 log.cc:1199] T 4bc84db94ed44cf9bab11e4626d2ba6e P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/4bc84db94ed44cf9bab11e4626d2ba6e
I20260709 13:16:34.721630  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet 4bc84db94ed44cf9bab11e4626d2ba6e (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
W20260709 13:16:34.609551  6148 rpcz_store.cc:269] 0709 13:16:15.729159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.729468 (+   309us) service_pool.cc:224] Handling call
0709 13:16:34.601498 (+18872030us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:34.255451 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:34.255978 (+   527us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:34.256017 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:16:34.256029 (+    12us) tablet.cc:662] Decoding operations
0709 13:16:34.256556 (+   527us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:34.256610 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:34.256634 (+    24us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:16:34.256993 (+   359us) tablet.cc:701] Row locks acquired
0709 13:16:34.257008 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:16:34.257146 (+   138us) write_op.cc:270] Start()
0709 13:16:34.257248 (+   102us) write_op.cc:276] Timestamp: P: 1783602994257088 usec, L: 0
0709 13:16:34.257266 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:16:34.257806 (+   540us) log.cc:844] Serialized 1662 byte log entry
0709 13:16:34.259643 (+  1837us) op_driver.cc:464] REPLICATION: finished
0709 13:16:34.260050 (+   407us) write_op.cc:301] APPLY: starting
0709 13:16:34.260124 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:34.265014 (+  4890us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:34.265106 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:34.268601 (+  3495us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:34.268776 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:16:34.268827 (+    51us) write_op.cc:312] APPLY: finished
0709 13:16:34.269041 (+   214us) log.cc:844] Serialized 49 byte log entry
0709 13:16:34.270811 (+  1770us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:34.270911 (+   100us) write_op.cc:454] Released schema lock
0709 13:16:34.270953 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:34.279290 (+  8337us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:34.279323 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":318935,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":214,"apply.run_cpu_time_us":6270,"apply.run_wall_time_us":11187,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16768,"num_ops":4,"prepare.queue_time_us":300,"prepare.run_cpu_time_us":2627,"prepare.run_wall_time_us":2628,"replication_time_us":2268}]]}
I20260709 13:16:34.789312  6325 consensus_queue.cc:237] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:34.813603  6937 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:34.817907 12282 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:34.829285  6147 catalog_manager.cc:5697] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 11 to 12, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 12 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:34.839068  6404 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:34.844429  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bc84db94ed44cf9bab11e4626d2ba6e with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:53902
I20260709 13:16:34.865381  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet 4bc84db94ed44cf9bab11e4626d2ba6e (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:16:34.868050  6404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:16:34.868762  6404 raft_consensus.cc:606] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:34.870384 12287 log.cc:927] Time spent T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:16:34.871601  6404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:16:34.872445  6404 raft_consensus.cc:606] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Received request to transfer leadership to TS 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:34.877182 11377 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:16:34.881286 11939 raft_consensus.cc:993] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:34.881887 12274 raft_consensus.cc:1081] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:34.882366  6405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:16:34.882930  6405 raft_consensus.cc:606] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Received request to transfer leadership to TS 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:34.885501  6405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:16:34.885991  6405 raft_consensus.cc:606] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:34.887233  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:34.888855  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:34.890441  6330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57226
I20260709 13:16:34.891091  6330 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:34.891459  6330 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:34.919214  6330 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:34.921097  6330 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:16:34.922147  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:34.946564  6247 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:34.921895  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:34.950241  6405 raft_consensus.cc:3055] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:34.950551  6405 raft_consensus.cc:740] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:34.951326  6405 consensus_queue.cc:260] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:34.952704  6405 raft_consensus.cc:3060] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:34.925328  6151 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55326 (request call id 379) took 4570 ms. Trace:
I20260709 13:16:34.934165 12143 raft_consensus.cc:2955] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 7 to 11, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:34.969198  6249 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:34.970750 12272 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:34.971731  6405 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:34.935606  6937 raft_consensus.cc:2955] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 7 to 11, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:34.957674  6151 rpcz_store.cc:276] 0709 13:16:30.354724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.354896 (+   172us) service_pool.cc:224] Handling call
0709 13:16:34.925253 (+4570357us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:34.665579 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:34.666141 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:34.666176 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:16:34.666198 (+    22us) tablet.cc:662] Decoding operations
0709 13:16:34.667161 (+   963us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:34.667220 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:34.667248 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:16:34.668002 (+   754us) tablet.cc:701] Row locks acquired
0709 13:16:34.668027 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:16:34.668199 (+   172us) write_op.cc:270] Start()
0709 13:16:34.668319 (+   120us) write_op.cc:276] Timestamp: P: 1783602994668150 usec, L: 0
0709 13:16:34.668341 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:34.668961 (+   620us) log.cc:844] Serialized 3608 byte log entry
0709 13:16:34.671186 (+  2225us) op_driver.cc:464] REPLICATION: finished
0709 13:16:34.671518 (+   332us) write_op.cc:301] APPLY: starting
0709 13:16:34.671599 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:34.676713 (+  5114us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:34.676825 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:34.718580 (+ 41755us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:34.718774 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:16:34.718835 (+    61us) write_op.cc:312] APPLY: finished
0709 13:16:34.719044 (+   209us) log.cc:844] Serialized 89 byte log entry
0709 13:16:34.719229 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:34.719368 (+   139us) write_op.cc:454] Released schema lock
0709 13:16:34.723722 (+  4354us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:34.724066 (+   344us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:34.724104 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":48,"spinlock_wait_cycles":11008,"child_traces":[["op",{"apply.queue_time_us":116,"apply.run_cpu_time_us":12261,"apply.run_wall_time_us":52497,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37728,"num_ops":9,"prepare.queue_time_us":97,"prepare.run_cpu_time_us":3671,"prepare.run_wall_time_us":3672,"replication_time_us":2696}]]}
I20260709 13:16:34.985201  6399 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:34.986572 12272 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:34.975803  6247 raft_consensus.cc:2468] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:34.997578  6296 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:34.998394 11377 raft_consensus.cc:2804] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:34.998852 11377 raft_consensus.cc:697] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:34.999706 11377 consensus_queue.cc:237] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:34.999465  6146 catalog_manager.cc:5697] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:35.026230  6404 raft_consensus.cc:2955] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 7 to 11, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:35.045775  6325 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:35.046108  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f3c8c870200141efa8a5f7cc58ece4a6 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:35.048343 12244 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:35.049612  6146 catalog_manager.cc:5697] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 8 to 10, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 10 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:35.057116 11939 raft_consensus.cc:993] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:16:35.057688 11939 raft_consensus.cc:1081] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Signalling peer 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:16:35.060840  6937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:58276
I20260709 13:16:35.063023  6937 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:35.063906  6937 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:35.073259  6937 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:35.091687  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:35.092273  6330 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:35.093247  6937 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:35.096349  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:35.097049  6404 raft_consensus.cc:3055] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:35.097437  6404 raft_consensus.cc:740] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:35.105849 11939 raft_consensus.cc:993] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:16:35.106457 11939 raft_consensus.cc:1081] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Signalling peer 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:16:35.113435  6330 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 16.
I20260709 13:16:35.101277  6404 consensus_queue.cc:260] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:35.120707 11939 raft_consensus.cc:993] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:35.121189 11939 raft_consensus.cc:1081] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:35.122838  6937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:58276
I20260709 13:16:35.123402  6937 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:35.123741  6937 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.125397  6322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57226
I20260709 13:16:35.125960  6322 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:35.126271  6322 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:35.137912  6322 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:35.140043  6322 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:35.146173  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 58151.8us
I20260709 13:16:35.148195  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:35.148785  6249 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:35.152264  6147 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55342 (request call id 352) took 4796 ms. Trace:
I20260709 13:16:35.147498  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:35.154889  6399 raft_consensus.cc:3055] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:35.154667  6937 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:35.155179  6399 raft_consensus.cc:740] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:35.161574  6399 consensus_queue.cc:260] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:35.162781  6399 raft_consensus.cc:3060] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:35.167594  6937 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:35.170306  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:35.170888  6405 raft_consensus.cc:3055] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:35.171085  6405 raft_consensus.cc:740] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:35.176996  6405 consensus_queue.cc:260] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:35.178380  6405 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.196285  6404 raft_consensus.cc:3060] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:35.201643  6905 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:35.203171  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:35.203737  6325 raft_consensus.cc:3060] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.204697 12272 raft_consensus.cc:2804] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:35.205227 12272 raft_consensus.cc:697] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 16 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:35.208431  6399 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:35.214111 12272 consensus_queue.cc:237] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:35.215946  6325 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:35.216869  6296 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:35.220470  6905 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:35.230674  6405 raft_consensus.cc:2468] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:35.234347 12266 raft_consensus.cc:2804] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:35.152704  6147 rpcz_store.cc:276] 0709 13:16:30.355945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.357282 (+  1337us) service_pool.cc:224] Handling call
0709 13:16:35.152205 (+4794923us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:34.902146 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:34.902677 (+   531us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:34.902707 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:16:34.902753 (+    46us) tablet.cc:662] Decoding operations
0709 13:16:34.903699 (+   946us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:34.904501 (+   802us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:34.904759 (+   258us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:34.906187 (+  1428us) tablet.cc:701] Row locks acquired
0709 13:16:34.906583 (+   396us) write_op.cc:260] PREPARE: finished
0709 13:16:34.907131 (+   548us) write_op.cc:270] Start()
0709 13:16:34.907262 (+   131us) write_op.cc:276] Timestamp: P: 1783602994907093 usec, L: 0
0709 13:16:34.907284 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:34.907824 (+   540us) log.cc:844] Serialized 530 byte log entry
0709 13:16:34.909533 (+  1709us) op_driver.cc:464] REPLICATION: finished
0709 13:16:34.909996 (+   463us) write_op.cc:301] APPLY: starting
0709 13:16:34.910073 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:34.910934 (+   861us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:34.911033 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:34.911743 (+   710us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:34.911910 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:16:34.911956 (+    46us) write_op.cc:312] APPLY: finished
0709 13:16:34.912132 (+   176us) log.cc:844] Serialized 25 byte log entry
0709 13:16:34.912389 (+   257us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:34.912477 (+    88us) write_op.cc:454] Released schema lock
0709 13:16:34.912515 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:34.912903 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:34.912944 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9521,"reported_tablets":48,"spinlock_wait_cycles":23168,"child_traces":[["op",{"apply.queue_time_us":255,"apply.run_cpu_time_us":2856,"apply.run_wall_time_us":2856,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4192,"num_ops":1,"prepare.queue_time_us":998,"prepare.run_cpu_time_us":2458,"prepare.run_wall_time_us":5947,"replication_time_us":2118}]]}
I20260709 13:16:35.239437  6404 raft_consensus.cc:2468] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 16.
I20260709 13:16:35.247664 12297 raft_consensus.cc:2804] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:35.248498 12297 raft_consensus.cc:697] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:35.249570 12297 consensus_queue.cc:237] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:35.252137  6151 catalog_manager.cc:5697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 15 to 18, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 18 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:16:35.367712  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 69617.5us
W20260709 13:16:35.372957  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 61526.9us
I20260709 13:16:35.369925 12266 raft_consensus.cc:697] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:35.383962 12266 consensus_queue.cc:237] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:35.438477  6249 raft_consensus.cc:2468] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
W20260709 13:16:35.504594  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 129026us
I20260709 13:16:35.518275  6146 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49212 (request call id 206) took 3047 ms. Trace:
I20260709 13:16:35.519037  6146 rpcz_store.cc:276] 0709 13:16:32.471045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.471456 (+   411us) service_pool.cc:224] Handling call
0709 13:16:32.595386 (+123930us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b54002c15d4. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4f090 00007f4575bedf3a 00007f457b9a41cc 00007f457baa237e 00007f4579f632a4 00007f4579f63232 00007f4579f63161 00007f4579f630dc 00007f4579f62392 00007f4573f2048c 00007f4573f1f8c6
0709 13:16:35.518150 (+2922764us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:35.109695 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:35.110296 (+   601us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:35.110342 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:16:35.110367 (+    25us) tablet.cc:662] Decoding operations
0709 13:16:35.117651 (+  7284us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:35.117705 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:35.117730 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:16:35.118067 (+   337us) tablet.cc:701] Row locks acquired
0709 13:16:35.118106 (+    39us) write_op.cc:260] PREPARE: finished
0709 13:16:35.118237 (+   131us) write_op.cc:270] Start()
0709 13:16:35.118352 (+   115us) write_op.cc:276] Timestamp: P: 1783602995118194 usec, L: 0
0709 13:16:35.118399 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:16:35.119774 (+  1375us) log.cc:844] Serialized 907 byte log entry
0709 13:16:35.121489 (+  1715us) op_driver.cc:464] REPLICATION: finished
0709 13:16:35.121903 (+   414us) write_op.cc:301] APPLY: starting
0709 13:16:35.122000 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:35.123246 (+  1246us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:35.123333 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:35.124485 (+  1152us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:35.124633 (+   148us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:16:35.124673 (+    40us) write_op.cc:312] APPLY: finished
0709 13:16:35.124864 (+   191us) log.cc:844] Serialized 33 byte log entry
0709 13:16:35.125014 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:35.125090 (+    76us) write_op.cc:454] Released schema lock
0709 13:16:35.129176 (+  4086us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:35.132087 (+  2911us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:35.132118 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":73726,"reported_tablets":38,"spinlock_wait_cycles":31199616,"child_traces":[["op",{"apply.queue_time_us":206,"apply.run_cpu_time_us":3584,"apply.run_wall_time_us":9015,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8384,"num_ops":2,"prepare.queue_time_us":879,"prepare.run_cpu_time_us":3057,"prepare.run_wall_time_us":10368,"replication_time_us":2968}]]}
I20260709 13:16:35.560511  6249 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:35.565033 12310 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:35.580629  6405 raft_consensus.cc:1275] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:35.613500 12306 consensus_queue.cc:1048] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:35.614961  6330 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:35.648645 12313 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:16:35.674415  6404 raft_consensus.cc:1275] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:35.680704 12307 consensus_queue.cc:1048] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:16:35.698117  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 233829us
I20260709 13:16:35.697289  6148 catalog_manager.cc:5697] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 12 to 16, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 16 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:35.719910  6404 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:35.721567 12308 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:35.747932  6323 raft_consensus.cc:1275] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:35.754307 12308 consensus_queue.cc:1048] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:35.813942  6151 catalog_manager.cc:5697] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 7 to 11, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 13 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:35.837659  6146 catalog_manager.cc:5697] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 15 to 16, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 16 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:35.839344  6146 catalog_manager.cc:5697] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 12 to 13, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 13 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:35.840231  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet f3c8c870200141efa8a5f7cc58ece4a6 with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:53902
I20260709 13:16:35.894832  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:35.900291 12329 tablet_replica.cc:333] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:35.906914  6147 catalog_manager.cc:5697] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 12 to 13, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 13 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:35.919195  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 63254.9us
I20260709 13:16:35.925869  6396 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:35.928933 12310 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:35.945288  6147 catalog_manager.cc:5697] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 13 to 14, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 14 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:35.975289 12329 raft_consensus.cc:2243] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:35.976375 12329 raft_consensus.cc:2272] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:35.979948 12329 ts_tablet_manager.cc:1916] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:35.996066  6255 raft_consensus.cc:1275] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:36.002964 12319 consensus_queue.cc:1048] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:36.068008 12329 ts_tablet_manager.cc:1929] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:16:36.068542 12329 log.cc:1199] T f3c8c870200141efa8a5f7cc58ece4a6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/f3c8c870200141efa8a5f7cc58ece4a6
I20260709 13:16:36.082234  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet f3c8c870200141efa8a5f7cc58ece4a6 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:16:37.044355  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:37.286957  6322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:57884
I20260709 13:16:37.287570  6322 raft_consensus.cc:606] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:37.311403  6322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:57884
I20260709 13:16:37.312072  6322 raft_consensus.cc:606] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Received request to transfer leadership to TS 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:37.323686  6322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:57884
I20260709 13:16:37.324301  6322 raft_consensus.cc:606] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:37.325601  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:37.327340  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:37.487540 12293 raft_consensus.cc:993] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:16:37.488142 12293 raft_consensus.cc:1081] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:16:37.491190  6255 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50006
I20260709 13:16:37.491765  6255 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.492146  6255 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:37.500058  6255 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:37.513839 12333 raft_consensus.cc:993] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:16:37.514402 12333 raft_consensus.cc:1081] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:16:37.515892  6396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36172
I20260709 13:16:37.516410  6396 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.516736  6396 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:37.521914  6255 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:37.525182  6396 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:37.528904  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:37.529588  6322 raft_consensus.cc:3055] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:37.529901  6322 raft_consensus.cc:740] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:37.530642  6322 consensus_queue.cc:260] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:37.531908  6322 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:37.534334  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:37.534884  6937 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:37.553468  6937 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:37.554785  6222 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:37.555676 12312 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:37.556203 12312 raft_consensus.cc:697] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:37.557117 12312 consensus_queue.cc:237] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:37.562207  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:37.562764  6255 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:37.567896  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:37.568607  6325 raft_consensus.cc:3055] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:37.568924  6325 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:37.569687  6325 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:37.570709  6325 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:37.572667  6255 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 17.
I20260709 13:16:37.573918  6369 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:37.574668 12332 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:37.575178 12332 raft_consensus.cc:697] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:37.576032 12332 consensus_queue.cc:237] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:37.577234  6396 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:37.562726  6322 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:37.590219  6147 catalog_manager.cc:5697] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 10 to 11, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.603801  6325 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 17.
I20260709 13:16:37.663916  6151 catalog_manager.cc:5697] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 16 to 17, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 17 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:37.713842 12333 raft_consensus.cc:993] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:16:37.714372 12143 raft_consensus.cc:1081] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Signalling peer 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:16:37.721985  6940 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:41288
I20260709 13:16:37.722584  6940 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.722965  6940 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:37.874140  6940 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:37.876909  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:37.879273  6322 raft_consensus.cc:3055] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:37.879601  6322 raft_consensus.cc:740] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:37.890632  6322 consensus_queue.cc:260] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:37.891793  6322 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:37.908542  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:37.909492  6404 raft_consensus.cc:3060] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:37.936980  6940 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:38.056175  6941 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:38.075260  6331 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:38.083297 12245 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:38.089165  6247 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:16:38.092147 12245 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:38.100914  6323 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:16:38.114326  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 49367us
I20260709 13:16:38.128734  6404 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:38.136708 12328 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:38.179095  6322 raft_consensus.cc:2468] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:38.183218  6905 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
W20260709 13:16:38.244833  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 69530.5us
I20260709 13:16:38.248195 12320 raft_consensus.cc:2804] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:38.248785 12320 raft_consensus.cc:697] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:38.249322 12328 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:38.249752 12320 consensus_queue.cc:237] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:38.328356  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:38.341640  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 158482us
W20260709 13:16:38.344082  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 98105.4us
W20260709 13:16:38.350476  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 113826us
W20260709 13:16:38.390547  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 216010us
I20260709 13:16:38.472431  6148 catalog_manager.cc:5697] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 12 to 13, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 13 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:38.721609  6322 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:16:38.724009 12349 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:38.759140  6400 raft_consensus.cc:1275] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:16:38.760807 12350 consensus_queue.cc:1048] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:16:39.535019  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:39.749575  6396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:16:39.750975  6396 raft_consensus.cc:606] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:39.755585  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:16:39.757405  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:39.886857 12375 raft_consensus.cc:993] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:39.887431 12375 raft_consensus.cc:1081] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:39.890749  6322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57226
I20260709 13:16:39.891367  6322 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.891722  6322 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:39.963655  6322 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:40.006825  6253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:40.007463  6253 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:40.009087  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:40.009725  6404 raft_consensus.cc:3055] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:40.010001  6404 raft_consensus.cc:740] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:40.010736  6404 consensus_queue.cc:260] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:40.011826  6404 raft_consensus.cc:3060] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:40.016482  6253 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16.
I20260709 13:16:40.020515  6295 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:40.021533 12143 raft_consensus.cc:2804] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:40.021997 12143 raft_consensus.cc:697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:40.022716 12143 consensus_queue.cc:237] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:40.099864  6322 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 16 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:40.076820  6404 raft_consensus.cc:2468] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16.
I20260709 13:16:40.142220  6148 catalog_manager.cc:5697] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 15 to 16, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 16 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:40.415064  6404 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:16:40.417281 12310 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:40.537427  6253 raft_consensus.cc:1275] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:16:40.546969 12381 consensus_queue.cc:1048] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:40.758410  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:41.975204  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:42.095197  6322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:57884
I20260709 13:16:42.095898  6322 raft_consensus.cc:606] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:42.103231  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:16:42.105173  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:42.162904  6940 consensus_queue.cc:237] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:42.226220  6404 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:16:42.227380  6253 raft_consensus.cc:1275] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:16:42.227646 12320 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:42.228895 12350 consensus_queue.cc:1048] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:42.259472 12320 raft_consensus.cc:2955] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 5 to 14, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:42.261240  6253 raft_consensus.cc:2955] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 5 to 14, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:42.291910  6404 raft_consensus.cc:2955] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 5 to 14, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:42.301569  6141 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 19435892007a4e0a9b2b4d0b26ccd0c0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:16:42.316414  6148 catalog_manager.cc:5697] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 5 to 14, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New cstate: current_term: 18 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:42.430951  6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 19435892007a4e0a9b2b4d0b26ccd0c0 with delete_type TABLET_DATA_TOMBSTONED (TS a13ffe92eb374309a5c8476d9fbbb2b8 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:44786
I20260709 13:16:42.459860 12399 tablet_replica.cc:333] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:16:42.462297 12399 raft_consensus.cc:2243] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.477536 12399 raft_consensus.cc:2272] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.482851 12399 ts_tablet_manager.cc:1916] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:42.528018 12293 raft_consensus.cc:993] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:16:42.528573 12293 raft_consensus.cc:1081] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:16:42.534013  6404 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36172
I20260709 13:16:42.534584  6404 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:42.534925  6404 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:42.545835  6404 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:42.549059  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:42.549727  6322 raft_consensus.cc:3055] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:42.550036  6322 raft_consensus.cc:740] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:42.550823  6322 consensus_queue.cc:260] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:42.552045  6322 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:42.556088  6404 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:42.558751  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:42.559383  6940 raft_consensus.cc:3060] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:42.564098  6322 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:42.566540  6368 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:42.567806 12328 raft_consensus.cc:2804] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:42.568281 12328 raft_consensus.cc:697] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:42.569319 12328 consensus_queue.cc:237] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:42.569967 12399 ts_tablet_manager.cc:1929] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 13:16:42.608728 12399 log.cc:1199] T 19435892007a4e0a9b2b4d0b26ccd0c0 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/wals/19435892007a4e0a9b2b4d0b26ccd0c0
I20260709 13:16:42.567060  6940 raft_consensus.cc:2468] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:16:42.707430  6138 catalog_manager.cc:5028] TS a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): tablet 19435892007a4e0a9b2b4d0b26ccd0c0 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
W20260709 13:16:42.718878  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 161369us
I20260709 13:16:42.748004  6147 catalog_manager.cc:5697] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 10 to 11, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 11 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:42.986943  6221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 97558.2us
W20260709 13:16:43.041873  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 91504.8us
I20260709 13:16:43.069496  6322 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:43.071050 12415 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:43.106206  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:43.187834  6937 raft_consensus.cc:1275] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:43.195533 12416 consensus_queue.cc:1048] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:43.650887  6400 consensus_queue.cc:237] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
W20260709 13:16:43.715430  6371 consensus_peers.cc:597] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f4a17642c254c2e869ca48ecd16fce0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:43.716084  6323 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:43.718670  6249 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:43.720366 12416 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:43.722543 12416 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:43.751519  6255 raft_consensus.cc:2955] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:43.743986 12415 raft_consensus.cc:2955] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:43.779237  6147 catalog_manager.cc:5697] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 7, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 9 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:43.787106  6323 raft_consensus.cc:2955] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:43.899680  6327 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
W20260709 13:16:43.937947  6297 consensus_peers.cc:597] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1061e95aa2d446f2aeb9563f482f1cd9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:43.942163  6249 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:43.940888  6396 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:43.943778 12426 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:43.947407 12417 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:43.995217 12417 raft_consensus.cc:2955] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:44.009297  6396 raft_consensus.cc:2955] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:44.051671  6396 consensus_queue.cc:237] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:44.055619  6148 catalog_manager.cc:5697] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index -1 to 12, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 15 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:44.075148  6371 consensus_peers.cc:597] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aba53315de954573854008b23574a90f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:44.082170  6255 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:44.083916 12366 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:44.088294  6322 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:44.091096 12366 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:16:44.093397 12433 log.cc:927] Time spent T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 13:16:44.100975  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 69549.6us
I20260709 13:16:44.119423  6249 raft_consensus.cc:2955] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:44.149453 12407 raft_consensus.cc:2955] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:44.156924  6322 raft_consensus.cc:2955] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:44.185180 12441 ts_tablet_manager.cc:933] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:44.192101  6247 consensus_queue.cc:237] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:44.193248  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:44.192767  6148 catalog_manager.cc:5697] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index -1 to 10, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 13 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.218165  6255 raft_consensus.cc:2955] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
W20260709 13:16:44.226003  6222 consensus_peers.cc:597] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e31ff23bb63c4e33afd90afd6bf5f198. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:44.229341  6404 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:44.231303  6322 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:44.232844 12435 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:44.235371 12410 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:44.292052 12441 tablet_copy_client.cc:323] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.3:34111
I20260709 13:16:44.294281  6414 tablet_copy_service.cc:140] P b940f12ed61a49c4b3c11f13ef50fa92: Received BeginTabletCopySession request for tablet 7f4a17642c254c2e869ca48ecd16fce0 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41486)
I20260709 13:16:44.294899  6414 tablet_copy_service.cc:161] P b940f12ed61a49c4b3c11f13ef50fa92: Beginning new tablet copy session on tablet 7f4a17642c254c2e869ca48ecd16fce0 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41486: session id = 8600a3fead0e48a7aa813822ec44d0fe-7f4a17642c254c2e869ca48ecd16fce0
I20260709 13:16:44.305683 12435 raft_consensus.cc:2955] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:44.307646  6327 raft_consensus.cc:2955] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:44.315690  6396 raft_consensus.cc:2955] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:44.336349  6400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:16:44.336956  6400 raft_consensus.cc:606] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 LEADER]: Received request to transfer leadership to TS a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:44.342834  6414 tablet_copy_source_session.cc:215] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:44.343909  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:16:44.347529  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:44.366887 12441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4a17642c254c2e869ca48ecd16fce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.377434  6151 catalog_manager.cc:5697] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index -1 to 8, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:44.396178 12446 ts_tablet_manager.cc:933] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:44.442538 12446 tablet_copy_client.cc:323] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.2:39965
I20260709 13:16:44.444449  6341 tablet_copy_service.cc:140] P a13ffe92eb374309a5c8476d9fbbb2b8: Received BeginTabletCopySession request for tablet 1061e95aa2d446f2aeb9563f482f1cd9 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41502)
I20260709 13:16:44.445006  6341 tablet_copy_service.cc:161] P a13ffe92eb374309a5c8476d9fbbb2b8: Beginning new tablet copy session on tablet 1061e95aa2d446f2aeb9563f482f1cd9 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41502: session id = 8600a3fead0e48a7aa813822ec44d0fe-1061e95aa2d446f2aeb9563f482f1cd9
I20260709 13:16:44.454742  6341 tablet_copy_source_session.cc:215] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:44.458554 12416 raft_consensus.cc:993] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:44.459098 12415 raft_consensus.cc:1081] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:44.460716  6322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57226
I20260709 13:16:44.461261  6322 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:44.461583  6322 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:44.464008 12446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1061e95aa2d446f2aeb9563f482f1cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.469276  6322 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:44.472285  6255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:44.472846  6255 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:44.473886  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:44.474457  6404 raft_consensus.cc:3055] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:44.474730  6404 raft_consensus.cc:740] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:44.475455  6404 consensus_queue.cc:260] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:44.476459  6404 raft_consensus.cc:3060] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:44.482522  6255 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 18.
I20260709 13:16:44.483788  6295 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:44.489557 12389 raft_consensus.cc:2804] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:44.490068 12389 raft_consensus.cc:697] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:44.490841 12389 consensus_queue.cc:237] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:44.501515 12446 tablet_copy_client.cc:806] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:44.502173 12441 tablet_copy_client.cc:806] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:44.502254 12446 tablet_copy_client.cc:670] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:44.502964 12441 tablet_copy_client.cc:670] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:44.506748 12446 tablet_copy_client.cc:538] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:44.513284 12441 tablet_copy_client.cc:538] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:44.514755  6404 raft_consensus.cc:2468] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 18.
I20260709 13:16:44.516211 12446 tablet_bootstrap.cc:492] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:16:44.563817  6322 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 18 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:44.636031 12441 tablet_bootstrap.cc:492] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:16:44.763312 12455 ts_tablet_manager.cc:933] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:16:44.762771  6147 catalog_manager.cc:5697] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 17 to 18, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 18 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.858099 12455 tablet_copy_client.cc:323] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.1:43495
W20260709 13:16:44.857195  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 47353.7us
W20260709 13:16:44.873492  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 65859us
I20260709 13:16:44.882714  6265 tablet_copy_service.cc:140] P 2d6410349fdc47f5a98ba3c6f7d5510b: Received BeginTabletCopySession request for tablet e31ff23bb63c4e33afd90afd6bf5f198 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:38692)
I20260709 13:16:44.883694  6265 tablet_copy_service.cc:161] P 2d6410349fdc47f5a98ba3c6f7d5510b: Beginning new tablet copy session on tablet e31ff23bb63c4e33afd90afd6bf5f198 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:38692: session id = 8600a3fead0e48a7aa813822ec44d0fe-e31ff23bb63c4e33afd90afd6bf5f198
I20260709 13:16:44.884829 12456 ts_tablet_manager.cc:933] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:44.906442  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 126695us
I20260709 13:16:44.953795  6265 tablet_copy_source_session.cc:215] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:44.988205 12455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31ff23bb63c4e33afd90afd6bf5f198. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:45.031352  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 44424.2us
I20260709 13:16:45.057499 12456 tablet_copy_client.cc:323] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.3:34111
I20260709 13:16:45.060335  6414 tablet_copy_service.cc:140] P b940f12ed61a49c4b3c11f13ef50fa92: Received BeginTabletCopySession request for tablet aba53315de954573854008b23574a90f from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41486)
I20260709 13:16:45.060946  6414 tablet_copy_service.cc:161] P b940f12ed61a49c4b3c11f13ef50fa92: Beginning new tablet copy session on tablet aba53315de954573854008b23574a90f from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41486: session id = 8600a3fead0e48a7aa813822ec44d0fe-aba53315de954573854008b23574a90f
I20260709 13:16:45.070969  6414 tablet_copy_source_session.cc:215] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:45.086098 12456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba53315de954573854008b23574a90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.120323 12446 tablet_bootstrap.cc:492] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:16:45.121973  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 174432us
I20260709 13:16:45.168495  6404 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:16:45.143759  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 195915us
I20260709 13:16:45.157212 12455 tablet_copy_client.cc:806] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:45.176142 12455 tablet_copy_client.cc:670] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:45.178352 12446 tablet_bootstrap.cc:492] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:16:45.180208 12446 ts_tablet_manager.cc:1403] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.664s	user 0.064s	sys 0.040s
I20260709 13:16:45.189208  6247 raft_consensus.cc:1275] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:45.197652 12455 tablet_copy_client.cc:538] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:45.200338 12446 raft_consensus.cc:359] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:45.219941 12389 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:45.222553 12446 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:16:45.224807 12446 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:45.238459 12389 consensus_queue.cc:1048] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:45.272886 12455 tablet_bootstrap.cc:492] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:16:45.273905 12446 ts_tablet_manager.cc:1434] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.000s
I20260709 13:16:45.277223 12456 tablet_copy_client.cc:806] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:45.277889 12456 tablet_copy_client.cc:670] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:45.292323 12456 tablet_copy_client.cc:538] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:45.299767 12441 tablet_bootstrap.cc:492] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:45.312445 12441 tablet_bootstrap.cc:492] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:16:45.306015  6341 tablet_copy_service.cc:342] P a13ffe92eb374309a5c8476d9fbbb2b8: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-1061e95aa2d446f2aeb9563f482f1cd9 received from {username='slave'} at 127.0.0.1:41502
I20260709 13:16:45.318917  6341 tablet_copy_service.cc:434] P a13ffe92eb374309a5c8476d9fbbb2b8: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-1061e95aa2d446f2aeb9563f482f1cd9 on tablet 1061e95aa2d446f2aeb9563f482f1cd9 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:45.345497 12456 tablet_bootstrap.cc:492] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:16:45.340698 12441 ts_tablet_manager.cc:1403] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.706s	user 0.029s	sys 0.018s
I20260709 13:16:45.348745  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:45.357367 12441 raft_consensus.cc:359] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:45.372304 12441 raft_consensus.cc:740] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:16:45.418295  6937 raft_consensus.cc:1217] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 LEARNER]: Deduplicated request from leader. Original: 15.11->[15.12-15.12]   Dedup: 15.12->[]
I20260709 13:16:45.423079 12441 consensus_queue.cc:260] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:45.445092 12441 ts_tablet_manager.cc:1434] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.000s
I20260709 13:16:45.454514  6414 tablet_copy_service.cc:342] P b940f12ed61a49c4b3c11f13ef50fa92: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-7f4a17642c254c2e869ca48ecd16fce0 received from {username='slave'} at 127.0.0.1:41486
I20260709 13:16:45.455546  6414 tablet_copy_service.cc:434] P b940f12ed61a49c4b3c11f13ef50fa92: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-7f4a17642c254c2e869ca48ecd16fce0 on tablet 7f4a17642c254c2e869ca48ecd16fce0 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:45.600725 12455 tablet_bootstrap.cc:492] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:45.601728 12455 tablet_bootstrap.cc:492] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:16:45.602481 12455 ts_tablet_manager.cc:1403] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.330s	user 0.040s	sys 0.010s
I20260709 13:16:45.642714 12455 raft_consensus.cc:359] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:45.658022 12455 raft_consensus.cc:740] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:16:45.658885 12455 consensus_queue.cc:260] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:45.663722 12455 ts_tablet_manager.cc:1434] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.061s	user 0.004s	sys 0.002s
I20260709 13:16:45.680637  6265 tablet_copy_service.cc:342] P 2d6410349fdc47f5a98ba3c6f7d5510b: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-e31ff23bb63c4e33afd90afd6bf5f198 received from {username='slave'} at 127.0.0.1:38692
I20260709 13:16:45.681087  6265 tablet_copy_service.cc:434] P 2d6410349fdc47f5a98ba3c6f7d5510b: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-e31ff23bb63c4e33afd90afd6bf5f198 on tablet e31ff23bb63c4e33afd90afd6bf5f198 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:45.686663 12456 tablet_bootstrap.cc:492] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:45.687678 12456 tablet_bootstrap.cc:492] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:16:45.690092 12456 ts_tablet_manager.cc:1403] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.343s	user 0.028s	sys 0.017s
I20260709 13:16:45.707710 12456 raft_consensus.cc:359] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:45.718621 12456 raft_consensus.cc:740] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:16:45.720335 12456 consensus_queue.cc:260] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:45.735128 12456 ts_tablet_manager.cc:1434] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.038s	user 0.002s	sys 0.005s
I20260709 13:16:45.746377  6414 tablet_copy_service.cc:342] P b940f12ed61a49c4b3c11f13ef50fa92: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-aba53315de954573854008b23574a90f received from {username='slave'} at 127.0.0.1:41486
I20260709 13:16:45.746865  6414 tablet_copy_service.cc:434] P b940f12ed61a49c4b3c11f13ef50fa92: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-aba53315de954573854008b23574a90f on tablet aba53315de954573854008b23574a90f with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:45.816169 12468 raft_consensus.cc:1064] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:16:45.819289 12468 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:45.952762  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 62325.5us
I20260709 13:16:45.966344  6400 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:45.969213  6941 raft_consensus.cc:1217] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 13:16:45.992492  6937 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:46.000082 12479 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:16:46.030181  6937 raft_consensus.cc:1217] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
W20260709 13:16:46.050482  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 46812.7us
I20260709 13:16:46.050390 12487 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
W20260709 13:16:46.099085  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 67519.3us
W20260709 13:16:46.106559  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 59046.6us
I20260709 13:16:46.109853  6937 raft_consensus.cc:1217] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
W20260709 13:16:46.131983  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 83002.3us
I20260709 13:16:46.219024  6255 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:16:46.313539  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 90551.2us
I20260709 13:16:46.328212 12479 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:16:46.343456  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 60927.7us
I20260709 13:16:46.409718 12485 raft_consensus.cc:1064] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:16:46.412602 12485 consensus_queue.cc:237] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:46.424733 12490 raft_consensus.cc:2955] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.462759  6249 raft_consensus.cc:2955] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:16:46.473433  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 52563.6us
I20260709 13:16:46.447592  6935 raft_consensus.cc:2955] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.488291  6405 raft_consensus.cc:2955] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.499681  6937 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 LEARNER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:46.501344 12366 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:46.511243 12460 raft_consensus.cc:1064] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:16:46.514333 12460 consensus_queue.cc:237] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:46.522429  6253 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:46.531929  6151 catalog_manager.cc:5697] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 12 to 13, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.541605  6937 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEARNER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:46.543334 12495 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:46.543537 12366 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:46.550311  6323 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:46.565809 12460 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:46.586030  6327 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:46.589331  6404 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:46.601958 12460 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:16:46.612042 12495 raft_consensus.cc:2955] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.614688  6939 raft_consensus.cc:2955] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.630993 12485 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:46.652745 12499 raft_consensus.cc:2955] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.667868 12482 raft_consensus.cc:1064] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:16:46.670806 12482 consensus_queue.cc:237] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:46.682927  6941 raft_consensus.cc:2955] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.685774  6323 raft_consensus.cc:2955] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.709511  6404 raft_consensus.cc:2955] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.741905  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:46.758749  6327 raft_consensus.cc:2955] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.768390  6249 raft_consensus.cc:2955] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.810052  6253 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:46.811969  6939 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEARNER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:46.814054 12485 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:46.817111 12485 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:46.823520  6327 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:46.831046 12485 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:16:46.875078  6323 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:46.890543  6148 catalog_manager.cc:5697] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 8 to 9, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.892339  6148 catalog_manager.cc:5697] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 7 to 8, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.905436 12493 raft_consensus.cc:2955] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.906909  6939 raft_consensus.cc:2955] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.931967  6941 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:16:46.933758 12491 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:46.935215  6249 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:16:46.937562 12491 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:46.943931 12487 raft_consensus.cc:2955] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.945880  6253 consensus_queue.cc:237] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:46.959443  6248 raft_consensus.cc:2955] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.964398  6404 consensus_queue.cc:237] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:46.965512  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1061e95aa2d446f2aeb9563f482f1cd9 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:46.968532  6941 raft_consensus.cc:2955] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.961535  6247 raft_consensus.cc:2955] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:46.981171  6935 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:46.989835  6935 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:46.993760  6253 raft_consensus.cc:1275] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:46.994521  6327 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:46.983215 12493 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:46.993006 12495 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:16:47.034866  6146 catalog_manager.cc:5697] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 13 to 14, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New cstate: current_term: 15 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.037806  6327 raft_consensus.cc:2955] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:47.068737 12483 consensus_queue.cc:1048] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:16:47.068456 12462 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:16:47.090397  6391 tablet_service.cc:1558] Processing DeleteTablet for tablet 1061e95aa2d446f2aeb9563f482f1cd9 with delete_type TABLET_DATA_TOMBSTONED (TS b940f12ed61a49c4b3c11f13ef50fa92 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:36156
I20260709 13:16:47.089892  6151 catalog_manager.cc:5697] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 10 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.107149 12485 raft_consensus.cc:2955] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:47.122797 12495 raft_consensus.cc:2955] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:47.125821  6937 raft_consensus.cc:2955] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
W20260709 13:16:47.130576  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 69102.1us
I20260709 13:16:47.129820  6247 raft_consensus.cc:2955] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:47.151027  6941 raft_consensus.cc:2955] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:47.181896  6404 consensus_queue.cc:237] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:47.217465  6139 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e31ff23bb63c4e33afd90afd6bf5f198 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:47.222158  6935 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:47.235059  6247 raft_consensus.cc:1275] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:47.246078  6326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:57884
I20260709 13:16:47.247267  6326 raft_consensus.cc:606] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 LEADER]: Received request to transfer leadership to TS b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:47.248401 12527 tablet_replica.cc:333] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:16:47.249634 12527 raft_consensus.cc:2243] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.229557 12482 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:16:47.253820 12366 consensus_queue.cc:1048] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:47.254037  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:16:47.265516  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:47.265692 12527 raft_consensus.cc:2272] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.289507 12527 ts_tablet_manager.cc:1916] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:47.289963  6146 catalog_manager.cc:5697] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: config changed from index 8 to 9, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New cstate: current_term: 9 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.289963  6147 catalog_manager.cc:5697] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index 9 to 10, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:47.306943  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 102394us
I20260709 13:16:47.317487  6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f4a17642c254c2e869ca48ecd16fce0 with delete_type TABLET_DATA_TOMBSTONED (TS a13ffe92eb374309a5c8476d9fbbb2b8 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:44786
I20260709 13:16:47.317371 12482 raft_consensus.cc:2955] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:47.320618  6941 raft_consensus.cc:2955] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:47.345005 12524 raft_consensus.cc:993] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:16:47.345566 12524 raft_consensus.cc:1081] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 LEADER]: Signalling peer b940f12ed61a49c4b3c11f13ef50fa92 to start an election
I20260709 13:16:47.347152  6400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
 from {username='slave'} at 127.0.0.1:36172
I20260709 13:16:47.347734  6400 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:47.348062  6400 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:47.357249  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 119423us
W20260709 13:16:47.366492  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 130079us
I20260709 13:16:47.368422  6400 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:47.370265 12538 tablet_replica.cc:333] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:16:47.371663 12538 raft_consensus.cc:2243] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.371865  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:47.372505  6935 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:47.372836 12538 raft_consensus.cc:2272] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.373456  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:47.374012  6326 raft_consensus.cc:3055] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:47.374311  6326 raft_consensus.cc:740] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:47.375916  6400 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:47.377907  6323 raft_consensus.cc:2955] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:47.393563  6326 consensus_queue.cc:260] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:47.395001  6326 raft_consensus.cc:3060] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:47.397167  6140 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7f4a17642c254c2e869ca48ecd16fce0 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:47.403228  6326 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 18.
I20260709 13:16:47.404661  6368 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:47.405570 12485 raft_consensus.cc:2804] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:47.406056 12485 raft_consensus.cc:697] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:47.412699 12485 consensus_queue.cc:237] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:47.408607  6253 raft_consensus.cc:2955] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:47.437428  6935 raft_consensus.cc:2468] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 18.
I20260709 13:16:47.455363  6391 tablet_service.cc:1558] Processing DeleteTablet for tablet e31ff23bb63c4e33afd90afd6bf5f198 with delete_type TABLET_DATA_TOMBSTONED (TS b940f12ed61a49c4b3c11f13ef50fa92 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:36156
I20260709 13:16:47.456583  6140 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aba53315de954573854008b23574a90f with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:47.475420 12538 ts_tablet_manager.cc:1916] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:47.480449 12527 ts_tablet_manager.cc:1929] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.13
I20260709 13:16:47.481005 12527 log.cc:1199] T 1061e95aa2d446f2aeb9563f482f1cd9 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/wals/1061e95aa2d446f2aeb9563f482f1cd9
I20260709 13:16:47.514788  6151 catalog_manager.cc:5697] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 11 to 12, VOTER a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) evicted. New cstate: current_term: 13 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:47.515398  6140 catalog_manager.cc:5028] TS b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): tablet 1061e95aa2d446f2aeb9563f482f1cd9 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:16:47.517092 12527 tablet_replica.cc:333] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:16:47.537891 12527 raft_consensus.cc:2243] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.538795 12527 raft_consensus.cc:2272] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.532202  6146 catalog_manager.cc:5697] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 17 to 18, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 18 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.545897  6317 tablet_service.cc:1558] Processing DeleteTablet for tablet aba53315de954573854008b23574a90f with delete_type TABLET_DATA_TOMBSTONED (TS a13ffe92eb374309a5c8476d9fbbb2b8 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:44786
I20260709 13:16:47.564518 12527 ts_tablet_manager.cc:1916] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:47.639613 12527 ts_tablet_manager.cc:1929] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 13:16:47.640136 12527 log.cc:1199] T e31ff23bb63c4e33afd90afd6bf5f198 P b940f12ed61a49c4b3c11f13ef50fa92: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/wals/e31ff23bb63c4e33afd90afd6bf5f198
I20260709 13:16:47.641937  6140 catalog_manager.cc:5028] TS b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): tablet e31ff23bb63c4e33afd90afd6bf5f198 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:16:47.641748 12538 ts_tablet_manager.cc:1929] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 13:16:47.643157 12538 log.cc:1199] T 7f4a17642c254c2e869ca48ecd16fce0 P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/wals/7f4a17642c254c2e869ca48ecd16fce0
I20260709 13:16:47.644872  6138 catalog_manager.cc:5028] TS a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): tablet 7f4a17642c254c2e869ca48ecd16fce0 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:16:47.645344 12538 tablet_replica.cc:333] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:16:47.668896 12538 raft_consensus.cc:2243] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.672372 12538 raft_consensus.cc:2272] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.676386 12538 ts_tablet_manager.cc:1916] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:47.709352 12538 ts_tablet_manager.cc:1929] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:16:47.722219 12538 log.cc:1199] T aba53315de954573854008b23574a90f P a13ffe92eb374309a5c8476d9fbbb2b8: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/wals/aba53315de954573854008b23574a90f
I20260709 13:16:47.723959  6138 catalog_manager.cc:5028] TS a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): tablet aba53315de954573854008b23574a90f (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:16:47.821369  6323 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:16:47.823581 12450 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:47.887964  6935 raft_consensus.cc:1275] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:16:47.889562 12450 consensus_queue.cc:1048] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:16:48.052582  6222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 61787.6us
W20260709 13:16:48.071841  6219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 77645.7us
I20260709 13:16:48.271518  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:48.622146  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 49291.5us
I20260709 13:16:49.110800  6326 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
W20260709 13:16:49.215476  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 56900.5us
I20260709 13:16:49.232599  6400 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:16:49.232946  6297 consensus_peers.cc:597] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7508c25b6d9944dda6f30aac9f238ae6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:49.234102 12549 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:49.238293  6247 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:49.239912 12549 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:49.266772 12529 raft_consensus.cc:2955] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:49.269696  6249 raft_consensus.cc:2955] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:49.293058  6147 catalog_manager.cc:5697] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 10, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 14 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:49.287922  6400 raft_consensus.cc:2955] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:49.314528  6404 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:49.361771  6247 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:49.363819  6326 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:49.364053 12535 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:49.366330 12535 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:16:49.375095  6371 consensus_peers.cc:597] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 50e7a35d701c4730b5efb6fefa7f5ec6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:49.403319 12535 raft_consensus.cc:2955] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:49.410874  6326 raft_consensus.cc:2955] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:49.434600  6247 raft_consensus.cc:2955] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:49.455049  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:49.528270  6146 catalog_manager.cc:5697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: config changed from index -1 to 8, NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) added. New cstate: current_term: 10 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } } }
I20260709 13:16:49.713114  6400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6"
dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
mode: GRACEFUL
new_leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:16:49.713800  6400 raft_consensus.cc:606] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Received request to transfer leadership to TS 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:49.719349  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:16:49.737174  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:49.777117 12563 ts_tablet_manager.cc:933] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:49.778919 12562 ts_tablet_manager.cc:933] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe: Initiating tablet copy from peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:49.833684 12483 raft_consensus.cc:993] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: : Instructing follower 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:16:49.834254 12483 raft_consensus.cc:1081] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Signalling peer 2d6410349fdc47f5a98ba3c6f7d5510b to start an election
I20260709 13:16:49.839419  6249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
 from {username='slave'} at 127.0.0.1:49996
I20260709 13:16:49.840157  6249 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.840576  6249 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:49.855705  6249 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:49.857366 12562 tablet_copy_client.cc:323] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.3:34111
I20260709 13:16:49.859424  6414 tablet_copy_service.cc:140] P b940f12ed61a49c4b3c11f13ef50fa92: Received BeginTabletCopySession request for tablet 50e7a35d701c4730b5efb6fefa7f5ec6 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41486)
I20260709 13:16:49.860116  6414 tablet_copy_service.cc:161] P b940f12ed61a49c4b3c11f13ef50fa92: Beginning new tablet copy session on tablet 50e7a35d701c4730b5efb6fefa7f5ec6 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41486: session id = 8600a3fead0e48a7aa813822ec44d0fe-50e7a35d701c4730b5efb6fefa7f5ec6
I20260709 13:16:49.865710 12563 tablet_copy_client.cc:323] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Beginning tablet copy session from remote peer at address 127.4.254.2:39965
I20260709 13:16:49.867303  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:49.867888  6326 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:49.873848  6341 tablet_copy_service.cc:140] P a13ffe92eb374309a5c8476d9fbbb2b8: Received BeginTabletCopySession request for tablet 7508c25b6d9944dda6f30aac9f238ae6 from peer 8600a3fead0e48a7aa813822ec44d0fe ({username='slave'} at 127.0.0.1:41502)
I20260709 13:16:49.874714  6341 tablet_copy_service.cc:161] P a13ffe92eb374309a5c8476d9fbbb2b8: Beginning new tablet copy session on tablet 7508c25b6d9944dda6f30aac9f238ae6 from peer 8600a3fead0e48a7aa813822ec44d0fe at {username='slave'} at 127.0.0.1:41502: session id = 8600a3fead0e48a7aa813822ec44d0fe-7508c25b6d9944dda6f30aac9f238ae6
I20260709 13:16:49.884878  6414 tablet_copy_source_session.cc:215] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:49.893671  6341 tablet_copy_source_session.cc:215] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:49.894963  6326 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:49.895761  6249 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:49.909934  6329 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Rejecting Update request from peer b940f12ed61a49c4b3c11f13ef50fa92 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:49.910442  6219 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:49.896875  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:49.911375  6400 raft_consensus.cc:3055] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:49.911664  6400 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:49.912389  6400 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:49.913431  6400 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:49.918359 12534 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:49.918951 12534 raft_consensus.cc:697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Leader. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:49.919817 12534 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:49.930452 12562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e7a35d701c4730b5efb6fefa7f5ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.995947  6400 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d6410349fdc47f5a98ba3c6f7d5510b in term 11.
I20260709 13:16:50.023981 12562 tablet_copy_client.cc:806] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:50.044610  6151 catalog_manager.cc:5697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b reported cstate change: term changed from 10 to 11, leader changed from b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3) to 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1). New cstate: current_term: 11 leader_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.039378 12562 tablet_copy_client.cc:670] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
W20260709 13:16:50.067456  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 83035.9us
W20260709 13:16:50.149966  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 61734us
I20260709 13:16:50.155740 12563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7508c25b6d9944dda6f30aac9f238ae6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:50.160604  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 76886.8us
I20260709 13:16:50.221407 12562 tablet_copy_client.cc:538] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:50.234400 12562 tablet_bootstrap.cc:492] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
I20260709 13:16:50.252300  6249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53902
I20260709 13:16:50.274027  6249 raft_consensus.cc:606] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Received request to transfer leadership
I20260709 13:16:50.277987  6249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53902
I20260709 13:16:50.278529  6249 raft_consensus.cc:606] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Received request to transfer leadership
W20260709 13:16:50.280140  6139 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 50e7a35d701c4730b5efb6fefa7f5ec6 already in progress
I20260709 13:16:50.267354 12563 tablet_copy_client.cc:806] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:50.283084 12563 tablet_copy_client.cc:670] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:50.288674 12563 tablet_copy_client.cc:538] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:50.309300  6249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6"
dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53902
I20260709 13:16:50.309983  6249 raft_consensus.cc:606] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Received request to transfer leadership
W20260709 13:16:50.314952  6202 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:16:50.315364  6202 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 50e7a35d701c4730b5efb6fefa7f5ec6 already in progress
W20260709 13:16:50.315665  6202 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 50e7a35d701c4730b5efb6fefa7f5ec6 already in progress
I20260709 13:16:50.351580 12563 tablet_bootstrap.cc:492] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap starting.
W20260709 13:16:50.351958  6222 consensus_peers.cc:597] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b -> Peer 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105): Couldn't send request to peer 8600a3fead0e48a7aa813822ec44d0fe. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:50.360776  6329 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:50.362352 12574 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:50.387620 12567 raft_consensus.cc:993] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: : Instructing follower a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:50.388188 12567 raft_consensus.cc:1081] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Signalling peer a13ffe92eb374309a5c8476d9fbbb2b8 to start an election
I20260709 13:16:50.391465  6326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
 from {username='slave'} at 127.0.0.1:57230
I20260709 13:16:50.392045  6326 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:50.392406  6326 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:50.400677  6326 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:50.404002  6329 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:50.407245 12567 consensus_queue.cc:1059] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:50.411516  6400 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Refusing update from remote peer 2d6410349fdc47f5a98ba3c6f7d5510b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:50.413969 12567 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:50.414496  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:50.415598  6326 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:50.424652  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:50.425458  6400 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:50.455178  6400 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:50.458556  6249 raft_consensus.cc:3055] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:50.462348  6249 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d6410349fdc47f5a98ba3c6f7d5510b, State: Running, Role: LEADER
I20260709 13:16:50.463207  6249 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:50.464663  6249 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:50.480436  6404 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Rejecting Update request from peer 2d6410349fdc47f5a98ba3c6f7d5510b for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:16:50.511708  6296 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:50.512689 12549 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:50.513238 12549 raft_consensus.cc:697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:50.514271 12549 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:50.539726  6151 catalog_manager.cc:5697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 11 to 12, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 12 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.546351  6249 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
W20260709 13:16:50.583393 12576 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:16:50.590867 12563 tablet_bootstrap.cc:492] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=3 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:50.597924 12563 tablet_bootstrap.cc:492] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:16:50.598759 12563 ts_tablet_manager.cc:1403] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.251s	user 0.034s	sys 0.019s
I20260709 13:16:50.615517 12563 raft_consensus.cc:359] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:50.617273 12563 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:16:50.621001 12563 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:50.631794 12563 ts_tablet_manager.cc:1434] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:16:50.661772  6341 tablet_copy_service.cc:342] P a13ffe92eb374309a5c8476d9fbbb2b8: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-7508c25b6d9944dda6f30aac9f238ae6 received from {username='slave'} at 127.0.0.1:41502
I20260709 13:16:50.662196  6341 tablet_copy_service.cc:434] P a13ffe92eb374309a5c8476d9fbbb2b8: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-7508c25b6d9944dda6f30aac9f238ae6 on tablet 7508c25b6d9944dda6f30aac9f238ae6 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:50.708966 12562 tablet_bootstrap.cc:492] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=2 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:50.710085 12562 tablet_bootstrap.cc:492] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe: Bootstrap complete.
I20260709 13:16:50.710836 12562 ts_tablet_manager.cc:1403] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent bootstrapping tablet: real 0.477s	user 0.035s	sys 0.021s
I20260709 13:16:50.713801 12562 raft_consensus.cc:359] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:50.714679 12562 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Initialized, Role: LEARNER
I20260709 13:16:50.715397 12562 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true } }
I20260709 13:16:50.718092 12562 ts_tablet_manager.cc:1434] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:50.719786  6414 tablet_copy_service.cc:342] P b940f12ed61a49c4b3c11f13ef50fa92: Request end of tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-50e7a35d701c4730b5efb6fefa7f5ec6 received from {username='slave'} at 127.0.0.1:41486
I20260709 13:16:50.720198  6414 tablet_copy_service.cc:434] P b940f12ed61a49c4b3c11f13ef50fa92: ending tablet copy session 8600a3fead0e48a7aa813822ec44d0fe-50e7a35d701c4730b5efb6fefa7f5ec6 on tablet 50e7a35d701c4730b5efb6fefa7f5ec6 with peer 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:50.722965  6941 raft_consensus.cc:1217] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:16:50.738592  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:51.028890  6941 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEARNER]: Advancing to term 12
I20260709 13:16:51.036659  6400 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:51.041062 12549 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:51.075870  6249 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:51.082334 12549 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:51.162160  6941 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:51.164273 12580 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: NON_VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:51.195832 12575 raft_consensus.cc:1064] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:16:51.200390 12575 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:51.341926  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 121735us
I20260709 13:16:51.455349  6941 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:51.456926 12593 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:51.474925  6247 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:16:51.476591  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 44046.2us
I20260709 13:16:51.481997 12549 raft_consensus.cc:1064] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8: attempting to promote NON_VOTER 8600a3fead0e48a7aa813822ec44d0fe to VOTER
I20260709 13:16:51.486922 12529 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:16:51.484606 12549 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:51.511713  6938 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEARNER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:51.513437 12529 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:51.524308  6400 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:51.524614  6405 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:16:51.531670  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 45517.3us
I20260709 13:16:51.550683 12594 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:51.556643 12529 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:16:51.611155  6247 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:51.604434 12594 raft_consensus.cc:2955] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:51.615195 12595 raft_consensus.cc:2955] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 8 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:51.628101  6404 raft_consensus.cc:2955] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 8 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:51.630129  6935 raft_consensus.cc:2955] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 8 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:51.640151  6147 catalog_manager.cc:5697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 8 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.646389  6247 raft_consensus.cc:2955] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:51.654405 12549 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:51.660117  6249 raft_consensus.cc:2955] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 8 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:51.672778  6938 raft_consensus.cc:2955] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:51.700538  6146 catalog_manager.cc:5697] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 10 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:51.730185  6400 raft_consensus.cc:2955] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } attrs { replace: true } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:51.819878  6323 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:51.835239  6935 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:51.836768 12575 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:51.846596 12594 raft_consensus.cc:2955] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:51.851364  6938 raft_consensus.cc:2955] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:51.860754  6404 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:51.869637 12595 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:51.875391  6323 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:51.876816  6400 raft_consensus.cc:2955] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:51.887019  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:51.892827  6404 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:51.899935  6938 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:51.955843  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 50e7a35d701c4730b5efb6fefa7f5ec6 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:16:51.980425  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 73804.3us
I20260709 13:16:51.981283 12529 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:51.991276  6148 catalog_manager.cc:5697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: config changed from index 11 to 12, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 12 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:51.999068 12593 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:52.029467  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet 50e7a35d701c4730b5efb6fefa7f5ec6 with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:53902
I20260709 13:16:52.086530 12595 raft_consensus.cc:2955] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:52.111176 12612 tablet_replica.cc:333] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:52.123365  6326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9"
dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
mode: GRACEFUL
new_leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:57884
I20260709 13:16:52.129002  6326 raft_consensus.cc:606] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Received request to transfer leadership to TS 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:52.122550  6405 raft_consensus.cc:2955] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:52.116032  6935 raft_consensus.cc:2955] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } } }
I20260709 13:16:52.138731  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:16:52.140547  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:52.153664 12612 raft_consensus.cc:2243] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.162322  6138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7508c25b6d9944dda6f30aac9f238ae6 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:52.166239 12612 raft_consensus.cc:2272] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.182957  6151 catalog_manager.cc:5697] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: config changed from index 11 to 12, VOTER 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) evicted. New cstate: current_term: 14 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.199401 12612 ts_tablet_manager.cc:1916] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:52.213177  6239 tablet_service.cc:1558] Processing DeleteTablet for tablet 7508c25b6d9944dda6f30aac9f238ae6 with delete_type TABLET_DATA_TOMBSTONED (TS 2d6410349fdc47f5a98ba3c6f7d5510b not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:53902
I20260709 13:16:52.237011 12612 ts_tablet_manager.cc:1929] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.11
I20260709 13:16:52.237668 12612 log.cc:1199] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/50e7a35d701c4730b5efb6fefa7f5ec6
I20260709 13:16:52.239480  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet 50e7a35d701c4730b5efb6fefa7f5ec6 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:16:52.244026 12612 tablet_replica.cc:333] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:52.245143 12612 raft_consensus.cc:2243] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.245973 12612 raft_consensus.cc:2272] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.252859 12612 ts_tablet_manager.cc:1916] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:52.271092 12612 ts_tablet_manager.cc:1929] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:16:52.271615 12612 log.cc:1199] T 7508c25b6d9944dda6f30aac9f238ae6 P 2d6410349fdc47f5a98ba3c6f7d5510b: Deleting WAL directory at /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/wals/7508c25b6d9944dda6f30aac9f238ae6
I20260709 13:16:52.273329  6139 catalog_manager.cc:5028] TS 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): tablet 7508c25b6d9944dda6f30aac9f238ae6 (table test-workload [id=1d0c277e2a764f84a5bd12505138eaac]) successfully deleted
I20260709 13:16:52.431924 12575 raft_consensus.cc:993] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: : Instructing follower 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:16:52.432545 12575 raft_consensus.cc:1081] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Signalling peer 8600a3fead0e48a7aa813822ec44d0fe to start an election
I20260709 13:16:52.434312  6935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9"
dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
 from {username='slave'} at 127.0.0.1:41288
I20260709 13:16:52.434890  6935 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:52.435214  6935 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:52.443354  6935 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:52.468343  6247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b"
I20260709 13:16:52.468932  6247 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:52.471441  6935 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:52.472980  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:52.473733  6326 raft_consensus.cc:3055] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:52.482820  6326 raft_consensus.cc:740] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:52.508056  6326 consensus_queue.cc:260] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:52.515470  6326 raft_consensus.cc:3060] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:52.529320  6247 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 16.
I20260709 13:16:52.531667  6906 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe; no voters: 
I20260709 13:16:52.532413 12602 raft_consensus.cc:2804] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:52.532918 12602 raft_consensus.cc:697] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:52.533751 12602 consensus_queue.cc:237] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:52.558669  6326 raft_consensus.cc:2468] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 16.
I20260709 13:16:52.577407  6147 catalog_manager.cc:5697] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 15 to 16, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 16 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:52.633051  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 44888.7us
I20260709 13:16:52.966148  6249 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:16:52.967847 12602 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:53.002349  6326 raft_consensus.cc:1275] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:16:53.006816 12614 consensus_queue.cc:1048] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:53.141533  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:53.203711  5112 tablet_server.cc:179] TabletServer@127.4.254.1:0 shutting down...
W20260709 13:16:53.310165  6295 consensus_peers.cc:597] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.315711  6295 consensus_peers.cc:597] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.345911  6369 consensus_peers.cc:597] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.349855  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 47375.1us
W20260709 13:16:53.347295  6369 consensus_peers.cc:597] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.351290  6369 consensus_peers.cc:597] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.355566  6906 consensus_peers.cc:597] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.361654  6906 consensus_peers.cc:597] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.362108  6369 consensus_peers.cc:597] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.364131  6369 consensus_peers.cc:597] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.400487  6906 consensus_peers.cc:597] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.407099  6906 consensus_peers.cc:597] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.432265  6906 consensus_peers.cc:597] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.437279  6295 consensus_peers.cc:597] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.477447  6369 consensus_peers.cc:597] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.487653  6906 consensus_peers.cc:597] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:53.496084  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:53.499356  5112 tablet_replica.cc:333] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:53.504180  5112 raft_consensus.cc:2243] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:16:53.505512  5112 raft_consensus.cc:2272] T 47628993693e4f69a935e61e4071de94 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.508796  5112 tablet_replica.cc:333] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:53.511994  5112 raft_consensus.cc:2243] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.513947  5112 raft_consensus.cc:2272] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:53.543670  6369 consensus_peers.cc:597] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.547904  6295 consensus_peers.cc:597] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.667752  6369 consensus_peers.cc:597] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.668792  6295 consensus_peers.cc:597] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.673642  6295 consensus_peers.cc:597] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.674285  6295 consensus_peers.cc:597] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.678115  6369 consensus_peers.cc:597] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.685822  6369 consensus_peers.cc:597] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.688257  6906 consensus_peers.cc:597] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.693534  6906 consensus_peers.cc:597] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:53.691519  5112 tablet_replica.cc:333] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:53.695761  5112 raft_consensus.cc:2243] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.697662  5112 raft_consensus.cc:2272] T 1c399f07ba644d25ba3579e60d6962bd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:53.698644  6906 consensus_peers.cc:597] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.699990  6295 consensus_peers.cc:597] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.740015  6906 consensus_peers.cc:597] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.709887  6369 consensus_peers.cc:597] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:53.933333  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 223506us
I20260709 13:16:53.950208  5112 tablet_replica.cc:333] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:53.951153  5112 raft_consensus.cc:2243] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:16:54.021561  5112 raft_consensus.cc:2272] T 5176b2e1ff0145bdb28b559244b3cf5e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.054656  5112 tablet_replica.cc:333] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.055521  5112 raft_consensus.cc:2243] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.056450  5112 raft_consensus.cc:2272] T aba53315de954573854008b23574a90f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.125629  5112 tablet_replica.cc:333] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.150168 12567 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:54.172691 12567 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:54.175082 12567 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:54.176144  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:54.180341  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:54.183203  6221 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:54.184090 12604 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:54.183306 12567 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:54.185117 12567 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:54.189756  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:54.194042 12567 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:54.195492  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:54.197064  6221 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:54.195602  5112 raft_consensus.cc:2243] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.201411 12567 raft_consensus.cc:2706] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Received pre-election callback for term 19 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:16:54.204190  5112 raft_consensus.cc:2272] T 9e60eb0eafd44b02ac71f72df7d3e65d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.210284  5112 tablet_replica.cc:333] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.211154  5112 raft_consensus.cc:2243] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.220093  5112 raft_consensus.cc:2272] T 5e1866b70cb54443b0830659c633edcf P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.231756 12604 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:54.232461 12604 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:54.234150  5112 tablet_replica.cc:333] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.235054  5112 raft_consensus.cc:2243] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:16:54.236068  5112 raft_consensus.cc:2272] T 334e41443e364890b884c69082b3bb30 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.236927  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:54.238329  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:54.239753  6221 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:54.240525 12534 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:54.246982  5112 tablet_replica.cc:333] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.253525  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:54.251498 12567 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:54.255887 12567 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:54.253437  5112 raft_consensus.cc:2243] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.259336  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:54.259835  5112 raft_consensus.cc:2272] T ce99643832824368978841e0265f9d2d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.259732  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:54.261865  6219 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:54.262631 12534 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:54.263557 12604 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:54.259272 12567 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:54.269841  5112 tablet_replica.cc:333] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.277055  5112 raft_consensus.cc:2243] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:16:54.278326  5112 raft_consensus.cc:2272] T 0fbd02cf1f2d48d2ac594411f00f9678 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.285506  5112 tablet_replica.cc:333] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.286346  5112 raft_consensus.cc:2243] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.301590 12567 raft_consensus.cc:493] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:54.303540  5112 raft_consensus.cc:2272] T e25e23b6cebd41369f84b2c74e182cbd P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.302277 12567 raft_consensus.cc:515] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:54.306902  5112 tablet_replica.cc:333] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.319288  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:54.318351 12567 leader_election.cc:290] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:54.321218  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d35ec80c8064f08b90ca13dd30691c7" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:54.322075  5112 raft_consensus.cc:2243] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.323741  6221 leader_election.cc:304] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:54.324857 12567 raft_consensus.cc:2749] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:54.323966  5112 raft_consensus.cc:2272] T 47b0eafc00f84cdab5bdb591a10c058d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.328006  5112 tablet_replica.cc:333] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.338446  5112 raft_consensus.cc:2243] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:16:54.339893  5112 raft_consensus.cc:2272] T c17ed9277f5d4839b300200e6c909c0f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.348215 12534 raft_consensus.cc:493] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:54.350942 12534 raft_consensus.cc:515] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:54.353197  5112 tablet_replica.cc:333] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.354038  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:54.354532 12534 leader_election.cc:290] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:54.363087  5112 raft_consensus.cc:2243] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.363873  5112 raft_consensus.cc:2272] T bc0d5cf9e08445eea2f9773bf33622d4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.355141  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19435892007a4e0a9b2b4d0b26ccd0c0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:54.367029  6221 leader_election.cc:304] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:54.368351 12534 raft_consensus.cc:2749] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:54.371959  5112 tablet_replica.cc:333] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.379455  5112 raft_consensus.cc:2243] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:54.380538  5112 raft_consensus.cc:2272] T dd8e69d69ccd4bc99194b3d3e6633693 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.386456  5112 tablet_replica.cc:333] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.393841  5112 raft_consensus.cc:2243] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.401623  5112 raft_consensus.cc:2272] T cbc89cb8d0e64feba7a58705d738d699 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.407996  5112 tablet_replica.cc:333] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.413749  5112 raft_consensus.cc:2243] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.422067  5112 raft_consensus.cc:2272] T 3ca18f52abcd4cf291ae45a415535e88 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.424736  5112 tablet_replica.cc:333] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.432180  5112 raft_consensus.cc:2243] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:54.435874 12534 raft_consensus.cc:493] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:54.437463 12534 raft_consensus.cc:515] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:54.438047  5112 raft_consensus.cc:2272] T e31ff23bb63c4e33afd90afd6bf5f198 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.441274 12567 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:54.446219 12567 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:54.448096  5112 tablet_replica.cc:333] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.449111  5112 raft_consensus.cc:2243] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.445070 12604 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:54.449783  5112 raft_consensus.cc:2272] T 69156f57197e4f1fbed9461749553d8d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.450136 12604 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:54.450843  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:54.452180 12604 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:54.452951  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:54.453933  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:54.440395  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:54.441429  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b0bb0f383c43abb44e0ab66a228225" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:54.455965  6221 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:54.440467 12534 leader_election.cc:290] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:54.457366 12534 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:54.458284  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:54.459681  6222 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:54.460930 12534 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:54.459748  6221 leader_election.cc:304] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:54.462368 12534 raft_consensus.cc:2749] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:54.448415 12567 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:54.468215  5112 tablet_replica.cc:333] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.473744  5112 raft_consensus.cc:2243] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.474395  5112 raft_consensus.cc:2272] T b8b0bb0f383c43abb44e0ab66a228225 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.485276  5112 tablet_replica.cc:333] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.501777  5112 raft_consensus.cc:2243] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:16:54.502960  5112 raft_consensus.cc:2272] T ea04d9d509e04fbdafdf863603b94c70 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.505738  5112 tablet_replica.cc:333] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.508072  5112 raft_consensus.cc:2243] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:16:54.509117  5112 raft_consensus.cc:2272] T 884ae035eff04463b5ff7a054f75935d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.519918  5112 tablet_replica.cc:333] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.527602 12567 raft_consensus.cc:493] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:54.537420 12567 raft_consensus.cc:515] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:54.539525 12567 leader_election.cc:290] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:54.540594  5112 raft_consensus.cc:2243] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.540704  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:54.541338  5112 raft_consensus.cc:2272] T c0c4567153664b518d2f6515e419da60 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.542832  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efde1f99d92b4d97b29f2a2f0d1c1c62" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:54.544097  5112 tablet_replica.cc:333] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.544978  5112 raft_consensus.cc:2243] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:16:54.547099  6221 leader_election.cc:304] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:54.554018 12567 raft_consensus.cc:2749] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:54.555603  5112 raft_consensus.cc:2272] T c5f7d4daab074bd6b452f58e1a57a7ea P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.558226  5112 tablet_replica.cc:333] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.576839 12567 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:54.577515 12567 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:54.579752 12567 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:54.581265  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:54.584476  5112 raft_consensus.cc:2243] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.585245  5112 raft_consensus.cc:2272] T 26c3f5e2706b41929dff126f046ad839 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.587798  5112 tablet_replica.cc:333] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.588547  5112 raft_consensus.cc:2243] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.590036  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:54.592576  6222 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:54.594283 12567 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:54.601200  5112 raft_consensus.cc:2272] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.595327 12567 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:54.607502 12567 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:54.608712  5112 tablet_replica.cc:333] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.609661  5112 raft_consensus.cc:2243] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.610201  5112 raft_consensus.cc:2272] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.612874  5112 tablet_replica.cc:333] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.618752  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:54.623790 12567 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:54.626963 12529 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:54.627434  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:54.627512 12529 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:54.629277  6222 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:54.630460 12534 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:54.632754  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:54.635475 12534 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:54.636004 12534 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:54.637899  5112 raft_consensus.cc:2243] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:16:54.638448 12529 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:54.639379 12534 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:54.641429 12534 raft_consensus.cc:493] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:54.641921 12534 raft_consensus.cc:515] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:54.640828  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:54.643882  6295 leader_election.cc:336] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:54.644318  6295 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:54.643121  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:54.639394  5112 raft_consensus.cc:2272] T bade3854ad1b4b2492dd0ecd47e1398b P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.645862  6219 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:54.646603  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:54.646637 12604 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:54.647933 12534 leader_election.cc:290] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:54.648525  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9d4db6a641496881a55d48d32c6f7e" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:54.649966  6221 leader_election.cc:304] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:54.650390 12593 raft_consensus.cc:2749] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:54.651075 12534 raft_consensus.cc:2749] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:54.657194 12534 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:54.657747 12534 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:54.660840 12534 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:54.661408  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:54.662375  5112 tablet_replica.cc:333] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.663169  5112 raft_consensus.cc:2243] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.663745  5112 raft_consensus.cc:2272] T ae75079e4a9346d0a9b0c375570b7f9d P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.667824  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:54.669276  6221 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:54.671491 12534 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:54.744004  5112 tablet_replica.cc:333] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.748131  5112 raft_consensus.cc:2243] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.750393  5112 raft_consensus.cc:2272] T 1e2856a0d3994696bbc8de68c3679c2f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.753736 12604 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:54.754786 12604 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:54.759207 12604 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:54.768625  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:54.768707 12535 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:54.771647 12535 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:54.774760  5112 tablet_replica.cc:333] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.776654  5112 raft_consensus.cc:2243] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.778142  5112 raft_consensus.cc:2272] T b91f0c50e2de47c299569a0a5d7af6b8 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.791690 12535 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:54.793394  5112 tablet_replica.cc:333] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.793727  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:54.794528  5112 raft_consensus.cc:2243] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.795598  5112 raft_consensus.cc:2272] T e1c5cae95db44ec58187d3429c9bdf2e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.800139  5112 tablet_replica.cc:333] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.801403  5112 raft_consensus.cc:2243] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:16:54.803089  5112 raft_consensus.cc:2272] T ca1ca4c5e4934cf9b482701f5eb26d1a P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.807126  5112 tablet_replica.cc:333] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.808178  5112 raft_consensus.cc:2243] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.809722  5112 raft_consensus.cc:2272] T 7f4a17642c254c2e869ca48ecd16fce0 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.813767  6222 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d6410349fdc47f5a98ba3c6f7d5510b; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:54.815385 12534 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:54.813767  5112 tablet_replica.cc:333] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.825192  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:54.826164  6327 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:54.836966  6368 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:54.838995 12622 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:54.839478 12622 raft_consensus.cc:493] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:54.839864 12622 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:54.854907  6369 leader_election.cc:336] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:54.872277  5112 raft_consensus.cc:2243] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.873579  5112 raft_consensus.cc:2272] T 3d35ec80c8064f08b90ca13dd30691c7 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.904043 12622 raft_consensus.cc:515] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:54.907980  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47628993693e4f69a935e61e4071de94" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:54.908746  6323 raft_consensus.cc:3060] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:54.918067  5112 tablet_replica.cc:333] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.919236  5112 raft_consensus.cc:2243] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.922699  6323 raft_consensus.cc:2468] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
I20260709 13:16:54.924474  6368 leader_election.cc:304] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:54.925666 12598 raft_consensus.cc:2804] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:54.926373 12598 raft_consensus.cc:697] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:54.927610 12598 consensus_queue.cc:237] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:54.933571 12622 leader_election.cc:290] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:54.934320  5112 raft_consensus.cc:2272] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.938975  5112 tablet_replica.cc:333] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:54.940055  5112 raft_consensus.cc:2243] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.941090  5112 raft_consensus.cc:2272] T 4340bb97f0154dbb981570b2ee2f49c5 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.984567 12535 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:54.985549 12535 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:54.988329 12535 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:54.990316  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:55.005720  6369 leader_election.cc:336] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:55.047241  5112 tablet_replica.cc:333] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:55.048564  5112 raft_consensus.cc:2243] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.050374  5112 raft_consensus.cc:2272] T 0e9d4db6a641496881a55d48d32c6f7e P 2d6410349fdc47f5a98ba3c6f7d5510b [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:55.050910  6369 leader_election.cc:336] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:55.066720  5112 tablet_replica.cc:333] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:55.080816  5112 raft_consensus.cc:2243] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.081705  5112 raft_consensus.cc:2272] T 1230017e50f4469992de6002ca8cd7b6 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.085328  5112 tablet_replica.cc:333] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:55.105639  6148 catalog_manager.cc:5697] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 13 to 14, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 14 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.113148  6368 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:55.086755  5112 raft_consensus.cc:2243] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.126608  5112 raft_consensus.cc:2272] T 5af589183a05415d9cb49d32caedd78f P 2d6410349fdc47f5a98ba3c6f7d5510b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.130139  5112 tablet_replica.cc:333] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:55.131127  5112 raft_consensus.cc:2243] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.134397 12636 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:55.143889  5112 raft_consensus.cc:2272] T 772aad0e3cb043d989afc6d1abdbf6f4 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.155157  5112 tablet_replica.cc:333] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:55.162111  5112 raft_consensus.cc:2243] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.162928  5112 raft_consensus.cc:2272] T 1061e95aa2d446f2aeb9563f482f1cd9 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.165803  5112 tablet_replica.cc:333] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:55.173834  5112 raft_consensus.cc:2243] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.174678  5112 raft_consensus.cc:2272] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P 2d6410349fdc47f5a98ba3c6f7d5510b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.177546  5112 tablet_replica.cc:333] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b: stopping tablet replica
I20260709 13:16:55.178224  5112 raft_consensus.cc:2243] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.179765  5112 raft_consensus.cc:2272] T 05f408a1388f424db8b65332c1dcd467 P 2d6410349fdc47f5a98ba3c6f7d5510b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.289075 12626 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.289811 12626 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:55.293803  6295 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 122 similar messages]
W20260709 13:16:55.296233  6295 leader_election.cc:336] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:55.302718  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:55.303435  6405 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 16.
I20260709 13:16:55.303117 12626 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:55.304867 12614 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.305536 12614 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:55.308032 12614 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:55.309238  6296 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:55.309777  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:55.311872 12626 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:55.312269 12626 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.312646 12626 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:55.314188  6906 leader_election.cc:336] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:55.314646  6906 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:55.318393 12614 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:55.336694 12626 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:55.340461  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:55.341059  6405 raft_consensus.cc:3060] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:55.342639  6295 leader_election.cc:336] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:55.349509  6405 raft_consensus.cc:2468] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 17.
I20260709 13:16:55.350915  6296 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:55.351889 12635 raft_consensus.cc:2804] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:55.352522 12626 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:55.353175 12635 raft_consensus.cc:697] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:55.354477 12635 consensus_queue.cc:237] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:55.373078  6329 raft_consensus.cc:1275] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:55.374852 12629 consensus_queue.cc:1048] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:55.383922  6369 consensus_peers.cc:597] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.417383  6148 catalog_manager.cc:5697] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 16 to 17, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 17 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.424929 12635 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.427350 12635 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:55.433758  6295 leader_election.cc:336] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:55.446756  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:55.456185  6297 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:55.457304 12627 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:55.467947 12635 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:55.469749 12404 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.470319 12404 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:55.472729 12404 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:55.474148  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:55.474434 12598 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.474898  6327 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:55.475097 12598 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:55.476773  6905 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:55.477779 12404 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:55.478173 12404 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.478543 12404 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:55.480963  6369 leader_election.cc:336] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:55.484403 12598 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:55.487116  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:55.491628  6368 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:55.492959 12598 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:55.499354  6906 leader_election.cc:336] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:55.499786 12404 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:55.518433  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:55.519208  6329 raft_consensus.cc:3060] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:55.517846 12404 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:55.532260  6906 leader_election.cc:336] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:55.532888  6329 raft_consensus.cc:2468] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:55.534658  6905 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:55.540673 12633 raft_consensus.cc:2804] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:55.541397 12633 raft_consensus.cc:697] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:55.542512 12633 consensus_queue.cc:237] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:55.570210  6151 catalog_manager.cc:5697] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 12 to 13, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 13 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.592126 12627 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.592854 12627 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:55.595428 12529 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.596127 12593 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.596101 12529 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:55.596946 12593 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:55.595741 12627 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:55.600759 12593 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:55.601052  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:55.601680  6405 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:55.602807  6296 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:55.602008 12529 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:55.603581 12593 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:55.605875 12593 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.606352 12593 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:55.620141 12593 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:55.629890  6295 leader_election.cc:336] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:55.631615  6295 leader_election.cc:336] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:55.632133  6295 leader_election.cc:336] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:55.633562 12593 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:55.633424  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:55.634830  6405 raft_consensus.cc:3060] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:55.635442  6295 leader_election.cc:336] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:55.642985  6405 raft_consensus.cc:2468] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
I20260709 13:16:55.644536  6296 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:55.645375 12626 raft_consensus.cc:2804] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:55.645856 12626 raft_consensus.cc:697] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:55.646720 12626 consensus_queue.cc:237] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:55.653216 12529 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:16:55.654438  6369 consensus_peers.cc:597] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:55.654043 12529 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:55.658946  6369 consensus_peers.cc:597] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:55.660830  6295 leader_election.cc:336] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:55.670249 12633 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.670591 12635 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.670944 12633 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:55.671183 12635 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:55.676879  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:55.677162 12635 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:55.673329 12633 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:55.679086  6295 leader_election.cc:336] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:55.682824  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:55.686004  6296 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:55.686918 12635 raft_consensus.cc:2749] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:55.683379 12529 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:55.714602  6151 catalog_manager.cc:5697] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 14 to 15, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 15 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.726902 12614 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.727488 12614 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:55.730942 12614 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:55.732465  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:55.733191  6327 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 16.
I20260709 13:16:55.734571  6905 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:55.735739 12614 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:55.736169 12614 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.736583 12614 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:55.741943 12636 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.742551 12636 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:55.745774 12636 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:55.747857  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:55.748492  6327 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
W20260709 13:16:55.748878  6369 leader_election.cc:336] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:55.749861  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:55.750948 12629 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:55.751367 12629 raft_consensus.cc:493] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.751751 12629 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:55.757210  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 104315us
I20260709 13:16:55.758891  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:55.759158  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:55.761492  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:55.762079  6940 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 11.
I20260709 13:16:55.756767 12614 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:55.770845  6938 raft_consensus.cc:2393] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 17: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:55.771705 12614 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:55.773247  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:55.773895  6327 raft_consensus.cc:3060] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:55.775449  6297 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:55.776876  6297 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:55.777676 12635 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:55.778009  6297 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:55.778744 12627 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:55.781289  6906 leader_election.cc:336] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:55.781824  6906 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:55.778033 12635 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.782685 12635 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:55.782903  6906 leader_election.cc:336] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:55.783768  6906 leader_election.cc:336] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:55.789903 12614 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:55.790834 12635 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:55.791921  6327 raft_consensus.cc:2468] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 17.
I20260709 13:16:55.792420 12627 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:55.794278  6905 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:55.795755 12614 raft_consensus.cc:2804] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:55.796279 12614 raft_consensus.cc:697] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:55.797256 12614 consensus_queue.cc:237] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:55.799997  6295 leader_election.cc:336] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:55.801234 12635 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:55.802297  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:55.799671 12629 raft_consensus.cc:515] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:55.802992  6938 raft_consensus.cc:3060] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:55.804715 12629 leader_election.cc:290] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:55.805763  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f7d4daab074bd6b452f58e1a57a7ea" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:55.806320  6327 raft_consensus.cc:3060] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:55.815321  6151 catalog_manager.cc:5697] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 16 to 17, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 17 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:55.817477  6369 leader_election.cc:336] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:55.826776  6327 raft_consensus.cc:2468] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 14.
I20260709 13:16:55.827955  6368 leader_election.cc:304] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:55.829527 12636 raft_consensus.cc:2804] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:55.830662 12636 raft_consensus.cc:697] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:55.831518 12636 consensus_queue.cc:237] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:55.839947  6938 raft_consensus.cc:2468] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 12.
I20260709 13:16:55.844751  6297 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:55.846153 12635 raft_consensus.cc:2804] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:55.846673 12635 raft_consensus.cc:697] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:55.847620 12635 consensus_queue.cc:237] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:55.850435  6295 consensus_peers.cc:597] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:55.851389 12614 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.852031 12614 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:55.854417 12614 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:55.865293  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:55.866020  6329 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:55.871181  6905 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:55.876170 12614 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:55.876571 12614 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.876925 12614 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:55.877390  6151 catalog_manager.cc:5697] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 11 to 12, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 12 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:55.883157  6369 consensus_peers.cc:597] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:55.888203  6369 consensus_peers.cc:597] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:55.889912 12627 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.890529 12627 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:55.891083  6148 catalog_manager.cc:5697] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 13 to 14, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 14 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.892807 12627 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:55.900435 12614 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:55.902004  6906 leader_election.cc:336] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:55.902534 12614 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:55.903231 12636 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.903859 12636 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:55.904547  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:55.905186  6329 raft_consensus.cc:3060] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:55.907378  6295 leader_election.cc:336] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:55.907771 12636 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:55.910543  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:55.911218  6941 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 17.
I20260709 13:16:55.917080  6405 raft_consensus.cc:1275] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:16:55.918694 12635 consensus_queue.cc:1048] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:16:55.922601  6369 leader_election.cc:336] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:55.936264  6297 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:55.937525 12627 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:55.938001 12627 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.938367 12627 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:55.950523  6295 consensus_peers.cc:597] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:55.955440  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:55.959587  6368 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:55.960408 12629 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:55.961282  6369 consensus_peers.cc:597] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:55.987397 12593 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:55.988201 12593 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:55.990451 12593 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:55.995522  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:55.996121  6404 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
W20260709 13:16:55.997637  6295 consensus_peers.cc:597] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:56.000114  6329 raft_consensus.cc:2468] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:56.001502  6905 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:56.002558 12614 raft_consensus.cc:2804] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:56.002640  6296 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:56.003219 12614 raft_consensus.cc:697] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:56.004236 12614 consensus_queue.cc:237] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:56.015998  6369 consensus_peers.cc:597] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:56.008394 12593 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:56.026656 12593 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:56.027062 12593 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:56.034524  6369 consensus_peers.cc:597] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:56.041785 12529 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:56.045253 12529 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:56.047529 12529 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:56.051470 12593 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:56.073638  6906 leader_election.cc:336] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:56.084810  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:56.079814 12593 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:56.093392  6295 consensus_peers.cc:597] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:56.094096  6295 leader_election.cc:336] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:56.097330  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:56.097976  6405 raft_consensus.cc:3060] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:56.099709  6369 consensus_peers.cc:597] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:56.101653  6295 consensus_peers.cc:597] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:56.102156  6295 leader_election.cc:336] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:56.101998 12627 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:56.102705  6295 consensus_peers.cc:597] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:56.103159  6295 leader_election.cc:336] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:56.104308 12627 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 18 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:56.108371  6148 catalog_manager.cc:5697] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 11 to 12, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 12 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.114246  6405 raft_consensus.cc:2468] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:56.116807  6296 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:56.117949 12627 raft_consensus.cc:2804] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:56.119225 12627 raft_consensus.cc:697] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:56.120216 12627 consensus_queue.cc:237] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:56.127099 12660 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
W20260709 13:16:56.127153  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 55479.6us
I20260709 13:16:56.127889 12660 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:56.128386  6295 leader_election.cc:336] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:56.130071  6297 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:56.130896 12529 raft_consensus.cc:2749] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:56.131430  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:56.132064  6329 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:56.133258  6905 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:56.134366 12659 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:56.134802 12659 raft_consensus.cc:493] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:56.135226 12659 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:56.138885  6329 raft_consensus.cc:1275] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:16:56.140909 12614 consensus_queue.cc:1048] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:56.143318 12659 raft_consensus.cc:515] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:56.145427 12660 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:56.146771  6295 consensus_peers.cc:597] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:56.147291  6295 consensus_peers.cc:597] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:56.147799  6369 consensus_peers.cc:597] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:56.149140  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bade3854ad1b4b2492dd0ecd47e1398b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:56.149901  6327 raft_consensus.cc:3060] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:56.149235 12659 leader_election.cc:290] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:56.158162  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea04d9d509e04fbdafdf863603b94c70" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:56.158666  6327 raft_consensus.cc:2468] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 15.
I20260709 13:16:56.158792  6935 raft_consensus.cc:3060] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:56.163633  6906 consensus_peers.cc:597] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:56.164165  6906 consensus_peers.cc:597] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:56.167305  6935 raft_consensus.cc:2468] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 18.
I20260709 13:16:56.168727  6905 leader_election.cc:304] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:56.175452  6405 raft_consensus.cc:1275] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:16:56.175747  6369 consensus_peers.cc:597] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:56.176698 12659 raft_consensus.cc:2804] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:56.177451 12529 consensus_queue.cc:1048] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:56.177246 12659 raft_consensus.cc:697] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:56.182720 12659 consensus_queue.cc:237] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:56.548918  5112 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 6277)
W20260709 13:16:57.139818 12659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.030s	sys 0.072s
W20260709 13:16:57.140468 12659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.030s	sys 0.073s
I20260709 13:16:57.202925  6327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57226 (request call id 2611) took 1031 ms. Trace:
I20260709 13:16:57.203358  6327 rpcz_store.cc:276] 0709 13:16:56.171863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.176737 (+  4874us) service_pool.cc:224] Handling call
0709 13:16:56.177013 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.202641 (+1025628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.202661 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.202691 (+    30us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:57.202716 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.202755 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.202855 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.214134 12667 raft_consensus.cc:493] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.214183 12668 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.214926 12667 raft_consensus.cc:515] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:57.215112 12668 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.217175 12668 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.217175 12667 leader_election.cc:290] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:56.166019  6906 consensus_peers.cc:597] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.250672  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 1.0846e+06us
W20260709 13:16:57.251361  6906 consensus_peers.cc:597] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.251892  6906 consensus_peers.cc:597] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:57.264979 12659 raft_consensus.cc:493] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.265626 12659 raft_consensus.cc:515] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } attrs { replace: true } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.267459 12667 raft_consensus.cc:493] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
W20260709 13:16:57.268149  6906 consensus_peers.cc:597] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:57.268069 12667 raft_consensus.cc:515] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.269328 12659 leader_election.cc:290] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.270747 12667 leader_election.cc:290] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.283880 12670 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:57.284693 12670 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.286790 12674 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:57.287081 12670 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.261106 12671 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:57.293578 12677 raft_consensus.cc:493] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:57.297529 12677 raft_consensus.cc:515] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.299947 12677 leader_election.cc:290] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.305900 12677 raft_consensus.cc:493] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:57.306452 12677 raft_consensus.cc:515] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.311969 12677 leader_election.cc:290] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.295576 12671 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.319242 12671 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.319272 12667 raft_consensus.cc:493] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:57.320024 12667 raft_consensus.cc:515] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.321403 12673 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.322230 12667 leader_election.cc:290] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.314927 12677 raft_consensus.cc:493] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.322002 12673 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.323055 12677 raft_consensus.cc:515] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:57.324342 12673 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.287379 12674 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.326377 12674 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.327278 12677 leader_election.cc:290] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:57.329619 12677 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.329766 12667 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.330186 12677 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:57.330554 12667 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.332502 12677 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:57.334314 12667 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.336401 12668 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:57.336989 12668 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.339000 12668 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.341856  6329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41502 (request call id 1557) took 1199 ms. Trace:
I20260709 13:16:57.342391  6329 rpcz_store.cc:276] 0709 13:16:56.142819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.142967 (+   148us) service_pool.cc:224] Handling call
0709 13:16:56.143288 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.143638 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.143666 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.144175 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.341306 (+1197131us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b5400309420. stack: 00007f4572ac6343 00007f4572ac6240 00007f45724551d4 00007f457c193304 00007f457c193299 00007f4575b4f090 00007f4575b5c6b8 00007f4575be592b 00007f4575be483e 00007f457aba9419 00007f4574120bd4 00007f4574120b62 00007f4574120a91 00007f4574120a0c 00007f457411fcc2 00007f4573f2048c
0709 13:16:57.341381 (+    75us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:57.341427 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.341494 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.341534 (+    40us) raft_consensus.cc:1685] finished
0709 13:16:57.341545 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.341757 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":64088960,"thread_start_us":7170,"threads_started":1,"wal-append.queue_time_us":5645,"wal-append.run_cpu_time_us":1921,"wal-append.run_wall_time_us":1029867}
I20260709 13:16:57.345566 12667 raft_consensus.cc:493] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:57.346606 12667 raft_consensus.cc:515] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.346046 12679 raft_consensus.cc:493] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.348086 12679 raft_consensus.cc:515] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:57.350901 12679 leader_election.cc:290] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.355911 12667 leader_election.cc:290] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.355530  6148 catalog_manager.cc:5697] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 13 to 14, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 14 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:57.362946  6405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.182s	user 0.022s	sys 0.036s
W20260709 13:16:57.363394  6405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.182s	user 0.023s	sys 0.036s
I20260709 13:16:57.364074  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36172 (request call id 3340) took 1184 ms. Trace:
I20260709 13:16:57.364715 12667 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:57.365280 12667 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.367264 12667 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.368494 12668 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:57.369025 12668 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.371798 12668 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.364405  6405 rpcz_store.cc:276] 0709 13:16:56.179436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.179661 (+   225us) service_pool.cc:224] Handling call
0709 13:16:56.179972 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.180517 (+   545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.180552 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.181060 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.363716 (+1182656us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:57.363754 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.363820 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.363863 (+    43us) raft_consensus.cc:1685] finished
0709 13:16:57.363873 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.363989 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3066,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":1182253,"threads_started":1,"wal-append.queue_time_us":230818}
I20260709 13:16:57.396958  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.392678 12659 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:57.407646 12659 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.390810 12669 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.409685 12669 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.411721 12669 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.432015 12688 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:57.433063 12688 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.434482 12690 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.423566 12669 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.444792  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.424022 12675 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:57.453963  6329 raft_consensus.cc:1275] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:57.431491 12683 raft_consensus.cc:493] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.483031  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.483855  6327 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 12.
I20260709 13:16:57.488010  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c422c1ccba3c4f8c9a7811e10c0f5dd3" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.490063  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9bf1ef8bde4a7db7ca1d39945d2ffe" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:57.499604  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 103520us
I20260709 13:16:57.497534 12686 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.502696 12686 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.454061 12669 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.447702 12690 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.497700 12659 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.510502  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.497200 12671 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.515348 12691 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.518352 12671 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.516275 12682 raft_consensus.cc:493] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:57.521931  6151 catalog_manager.cc:5697] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 14 to 15, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 15 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:57.523005 12682 raft_consensus.cc:515] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.479032 12675 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.547729 12687 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.548368 12687 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
W20260709 13:16:57.549639  5112 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 6277)
I20260709 13:16:57.551015 12687 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:57.545392 12691 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.553547 12691 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:57.525084 12682 leader_election.cc:290] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.556885 12695 raft_consensus.cc:493] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.557323 12678 raft_consensus.cc:493] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.483604 12683 raft_consensus.cc:515] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.512286 12688 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:57.570758 12685 raft_consensus.cc:493] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.571424 12685 raft_consensus.cc:515] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.579532 12671 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.557571 12695 raft_consensus.cc:515] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.609524 12671 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.621400  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.612227 12686 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.620707  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.624853  6404 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:57.562762 12678 raft_consensus.cc:515] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:57.634716 12700 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:57.635048 12681 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.635689 12695 leader_election.cc:290] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.635427 12700 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.638166 12700 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:57.638849 12700 raft_consensus.cc:493] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.639499 12700 raft_consensus.cc:515] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:57.641005  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 45907.1us
I20260709 13:16:57.642165 12700 leader_election.cc:290] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.643008 12700 raft_consensus.cc:493] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.643170 12685 leader_election.cc:290] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.633663  6297 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
I20260709 13:16:57.619777 12668 raft_consensus.cc:493] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:57.623337 12687 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.619792 12674 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.621022 12696 raft_consensus.cc:493] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.642410 12701 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.623816 12671 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:57.643697 12700 raft_consensus.cc:515] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:57.652189  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 146364us
I20260709 13:16:57.647439  6907 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:57.650499 12685 raft_consensus.cc:2804] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:57.662662  6368 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:16:57.657629  6369 consensus_peers.cc:597] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.663935  6369 leader_election.cc:336] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:57.664350  6369 leader_election.cc:336] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:57.664927  6369 leader_election.cc:336] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:57.665343  6369 leader_election.cc:336] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:57.670221 12677 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:57.670270 12697 raft_consensus.cc:493] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:57.659055 12701 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.666698 12659 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:57.687268 12690 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.657769 12696 raft_consensus.cc:515] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.726193 12671 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:57.653359 12687 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.727413 12696 leader_election.cc:290] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.656984 12674 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.729323 12690 raft_consensus.cc:493] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.729916 12690 raft_consensus.cc:515] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.651242 12668 raft_consensus.cc:515] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.732196 12690 leader_election.cc:290] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.733301 12668 leader_election.cc:290] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.635613 12681 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:16:57.733978  6400 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:57.697104 12670 raft_consensus.cc:493] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.734735 12670 raft_consensus.cc:515] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:57.663470 12686 consensus_queue.cc:1048] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:16:57.671082 12689 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
W20260709 13:16:57.665702  6369 leader_election.cc:336] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:57.718314  6906 consensus_peers.cc:597] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.722685 12677 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:57.748687 12677 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:57.723340 12659 raft_consensus.cc:493] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:57.750198 12659 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:57.750494 12670 leader_election.cc:290] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:57.747571 12675 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:57.747949 12669 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:57.752921 12683 leader_election.cc:290] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.753500 12689 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.754930 12674 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.724131 12697 raft_consensus.cc:515] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.739117 12687 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.758435 12697 leader_election.cc:290] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:16:57.740144  6369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 74375.8us
I20260709 13:16:57.761910 12678 leader_election.cc:290] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:57.762084 12689 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.763154 12681 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
I20260709 13:16:57.760741 12701 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:57.773578  6295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 88414.6us
I20260709 13:16:57.720266 12685 raft_consensus.cc:697] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:57.778700  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.783607 12659 raft_consensus.cc:515] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:57.740754  6906 consensus_peers.cc:597] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.786700  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 45994us
I20260709 13:16:57.789098  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4a17642c254c2e869ca48ecd16fce0" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:57.787181  6906 consensus_peers.cc:597] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.790099  6906 leader_election.cc:336] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:57.790654  6906 leader_election.cc:336] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:57.796209  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:57.797014  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 134425us
I20260709 13:16:57.798558  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.784955 12701 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.800360 12701 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.798537 12695 raft_consensus.cc:493] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.795035 12689 raft_consensus.cc:493] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.802374  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.802810 12689 raft_consensus.cc:515] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.803462  6402 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 10.
I20260709 13:16:57.802518  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.804229 12695 raft_consensus.cc:515] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.804641  6403 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 15.
I20260709 13:16:57.806459 12695 leader_election.cc:290] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.807051  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e2856a0d3994696bbc8de68c3679c2f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.792778 12696 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.787508 12677 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.809448 12696 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.809873  6405 raft_consensus.cc:1240] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Rejecting Update request from peer 8600a3fead0e48a7aa813822ec44d0fe for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:57.811395 12696 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.802443 12701 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:57.804893 12689 leader_election.cc:290] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:57.813827  6369 consensus_peers.cc:597] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:57.814953  6369 leader_election.cc:336] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:57.820215 12659 leader_election.cc:290] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.821627 12710 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.822255 12710 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.822636  6907 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:57.824240 12701 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:57.824666 12701 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.825031 12701 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:57.825742  6907 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:57.826555  6907 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:57.827018 12675 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:57.827386 12675 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.827742 12675 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.828406 12689 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:57.828847 12689 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.828656 12699 consensus_queue.cc:1059] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:57.829272 12689 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:57.829420 12700 leader_election.cc:290] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.829797 12699 raft_consensus.cc:3055] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:57.830260 12685 consensus_queue.cc:237] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.823719 12696 raft_consensus.cc:493] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b940f12ed61a49c4b3c11f13ef50fa92)
I20260709 13:16:57.798118  6368 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:57.834903  6368 leader_election.cc:304] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:57.834971  6369 leader_election.cc:336] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:57.833487 12690 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.833706 12696 raft_consensus.cc:515] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.837428 12690 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.839246 12696 leader_election.cc:290] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.839495 12690 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.839756 12696 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.840269 12696 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.830209 12699 raft_consensus.cc:740] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:57.840126 12681 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:57.842016 12699 consensus_queue.cc:260] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.843300 12699 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:57.843573 12710 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.844435  6323 raft_consensus.cc:1275] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:16:57.844678  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
W20260709 13:16:57.844612  6369 leader_election.cc:336] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:57.845746  6369 leader_election.cc:336] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:57.846741  6369 leader_election.cc:336] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:57.848891  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1230017e50f4469992de6002ca8cd7b6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:57.847149  6295 consensus_peers.cc:597] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:57.850193  6295 leader_election.cc:336] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:57.850919  6295 consensus_peers.cc:597] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:57.851276  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
W20260709 13:16:57.851363  6295 consensus_peers.cc:597] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.851985  6398 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
W20260709 13:16:57.852139  6295 leader_election.cc:336] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:57.852849  6295 leader_election.cc:336] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:57.853765  6295 leader_election.cc:336] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:57.854300  6295 leader_election.cc:336] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:57.857023  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.857324  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c5cae95db44ec58187d3429c9bdf2e" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.858722  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.859591  6396 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:57.861625  6907 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:57.862608 12659 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:57.862977 12659 raft_consensus.cc:493] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.865510  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.866113  6403 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:57.866250 12659 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:57.868149  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:57.868718  6398 raft_consensus.cc:3060] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:57.876171  6398 raft_consensus.cc:2468] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 15.
I20260709 13:16:57.891239  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.891384  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1866b70cb54443b0830659c633edcf" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.893110  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.893638 12659 raft_consensus.cc:515] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.895339 12659 leader_election.cc:290] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.896833  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.897552  6329 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:16:57.898422  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91f0c50e2de47c299569a0a5d7af6b8" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.899381  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4340bb97f0154dbb981570b2ee2f49c5" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.906064  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba53315de954573854008b23574a90f" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.849637 12681 raft_consensus.cc:2749] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:57.911768  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:57.913048  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.913471 12667 raft_consensus.cc:493] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.913688  6331 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:57.914188 12667 raft_consensus.cc:515] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.915352  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.916568  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.916381 12675 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:57.914649  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.918757  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b0ed24d02e419bb6f1e4b24f0bcff5" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:57.919986 12696 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:57.846738 12677 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.922185  6322 raft_consensus.cc:1275] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:57.922326  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b0eafc00f84cdab5bdb591a10c058d" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.923223  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.923697  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.923923  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.924544  6329 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
W20260709 13:16:57.925181  6295 leader_election.cc:336] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:57.925794  6331 raft_consensus.cc:1275] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
W20260709 13:16:57.926048  6295 leader_election.cc:336] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:57.926707  6295 leader_election.cc:336] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:57.927073  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0d5cf9e08445eea2f9773bf33622d4" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:16:57.927265  6295 consensus_peers.cc:597] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:57.927870  6295 leader_election.cc:336] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:57.929770  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af589183a05415d9cb49d32caedd78f" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:57.930490  6938 raft_consensus.cc:2393] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 15: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:57.926266  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c399f07ba644d25ba3579e60d6962bd" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.933558  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:57.933574  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec594ed8e8449619512ba6e0d3d04cf" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.936465  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:57.933596 12667 leader_election.cc:290] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:57.938678  6938 raft_consensus.cc:2393] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 11: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:57.942646  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:57.943027  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.943604  6405 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:16:57.945075  6907 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:57.946322  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.946553  6907 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:57.951030 12710 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:57.951429 12710 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.951820 12710 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:57.953529  6907 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:57.954258  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:57.954494 12706 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:57.954845  6403 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:57.954954 12706 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:57.955408 12706 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:57.958702  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.958945  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce99643832824368978841e0265f9d2d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:57.963032 12696 raft_consensus.cc:2804] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:57.963786 12696 raft_consensus.cc:697] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 15 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:57.964102  6396 raft_consensus.cc:1275] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:57.975863  6935 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:57.989876  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.997745  6403 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:57.971213  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:57.999162  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:57.954707  6907 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:57.999897  6400 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:58.001603  6940 raft_consensus.cc:2393] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:57.969877  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:57.944322 12675 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:16:58.001737  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 47087.5us
I20260709 13:16:57.971524 12706 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.008635 12706 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:58.005905  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:58.012975  6938 raft_consensus.cc:2393] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 14: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:58.011096  6907 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:58.015792  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:58.021646  6935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.013314 12699 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:58.021592  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:58.030565  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:58.031677 12710 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.018054 12659 raft_consensus.cc:2804] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:58.033547 12659 raft_consensus.cc:697] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:58.034437 12659 consensus_queue.cc:237] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.000371 12689 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.043960  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:58.044737  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:58.045933  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5176b2e1ff0145bdb28b559244b3cf5e" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:58.048620  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:58.049410  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:58.052006  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca18f52abcd4cf291ae45a415535e88" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:57.975181 12696 consensus_queue.cc:237] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.058961  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25e23b6cebd41369f84b2c74e182cbd" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:58.055843  6905 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:58.061148  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fbd02cf1f2d48d2ac594411f00f9678" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:58.030031 12699 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:58.062289  6331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e60eb0eafd44b02ac71f72df7d3e65d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:58.017426 12701 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.064811  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeec6c3b81b4e22b65d23b164087705" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.065292  6941 raft_consensus.cc:2393] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 16: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:58.064682  6322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:58.060672  6905 leader_election.cc:304] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.074533  6368 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:58.073395  6295 leader_election.cc:336] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.071156  6296 leader_election.cc:304] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.057265 12690 consensus_queue.cc:1048] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:16:58.068120 12691 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:58.099009 12691 raft_consensus.cc:493] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:58.099496 12691 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:58.098488  6937 raft_consensus.cc:1275] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:58.101850 12678 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:58.105402  6368 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:58.078856  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc84db94ed44cf9bab11e4626d2ba6e" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.074141 12681 raft_consensus.cc:493] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.107900 12681 raft_consensus.cc:515] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:16:58.108220 12667 raft_consensus.cc:2749] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:58.109469 12678 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.109915 12681 leader_election.cc:290] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:58.107115  6368 leader_election.cc:304] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:58.111443  6368 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:58.112447  6148 catalog_manager.cc:5697] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 17 to 18, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2). New cstate: current_term: 18 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.068071 12699 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:58.117667  6940 raft_consensus.cc:1240] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:58.113273  6905 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:58.119526  6296 leader_election.cc:304] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.110316 12690 raft_consensus.cc:2749] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:58.124861  6938 raft_consensus.cc:2468] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:58.128669  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1061e95aa2d446f2aeb9563f482f1cd9" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.129015 12675 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:58.137770 12675 raft_consensus.cc:493] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:58.138127 12675 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:58.141975 12678 raft_consensus.cc:2749] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:58.129729 12710 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:58.130471  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b743ddeba148d8a8fb0d816501812b" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.130539  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c1e4f96c604cc898081f72ae4eacf2" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.131619  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.146832 12675 raft_consensus.cc:515] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.120319 12697 raft_consensus.cc:2749] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:58.148165  6941 raft_consensus.cc:2393] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 13: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:58.149111 12675 leader_election.cc:290] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:58.120028  6905 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.151866  6905 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.152763  6905 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.155789  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.160498  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.161191 12689 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:58.161454  6942 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:58.167263 12683 consensus_queue.cc:1059] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:58.168459 12683 raft_consensus.cc:3055] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:58.153601 12710 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:58.168922 12683 raft_consensus.cc:740] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:58.172170  6942 raft_consensus.cc:1240] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:58.173025  6940 raft_consensus.cc:1240] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:58.174180  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ff23bb63c4e33afd90afd6bf5f198" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.175169  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad52cf302674a048c4b3a989596b435" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.156049 12675 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:58.177184  6939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7143f4f3a1eb4f73ae609d74917b08bc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.178459  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17ed9277f5d4839b300200e6c909c0f" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.179960  6942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae75079e4a9346d0a9b0c375570b7f9d" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.181152  6939 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:58.157459 12697 consensus_queue.cc:1048] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:16:58.183179  6940 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:58.184139  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334e41443e364890b884c69082b3bb30" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:58.185918 12701 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:58.188235 12691 raft_consensus.cc:515] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.189550  6941 raft_consensus.cc:2393] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 12: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:58.118468 12681 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:58.192736  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:58.170176 12683 consensus_queue.cc:260] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.194499 12683 raft_consensus.cc:3060] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:58.197419 12699 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.201292  6937 raft_consensus.cc:1240] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:58.192682 12691 leader_election.cc:290] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:16:58.199831  6368 leader_election.cc:304] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:58.206619 12678 raft_consensus.cc:2749] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:58.199297  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.212325  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:58.213311  6396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
W20260709 13:16:58.213881  6369 leader_election.cc:336] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:58.220067  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 67338.4us
I20260709 13:16:58.221581 12675 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:58.222258 12675 consensus_queue.cc:1048] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:58.223376  6905 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:58.227409  6935 raft_consensus.cc:1240] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:58.228252  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884ae035eff04463b5ff7a054f75935d" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:58.230983  6297 leader_election.cc:304] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.232138 12697 raft_consensus.cc:2749] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:58.233088  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:58.230165 12675 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:58.236241 12675 raft_consensus.cc:493] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2d6410349fdc47f5a98ba3c6f7d5510b)
I20260709 13:16:58.236723 12675 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:58.250478 12691 consensus_queue.cc:1048] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:58.255839  6905 leader_election.cc:304] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.231470 12699 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:16:58.257815  6368 leader_election.cc:304] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:58.261977 12706 raft_consensus.cc:2749] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:58.264935  6906 consensus_peers.cc:597] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.265491  6906 consensus_peers.cc:597] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:58.266126  6906 leader_election.cc:336] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.266898  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:58.269835 12675 raft_consensus.cc:515] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.272030 12675 leader_election.cc:290] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Requested vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:58.288782  6963 debug-util.cc:398] Leaking SignalData structure 0x7b0800353840 after lost signal to thread 5115
W20260709 13:16:58.290167  6963 debug-util.cc:398] Leaking SignalData structure 0x7b080003f260 after lost signal to thread 6188
W20260709 13:16:58.291608  6963 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9500 after lost signal to thread 6355
W20260709 13:16:58.292835  6963 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9000 after lost signal to thread 6429
W20260709 13:16:58.294085  6963 debug-util.cc:398] Leaking SignalData structure 0x7b0800317e20 after lost signal to thread 6966
I20260709 13:16:58.294976  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090a0dad86b546e6b091b67e69cc1bcc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:58.297652  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:58.299860  6371 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:58.300649 12677 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.305092  6297 leader_election.cc:304] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.305999  6371 leader_election.cc:304] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:58.305101  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:58.307188  6327 raft_consensus.cc:2468] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:58.302273  6148 catalog_manager.cc:5697] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 14 to 15, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 15 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:58.309646 12697 consensus_queue.cc:1048] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:58.309998 12677 raft_consensus.cc:2749] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.311199  6371 leader_election.cc:304] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:58.312100  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:58.312664  6371 leader_election.cc:304] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:58.313292 12698 raft_consensus.cc:2749] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:58.315037  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:58.309553  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:58.317353  6329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1ca4c5e4934cf9b482701f5eb26d1a" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:58.318037  6329 raft_consensus.cc:3060] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:58.318926  6371 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:58.319875 12681 raft_consensus.cc:2749] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:58.320705 12712 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.323551  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:58.325434  6148 catalog_manager.cc:5697] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 12 to 13, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 13 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:58.335392  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772aad0e3cb043d989afc6d1abdbf6f4" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:58.336222  6330 raft_consensus.cc:3060] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:58.323011  6371 leader_election.cc:304] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:58.340418 12681 raft_consensus.cc:2749] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:58.336043  6297 leader_election.cc:304] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:58.350075  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:58.358271  6905 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.360917  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f408a1388f424db8b65332c1dcd467" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:58.361625  6327 raft_consensus.cc:3060] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:58.364040  6329 raft_consensus.cc:2468] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 13.
I20260709 13:16:58.324708 12673 raft_consensus.cc:2749] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:58.366070  6326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:58.367154  6297 leader_election.cc:304] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:58.403226  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 45036.5us
I20260709 13:16:58.404282  6905 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.395689 12668 raft_consensus.cc:2749] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:58.408592 12691 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.348768 12679 consensus_queue.cc:1059] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:16:58.411845  6905 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.412539 12699 raft_consensus.cc:2749] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:58.413344 12699 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.415586  6905 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.416492 12710 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:58.395476 12697 raft_consensus.cc:2749] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:58.423170  6905 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:58.423243  6295 consensus_peers.cc:597] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:58.424013 12675 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.424938 12679 raft_consensus.cc:3055] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:58.425374 12679 raft_consensus.cc:740] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:58.426172 12679 consensus_queue.cc:260] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.427556 12679 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:58.450906  6327 raft_consensus.cc:2468] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:16:58.453586  6330 raft_consensus.cc:2468] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
W20260709 13:16:58.466951  6906 leader_election.cc:336] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:58.468145  6906 leader_election.cc:336] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.481302 12675 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.481951 12675 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.484225 12675 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:16:58.500612  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 177686us
I20260709 13:16:58.502033  6371 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:58.509989  6906 leader_election.cc:336] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.510614  6906 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:58.518853  6371 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:58.519385  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 50252us
W20260709 13:16:58.519984  6906 consensus_peers.cc:597] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:58.520466  6906 leader_election.cc:336] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:58.521140  6906 leader_election.cc:336] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.522655  6371 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:58.523298  6906 leader_election.cc:304] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.489828 12678 raft_consensus.cc:2749] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:58.528105  6371 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:58.523764 12712 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:58.538179  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 171125us
W20260709 13:16:58.540992  6906 leader_election.cc:336] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.541316 12702 raft_consensus.cc:2749] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.541509 12712 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:58.543409  6906 leader_election.cc:336] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.543486 12712 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:58.543991  6906 leader_election.cc:304] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:58.545003  6906 leader_election.cc:336] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.545346 12702 raft_consensus.cc:2749] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:58.545451  6906 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:58.549160  6297 leader_election.cc:304] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:58.550503  5112 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 6277)
I20260709 13:16:58.550879  6297 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:58.525105 12681 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:58.524173 12675 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:58.567878  6297 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b
W20260709 13:16:58.568862  6906 leader_election.cc:336] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.569996  6906 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:16:58.571524  6905 leader_election.cc:304] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:58.572831 12710 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:58.573642 12710 raft_consensus.cc:2804] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:58.573563  6905 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.574391 12710 raft_consensus.cc:697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:58.575768 12699 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:58.575470 12710 consensus_queue.cc:237] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.577562  6905 leader_election.cc:304] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:58.578630 12669 raft_consensus.cc:2804] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:58.579165 12669 raft_consensus.cc:697] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:16:58.579190  6905 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:16:58.580315 12669 consensus_queue.cc:237] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.581331 12699 raft_consensus.cc:2804] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:58.582070 12699 raft_consensus.cc:697] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
W20260709 13:16:58.572477  6906 leader_election.cc:336] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.583865  6906 leader_election.cc:304] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.567379 12702 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.566756 12697 raft_consensus.cc:2749] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.587577 12675 raft_consensus.cc:2749] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.569649 12668 raft_consensus.cc:2749] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:58.597365  6906 leader_election.cc:336] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.597853  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e69d69ccd4bc99194b3d3e6633693" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:58.586444 12694 raft_consensus.cc:2764] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:58.597936  6906 leader_election.cc:304] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:16:58.610442  6906 leader_election.cc:336] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:58.611979  6906 leader_election.cc:336] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.612481  6906 leader_election.cc:304] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.619709  6297 leader_election.cc:304] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:58.601825 12712 raft_consensus.cc:2749] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:58.617251 12675 raft_consensus.cc:2749] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:58.613210 12702 raft_consensus.cc:2749] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.594506 12731 raft_consensus.cc:2804] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:16:58.636047  6906 leader_election.cc:336] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.630633  6297 leader_election.cc:304] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.637395  6400 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 15. Current term is 16. Ops: []
W20260709 13:16:58.639900  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 54779.3us
I20260709 13:16:58.608551 12679 consensus_queue.cc:1059] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260709 13:16:58.642467  6906 consensus_peers.cc:597] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:58.645048  6297 leader_election.cc:304] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:58.646091  6940 raft_consensus.cc:1275] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:16:58.636760 12694 raft_consensus.cc:2749] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:58.599984 12699 consensus_queue.cc:237] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.633724 12697 consensus_queue.cc:1059] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:16:58.654608 12679 raft_consensus.cc:3055] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:58.658665 12679 raft_consensus.cc:740] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:58.659866 12679 consensus_queue.cc:260] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.640435 12681 raft_consensus.cc:2749] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.668536 12679 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:58.646415 12698 raft_consensus.cc:2749] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.674611 12697 raft_consensus.cc:3055] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:58.677402 12668 raft_consensus.cc:2749] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:58.679750  6297 leader_election.cc:304] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:58.691998  6297 leader_election.cc:304] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:58.702713  6296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.709784  6297 leader_election.cc:304] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:58.694712 12685 raft_consensus.cc:2749] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.694347 12682 raft_consensus.cc:2749] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:58.697746 12697 raft_consensus.cc:740] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:58.749621  6297 leader_election.cc:304] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:58.749604  6398 raft_consensus.cc:1240] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:58.735314 12683 consensus_queue.cc:1059] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:16:58.757596 12734 raft_consensus.cc:2749] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:58.769384 12682 consensus_queue.cc:1059] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:58.710073 12694 consensus_queue.cc:1059] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:16:58.753103 12668 raft_consensus.cc:2749] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:58.789007 12698 raft_consensus.cc:3055] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:58.757012 12731 raft_consensus.cc:697] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:58.793493 12698 raft_consensus.cc:740] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:58.805195 12694 consensus_queue.cc:1059] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:58.810196  6147 catalog_manager.cc:5697] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 12 to 13, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 13 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:58.814847  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 105919us
I20260709 13:16:58.822881 12685 raft_consensus.cc:3055] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:58.823414 12685 raft_consensus.cc:740] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:58.825496  6328 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:16:58.826514 12682 consensus_queue.cc:1048] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:58.829865 12698 consensus_queue.cc:260] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.831336 12698 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:58.824358 12685 consensus_queue.cc:260] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:58.836781 12742 log.cc:927] Time spent T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe: Append to log took a long time: real 0.141s	user 0.000s	sys 0.003s
I20260709 13:16:58.797118 12697 consensus_queue.cc:260] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.846060 12697 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:58.886269  6296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 88378.8us
I20260709 13:16:58.894469  6397 raft_consensus.cc:1275] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:16:58.896059  6403 raft_consensus.cc:1275] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:58.896705 12733 consensus_queue.cc:1059] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:16:58.875443 12706 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:16:58.886343 12731 consensus_queue.cc:237] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.907037 12685 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.913213 12734 raft_consensus.cc:3055] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:58.940029 12734 raft_consensus.cc:740] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:16:58.940976 12734 consensus_queue.cc:260] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:58.942317 12734 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:58.935786  6147 catalog_manager.cc:5697] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 13 to 14, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 14 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:58.944418  6403 raft_consensus.cc:1240] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Rejecting Update request from peer a13ffe92eb374309a5c8476d9fbbb2b8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:58.945989  6147 catalog_manager.cc:5697] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 11 to 12, leader changed from 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 12 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:58.976619  6906 leader_election.cc:336] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.977202  6906 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
W20260709 13:16:58.978214  6906 leader_election.cc:336] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:16:58.981760 12702 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:58.982196 12691 consensus_queue.cc:1048] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:58.982962 12702 consensus_queue.cc:1048] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:16:58.997107  6906 leader_election.cc:336] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:16:58.997992  6906 consensus_peers.cc:597] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:59.060038  6323 raft_consensus.cc:1275] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:59.061702 12740 consensus_queue.cc:1048] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:59.113299  6906 consensus_peers.cc:597] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:59.114187  6906 consensus_peers.cc:597] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:59.127526  6324 raft_consensus.cc:1275] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:59.142797  6148 catalog_manager.cc:5697] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 12 to 13, leader changed from 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 13 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.146282 12699 consensus_queue.cc:1048] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:59.152915  6324 raft_consensus.cc:1275] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:16:59.153321  6369 consensus_peers.cc:597] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:59.181023 12757 consensus_queue.cc:1048] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:16:59.227648  6906 consensus_peers.cc:597] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:59.263948  6906 consensus_peers.cc:597] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:59.270426  6369 consensus_peers.cc:597] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:59.346526 12685 raft_consensus.cc:493] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8600a3fead0e48a7aa813822ec44d0fe)
I20260709 13:16:59.347086 12685 raft_consensus.cc:515] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:59.349587 12685 leader_election.cc:290] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:59.351483  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:59.352303  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3009228e555646f4870d29db171cddfb" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:59.353021  6941 raft_consensus.cc:2393] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a13ffe92eb374309a5c8476d9fbbb2b8 in current term 13: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:16:59.355021  6296 leader_election.cc:304] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:16:59.356684 12753 raft_consensus.cc:3060] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:59.365033 12753 raft_consensus.cc:2749] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:59.373602  6369 consensus_peers.cc:597] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:59.439841  6937 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:59.441241 12756 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:16:59.447844  6369 consensus_peers.cc:597] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:59.468827 12756 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:59.469470 12756 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:59.468750 12686 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:59.482921 12686 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:59.490227  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:59.490974  6327 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:59.492931  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:59.493727  6941 raft_consensus.cc:2393] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 15: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:59.485016 12686 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:59.494808  6368 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:59.496145 12737 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:59.496543 12737 raft_consensus.cc:493] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:59.496905 12737 raft_consensus.cc:3060] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:59.497838 12756 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:59.501958  6941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:59.502713  6941 raft_consensus.cc:2393] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:59.508651  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:16:59.509289  6327 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:59.511873 12737 raft_consensus.cc:515] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:59.512676  6368 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:59.514070 12737 leader_election.cc:290] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:59.515477 12678 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:59.515863 12678 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:16:59.516224 12678 raft_consensus.cc:3060] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:59.521185  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:59.522383  6937 raft_consensus.cc:2393] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 15: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:59.528733  6330 raft_consensus.cc:1275] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:59.530786  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7508c25b6d9944dda6f30aac9f238ae6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
W20260709 13:16:59.544378  6295 consensus_peers.cc:597] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:59.544988 12686 consensus_queue.cc:1048] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:16:59.569458  5112 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 6277)
I20260709 13:16:59.592196 12678 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:59.595330  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:16:59.596057  6937 raft_consensus.cc:2393] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 13: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:16:59.597584  6330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:16:59.602344  6327 raft_consensus.cc:2468] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 15.
I20260709 13:16:59.606619  6368 leader_election.cc:304] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
W20260709 13:16:59.607376  6295 consensus_peers.cc:597] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:59.608108 12737 raft_consensus.cc:2804] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:59.608647 12737 raft_consensus.cc:697] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:59.609524 12737 consensus_queue.cc:237] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:59.625800  6369 consensus_peers.cc:597] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:59.623273 12678 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:59.635778  6330 raft_consensus.cc:2468] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 13.
I20260709 13:16:59.637235  6368 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe
I20260709 13:16:59.639389 12678 raft_consensus.cc:2804] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:59.653558  6148 catalog_manager.cc:5697] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 14 to 15, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 15 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.641577 12678 raft_consensus.cc:697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Becoming Leader. State: Replica: b940f12ed61a49c4b3c11f13ef50fa92, State: Running, Role: LEADER
I20260709 13:16:59.658413 12678 consensus_queue.cc:237] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:16:59.703272  6295 consensus_peers.cc:597] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.724395  6295 consensus_peers.cc:597] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:59.719762  6148 catalog_manager.cc:5697] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 reported cstate change: term changed from 12 to 13, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3). New cstate: current_term: 13 leader_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:59.766542  6295 consensus_peers.cc:597] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.833650  6369 consensus_peers.cc:597] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.838855  6369 consensus_peers.cc:597] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.863481  6369 consensus_peers.cc:597] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.877559  6369 consensus_peers.cc:597] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.899047  6295 consensus_peers.cc:597] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.914507  6369 consensus_peers.cc:597] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:59.964401 12753 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.964993 12753 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:59.967247 12753 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:16:59.968799  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:16:59.969892  6403 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 13.
I20260709 13:16:59.970108  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:16:59.970736  6937 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 14.
I20260709 13:16:59.971114  6296 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:16:59.972003 12753 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:59.972407 12753 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.972793 12753 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:59.987572 12753 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:16:59.991063  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:16:59.991626  6403 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:00.003289 12740 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.003875 12740 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:00.005944 12740 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:17:00.013644  6403 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
I20260709 13:17:00.016212  6296 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:17:00.017058 12698 raft_consensus.cc:2804] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:00.017761 12698 raft_consensus.cc:697] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Becoming Leader. State: Replica: a13ffe92eb374309a5c8476d9fbbb2b8, State: Running, Role: LEADER
I20260709 13:17:00.018620 12698 consensus_queue.cc:237] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:00.025787 12753 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [CANDIDATE]: Term 15 election: Requested vote from peers b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:17:00.026125  6295 consensus_peers.cc:597] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:00.034615  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:17:00.035367  6400 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:17:00.040529  6907 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:17:00.040751  6937 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:00.041720 12696 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:00.042092 12696 raft_consensus.cc:493] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.042429 12696 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:00.046906 12737 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:00.050084 12696 raft_consensus.cc:515] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:00.053730 12706 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.054296 12706 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:00.056653 12706 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:17:00.065259  6369 consensus_peers.cc:597] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:00.069463  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:17:00.070173  6403 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 16.
I20260709 13:17:00.074559  6907 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:17:00.077872 12740 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:00.078334 12740 raft_consensus.cc:493] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.078737 12740 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:00.090252 12696 leader_election.cc:290] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:17:00.091652  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:17:00.100005  6403 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:00.104053  6148 catalog_manager.cc:5697] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.125036  6330 raft_consensus.cc:1275] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:00.131655 12737 consensus_queue.cc:1048] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:00.094411 12740 raft_consensus.cc:515] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:00.147921  6403 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 15.
I20260709 13:17:00.180583  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:17:00.181279  6327 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 14.
I20260709 13:17:00.179078  6907 leader_election.cc:304] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
I20260709 13:17:00.194864  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:17:00.197928  6327 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 16.
I20260709 13:17:00.202260  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c8c870200141efa8a5f7cc58ece4a6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:17:00.202996  6327 raft_consensus.cc:3060] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:00.189240 12784 raft_consensus.cc:2804] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:00.216027  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:17:00.217859  6323 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:00.190455 12740 leader_election.cc:290] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:17:00.239444  6297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:33105, user_credentials={real_user=slave}} blocked reactor thread for 221413us
I20260709 13:17:00.244778  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
I20260709 13:17:00.245440  6937 raft_consensus.cc:3060] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:00.267970  6323 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 17.
I20260709 13:17:00.269582  6400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cead5798bd4451a23aee760d202f18" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:17:00.241017 12784 raft_consensus.cc:697] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:17:00.270233  6400 raft_consensus.cc:3060] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:00.300621  6327 raft_consensus.cc:2468] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 15.
W20260709 13:17:00.313325  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 93694.7us
W20260709 13:17:00.326663  6906 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111) [suppressed 319 similar messages]
I20260709 13:17:00.284325 12706 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.342092  6400 raft_consensus.cc:2468] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 17.
W20260709 13:17:00.345947  6907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:34111, user_credentials={real_user=slave}} blocked reactor thread for 63535.1us
I20260709 13:17:00.351423  6905 leader_election.cc:304] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:17:00.338433 12706 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:00.359733 12740 raft_consensus.cc:2804] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:00.366112 12788 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.391037  6941 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:17:00.349937 12784 consensus_queue.cc:237] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:00.398267 12706 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:17:00.393021 12740 raft_consensus.cc:697] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:17:00.400863 12740 consensus_queue.cc:237] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:17:00.417788  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 78346.8us
I20260709 13:17:00.419842  6327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:17:00.420274  6323 raft_consensus.cc:1275] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Refusing update from remote peer b940f12ed61a49c4b3c11f13ef50fa92: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:17:00.420485  6327 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:17:00.435269  6905 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:17:00.437321 12696 raft_consensus.cc:493] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.438052 12696 raft_consensus.cc:515] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:00.444864 12791 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:00.445581 12791 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.446067 12791 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.449499 12789 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:00.441008 12696 leader_election.cc:290] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
W20260709 13:17:00.461201  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 131461us
I20260709 13:17:00.406690 12788 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:17:00.501509  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 64996.4us
I20260709 13:17:00.503921  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:17:00.504142  6937 raft_consensus.cc:2468] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13ffe92eb374309a5c8476d9fbbb2b8 in term 15.
W20260709 13:17:00.524716  6295 consensus_peers.cc:597] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:00.525341  6295 consensus_peers.cc:597] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:00.539915 12788 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
W20260709 13:17:00.545555  6295 consensus_peers.cc:597] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:00.547037  6295 consensus_peers.cc:597] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:00.556327  6403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:17:00.557062  6403 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 11.
I20260709 13:17:00.559494  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" is_pre_election: true
I20260709 13:17:00.560163  6324 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b940f12ed61a49c4b3c11f13ef50fa92 in term 11.
I20260709 13:17:00.563354  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e7a35d701c4730b5efb6fefa7f5ec6" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" is_pre_election: true
I20260709 13:17:00.563973  6368 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92; no voters: 
W20260709 13:17:00.571645  5112 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 6277)
I20260709 13:17:00.581674  6907 leader_election.cc:304] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
W20260709 13:17:00.590867  6369 consensus_peers.cc:597] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:00.591468  6369 consensus_peers.cc:597] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:00.595615 12784 raft_consensus.cc:2749] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:00.597064 12686 consensus_queue.cc:1048] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:00.587891 12802 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:00.598551 12802 raft_consensus.cc:493] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.599018 12802 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.598294  6151 catalog_manager.cc:5697] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 13 to 15, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 15 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:00.527022 12791 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:00.612699  6938 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:00.614558 12791 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:17:00.620401  6937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
I20260709 13:17:00.621213  6937 raft_consensus.cc:2393] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 12: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
I20260709 13:17:00.626204  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b940f12ed61a49c4b3c11f13ef50fa92"
I20260709 13:17:00.630964  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "8600a3fead0e48a7aa813822ec44d0fe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:17:00.632794  6324 raft_consensus.cc:3060] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.629648  6151 catalog_manager.cc:5697] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 15 to 17, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 17 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:00.641685  6324 raft_consensus.cc:2468] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8600a3fead0e48a7aa813822ec44d0fe in term 12.
I20260709 13:17:00.607134 12802 raft_consensus.cc:515] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:00.649619  6400 raft_consensus.cc:1275] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Refusing update from remote peer a13ffe92eb374309a5c8476d9fbbb2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:00.651981  6905 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8; no voters: 
I20260709 13:17:00.652418  6399 raft_consensus.cc:2393] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8600a3fead0e48a7aa813822ec44d0fe in current term 12: Already voted for candidate b940f12ed61a49c4b3c11f13ef50fa92 in this term.
I20260709 13:17:00.652721 12753 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:00.653995 12784 raft_consensus.cc:2804] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:00.654561 12784 raft_consensus.cc:697] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Becoming Leader. State: Replica: 8600a3fead0e48a7aa813822ec44d0fe, State: Running, Role: LEADER
I20260709 13:17:00.655459 12784 consensus_queue.cc:237] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:00.656345 12802 leader_election.cc:290] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Requested vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:17:00.665848  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8"
I20260709 13:17:00.669507  6324 raft_consensus.cc:2393] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b940f12ed61a49c4b3c11f13ef50fa92 in current term 12: Already voted for candidate 8600a3fead0e48a7aa813822ec44d0fe in this term.
W20260709 13:17:00.666263  6906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:43495, user_credentials={real_user=slave}} blocked reactor thread for 53469.9us
I20260709 13:17:00.689960 12753 consensus_queue.cc:1048] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:17:00.697080  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 45167.3us
I20260709 13:17:00.710000  6940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef76416cb5194a2cb26550333d72c307" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe"
W20260709 13:17:00.727011  6295 consensus_peers.cc:597] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:00.729638  6371 leader_election.cc:304] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:17:00.730440 12802 raft_consensus.cc:2749] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:00.740490  6906 consensus_peers.cc:597] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:00.752266  6906 consensus_peers.cc:597] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:00.752969  6906 consensus_peers.cc:597] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:00.753515  6906 consensus_peers.cc:597] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:00.759151  6151 catalog_manager.cc:5697] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe reported cstate change: term changed from 10 to 12, leader changed from a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2) to 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4). New cstate: current_term: 12 leader_uuid: "8600a3fead0e48a7aa813822ec44d0fe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:00.792695  6906 consensus_peers.cc:597] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:00.810799  6906 consensus_peers.cc:597] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:00.836612  6906 consensus_peers.cc:597] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:00.840301  6906 consensus_peers.cc:597] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:00.900609  6400 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:00.904579  6330 raft_consensus.cc:1275] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:00.905475 12791 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:17:00.909565 12784 consensus_queue.cc:1048] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:17:00.939334  6906 consensus_peers.cc:597] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:00.995577  6906 consensus_peers.cc:597] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:01.004933  6906 consensus_peers.cc:597] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:01.013051  6906 consensus_peers.cc:597] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:01.016428  6905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 54987us
I20260709 13:17:01.027873  6328 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:17:01.034889  6295 consensus_peers.cc:597] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:01.046731  6399 raft_consensus.cc:1275] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:01.055771 12779 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
W20260709 13:17:01.078552  6906 consensus_peers.cc:597] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:01.078719 12784 consensus_queue.cc:1048] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:17:01.098821  6330 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:01.111713 12824 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:01.185896  6400 raft_consensus.cc:1275] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Refusing update from remote peer 8600a3fead0e48a7aa813822ec44d0fe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:01.191766 12779 consensus_queue.cc:1048] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:17:01.401757  6369 consensus_peers.cc:597] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:01.538379  6906 consensus_peers.cc:597] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:01.572126  5112 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 6277)
W20260709 13:17:01.611600  6906 consensus_peers.cc:597] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:01.631877  6369 consensus_peers.cc:597] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:01.687626  6906 consensus_peers.cc:597] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:01.722600  6906 consensus_peers.cc:597] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:01.801491  6906 consensus_peers.cc:597] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:01.852126  6369 consensus_peers.cc:597] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:01.989964  6295 consensus_peers.cc:597] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.011576  6369 consensus_peers.cc:597] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.108071  6295 consensus_peers.cc:597] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.115456  6369 consensus_peers.cc:597] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.127120  6295 consensus_peers.cc:597] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.199572  6295 consensus_peers.cc:597] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.534708  6295 consensus_peers.cc:597] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.539537  6295 consensus_peers.cc:597] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.572861  5112 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 6277)
W20260709 13:17:02.591219  6369 consensus_peers.cc:597] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.594116  6369 consensus_peers.cc:597] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.594666  6369 consensus_peers.cc:597] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.598076  6369 consensus_peers.cc:597] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.609160  6295 consensus_peers.cc:597] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.619796  6369 consensus_peers.cc:597] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.620404  6369 consensus_peers.cc:597] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.008406  6906 consensus_peers.cc:597] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:03.046492  6369 consensus_peers.cc:597] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:03.049165  6369 consensus_peers.cc:597] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.048609  6906 consensus_peers.cc:597] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.056595  6295 consensus_peers.cc:597] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:03.057564  6295 consensus_peers.cc:597] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:03.103463  6295 consensus_peers.cc:597] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:03.158772  6906 consensus_peers.cc:597] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.178256  6295 consensus_peers.cc:597] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:03.192215  6906 consensus_peers.cc:597] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.319075  6906 consensus_peers.cc:597] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.379045  6185 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa920 after lost signal to thread 5115
W20260709 13:17:03.380239  6185 debug-util.cc:398] Leaking SignalData structure 0x7b08003885a0 after lost signal to thread 6188
W20260709 13:17:03.381626  6185 debug-util.cc:398] Leaking SignalData structure 0x7b08003b8be0 after lost signal to thread 6355
W20260709 13:17:03.382860  6185 debug-util.cc:398] Leaking SignalData structure 0x7b08000be700 after lost signal to thread 6429
W20260709 13:17:03.384397  6185 debug-util.cc:398] Leaking SignalData structure 0x7b0800364fa0 after lost signal to thread 6966
W20260709 13:17:03.417703  6295 consensus_peers.cc:597] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.440265  6906 consensus_peers.cc:597] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.470453  6906 consensus_peers.cc:597] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.490707  6906 consensus_peers.cc:597] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.495327  6295 consensus_peers.cc:597] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:03.535938  6906 consensus_peers.cc:597] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.573383  5112 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 6277)
W20260709 13:17:03.607673  6906 consensus_peers.cc:597] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:03.631731  6906 consensus_peers.cc:597] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.654062  6906 consensus_peers.cc:597] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.680858  6906 consensus_peers.cc:597] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:03.791004  6906 consensus_peers.cc:597] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:04.086869  6368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39965, user_credentials={real_user=slave}} blocked reactor thread for 50503.8us
W20260709 13:17:04.127954  6369 consensus_peers.cc:597] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:04.141384  6369 consensus_peers.cc:597] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.213342  6906 consensus_peers.cc:597] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:04.238432  6906 consensus_peers.cc:597] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:04.264940  6906 consensus_peers.cc:597] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:04.294606  6906 consensus_peers.cc:597] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:04.413300  6295 consensus_peers.cc:597] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.438773  6295 consensus_peers.cc:597] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.491741  6369 consensus_peers.cc:597] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.535194  6369 consensus_peers.cc:597] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.550236  6295 consensus_peers.cc:597] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.574941  5112 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 6277)
W20260709 13:17:04.722469  6369 consensus_peers.cc:597] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.723690  6295 consensus_peers.cc:597] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.811442  6369 consensus_peers.cc:597] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.004052  6295 consensus_peers.cc:597] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.005501  6369 consensus_peers.cc:597] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.021754  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff4e0 after lost signal to thread 5115
W20260709 13:17:05.023945  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08003e2a80 after lost signal to thread 6188
W20260709 13:17:05.029364  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002fbcc0 after lost signal to thread 6355
W20260709 13:17:05.032714  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5540 after lost signal to thread 6429
W20260709 13:17:05.039786  6426 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7340 after lost signal to thread 6966
W20260709 13:17:05.055753  6369 consensus_peers.cc:597] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.126864  6295 consensus_peers.cc:597] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.130718  6906 consensus_peers.cc:597] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.144181  6295 consensus_peers.cc:597] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.222918  6369 consensus_peers.cc:597] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.224575  6369 consensus_peers.cc:597] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.304837  6369 consensus_peers.cc:597] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.333945  6295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111) [suppressed 445 similar messages]
W20260709 13:17:05.448151  6906 consensus_peers.cc:597] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:05.561357  6369 consensus_peers.cc:597] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.575655  5112 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 6277)
W20260709 13:17:05.613461  6369 consensus_peers.cc:597] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:05.620354  6295 consensus_peers.cc:597] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:05.680156  6295 consensus_peers.cc:597] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:05.713598  6906 consensus_peers.cc:597] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.780011  6906 consensus_peers.cc:597] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.823681  6295 consensus_peers.cc:597] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:05.877441  6295 consensus_peers.cc:597] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:05.894826  6906 consensus_peers.cc:597] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.939072  6295 consensus_peers.cc:597] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:05.986364  6906 consensus_peers.cc:597] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.990002  6906 consensus_peers.cc:597] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:06.064169  6295 consensus_peers.cc:597] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:06.114620  6906 consensus_peers.cc:597] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:06.117532  6906 consensus_peers.cc:597] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:06.169246  6906 consensus_peers.cc:597] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:06.198552  6906 consensus_peers.cc:597] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:06.253053  6906 consensus_peers.cc:597] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:06.363762  6906 consensus_peers.cc:597] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:06.364346  6906 consensus_peers.cc:597] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:17:06.437106  5112 tablet_server.cc:196] TabletServer@127.4.254.1:0 shutdown complete.
W20260709 13:17:06.571808  6295 consensus_peers.cc:597] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:17:06.606746  5112 tablet_server.cc:179] TabletServer@127.4.254.2:0 shutting down...
W20260709 13:17:06.647539  6368 consensus_peers.cc:597] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.648303  6906 consensus_peers.cc:597] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:06.648916  6906 consensus_peers.cc:597] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:06.683593  6905 consensus_peers.cc:597] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.684140  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:06.685057  5112 tablet_replica.cc:333] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.686031  5112 raft_consensus.cc:2243] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.686988  5112 raft_consensus.cc:2272] T 47628993693e4f69a935e61e4071de94 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.689260  5112 tablet_replica.cc:333] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.690181  5112 raft_consensus.cc:2243] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.691001  5112 raft_consensus.cc:2272] T 7eeec6c3b81b4e22b65d23b164087705 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.694119  5112 tablet_replica.cc:333] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.694949  5112 raft_consensus.cc:2243] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.696102  5112 raft_consensus.cc:2272] T 41e18ec9396146c6acf964c759dd56fc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.698174  5112 tablet_replica.cc:333] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.698813  5112 raft_consensus.cc:2243] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.699347  5112 raft_consensus.cc:2272] T 7143f4f3a1eb4f73ae609d74917b08bc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.702155  5112 tablet_replica.cc:333] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.702991  5112 raft_consensus.cc:2243] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.704231  5112 raft_consensus.cc:2272] T 1c399f07ba644d25ba3579e60d6962bd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.706406  6369 consensus_peers.cc:597] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:17:06.706959  5112 tablet_replica.cc:333] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.707784  5112 raft_consensus.cc:2243] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.708894  5112 raft_consensus.cc:2272] T 5176b2e1ff0145bdb28b559244b3cf5e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.711609  5112 tablet_replica.cc:333] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.712471  5112 raft_consensus.cc:2243] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.713644  5112 raft_consensus.cc:2272] T 9e60eb0eafd44b02ac71f72df7d3e65d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.714437  6905 consensus_peers.cc:597] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.716420  5112 tablet_replica.cc:333] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.717299  5112 raft_consensus.cc:2243] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.717869  5112 raft_consensus.cc:2272] T f3c8c870200141efa8a5f7cc58ece4a6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.720578  5112 tablet_replica.cc:333] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.721473  5112 raft_consensus.cc:2243] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.722671  5112 raft_consensus.cc:2272] T 0fbd02cf1f2d48d2ac594411f00f9678 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.724705  5112 tablet_replica.cc:333] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.725358  5112 raft_consensus.cc:2243] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.726449  5112 raft_consensus.cc:2272] T 334e41443e364890b884c69082b3bb30 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.728605  5112 tablet_replica.cc:333] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.729214  5112 raft_consensus.cc:2243] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.729725  5112 raft_consensus.cc:2272] T 55cead5798bd4451a23aee760d202f18 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.731509  5112 tablet_replica.cc:333] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.732043  5112 raft_consensus.cc:2243] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.732748  5112 raft_consensus.cc:2272] T ce99643832824368978841e0265f9d2d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.735121  5112 tablet_replica.cc:333] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.735772  5112 raft_consensus.cc:2243] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.736788  5112 raft_consensus.cc:2272] T e25e23b6cebd41369f84b2c74e182cbd P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.738116  6368 consensus_peers.cc:597] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.739226  5112 tablet_replica.cc:333] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.740159  5112 raft_consensus.cc:2243] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.740921  5112 raft_consensus.cc:2272] T 5e1866b70cb54443b0830659c633edcf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.743535  5112 tablet_replica.cc:333] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.744361  5112 raft_consensus.cc:2243] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.744987  5112 raft_consensus.cc:2272] T ef76416cb5194a2cb26550333d72c307 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.747611  5112 tablet_replica.cc:333] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.748376  5112 raft_consensus.cc:2243] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.749590  5112 raft_consensus.cc:2272] T 3ca18f52abcd4cf291ae45a415535e88 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.752075  5112 tablet_replica.cc:333] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.752602  5112 raft_consensus.cc:2243] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.753561  5112 raft_consensus.cc:2272] T e31ff23bb63c4e33afd90afd6bf5f198 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.755561  5112 tablet_replica.cc:333] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.756354  5112 raft_consensus.cc:2243] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.757614  5112 raft_consensus.cc:2272] T dd8e69d69ccd4bc99194b3d3e6633693 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.760411  5112 tablet_replica.cc:333] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.761227  5112 raft_consensus.cc:2243] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:06.761678  6905 consensus_peers.cc:597] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.762108  5112 raft_consensus.cc:2272] T 69156f57197e4f1fbed9461749553d8d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.764899  5112 tablet_replica.cc:333] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
W20260709 13:17:06.765573  6905 consensus_peers.cc:597] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.765787  5112 raft_consensus.cc:2243] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.767035  5112 raft_consensus.cc:2272] T ea04d9d509e04fbdafdf863603b94c70 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.769188  5112 tablet_replica.cc:333] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.769860  5112 raft_consensus.cc:2243] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.770740  5112 raft_consensus.cc:2272] T 47b0eafc00f84cdab5bdb591a10c058d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.773270  5112 tablet_replica.cc:333] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.774061  5112 raft_consensus.cc:2243] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.774892  5112 raft_consensus.cc:2272] T c17ed9277f5d4839b300200e6c909c0f P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.777562  5112 tablet_replica.cc:333] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.778299  5112 raft_consensus.cc:2243] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.778925  5112 raft_consensus.cc:2272] T 3009228e555646f4870d29db171cddfb P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.781435  5112 tablet_replica.cc:333] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.782178  5112 raft_consensus.cc:2243] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.782801  5112 raft_consensus.cc:2272] T 50e7a35d701c4730b5efb6fefa7f5ec6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.784993  5112 tablet_replica.cc:333] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.785553  5112 raft_consensus.cc:2243] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.786420  5112 raft_consensus.cc:2272] T 884ae035eff04463b5ff7a054f75935d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.788338  5112 tablet_replica.cc:333] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.788882  5112 raft_consensus.cc:2243] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.789495  5112 raft_consensus.cc:2272] T c0c4567153664b518d2f6515e419da60 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.791383  5112 tablet_replica.cc:333] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.791929  5112 raft_consensus.cc:2243] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.792778  5112 raft_consensus.cc:2272] T b91f0c50e2de47c299569a0a5d7af6b8 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.795120  5112 tablet_replica.cc:333] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.795881  5112 raft_consensus.cc:2243] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.796398  5112 raft_consensus.cc:2272] T bec594ed8e8449619512ba6e0d3d04cf P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.797283  6906 consensus_peers.cc:597] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:17:06.798626  5112 tablet_replica.cc:333] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.799417  5112 raft_consensus.cc:2243] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.800539  5112 raft_consensus.cc:2272] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.802660  5112 tablet_replica.cc:333] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.803259  5112 raft_consensus.cc:2243] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.803967  5112 raft_consensus.cc:2272] T c5f7d4daab074bd6b452f58e1a57a7ea P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.806430  5112 tablet_replica.cc:333] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.807166  5112 raft_consensus.cc:2243] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.808050  5112 raft_consensus.cc:2272] T 4bc84db94ed44cf9bab11e4626d2ba6e P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.810477  5112 tablet_replica.cc:333] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.811112  5112 raft_consensus.cc:2243] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.811825  5112 raft_consensus.cc:2272] T ca1ca4c5e4934cf9b482701f5eb26d1a P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.814106  5112 tablet_replica.cc:333] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.814932  5112 raft_consensus.cc:2243] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.815677  5112 raft_consensus.cc:2272] T 4ad52cf302674a048c4b3a989596b435 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.818161  5112 tablet_replica.cc:333] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.818907  5112 raft_consensus.cc:2243] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.819607  5112 raft_consensus.cc:2272] T 3d35ec80c8064f08b90ca13dd30691c7 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.822455  5112 tablet_replica.cc:333] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.823274  5112 raft_consensus.cc:2243] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.823884  5112 raft_consensus.cc:2272] T 72b743ddeba148d8a8fb0d816501812b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.824842  6905 consensus_peers.cc:597] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.827351  5112 tablet_replica.cc:333] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.828228  5112 raft_consensus.cc:2243] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.828924  5112 raft_consensus.cc:2272] T 7508c25b6d9944dda6f30aac9f238ae6 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.831696  5112 tablet_replica.cc:333] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.832449  5112 raft_consensus.cc:2243] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.833012  5112 raft_consensus.cc:2272] T 1061e95aa2d446f2aeb9563f482f1cd9 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.833084  6368 consensus_peers.cc:597] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.835767  5112 tablet_replica.cc:333] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.836544  5112 raft_consensus.cc:2243] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.837217  5112 raft_consensus.cc:2272] T 772aad0e3cb043d989afc6d1abdbf6f4 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.837265  6368 consensus_peers.cc:597] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.839826  5112 tablet_replica.cc:333] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.840607  5112 raft_consensus.cc:2243] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.843554  5112 raft_consensus.cc:2272] T 4340bb97f0154dbb981570b2ee2f49c5 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.845108  6368 consensus_peers.cc:597] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.846357  5112 tablet_replica.cc:333] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
W20260709 13:17:06.845321  6369 consensus_peers.cc:597] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:06.847167  5112 raft_consensus.cc:2243] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.847829  5112 raft_consensus.cc:2272] T 090a0dad86b546e6b091b67e69cc1bcc P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.848896  6368 consensus_peers.cc:597] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.850128  5112 tablet_replica.cc:333] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.850890  5112 raft_consensus.cc:2243] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.851545  5112 raft_consensus.cc:2272] T bade3854ad1b4b2492dd0ecd47e1398b P a13ffe92eb374309a5c8476d9fbbb2b8 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.859650  6905 consensus_peers.cc:597] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.860294  6905 consensus_peers.cc:597] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.860891  6368 consensus_peers.cc:597] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.862763  5112 tablet_replica.cc:333] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.863909  5112 raft_consensus.cc:2243] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.864727  5112 raft_consensus.cc:2272] T ae75079e4a9346d0a9b0c375570b7f9d P a13ffe92eb374309a5c8476d9fbbb2b8 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.865293  6905 consensus_peers.cc:597] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.866041  6905 consensus_peers.cc:597] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.867413  5112 tablet_replica.cc:333] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.867995  5112 raft_consensus.cc:2243] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.868461  5112 raft_consensus.cc:2272] T c2c1e4f96c604cc898081f72ae4eacf2 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.870385  5112 tablet_replica.cc:333] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.870867  5112 raft_consensus.cc:2243] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.871775  5112 raft_consensus.cc:2272] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P a13ffe92eb374309a5c8476d9fbbb2b8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.873839  5112 tablet_replica.cc:333] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8: stopping tablet replica
I20260709 13:17:06.874334  5112 raft_consensus.cc:2243] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.875048  5112 raft_consensus.cc:2272] T 05f408a1388f424db8b65332c1dcd467 P a13ffe92eb374309a5c8476d9fbbb2b8 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.907148  6369 consensus_peers.cc:597] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:06.926156  6905 consensus_peers.cc:597] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.944779  6905 consensus_peers.cc:597] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.972085  6905 consensus_peers.cc:597] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.976763  6905 consensus_peers.cc:597] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.989573  6368 consensus_peers.cc:597] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.004902  6368 consensus_peers.cc:597] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.021530  6368 consensus_peers.cc:597] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.021888  6905 consensus_peers.cc:597] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.041009  6905 consensus_peers.cc:597] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.049688  6368 consensus_peers.cc:597] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.073273  6905 consensus_peers.cc:597] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.085665  6368 consensus_peers.cc:597] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.092659  6369 consensus_peers.cc:597] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:07.107879  6368 consensus_peers.cc:597] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.113727  6368 consensus_peers.cc:597] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.159994  6368 consensus_peers.cc:597] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.198493  6369 consensus_peers.cc:597] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:07.329952  6369 consensus_peers.cc:597] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:07.433974  6369 consensus_peers.cc:597] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:07.542861  6369 consensus_peers.cc:597] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:07.690958  6369 consensus_peers.cc:597] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:17:07.762563  5112 tablet_server.cc:196] TabletServer@127.4.254.2:0 shutdown complete.
I20260709 13:17:07.817296 12857 raft_consensus.cc:493] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:17:07.818456 12835 raft_consensus.cc:493] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:17:07.818089 12857 raft_consensus.cc:515] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:17:07.818984 12835 raft_consensus.cc:515] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:17:07.820772 12835 leader_election.cc:290] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:17:07.820813 12857 leader_election.cc:290] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:17:07.835701  6369 leader_election.cc:336] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:17:07.836417  6369 leader_election.cc:336] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:17:07.838577  6368 leader_election.cc:336] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111)
I20260709 13:17:07.839123  6368 leader_election.cc:304] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:17:07.839934 12857 raft_consensus.cc:2749] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:17:07.840158  6368 leader_election.cc:336] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111)
W20260709 13:17:07.840349  6369 consensus_peers.cc:597] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:17:07.840667  6368 leader_election.cc:304] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:17:07.841363 12857 raft_consensus.cc:2749] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:07.864868 12861 raft_consensus.cc:493] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:17:07.869297 12857 raft_consensus.cc:493] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:17:07.870620 12857 raft_consensus.cc:515] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } }
I20260709 13:17:07.868584 12861 raft_consensus.cc:515] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:07.872170  5112 tablet_server.cc:179] TabletServer@127.4.254.3:0 shutting down...
I20260709 13:17:07.874289 12861 leader_election.cc:290] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:17:07.879391 12857 leader_election.cc:290] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495)
W20260709 13:17:07.879827  6905 leader_election.cc:336] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111)
W20260709 13:17:07.880885  6368 leader_election.cc:336] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111)
I20260709 13:17:07.881186 12857 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:17:07.881850 12857 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
W20260709 13:17:07.882193  6369 leader_election.cc:336] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:17:07.882647  6369 leader_election.cc:304] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:17:07.883414 12835 raft_consensus.cc:2749] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:07.883942 12857 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), 8600a3fead0e48a7aa813822ec44d0fe (127.4.254.4:33105)
I20260709 13:17:07.885484  6938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e18ec9396146c6acf964c759dd56fc" candidate_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8600a3fead0e48a7aa813822ec44d0fe" is_pre_election: true
W20260709 13:17:07.888883  6368 leader_election.cc:336] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111)
I20260709 13:17:07.889294  6368 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 8600a3fead0e48a7aa813822ec44d0fe, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:17:07.889894 12857 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:07.904129  6907 consensus_peers.cc:597] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.908258  6906 leader_election.cc:336] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:17:07.908645  6906 leader_election.cc:304] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:17:07.909216 12861 raft_consensus.cc:2749] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:07.911345  6906 consensus_peers.cc:597] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:07.917682  6907 consensus_peers.cc:597] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.925079  6907 consensus_peers.cc:597] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.940945  6907 consensus_peers.cc:597] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.949393  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:07.951176  5112 tablet_replica.cc:333] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:07.952317  5112 raft_consensus.cc:2243] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.953459  5112 raft_consensus.cc:2272] T 47628993693e4f69a935e61e4071de94 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.956765  5112 tablet_replica.cc:333] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:07.957445  5112 raft_consensus.cc:2243] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.957916  5112 raft_consensus.cc:2272] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P b940f12ed61a49c4b3c11f13ef50fa92 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.959790  5112 tablet_replica.cc:333] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:07.960363  5112 raft_consensus.cc:2243] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.961225  5112 raft_consensus.cc:2272] T 7eeec6c3b81b4e22b65d23b164087705 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.963229  5112 tablet_replica.cc:333] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:07.964010  5112 raft_consensus.cc:2243] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.964594  5112 raft_consensus.cc:2272] T 41e18ec9396146c6acf964c759dd56fc P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.967090  5112 tablet_replica.cc:333] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:07.968492  5112 raft_consensus.cc:2243] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.969594  5112 raft_consensus.cc:2272] T ef76416cb5194a2cb26550333d72c307 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.972329  5112 tablet_replica.cc:333] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:07.973104  5112 raft_consensus.cc:2243] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.974161  5112 raft_consensus.cc:2272] T 7143f4f3a1eb4f73ae609d74917b08bc P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.976259  5112 tablet_replica.cc:333] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:07.977007  5112 raft_consensus.cc:2243] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.977842  5112 raft_consensus.cc:2272] T aba53315de954573854008b23574a90f P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.979686  5112 tablet_replica.cc:333] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:07.980208  5112 raft_consensus.cc:2243] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.980625  5112 raft_consensus.cc:2272] T 9e60eb0eafd44b02ac71f72df7d3e65d P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.982535  5112 tablet_replica.cc:333] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:07.983179  5112 raft_consensus.cc:2243] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.984087  5112 raft_consensus.cc:2272] T 5e1866b70cb54443b0830659c633edcf P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.986780  5112 tablet_replica.cc:333] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:07.987500  5112 raft_consensus.cc:2243] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.988060  5112 raft_consensus.cc:2272] T f3c8c870200141efa8a5f7cc58ece4a6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.989923  5112 tablet_replica.cc:333] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:07.990434  5112 raft_consensus.cc:2243] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.990859  5112 raft_consensus.cc:2272] T 0fbd02cf1f2d48d2ac594411f00f9678 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.993070  5112 tablet_replica.cc:333] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:07.993718  5112 raft_consensus.cc:2243] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.994299  5112 raft_consensus.cc:2272] T 55cead5798bd4451a23aee760d202f18 P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.995433 12857 raft_consensus.cc:493] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:17:07.995878 12857 raft_consensus.cc:515] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } }
I20260709 13:17:07.996408  5112 tablet_replica.cc:333] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:07.997025  5112 raft_consensus.cc:2243] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.997692 12857 leader_election.cc:290] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:17:07.997978  5112 raft_consensus.cc:2272] T ce99643832824368978841e0265f9d2d P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:08.001237  6368 leader_election.cc:336] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111)
I20260709 13:17:08.001811  5112 tablet_replica.cc:333] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
W20260709 13:17:08.001847  6369 leader_election.cc:336] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:17:08.002341  6369 leader_election.cc:304] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b940f12ed61a49c4b3c11f13ef50fa92; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:17:08.002524  5112 raft_consensus.cc:2243] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.002883 12857 raft_consensus.cc:2749] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:08.003537  5112 raft_consensus.cc:2272] T e25e23b6cebd41369f84b2c74e182cbd P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.006067  5112 tablet_replica.cc:333] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.006878  5112 raft_consensus.cc:2243] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.007558  5112 raft_consensus.cc:2272] T bc0d5cf9e08445eea2f9773bf33622d4 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:08.009509  6907 consensus_peers.cc:597] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:08.009732  5112 tablet_replica.cc:333] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.010367  5112 raft_consensus.cc:2243] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.010818  5112 raft_consensus.cc:2272] T cbc89cb8d0e64feba7a58705d738d699 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.012557  5112 tablet_replica.cc:333] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.013200  5112 raft_consensus.cc:2243] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.013641  5112 raft_consensus.cc:2272] T 3ca18f52abcd4cf291ae45a415535e88 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.015462  5112 tablet_replica.cc:333] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.016032  5112 raft_consensus.cc:2243] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.016426 12861 raft_consensus.cc:493] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:17:08.016541  5112 raft_consensus.cc:2272] T c2c1e4f96c604cc898081f72ae4eacf2 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.016983 12861 raft_consensus.cc:515] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:08.019162  5112 tablet_replica.cc:333] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.019879  5112 raft_consensus.cc:2243] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.018914 12861 leader_election.cc:290] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
I20260709 13:17:08.020916  5112 raft_consensus.cc:2272] T 69156f57197e4f1fbed9461749553d8d P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:08.023169  6906 leader_election.cc:336] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:17:08.023572  5112 tablet_replica.cc:333] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.024266  5112 raft_consensus.cc:2243] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.025055  5112 raft_consensus.cc:2272] T b8b0bb0f383c43abb44e0ab66a228225 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:08.025863  6905 leader_election.cc:336] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111)
I20260709 13:17:08.026315  6905 leader_election.cc:304] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:17:08.026963 12861 raft_consensus.cc:2749] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:08.027410  5112 tablet_replica.cc:333] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.028082  5112 raft_consensus.cc:2243] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.028613  5112 raft_consensus.cc:2272] T 26c3f5e2706b41929dff126f046ad839 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.030910  5112 tablet_replica.cc:333] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.031635  5112 raft_consensus.cc:2243] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.032198  5112 raft_consensus.cc:2272] T 5176b2e1ff0145bdb28b559244b3cf5e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.034273  5112 tablet_replica.cc:333] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.034840  5112 raft_consensus.cc:2243] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.035315  5112 raft_consensus.cc:2272] T 090a0dad86b546e6b091b67e69cc1bcc P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.037846  5112 tablet_replica.cc:333] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.038532  5112 raft_consensus.cc:2243] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.039561  5112 raft_consensus.cc:2272] T 1e2856a0d3994696bbc8de68c3679c2f P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.041407  5112 tablet_replica.cc:333] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.041901  5112 raft_consensus.cc:2243] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.042681  5112 raft_consensus.cc:2272] T c5f7d4daab074bd6b452f58e1a57a7ea P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.044356  5112 tablet_replica.cc:333] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.044864  5112 raft_consensus.cc:2243] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.045902  5112 raft_consensus.cc:2272] T b91f0c50e2de47c299569a0a5d7af6b8 P b940f12ed61a49c4b3c11f13ef50fa92 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.048225  5112 tablet_replica.cc:333] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.048661  5112 raft_consensus.cc:2243] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.049479  5112 raft_consensus.cc:2272] T bec594ed8e8449619512ba6e0d3d04cf P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.051597  5112 tablet_replica.cc:333] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.052287  5112 raft_consensus.cc:2243] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.053407  5112 raft_consensus.cc:2272] T 19435892007a4e0a9b2b4d0b26ccd0c0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.055229  5112 tablet_replica.cc:333] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.055912  5112 raft_consensus.cc:2243] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.056504  5112 raft_consensus.cc:2272] T c422c1ccba3c4f8c9a7811e10c0f5dd3 P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.059522  5112 tablet_replica.cc:333] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.060199  5112 raft_consensus.cc:2243] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.060913  5112 raft_consensus.cc:2272] T 884ae035eff04463b5ff7a054f75935d P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.062902  5112 tablet_replica.cc:333] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.063401  5112 raft_consensus.cc:2243] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.064188  5112 raft_consensus.cc:2272] T c0c4567153664b518d2f6515e419da60 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.066109  5112 tablet_replica.cc:333] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.066637  5112 raft_consensus.cc:2243] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.067052  5112 raft_consensus.cc:2272] T 4bc84db94ed44cf9bab11e4626d2ba6e P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.069307  5112 tablet_replica.cc:333] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.070132  5112 raft_consensus.cc:2243] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.071285  5112 raft_consensus.cc:2272] T e1c5cae95db44ec58187d3429c9bdf2e P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.073700  5112 tablet_replica.cc:333] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.074314  5112 raft_consensus.cc:2243] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.074769  5112 raft_consensus.cc:2272] T 4ad52cf302674a048c4b3a989596b435 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.076896  5112 tablet_replica.cc:333] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.077523  5112 raft_consensus.cc:2243] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.078469  5112 raft_consensus.cc:2272] T 3d35ec80c8064f08b90ca13dd30691c7 P b940f12ed61a49c4b3c11f13ef50fa92 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.080724  5112 tablet_replica.cc:333] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.081364  5112 raft_consensus.cc:2243] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.082340  5112 raft_consensus.cc:2272] T 72b743ddeba148d8a8fb0d816501812b P b940f12ed61a49c4b3c11f13ef50fa92 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.084673  5112 tablet_replica.cc:333] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
W20260709 13:17:08.084617  6907 consensus_peers.cc:597] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:08.085492  5112 raft_consensus.cc:2243] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.086601  5112 raft_consensus.cc:2272] T 7f4a17642c254c2e869ca48ecd16fce0 P b940f12ed61a49c4b3c11f13ef50fa92 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.088515  5112 tablet_replica.cc:333] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.089003  5112 raft_consensus.cc:2243] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.089810  5112 raft_consensus.cc:2272] T 7508c25b6d9944dda6f30aac9f238ae6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.091542  5112 tablet_replica.cc:333] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.092106  5112 raft_consensus.cc:2243] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.092552  5112 raft_consensus.cc:2272] T fc9bf1ef8bde4a7db7ca1d39945d2ffe P b940f12ed61a49c4b3c11f13ef50fa92 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.094630  5112 tablet_replica.cc:333] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.095230  5112 raft_consensus.cc:2243] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.095870  5112 raft_consensus.cc:2272] T 5af589183a05415d9cb49d32caedd78f P b940f12ed61a49c4b3c11f13ef50fa92 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.098349  5112 tablet_replica.cc:333] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.099038  5112 raft_consensus.cc:2243] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.100075  5112 raft_consensus.cc:2272] T 50e7a35d701c4730b5efb6fefa7f5ec6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:08.100368  6907 consensus_peers.cc:597] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:08.102079  5112 tablet_replica.cc:333] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.102628  5112 raft_consensus.cc:2243] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.103386  5112 raft_consensus.cc:2272] T 3009228e555646f4870d29db171cddfb P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.105386  5112 tablet_replica.cc:333] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.105857  5112 raft_consensus.cc:2243] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.106408  5112 raft_consensus.cc:2272] T 0e9d4db6a641496881a55d48d32c6f7e P b940f12ed61a49c4b3c11f13ef50fa92 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.108067  5112 tablet_replica.cc:333] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.108531  5112 raft_consensus.cc:2243] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.109297  5112 raft_consensus.cc:2272] T 1230017e50f4469992de6002ca8cd7b6 P b940f12ed61a49c4b3c11f13ef50fa92 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.111140  5112 tablet_replica.cc:333] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92: stopping tablet replica
I20260709 13:17:08.111582  5112 raft_consensus.cc:2243] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.112022  5112 raft_consensus.cc:2272] T efde1f99d92b4d97b29f2a2f0d1c1c62 P b940f12ed61a49c4b3c11f13ef50fa92 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.115257 12861 raft_consensus.cc:493] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:17:08.115809 12861 raft_consensus.cc:515] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "b940f12ed61a49c4b3c11f13ef50fa92" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 34111 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:08.119345 12863 raft_consensus.cc:493] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:17:08.119525 12861 leader_election.cc:290] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965), b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111)
I20260709 13:17:08.119961 12863 raft_consensus.cc:515] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:08.123823 12863 leader_election.cc:290] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:17:08.126260  6907 leader_election.cc:336] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:17:08.128649  6905 leader_election.cc:336] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111)
W20260709 13:17:08.129405  6906 leader_election.cc:336] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:17:08.129115  6905 leader_election.cc:304] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: a13ffe92eb374309a5c8476d9fbbb2b8, b940f12ed61a49c4b3c11f13ef50fa92
I20260709 13:17:08.131327 12863 raft_consensus.cc:2749] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:08.137447  6905 leader_election.cc:336] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111)
W20260709 13:17:08.137650  6907 consensus_peers.cc:597] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:08.137916  6905 leader_election.cc:304] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:17:08.138763 12863 raft_consensus.cc:2749] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:08.151124 12863 raft_consensus.cc:493] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:17:08.151772 12863 raft_consensus.cc:515] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:08.154117 12863 leader_election.cc:290] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:17:08.160032  6905 leader_election.cc:336] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111)
W20260709 13:17:08.162170  6906 leader_election.cc:336] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
I20260709 13:17:08.162650  6906 leader_election.cc:304] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:17:08.164152 12863 raft_consensus.cc:2749] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:08.199822  6907 consensus_peers.cc:597] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:08.231192  6907 consensus_peers.cc:597] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.3:34111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:08.234596  6906 consensus_peers.cc:597] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:08.246119  6907 consensus_peers.cc:597] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.3:34111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:08.249843  6907 consensus_peers.cc:597] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.3:34111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:08.265974 12863 raft_consensus.cc:493] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a13ffe92eb374309a5c8476d9fbbb2b8)
I20260709 13:17:08.266484 12863 raft_consensus.cc:515] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d6410349fdc47f5a98ba3c6f7d5510b" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 43495 } } peers { permanent_uuid: "a13ffe92eb374309a5c8476d9fbbb2b8" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39965 } } peers { permanent_uuid: "8600a3fead0e48a7aa813822ec44d0fe" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 33105 } attrs { promote: false } }
I20260709 13:17:08.268193 12863 leader_election.cc:290] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495), a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965)
W20260709 13:17:08.271633  6906 leader_election.cc:336] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111)
W20260709 13:17:08.272066  6905 leader_election.cc:336] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111)
I20260709 13:17:08.272439  6905 leader_election.cc:304] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8600a3fead0e48a7aa813822ec44d0fe; no voters: 2d6410349fdc47f5a98ba3c6f7d5510b, a13ffe92eb374309a5c8476d9fbbb2b8
I20260709 13:17:08.273084 12863 raft_consensus.cc:2749] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:08.294024  6907 consensus_peers.cc:597] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.3:34111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:08.368547  6907 consensus_peers.cc:597] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.3:34111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:08.385030  6907 consensus_peers.cc:597] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.3:34111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:08.389389  6907 consensus_peers.cc:597] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer b940f12ed61a49c4b3c11f13ef50fa92 (127.4.254.3:34111): Couldn't send request to peer b940f12ed61a49c4b3c11f13ef50fa92. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.3:34111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:08.390542  6906 consensus_peers.cc:597] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:08.552781  6906 consensus_peers.cc:597] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:08.682301  6906 consensus_peers.cc:597] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:08.850677  6906 consensus_peers.cc:597] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:08.865094  6906 consensus_peers.cc:597] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:08.891450  6906 consensus_peers.cc:597] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:17:08.892349  5112 tablet_server.cc:196] TabletServer@127.4.254.3:0 shutdown complete.
W20260709 13:17:08.909636  6906 consensus_peers.cc:597] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:08.950040  6906 consensus_peers.cc:597] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:08.997067  5112 tablet_server.cc:179] TabletServer@127.4.254.4:0 shutting down...
I20260709 13:17:09.045289  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:09.046025  5112 tablet_replica.cc:333] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.046754  5112 raft_consensus.cc:2243] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.047417  5112 raft_consensus.cc:2272] T aba53315de954573854008b23574a90f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.049728  5112 tablet_replica.cc:333] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.050335  5112 raft_consensus.cc:2243] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.050910  5112 raft_consensus.cc:2272] T 7f4a17642c254c2e869ca48ecd16fce0 P 8600a3fead0e48a7aa813822ec44d0fe [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.052896  5112 tablet_replica.cc:333] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.053524  5112 raft_consensus.cc:2243] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.053974  5112 raft_consensus.cc:2272] T 7508c25b6d9944dda6f30aac9f238ae6 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.056005  5112 tablet_replica.cc:333] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.056615  5112 raft_consensus.cc:2243] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.057427  5112 raft_consensus.cc:2272] T 19435892007a4e0a9b2b4d0b26ccd0c0 P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.059274  5112 tablet_replica.cc:333] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.059805  5112 raft_consensus.cc:2243] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.060267  5112 raft_consensus.cc:2272] T b91f0c50e2de47c299569a0a5d7af6b8 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.062163  5112 tablet_replica.cc:333] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.062708  5112 raft_consensus.cc:2243] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.063472  5112 raft_consensus.cc:2272] T f3c8c870200141efa8a5f7cc58ece4a6 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.065467  5112 tablet_replica.cc:333] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.066180  5112 raft_consensus.cc:2243] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.066910  5112 raft_consensus.cc:2272] T 334e41443e364890b884c69082b3bb30 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.068673  5112 tablet_replica.cc:333] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.069206  5112 raft_consensus.cc:2243] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.069909  5112 raft_consensus.cc:2272] T c2c1e4f96c604cc898081f72ae4eacf2 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.071790  5112 tablet_replica.cc:333] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.072268  5112 raft_consensus.cc:2243] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.073189  5112 raft_consensus.cc:2272] T bade3854ad1b4b2492dd0ecd47e1398b P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.075606  5112 tablet_replica.cc:333] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.076246  5112 raft_consensus.cc:2243] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.077339  5112 raft_consensus.cc:2272] T e31ff23bb63c4e33afd90afd6bf5f198 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:09.077631  6906 consensus_peers.cc:597] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe -> Peer 2d6410349fdc47f5a98ba3c6f7d5510b (127.4.254.1:43495): Couldn't send request to peer 2d6410349fdc47f5a98ba3c6f7d5510b. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:43495: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:17:09.079511  5112 tablet_replica.cc:333] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.080120  5112 raft_consensus.cc:2243] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.080883  5112 raft_consensus.cc:2272] T cbc89cb8d0e64feba7a58705d738d699 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.082897  5112 tablet_replica.cc:333] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.083447  5112 raft_consensus.cc:2243] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.083962  5112 raft_consensus.cc:2272] T 1c399f07ba644d25ba3579e60d6962bd P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.086220  5112 tablet_replica.cc:333] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.086807  5112 raft_consensus.cc:2243] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.087277  5112 raft_consensus.cc:2272] T 72b743ddeba148d8a8fb0d816501812b P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.089207  5112 tablet_replica.cc:333] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.089805  5112 raft_consensus.cc:2243] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.090530  5112 raft_consensus.cc:2272] T 1061e95aa2d446f2aeb9563f482f1cd9 P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.092518  5112 tablet_replica.cc:333] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.093019  5112 raft_consensus.cc:2243] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.093808  5112 raft_consensus.cc:2272] T 772aad0e3cb043d989afc6d1abdbf6f4 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.095621  5112 tablet_replica.cc:333] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.096140  5112 raft_consensus.cc:2243] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.096875  5112 raft_consensus.cc:2272] T 5af589183a05415d9cb49d32caedd78f P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.098649  5112 tablet_replica.cc:333] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.099159  5112 raft_consensus.cc:2243] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.099895  5112 raft_consensus.cc:2272] T 0e9d4db6a641496881a55d48d32c6f7e P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.101732  5112 tablet_replica.cc:333] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.102242  5112 raft_consensus.cc:2243] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.102995  5112 raft_consensus.cc:2272] T efde1f99d92b4d97b29f2a2f0d1c1c62 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.104911  5112 tablet_replica.cc:333] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.105508  5112 raft_consensus.cc:2243] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.105949  5112 raft_consensus.cc:2272] T ea04d9d509e04fbdafdf863603b94c70 P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.107862  5112 tablet_replica.cc:333] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.108397  5112 raft_consensus.cc:2243] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.108835  5112 raft_consensus.cc:2272] T 7eeec6c3b81b4e22b65d23b164087705 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.110715  5112 tablet_replica.cc:333] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.111487  5112 raft_consensus.cc:2243] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.112363  5112 raft_consensus.cc:2272] T 55cead5798bd4451a23aee760d202f18 P 8600a3fead0e48a7aa813822ec44d0fe [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.114630  5112 tablet_replica.cc:333] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
W20260709 13:17:09.115206  6905 consensus_peers.cc:597] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe -> Peer a13ffe92eb374309a5c8476d9fbbb2b8 (127.4.254.2:39965): Couldn't send request to peer a13ffe92eb374309a5c8476d9fbbb2b8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:09.115408  5112 raft_consensus.cc:2243] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.116475  5112 raft_consensus.cc:2272] T b8b0bb0f383c43abb44e0ab66a228225 P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.119014  5112 tablet_replica.cc:333] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.119863  5112 raft_consensus.cc:2243] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.120888  5112 raft_consensus.cc:2272] T b2b0ed24d02e419bb6f1e4b24f0bcff5 P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.123298  5112 tablet_replica.cc:333] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.123831  5112 raft_consensus.cc:2243] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.124307  5112 raft_consensus.cc:2272] T 4340bb97f0154dbb981570b2ee2f49c5 P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.126250  5112 tablet_replica.cc:333] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.126791  5112 raft_consensus.cc:2243] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.127243  5112 raft_consensus.cc:2272] T 50e7a35d701c4730b5efb6fefa7f5ec6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.129511  5112 tablet_replica.cc:333] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.130057  5112 raft_consensus.cc:2243] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.130508  5112 raft_consensus.cc:2272] T 3009228e555646f4870d29db171cddfb P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.132381  5112 tablet_replica.cc:333] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.132920  5112 raft_consensus.cc:2243] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.133364  5112 raft_consensus.cc:2272] T 47b0eafc00f84cdab5bdb591a10c058d P 8600a3fead0e48a7aa813822ec44d0fe [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.135450  5112 tablet_replica.cc:333] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.135970  5112 raft_consensus.cc:2243] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.136708  5112 raft_consensus.cc:2272] T bc0d5cf9e08445eea2f9773bf33622d4 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.138586  5112 tablet_replica.cc:333] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.139098  5112 raft_consensus.cc:2243] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.139868  5112 raft_consensus.cc:2272] T 05f408a1388f424db8b65332c1dcd467 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.141701  5112 tablet_replica.cc:333] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.142223  5112 raft_consensus.cc:2243] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.142678  5112 raft_consensus.cc:2272] T bec594ed8e8449619512ba6e0d3d04cf P 8600a3fead0e48a7aa813822ec44d0fe [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.144702  5112 tablet_replica.cc:333] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.145291  5112 raft_consensus.cc:2243] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.146231  5112 raft_consensus.cc:2272] T ca1ca4c5e4934cf9b482701f5eb26d1a P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.148357  5112 tablet_replica.cc:333] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.148876  5112 raft_consensus.cc:2243] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.149516  5112 raft_consensus.cc:2272] T 1230017e50f4469992de6002ca8cd7b6 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.151393  5112 tablet_replica.cc:333] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.151878  5112 raft_consensus.cc:2243] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.152331  5112 raft_consensus.cc:2272] T 41e18ec9396146c6acf964c759dd56fc P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.154570  5112 tablet_replica.cc:333] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.155165  5112 raft_consensus.cc:2243] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.155912  5112 raft_consensus.cc:2272] T 090a0dad86b546e6b091b67e69cc1bcc P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.157848  5112 tablet_replica.cc:333] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.158432  5112 raft_consensus.cc:2243] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.159250  5112 raft_consensus.cc:2272] T ae75079e4a9346d0a9b0c375570b7f9d P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.160972  5112 tablet_replica.cc:333] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.161471  5112 raft_consensus.cc:2243] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.161942  5112 raft_consensus.cc:2272] T 1e2856a0d3994696bbc8de68c3679c2f P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.163681  5112 tablet_replica.cc:333] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.164186  5112 raft_consensus.cc:2243] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.164587  5112 raft_consensus.cc:2272] T 7143f4f3a1eb4f73ae609d74917b08bc P 8600a3fead0e48a7aa813822ec44d0fe [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.166380  5112 tablet_replica.cc:333] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.166842  5112 raft_consensus.cc:2243] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.167430  5112 raft_consensus.cc:2272] T dd8e69d69ccd4bc99194b3d3e6633693 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.169577  5112 tablet_replica.cc:333] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.170248  5112 raft_consensus.cc:2243] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.170938  5112 raft_consensus.cc:2272] T 26c3f5e2706b41929dff126f046ad839 P 8600a3fead0e48a7aa813822ec44d0fe [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.172863  5112 tablet_replica.cc:333] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.173408  5112 raft_consensus.cc:2243] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.174151  5112 raft_consensus.cc:2272] T 4bc84db94ed44cf9bab11e4626d2ba6e P 8600a3fead0e48a7aa813822ec44d0fe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.176028  5112 tablet_replica.cc:333] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.176522  5112 raft_consensus.cc:2243] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.177397  5112 raft_consensus.cc:2272] T 4ad52cf302674a048c4b3a989596b435 P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.179371  5112 tablet_replica.cc:333] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.179857  5112 raft_consensus.cc:2243] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.180312  5112 raft_consensus.cc:2272] T e1c5cae95db44ec58187d3429c9bdf2e P 8600a3fead0e48a7aa813822ec44d0fe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.182163  5112 tablet_replica.cc:333] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.182626  5112 raft_consensus.cc:2243] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.183390  5112 raft_consensus.cc:2272] T c17ed9277f5d4839b300200e6c909c0f P 8600a3fead0e48a7aa813822ec44d0fe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.185230  5112 tablet_replica.cc:333] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe: stopping tablet replica
I20260709 13:17:09.185679  5112 raft_consensus.cc:2243] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.186450  5112 raft_consensus.cc:2272] T ef76416cb5194a2cb26550333d72c307 P 8600a3fead0e48a7aa813822ec44d0fe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.547386  5112 tablet_server.cc:196] TabletServer@127.4.254.4:0 shutdown complete.
I20260709 13:17:09.613447  5112 master.cc:562] Master@127.4.254.62:46653 shutting down...
I20260709 13:17:09.645462  5112 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.646013  5112 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.646289  5112 tablet_replica.cc:333] T 00000000000000000000000000000000 P c499d062fa5b4229bfb05f1ac581a6c6: stopping tablet replica
I20260709 13:17:09.853756  5112 master.cc:584] Master@127.4.254.62:46653 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (208763 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:17:09.951574  5112 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.254.62:45155
I20260709 13:17:09.952617  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:09.958506 12867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:09.958658 12866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:09.959052 12869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:09.960836  5112 server_base.cc:1061] running on GCE node
I20260709 13:17:09.963721  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:09.963899  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:09.964010  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603029963998 us; error 0 us; skew 500 ppm
I20260709 13:17:09.964455  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:09.966759  5112 webserver.cc:533] Webserver started at http://127.4.254.62:34455/ using document root <none> and password file <none>
I20260709 13:17:09.967196  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:09.967343  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:09.967552  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:09.968611  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/master-0-root/instance:
uuid: "4111455ddcc04ce3bd95cf730a36307b"
format_stamp: "Formatted at 2026-07-09 13:17:09 on dist-test-slave-k73n"
I20260709 13:17:09.972790  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:09.976032 12874 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:09.976768  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:17:09.977051  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/master-0-root
uuid: "4111455ddcc04ce3bd95cf730a36307b"
format_stamp: "Formatted at 2026-07-09 13:17:09 on dist-test-slave-k73n"
I20260709 13:17:09.977378  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:09.992909  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:09.994166  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:10.031381  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.62:45155
I20260709 13:17:10.031481 12925 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.62:45155 every 8 connection(s)
I20260709 13:17:10.035277 12926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.045413 12926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b: Bootstrap starting.
I20260709 13:17:10.050168 12926 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.054345 12926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b: No bootstrap required, opened a new log
I20260709 13:17:10.056589 12926 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4111455ddcc04ce3bd95cf730a36307b" member_type: VOTER }
I20260709 13:17:10.056967 12926 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.057199 12926 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4111455ddcc04ce3bd95cf730a36307b, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.057734 12926 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4111455ddcc04ce3bd95cf730a36307b" member_type: VOTER }
I20260709 13:17:10.058182 12926 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:10.058386 12926 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:10.058602 12926 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.063127 12926 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4111455ddcc04ce3bd95cf730a36307b" member_type: VOTER }
I20260709 13:17:10.063611 12926 leader_election.cc:304] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4111455ddcc04ce3bd95cf730a36307b; no voters: 
I20260709 13:17:10.064657 12926 leader_election.cc:290] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:10.065059 12929 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.066610 12929 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [term 1 LEADER]: Becoming Leader. State: Replica: 4111455ddcc04ce3bd95cf730a36307b, State: Running, Role: LEADER
I20260709 13:17:10.067315 12929 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4111455ddcc04ce3bd95cf730a36307b" member_type: VOTER }
I20260709 13:17:10.067975 12926 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:10.072474 12931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4111455ddcc04ce3bd95cf730a36307b. Latest consensus state: current_term: 1 leader_uuid: "4111455ddcc04ce3bd95cf730a36307b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4111455ddcc04ce3bd95cf730a36307b" member_type: VOTER } }
I20260709 13:17:10.073204 12931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:10.074909 12930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4111455ddcc04ce3bd95cf730a36307b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4111455ddcc04ce3bd95cf730a36307b" member_type: VOTER } }
I20260709 13:17:10.075263 12936 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:10.075562 12930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:10.080394 12936 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:10.084314  5112 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:10.089646 12936 catalog_manager.cc:1383] Generated new cluster ID: a7c65fe2c51e4cd286cb4d9bf0838eeb
I20260709 13:17:10.089910 12936 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:10.108932 12936 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:10.110162 12936 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:10.121032 12936 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b: Generated new TSK 0
I20260709 13:17:10.121632 12936 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:10.151048  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:10.157217 12947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:10.158380 12948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:10.159688 12950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:10.160903  5112 server_base.cc:1061] running on GCE node
I20260709 13:17:10.162849  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:10.163028  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:10.163148  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603030163136 us; error 0 us; skew 500 ppm
I20260709 13:17:10.163597  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:10.165802  5112 webserver.cc:533] Webserver started at http://127.4.254.1:39453/ using document root <none> and password file <none>
I20260709 13:17:10.166239  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:10.166426  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:10.166678  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:10.167757  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/instance:
uuid: "66218fb7f83e41ffa427b95015c3bf18"
format_stamp: "Formatted at 2026-07-09 13:17:10 on dist-test-slave-k73n"
I20260709 13:17:10.172127  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:10.175318 12955 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:10.176059  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:17:10.176369  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-0-root
uuid: "66218fb7f83e41ffa427b95015c3bf18"
format_stamp: "Formatted at 2026-07-09 13:17:10 on dist-test-slave-k73n"
I20260709 13:17:10.176635  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:10.199760  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:10.200947  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:10.202420  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:10.204645  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:10.204880  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:10.205139  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:10.205349  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:17:10.245038  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.1:42939
I20260709 13:17:10.245234 13017 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.1:42939 every 8 connection(s)
I20260709 13:17:10.249991  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:10.257751 13022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:10.258888 13023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:10.261889 13025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:10.262198  5112 server_base.cc:1061] running on GCE node
I20260709 13:17:10.264801 13018 heartbeater.cc:344] Connected to a master server at 127.4.254.62:45155
I20260709 13:17:10.265097  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:10.265249 13018 heartbeater.cc:461] Registering TS with master...
W20260709 13:17:10.265424  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:10.265702  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603030265683 us; error 0 us; skew 500 ppm
I20260709 13:17:10.266149 13018 heartbeater.cc:507] Master 127.4.254.62:45155 requested a full tablet report, sending...
I20260709 13:17:10.266335  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:10.268412 12891 ts_manager.cc:194] Registered new tserver with Master: 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:10.269246  5112 webserver.cc:533] Webserver started at http://127.4.254.2:38357/ using document root <none> and password file <none>
I20260709 13:17:10.269905  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:10.270143  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:10.270462  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:10.270475 12891 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34410
I20260709 13:17:10.272096  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/instance:
uuid: "293c23c890764727a91d599e0d75604f"
format_stamp: "Formatted at 2026-07-09 13:17:10 on dist-test-slave-k73n"
I20260709 13:17:10.276549  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:17:10.280128 13030 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:10.280990  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:10.281296  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-1-root
uuid: "293c23c890764727a91d599e0d75604f"
format_stamp: "Formatted at 2026-07-09 13:17:10 on dist-test-slave-k73n"
I20260709 13:17:10.281530  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:10.302932  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:10.304102  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:10.305469  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:10.307675  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:10.307845  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:10.308128  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:10.308288  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:10.347074  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.2:39523
I20260709 13:17:10.347178 13092 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.2:39523 every 8 connection(s)
I20260709 13:17:10.351815  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:10.358623 13096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:10.359619 13097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:10.363472 13100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:10.364282 13093 heartbeater.cc:344] Connected to a master server at 127.4.254.62:45155
I20260709 13:17:10.364341  5112 server_base.cc:1061] running on GCE node
I20260709 13:17:10.364887 13093 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:10.365482  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:10.365628 13093 heartbeater.cc:507] Master 127.4.254.62:45155 requested a full tablet report, sending...
W20260709 13:17:10.365748  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:10.366171  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603030366146 us; error 0 us; skew 500 ppm
I20260709 13:17:10.366791  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:10.368065 12891 ts_manager.cc:194] Registered new tserver with Master: 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:10.369572  5112 webserver.cc:533] Webserver started at http://127.4.254.3:37451/ using document root <none> and password file <none>
I20260709 13:17:10.369961 12891 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34420
I20260709 13:17:10.370368  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:10.370662  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:10.370986  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:10.372501  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/instance:
uuid: "c538e5be22524c9a970f7a59c5379288"
format_stamp: "Formatted at 2026-07-09 13:17:10 on dist-test-slave-k73n"
I20260709 13:17:10.376839  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:17:10.380528 13104 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:10.381281  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:10.381570  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-2-root
uuid: "c538e5be22524c9a970f7a59c5379288"
format_stamp: "Formatted at 2026-07-09 13:17:10 on dist-test-slave-k73n"
I20260709 13:17:10.381855  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:10.396894  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:10.398164  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:10.399883  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:10.402328  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:10.402567  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:10.402823  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:10.402995  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:10.442324  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.3:36831
I20260709 13:17:10.442438 13166 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.3:36831 every 8 connection(s)
I20260709 13:17:10.447094  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:10.454649 13170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:10.456741 13171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:10.457329  5112 server_base.cc:1061] running on GCE node
W20260709 13:17:10.458534 13173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:10.459645  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:10.459920  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:10.460124  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603030460106 us; error 0 us; skew 500 ppm
I20260709 13:17:10.460602 13167 heartbeater.cc:344] Connected to a master server at 127.4.254.62:45155
I20260709 13:17:10.460773  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:10.461040 13167 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:10.462029 13167 heartbeater.cc:507] Master 127.4.254.62:45155 requested a full tablet report, sending...
I20260709 13:17:10.463549  5112 webserver.cc:533] Webserver started at http://127.4.254.4:44555/ using document root <none> and password file <none>
I20260709 13:17:10.464125  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:10.464155 12891 ts_manager.cc:194] Registered new tserver with Master: c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:10.464412  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:10.464811  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:10.465807 12891 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34426
I20260709 13:17:10.465939  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-3-root/instance:
uuid: "c6c79a100f9043f590697441315084ed"
format_stamp: "Formatted at 2026-07-09 13:17:10 on dist-test-slave-k73n"
I20260709 13:17:10.470613  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:17:10.473886 13178 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:10.474630  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:10.474933  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-3-root
uuid: "c6c79a100f9043f590697441315084ed"
format_stamp: "Formatted at 2026-07-09 13:17:10 on dist-test-slave-k73n"
I20260709 13:17:10.475244  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:10.485617  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:10.486778  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:10.488108  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:10.490334  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:10.490535  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:10.490798  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:10.490959  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:10.532181  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.4:36179
I20260709 13:17:10.532260 13240 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.4:36179 every 8 connection(s)
I20260709 13:17:10.546527 13241 heartbeater.cc:344] Connected to a master server at 127.4.254.62:45155
I20260709 13:17:10.546985 13241 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:10.547812 13241 heartbeater.cc:507] Master 127.4.254.62:45155 requested a full tablet report, sending...
I20260709 13:17:10.549741 12891 ts_manager.cc:194] Registered new tserver with Master: c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:10.550149  5112 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014976379s
I20260709 13:17:10.551240 12891 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34430
I20260709 13:17:10.576208 12891 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34436:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:17:10.807452 12982 tablet_service.cc:1511] Processing CreateTablet for tablet e72a3ace6e8c4edfb0b28ddf70ceb000 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:10.807452 12983 tablet_service.cc:1511] Processing CreateTablet for tablet 3989a176cafa4e99bb287f8dbd9a9f1c (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:10.809046 12982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72a3ace6e8c4edfb0b28ddf70ceb000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.811088 12983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3989a176cafa4e99bb287f8dbd9a9f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.815817 12981 tablet_service.cc:1511] Processing CreateTablet for tablet 96e5c0d26b904f169897a58bdf500a3a (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:10.817274 12981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e5c0d26b904f169897a58bdf500a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.822418 12980 tablet_service.cc:1511] Processing CreateTablet for tablet a3fa4a311cc64cd197ab6bdae52c3f96 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:10.823863 12980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3fa4a311cc64cd197ab6bdae52c3f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.825343 13132 tablet_service.cc:1511] Processing CreateTablet for tablet 3989a176cafa4e99bb287f8dbd9a9f1c (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:10.830297 13132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3989a176cafa4e99bb287f8dbd9a9f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.830888 13131 tablet_service.cc:1511] Processing CreateTablet for tablet e72a3ace6e8c4edfb0b28ddf70ceb000 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:10.832733 13131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72a3ace6e8c4edfb0b28ddf70ceb000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.834698 13130 tablet_service.cc:1511] Processing CreateTablet for tablet 9713e0bcb2b64111a73eaa424eb16574 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:10.841625 13130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9713e0bcb2b64111a73eaa424eb16574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.845427 13129 tablet_service.cc:1511] Processing CreateTablet for tablet a3fa4a311cc64cd197ab6bdae52c3f96 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:10.847350 13129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3fa4a311cc64cd197ab6bdae52c3f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.857803 12979 tablet_service.cc:1511] Processing CreateTablet for tablet 84a9a68cea89454584f50702e5bd032d (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:10.859831 12979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a9a68cea89454584f50702e5bd032d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.882006 13205 tablet_service.cc:1511] Processing CreateTablet for tablet 96e5c0d26b904f169897a58bdf500a3a (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:10.881847 13206 tablet_service.cc:1511] Processing CreateTablet for tablet 3989a176cafa4e99bb287f8dbd9a9f1c (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:10.883502 13205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e5c0d26b904f169897a58bdf500a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.884433 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3989a176cafa4e99bb287f8dbd9a9f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.894340 13204 tablet_service.cc:1511] Processing CreateTablet for tablet 9713e0bcb2b64111a73eaa424eb16574 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:10.895891 13204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9713e0bcb2b64111a73eaa424eb16574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.896759 13128 tablet_service.cc:1511] Processing CreateTablet for tablet 5483c64ceb1f41e9a6eec70e2f257f96 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:10.898226 13128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5483c64ceb1f41e9a6eec70e2f257f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.903311 13203 tablet_service.cc:1511] Processing CreateTablet for tablet 84a9a68cea89454584f50702e5bd032d (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:10.906308 13203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a9a68cea89454584f50702e5bd032d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.930513 13057 tablet_service.cc:1511] Processing CreateTablet for tablet 96e5c0d26b904f169897a58bdf500a3a (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:10.931972 13057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e5c0d26b904f169897a58bdf500a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.931809 13055 tablet_service.cc:1511] Processing CreateTablet for tablet a3fa4a311cc64cd197ab6bdae52c3f96 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:10.934257 13058 tablet_service.cc:1511] Processing CreateTablet for tablet e72a3ace6e8c4edfb0b28ddf70ceb000 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:10.929904 13056 tablet_service.cc:1511] Processing CreateTablet for tablet 9713e0bcb2b64111a73eaa424eb16574 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:10.934176 13054 tablet_service.cc:1511] Processing CreateTablet for tablet 84a9a68cea89454584f50702e5bd032d (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:10.935607 13055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3fa4a311cc64cd197ab6bdae52c3f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.941504 13058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e72a3ace6e8c4edfb0b28ddf70ceb000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.942109 13056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9713e0bcb2b64111a73eaa424eb16574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.945479 13054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a9a68cea89454584f50702e5bd032d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.956231 13257 tablet_bootstrap.cc:492] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:10.956637 13202 tablet_service.cc:1511] Processing CreateTablet for tablet 5483c64ceb1f41e9a6eec70e2f257f96 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:10.958099 13202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5483c64ceb1f41e9a6eec70e2f257f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.971956 13131 tablet_service.cc:1511] Processing CreateTablet for tablet f0d38bed483b4fa18d0cf4242e2eb808 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:10.978430 13053 tablet_service.cc:1511] Processing CreateTablet for tablet f0d38bed483b4fa18d0cf4242e2eb808 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:10.979919 13053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d38bed483b4fa18d0cf4242e2eb808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.980372 13201 tablet_service.cc:1511] Processing CreateTablet for tablet f0d38bed483b4fa18d0cf4242e2eb808 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:10.981793 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d38bed483b4fa18d0cf4242e2eb808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.985173 13258 tablet_bootstrap.cc:492] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:10.988710 13131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d38bed483b4fa18d0cf4242e2eb808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.994938 12980 tablet_service.cc:1511] Processing CreateTablet for tablet 8de0a1c110064cd8b8cecc8c4728e755 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:10.996373 12980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de0a1c110064cd8b8cecc8c4728e755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.997184 13052 tablet_service.cc:1511] Processing CreateTablet for tablet 8de0a1c110064cd8b8cecc8c4728e755 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:10.998528 13052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de0a1c110064cd8b8cecc8c4728e755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.993017 12982 tablet_service.cc:1511] Processing CreateTablet for tablet 5483c64ceb1f41e9a6eec70e2f257f96 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:11.000588 12982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5483c64ceb1f41e9a6eec70e2f257f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.016467 13129 tablet_service.cc:1511] Processing CreateTablet for tablet 8de0a1c110064cd8b8cecc8c4728e755 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:11.018399 13205 tablet_service.cc:1511] Processing CreateTablet for tablet f418ed3813fa42608ed35304ac9d123b (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:11.019825 13205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f418ed3813fa42608ed35304ac9d123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.021534 13129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de0a1c110064cd8b8cecc8c4728e755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.025677 12979 tablet_service.cc:1511] Processing CreateTablet for tablet f418ed3813fa42608ed35304ac9d123b (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:11.033882 12979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f418ed3813fa42608ed35304ac9d123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.037621 13051 tablet_service.cc:1511] Processing CreateTablet for tablet f418ed3813fa42608ed35304ac9d123b (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:11.041504 13051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f418ed3813fa42608ed35304ac9d123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.039932 13200 tablet_service.cc:1511] Processing CreateTablet for tablet 33a739979c3244169c69c7c9d1c223c0 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:11.040037 13132 tablet_service.cc:1511] Processing CreateTablet for tablet 33a739979c3244169c69c7c9d1c223c0 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:11.050662 13132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a739979c3244169c69c7c9d1c223c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.050760 13200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a739979c3244169c69c7c9d1c223c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.066673 13050 tablet_service.cc:1511] Processing CreateTablet for tablet ad2b72f78e37437ca470520c1736e2f0 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:11.068861 13050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2b72f78e37437ca470520c1736e2f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:11.086510 12939 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:11.092759 13258 tablet_bootstrap.cc:654] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.092759 13257 tablet_bootstrap.cc:654] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.100134 12981 tablet_service.cc:1511] Processing CreateTablet for tablet 33a739979c3244169c69c7c9d1c223c0 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:11.100966 13129 tablet_service.cc:1511] Processing CreateTablet for tablet ad2b72f78e37437ca470520c1736e2f0 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:11.104781 12981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a739979c3244169c69c7c9d1c223c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.101737 13259 tablet_bootstrap.cc:492] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:11.106365 12980 tablet_service.cc:1511] Processing CreateTablet for tablet d833eb39cd9d47c28d825a09d0bb7d56 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:11.107542 13129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2b72f78e37437ca470520c1736e2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.118615 12983 tablet_service.cc:1511] Processing CreateTablet for tablet e9198523b1084931b95003027883ba99 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:11.119968 13058 tablet_service.cc:1511] Processing CreateTablet for tablet d833eb39cd9d47c28d825a09d0bb7d56 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:11.121362 13058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d833eb39cd9d47c28d825a09d0bb7d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.120780 13202 tablet_service.cc:1511] Processing CreateTablet for tablet e9198523b1084931b95003027883ba99 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:11.116360 13128 tablet_service.cc:1511] Processing CreateTablet for tablet d833eb39cd9d47c28d825a09d0bb7d56 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:11.123471 13260 tablet_bootstrap.cc:492] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:11.124361 13128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d833eb39cd9d47c28d825a09d0bb7d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.126600 13259 tablet_bootstrap.cc:654] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.098814 13204 tablet_service.cc:1511] Processing CreateTablet for tablet ad2b72f78e37437ca470520c1736e2f0 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:11.107656 12980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d833eb39cd9d47c28d825a09d0bb7d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.132483 13056 tablet_service.cc:1511] Processing CreateTablet for tablet e9198523b1084931b95003027883ba99 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:11.138505 13204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2b72f78e37437ca470520c1736e2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.138710 13056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9198523b1084931b95003027883ba99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.136219 13260 tablet_bootstrap.cc:654] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.144451 13130 tablet_service.cc:1511] Processing CreateTablet for tablet df6e641d04594c2797442b2393549f6c (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:11.145814 13202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9198523b1084931b95003027883ba99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.151494 13130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df6e641d04594c2797442b2393549f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.162693 12983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9198523b1084931b95003027883ba99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.183385 13205 tablet_service.cc:1511] Processing CreateTablet for tablet df6e641d04594c2797442b2393549f6c (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:11.184772 13205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df6e641d04594c2797442b2393549f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.186842 13259 tablet_bootstrap.cc:492] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:11.187345 13259 ts_tablet_manager.cc:1403] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.016s
I20260709 13:17:11.190567 13259 raft_consensus.cc:359] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:11.191273 13259 raft_consensus.cc:385] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.191562 13259 raft_consensus.cc:740] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.184964 13258 tablet_bootstrap.cc:492] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:11.192549 13258 ts_tablet_manager.cc:1403] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.215s	user 0.007s	sys 0.022s
I20260709 13:17:11.195967 13258 raft_consensus.cc:359] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.196187 12982 tablet_service.cc:1511] Processing CreateTablet for tablet df6e641d04594c2797442b2393549f6c (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:11.196657 13258 raft_consensus.cc:385] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.196997 13258 raft_consensus.cc:740] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.197597 12982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df6e641d04594c2797442b2393549f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.197767 13258 consensus_queue.cc:260] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.199177 13259 consensus_queue.cc:260] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:11.204984 13053 tablet_service.cc:1511] Processing CreateTablet for tablet 4903a5109902424b919c33e97f22b096 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:11.206424 13201 tablet_service.cc:1511] Processing CreateTablet for tablet 4903a5109902424b919c33e97f22b096 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:11.206875 13053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4903a5109902424b919c33e97f22b096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.207748 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4903a5109902424b919c33e97f22b096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.217922 12979 tablet_service.cc:1511] Processing CreateTablet for tablet fcb4737defc94214adbcf8b7639f3087 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:11.219229 12979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb4737defc94214adbcf8b7639f3087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.238085 13056 tablet_service.cc:1511] Processing CreateTablet for tablet fcb4737defc94214adbcf8b7639f3087 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:11.239276 13257 tablet_bootstrap.cc:492] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:11.239898 13056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb4737defc94214adbcf8b7639f3087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.240008 13257 ts_tablet_manager.cc:1403] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.284s	user 0.015s	sys 0.007s
I20260709 13:17:11.246897 13204 tablet_service.cc:1511] Processing CreateTablet for tablet a154faa8adb64071b0226241e5c5fd24 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:11.247310 13129 tablet_service.cc:1511] Processing CreateTablet for tablet fcb4737defc94214adbcf8b7639f3087 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:11.248704 13204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a154faa8adb64071b0226241e5c5fd24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.252574 13129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb4737defc94214adbcf8b7639f3087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.258569 12981 tablet_service.cc:1511] Processing CreateTablet for tablet a154faa8adb64071b0226241e5c5fd24 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:11.260411 12981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a154faa8adb64071b0226241e5c5fd24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.273272 13018 heartbeater.cc:499] Master 127.4.254.62:45155 was elected leader, sending a full tablet report...
I20260709 13:17:11.244581 13257 raft_consensus.cc:359] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.228629 13128 tablet_service.cc:1511] Processing CreateTablet for tablet 4903a5109902424b919c33e97f22b096 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:11.279816 13128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4903a5109902424b919c33e97f22b096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.291076 13130 tablet_service.cc:1511] Processing CreateTablet for tablet 668888eb645947b9a0eeb86f97889199 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:11.292440 13130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668888eb645947b9a0eeb86f97889199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.281894 13257 raft_consensus.cc:385] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.296344 13241 heartbeater.cc:499] Master 127.4.254.62:45155 was elected leader, sending a full tablet report...
I20260709 13:17:11.298131 13258 ts_tablet_manager.cc:1434] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.105s	user 0.014s	sys 0.074s
I20260709 13:17:11.299031 13167 heartbeater.cc:499] Master 127.4.254.62:45155 was elected leader, sending a full tablet report...
I20260709 13:17:11.299338 13258 tablet_bootstrap.cc:492] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:11.301254 13201 tablet_service.cc:1511] Processing CreateTablet for tablet 668888eb645947b9a0eeb86f97889199 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:11.302922 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668888eb645947b9a0eeb86f97889199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.294610 13257 raft_consensus.cc:740] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.304544 13257 consensus_queue.cc:260] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.315412 13260 tablet_bootstrap.cc:492] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:11.315965 13260 ts_tablet_manager.cc:1403] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.193s	user 0.014s	sys 0.013s
I20260709 13:17:11.328770 13260 raft_consensus.cc:359] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.329672 13260 raft_consensus.cc:385] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.330060 13260 raft_consensus.cc:740] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.329782 12979 tablet_service.cc:1511] Processing CreateTablet for tablet 668888eb645947b9a0eeb86f97889199 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:11.330862 13257 ts_tablet_manager.cc:1434] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.012s
I20260709 13:17:11.331218 12979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668888eb645947b9a0eeb86f97889199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.331918 13257 tablet_bootstrap.cc:492] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:11.333698 13259 ts_tablet_manager.cc:1434] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.146s	user 0.026s	sys 0.037s
I20260709 13:17:11.334786 13259 tablet_bootstrap.cc:492] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:11.338307 13257 tablet_bootstrap.cc:654] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.339226 13260 consensus_queue.cc:260] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.350251 13058 tablet_service.cc:1511] Processing CreateTablet for tablet a154faa8adb64071b0226241e5c5fd24 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:11.352170 13058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a154faa8adb64071b0226241e5c5fd24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.367594 13258 tablet_bootstrap.cc:654] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.372859 13093 heartbeater.cc:499] Master 127.4.254.62:45155 was elected leader, sending a full tablet report...
I20260709 13:17:11.377305 13050 tablet_service.cc:1511] Processing CreateTablet for tablet 64cb17552f904cb5b72197a75fa78b6f (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:11.379655 13050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64cb17552f904cb5b72197a75fa78b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.385507 13265 raft_consensus.cc:493] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.386317 13259 tablet_bootstrap.cc:654] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.386035 13265 raft_consensus.cc:515] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.401499 13265 leader_election.cc:290] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:11.411875 13204 tablet_service.cc:1511] Processing CreateTablet for tablet 64cb17552f904cb5b72197a75fa78b6f (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:11.418128 12979 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3b9e0089ed417d857d2dacb7cdc85f (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:11.423623 13204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64cb17552f904cb5b72197a75fa78b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.430902 13053 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3b9e0089ed417d857d2dacb7cdc85f (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:11.432346 13053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3b9e0089ed417d857d2dacb7cdc85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.436661 12979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3b9e0089ed417d857d2dacb7cdc85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.438830 13266 raft_consensus.cc:493] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.439388 13266 raft_consensus.cc:515] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
W20260709 13:17:11.447081 13168 tablet.cc:2406] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:11.448695 13266 leader_election.cc:290] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:11.451759 13260 ts_tablet_manager.cc:1434] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.135s	user 0.013s	sys 0.025s
I20260709 13:17:11.452894 13260 tablet_bootstrap.cc:492] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:11.453336 13257 tablet_bootstrap.cc:492] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:11.453910 13257 ts_tablet_manager.cc:1403] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.027s
I20260709 13:17:11.457520 13202 tablet_service.cc:1511] Processing CreateTablet for tablet b5ad68b455024af5a1dfcc5dd42cc600 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:11.459301 13202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ad68b455024af5a1dfcc5dd42cc600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.459784 13257 raft_consensus.cc:359] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:11.460552 13257 raft_consensus.cc:385] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.460853 13257 raft_consensus.cc:740] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.462746 12981 tablet_service.cc:1511] Processing CreateTablet for tablet b5ad68b455024af5a1dfcc5dd42cc600 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:11.464027 12981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ad68b455024af5a1dfcc5dd42cc600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.464551 13056 tablet_service.cc:1511] Processing CreateTablet for tablet b5ad68b455024af5a1dfcc5dd42cc600 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:11.465902 13056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ad68b455024af5a1dfcc5dd42cc600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.492543 13128 tablet_service.cc:1511] Processing CreateTablet for tablet 64cb17552f904cb5b72197a75fa78b6f (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:11.493827 13258 tablet_bootstrap.cc:492] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:11.493956 13128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64cb17552f904cb5b72197a75fa78b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.494527 13258 ts_tablet_manager.cc:1403] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.195s	user 0.015s	sys 0.014s
I20260709 13:17:11.508649 13257 consensus_queue.cc:260] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:11.509634 12982 tablet_service.cc:1511] Processing CreateTablet for tablet 11a2dad5f61d4971a5a7ae53bfe10ca3 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:11.511004 12982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a2dad5f61d4971a5a7ae53bfe10ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.511356 13257 ts_tablet_manager.cc:1434] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.004s
I20260709 13:17:11.512404 13257 tablet_bootstrap.cc:492] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:11.516183 13050 tablet_service.cc:1511] Processing CreateTablet for tablet 0384e7d3a9d74a11bb77367cbaea5476 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:11.517289 13259 tablet_bootstrap.cc:492] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:11.517565 13050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0384e7d3a9d74a11bb77367cbaea5476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.517892 13259 ts_tablet_manager.cc:1403] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.183s	user 0.017s	sys 0.015s
I20260709 13:17:11.522603 13201 tablet_service.cc:1511] Processing CreateTablet for tablet 11a2dad5f61d4971a5a7ae53bfe10ca3 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:11.524024 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a2dad5f61d4971a5a7ae53bfe10ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.534108 13130 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3b9e0089ed417d857d2dacb7cdc85f (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:11.535022 13132 tablet_service.cc:1511] Processing CreateTablet for tablet 0384e7d3a9d74a11bb77367cbaea5476 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:11.535514 13130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3b9e0089ed417d857d2dacb7cdc85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.536293 13132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0384e7d3a9d74a11bb77367cbaea5476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.537623 13129 tablet_service.cc:1511] Processing CreateTablet for tablet 11a2dad5f61d4971a5a7ae53bfe10ca3 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:11.538844 13129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a2dad5f61d4971a5a7ae53bfe10ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.542397 13058 tablet_service.cc:1511] Processing CreateTablet for tablet 66acbaec0edb4d7fbd364d37ccac32ab (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:11.543669 13058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66acbaec0edb4d7fbd364d37ccac32ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.540943 13205 tablet_service.cc:1511] Processing CreateTablet for tablet 0384e7d3a9d74a11bb77367cbaea5476 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:11.547147 13205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0384e7d3a9d74a11bb77367cbaea5476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.550182 13131 tablet_service.cc:1511] Processing CreateTablet for tablet 66acbaec0edb4d7fbd364d37ccac32ab (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:11.551501 13131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66acbaec0edb4d7fbd364d37ccac32ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.542402 12983 tablet_service.cc:1511] Processing CreateTablet for tablet 66acbaec0edb4d7fbd364d37ccac32ab (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:11.550400 13258 raft_consensus.cc:359] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:11.554378 12983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66acbaec0edb4d7fbd364d37ccac32ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.554380 13258 raft_consensus.cc:385] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.560173 13258 raft_consensus.cc:740] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.560961 13258 consensus_queue.cc:260] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:11.565181 13259 raft_consensus.cc:359] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:11.566015 13259 raft_consensus.cc:385] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.566360 13259 raft_consensus.cc:740] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.575102 13259 consensus_queue.cc:260] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:11.566964 13260 tablet_bootstrap.cc:654] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.575623 13200 tablet_service.cc:1511] Processing CreateTablet for tablet 6c270ee9d9bf4efaa6f866fe2f248663 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:11.580430 13258 ts_tablet_manager.cc:1434] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 13:17:11.581549 13258 tablet_bootstrap.cc:492] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:11.583711 13200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c270ee9d9bf4efaa6f866fe2f248663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.589423 13053 tablet_service.cc:1511] Processing CreateTablet for tablet 6c270ee9d9bf4efaa6f866fe2f248663 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:11.590296 12979 tablet_service.cc:1511] Processing CreateTablet for tablet 6c270ee9d9bf4efaa6f866fe2f248663 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:11.590431 13203 tablet_service.cc:1511] Processing CreateTablet for tablet 8526082d24944a48aab1c0d78d626587 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:11.591753 12979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c270ee9d9bf4efaa6f866fe2f248663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.592052 13203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8526082d24944a48aab1c0d78d626587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.592759 13259 ts_tablet_manager.cc:1434] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.074s	user 0.003s	sys 0.005s
I20260709 13:17:11.598677 13259 tablet_bootstrap.cc:492] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:11.590917 13053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c270ee9d9bf4efaa6f866fe2f248663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.604925 12981 tablet_service.cc:1511] Processing CreateTablet for tablet 8526082d24944a48aab1c0d78d626587 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:11.606308 12981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8526082d24944a48aab1c0d78d626587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.606778 13054 tablet_service.cc:1511] Processing CreateTablet for tablet 668942e4495f4e6ca677aa883843b165 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:11.607870 13054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668942e4495f4e6ca677aa883843b165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.609782 13267 raft_consensus.cc:493] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.598904 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72a3ace6e8c4edfb0b28ddf70ceb000" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:11.610327 13267 raft_consensus.cc:515] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.627979 13267 leader_election.cc:290] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:11.628690 13267 raft_consensus.cc:493] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.629830 13127 tablet_service.cc:1511] Processing CreateTablet for tablet 8526082d24944a48aab1c0d78d626587 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:11.631271 13127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8526082d24944a48aab1c0d78d626587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.631625 13257 tablet_bootstrap.cc:654] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.637362 12993 raft_consensus.cc:2468] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:11.638720 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72a3ace6e8c4edfb0b28ddf70ceb000" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
W20260709 13:17:11.640760 13107 leader_election.cc:343] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.649474 13129 tablet_service.cc:1511] Processing CreateTablet for tablet 668942e4495f4e6ca677aa883843b165 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:11.650868 13129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668942e4495f4e6ca677aa883843b165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.677943 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9713e0bcb2b64111a73eaa424eb16574" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
W20260709 13:17:11.680038 13181 leader_election.cc:343] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.671914 13267 raft_consensus.cc:515] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:11.682138 13258 tablet_bootstrap.cc:654] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.683581 13267 leader_election.cc:290] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:11.688387 13257 tablet_bootstrap.cc:492] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:11.688931 13257 ts_tablet_manager.cc:1403] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.177s	user 0.005s	sys 0.008s
I20260709 13:17:11.689949 13053 tablet_service.cc:1511] Processing CreateTablet for tablet 4bf030a2e0b44f30ace670a840933368 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:11.691150 13053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bf030a2e0b44f30ace670a840933368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.691318 13131 tablet_service.cc:1511] Processing CreateTablet for tablet 4bf030a2e0b44f30ace670a840933368 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:11.692107 13257 raft_consensus.cc:359] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.704510 13204 tablet_service.cc:1511] Processing CreateTablet for tablet 668942e4495f4e6ca677aa883843b165 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:11.699043 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9713e0bcb2b64111a73eaa424eb16574" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:11.720808 13142 raft_consensus.cc:2468] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:11.721213 13131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bf030a2e0b44f30ace670a840933368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.707065 13050 tablet_service.cc:1511] Processing CreateTablet for tablet 5505b452a14d41e1877484ca6696497a (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:11.722484 13050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5505b452a14d41e1877484ca6696497a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.717353 13259 tablet_bootstrap.cc:654] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.731338 13260 tablet_bootstrap.cc:492] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:11.731889 13260 ts_tablet_manager.cc:1403] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.279s	user 0.014s	sys 0.004s
I20260709 13:17:11.718200 13202 tablet_service.cc:1511] Processing CreateTablet for tablet 5505b452a14d41e1877484ca6696497a (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:11.707525 13257 raft_consensus.cc:385] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.741627 13266 raft_consensus.cc:493] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.742218 13266 raft_consensus.cc:515] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:11.743630 13201 tablet_service.cc:1511] Processing CreateTablet for tablet 50831cc643d24f00880db6263d32d280 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:11.747713 13266 leader_election.cc:290] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:11.748696 13204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668942e4495f4e6ca677aa883843b165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.739243 13257 raft_consensus.cc:740] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.753670 13202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5505b452a14d41e1877484ca6696497a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.753427 13257 consensus_queue.cc:260] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.755678 13257 ts_tablet_manager.cc:1434] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.001s
I20260709 13:17:11.756609 13257 tablet_bootstrap.cc:492] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:11.757987 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50831cc643d24f00880db6263d32d280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.763870 13259 tablet_bootstrap.cc:492] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:11.767505 13259 ts_tablet_manager.cc:1403] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.169s	user 0.008s	sys 0.009s
I20260709 13:17:11.770123 13260 raft_consensus.cc:359] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.770958 13260 raft_consensus.cc:385] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.771271 13260 raft_consensus.cc:740] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.772171 13260 consensus_queue.cc:260] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.774389 13260 ts_tablet_manager.cc:1434] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:17:11.774515 13259 raft_consensus.cc:359] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:11.775277 13259 raft_consensus.cc:385] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.775357 13260 tablet_bootstrap.cc:492] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:11.778052 13130 tablet_service.cc:1511] Processing CreateTablet for tablet 50831cc643d24f00880db6263d32d280 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:11.779469 13130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50831cc643d24f00880db6263d32d280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.780109 13258 tablet_bootstrap.cc:492] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:11.780611 13258 ts_tablet_manager.cc:1403] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.199s	user 0.020s	sys 0.005s
I20260709 13:17:11.775591 13259 raft_consensus.cc:740] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.803771 13269 raft_consensus.cc:493] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.803927 13258 raft_consensus.cc:359] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.804687 13258 raft_consensus.cc:385] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.804391 13269 raft_consensus.cc:515] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.804152 13058 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9cc31f16c2467c84113f244fcea75f (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:11.804978 13258 raft_consensus.cc:740] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.806051 13058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9cc31f16c2467c84113f244fcea75f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.805841 13258 consensus_queue.cc:260] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.808123 13258 ts_tablet_manager.cc:1434] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 13:17:11.819351 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e5c0d26b904f169897a58bdf500a3a" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:11.820501 13269 leader_election.cc:290] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:11.817518 13258 tablet_bootstrap.cc:492] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:11.829869 13181 leader_election.cc:304] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f
I20260709 13:17:11.831061 12979 tablet_service.cc:1511] Processing CreateTablet for tablet 4bf030a2e0b44f30ace670a840933368 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:11.840471 12979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bf030a2e0b44f30ace670a840933368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.842465 13205 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9cc31f16c2467c84113f244fcea75f (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:11.843842 13205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9cc31f16c2467c84113f244fcea75f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.844043 13260 tablet_bootstrap.cc:654] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.794888 13259 consensus_queue.cc:260] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:11.856348 13108 leader_election.cc:304] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f
I20260709 13:17:11.860282 13265 raft_consensus.cc:2804] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:11.860707 13265 raft_consensus.cc:493] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.861056 13265 raft_consensus.cc:3060] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.858747 12982 tablet_service.cc:1511] Processing CreateTablet for tablet 5505b452a14d41e1877484ca6696497a (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:11.867615 12982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5505b452a14d41e1877484ca6696497a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.870127 13265 raft_consensus.cc:515] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.871383 13054 tablet_service.cc:1511] Processing CreateTablet for tablet c9bc9d818fc44989bdc08e740dfcd1b3 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:11.872715 13054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9bc9d818fc44989bdc08e740dfcd1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.875298 13203 tablet_service.cc:1511] Processing CreateTablet for tablet 720ddf9396de4255ba8105124c624739 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:11.876617 13203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720ddf9396de4255ba8105124c624739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.872733 13265 leader_election.cc:290] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:11.899544 13266 raft_consensus.cc:2804] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:11.900031 13266 raft_consensus.cc:493] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.900398 13266 raft_consensus.cc:3060] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.902622 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72a3ace6e8c4edfb0b28ddf70ceb000" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:11.903115 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72a3ace6e8c4edfb0b28ddf70ceb000" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:11.903319 12993 raft_consensus.cc:3060] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.906255 13056 tablet_service.cc:1511] Processing CreateTablet for tablet 720ddf9396de4255ba8105124c624739 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:11.907677 13056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720ddf9396de4255ba8105124c624739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.911302 13200 tablet_service.cc:1511] Processing CreateTablet for tablet 7205bc9d20124044a1f1e9be55845ed6 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:11.912686 13200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7205bc9d20124044a1f1e9be55845ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.915328 13257 tablet_bootstrap.cc:654] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.922312 13206 tablet_service.cc:1511] Processing CreateTablet for tablet fcf41f772abd4db09c73e0c6619642fe (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:11.922533 12979 tablet_service.cc:1511] Processing CreateTablet for tablet c9bc9d818fc44989bdc08e740dfcd1b3 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:11.922398 12981 tablet_service.cc:1511] Processing CreateTablet for tablet 50831cc643d24f00880db6263d32d280 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:11.923832 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf41f772abd4db09c73e0c6619642fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.923923 12979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9bc9d818fc44989bdc08e740dfcd1b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:11.904703 12958 leader_election.cc:343] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.925452 12981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50831cc643d24f00880db6263d32d280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.911007 12993 raft_consensus.cc:2468] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:11.929391 13259 ts_tablet_manager.cc:1434] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.162s	user 0.007s	sys 0.002s
I20260709 13:17:11.929718 13108 leader_election.cc:304] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:11.930644 13259 tablet_bootstrap.cc:492] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:11.930884 13265 raft_consensus.cc:2804] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:11.943135 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72a3ace6e8c4edfb0b28ddf70ceb000" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:11.947208 13131 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9cc31f16c2467c84113f244fcea75f (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:11.951498 12983 tablet_service.cc:1511] Processing CreateTablet for tablet 720ddf9396de4255ba8105124c624739 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:11.951891 13132 tablet_service.cc:1511] Processing CreateTablet for tablet c9bc9d818fc44989bdc08e740dfcd1b3 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:11.952972 12983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720ddf9396de4255ba8105124c624739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.953069 13132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9bc9d818fc44989bdc08e740dfcd1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.958693 13131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9cc31f16c2467c84113f244fcea75f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.965570 13053 tablet_service.cc:1511] Processing CreateTablet for tablet fcf41f772abd4db09c73e0c6619642fe (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:11.967903 13053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf41f772abd4db09c73e0c6619642fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.974644 12980 tablet_service.cc:1511] Processing CreateTablet for tablet 7205bc9d20124044a1f1e9be55845ed6 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:11.975216 13266 raft_consensus.cc:515] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:11.976013 12980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7205bc9d20124044a1f1e9be55845ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.977475 13266 leader_election.cc:290] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:11.963753 13265 raft_consensus.cc:697] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:11.990079 13127 tablet_service.cc:1511] Processing CreateTablet for tablet 7205bc9d20124044a1f1e9be55845ed6 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:11.993005 13203 tablet_service.cc:1511] Processing CreateTablet for tablet b872974f73d3469981669da74502740b (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:11.996660 13203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b872974f73d3469981669da74502740b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.996918 13265 consensus_queue.cc:237] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:11.998991 13054 tablet_service.cc:1511] Processing CreateTablet for tablet b872974f73d3469981669da74502740b (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:12.000259 13054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b872974f73d3469981669da74502740b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.000722 13127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7205bc9d20124044a1f1e9be55845ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.013157 13260 tablet_bootstrap.cc:492] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:12.018193 13260 ts_tablet_manager.cc:1403] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.243s	user 0.006s	sys 0.010s
W20260709 13:17:11.967036 13181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:36831, user_credentials={real_user=slave}} blocked reactor thread for 137311us
I20260709 13:17:12.026549 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9713e0bcb2b64111a73eaa424eb16574" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:12.029043 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9713e0bcb2b64111a73eaa424eb16574" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:12.029711 13142 raft_consensus.cc:3060] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:12.033679 13181 leader_election.cc:343] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:12.034489 13181 leader_election.cc:343] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.040365 12983 tablet_service.cc:1511] Processing CreateTablet for tablet 59c00d97a4f0421d95d71476563154ed (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:12.040838 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e5c0d26b904f169897a58bdf500a3a" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:12.042865 13269 raft_consensus.cc:493] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.043359 13269 raft_consensus.cc:515] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:12.044696 13280 raft_consensus.cc:493] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.045235 13280 raft_consensus.cc:515] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:12.045706 13269 leader_election.cc:290] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:12.045643 13260 raft_consensus.cc:359] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:12.046728 13260 raft_consensus.cc:385] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.047158 13260 raft_consensus.cc:740] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.047366 13280 leader_election.cc:290] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:12.049944 13199 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9d17ac0f6d4b9a9851a6aa26127256 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:12.051321 13199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9d17ac0f6d4b9a9851a6aa26127256. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:12.052057 13107 leader_election.cc:343] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.052582 13128 tablet_service.cc:1511] Processing CreateTablet for tablet fcf41f772abd4db09c73e0c6619642fe (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:12.054278 13128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf41f772abd4db09c73e0c6619642fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.054242 13129 tablet_service.cc:1511] Processing CreateTablet for tablet 59c00d97a4f0421d95d71476563154ed (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:12.054477 13053 tablet_service.cc:1511] Processing CreateTablet for tablet f045d0ee1dab4622a49c705aec5c2168 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:12.055599 13129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c00d97a4f0421d95d71476563154ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.055794 13053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f045d0ee1dab4622a49c705aec5c2168. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:12.058997 13182 leader_election.cc:343] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.059525 13182 leader_election.cc:304] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:12.059821 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fa4a311cc64cd197ab6bdae52c3f96" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:12.060524 13068 raft_consensus.cc:2468] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 0.
I20260709 13:17:12.062126 13266 raft_consensus.cc:2749] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:12.062451 13141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:12.062395 12978 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9d17ac0f6d4b9a9851a6aa26127256 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:12.063872 13126 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9d17ac0f6d4b9a9851a6aa26127256 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:12.064203 13141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fa4a311cc64cd197ab6bdae52c3f96" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:12.064867 13141 raft_consensus.cc:2468] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:12.065438 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72a3ace6e8c4edfb0b28ddf70ceb000" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:12.065696 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
W20260709 13:17:12.066057 13033 leader_election.cc:343] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.067101 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fa4a311cc64cd197ab6bdae52c3f96" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:12.067395 13050 tablet_service.cc:1511] Processing CreateTablet for tablet 59c00d97a4f0421d95d71476563154ed (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:12.067754 13138 raft_consensus.cc:2468] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 0.
I20260709 13:17:12.067814 12958 leader_election.cc:304] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18; no voters: 
I20260709 13:17:12.068661 13050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c00d97a4f0421d95d71476563154ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.069205 13126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9d17ac0f6d4b9a9851a6aa26127256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.070695 13142 raft_consensus.cc:2468] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:12.071938 13181 leader_election.cc:304] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f
I20260709 13:17:12.072763 13266 raft_consensus.cc:2804] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:12.048240 13260 consensus_queue.cc:260] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:12.073277 13266 raft_consensus.cc:697] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:12.080243 12979 tablet_service.cc:1511] Processing CreateTablet for tablet b872974f73d3469981669da74502740b (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:12.082762 13033 leader_election.cc:304] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:12.086138 13266 consensus_queue.cc:237] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
W20260709 13:17:12.089150 12939 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:12.089478 12958 leader_election.cc:304] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
W20260709 13:17:12.090723 12958 leader_election.cc:343] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.091833 13267 raft_consensus.cc:2749] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:12.097299 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:12.077253 13280 raft_consensus.cc:2804] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.098075 13216 raft_consensus.cc:2468] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 0.
I20260709 13:17:12.096199 12890 catalog_manager.cc:5697] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 0 to 1, leader changed from <none> to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:12.112941 13269 raft_consensus.cc:2804] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.113415 13269 raft_consensus.cc:493] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.113754 13269 raft_consensus.cc:3060] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.098070 13280 raft_consensus.cc:493] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.116581 13280 raft_consensus.cc:3060] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.110970 13260 ts_tablet_manager.cc:1434] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.000s
I20260709 13:17:12.105906 13258 tablet_bootstrap.cc:654] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.120961 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:12.123459 13056 tablet_service.cc:1511] Processing CreateTablet for tablet 1b13e68f1bda46e6afb535f52545dc00 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:12.132797 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fa4a311cc64cd197ab6bdae52c3f96" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:12.133531 13203 tablet_service.cc:1511] Processing CreateTablet for tablet f045d0ee1dab4622a49c705aec5c2168 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:12.135416 13203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f045d0ee1dab4622a49c705aec5c2168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.135923 13259 tablet_bootstrap.cc:654] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.140383 13056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b13e68f1bda46e6afb535f52545dc00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.141759 13125 tablet_service.cc:1511] Processing CreateTablet for tablet 1b13e68f1bda46e6afb535f52545dc00 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:12.143079 13125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b13e68f1bda46e6afb535f52545dc00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.151021 13132 tablet_service.cc:1511] Processing CreateTablet for tablet f045d0ee1dab4622a49c705aec5c2168 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:12.152523 13257 tablet_bootstrap.cc:492] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:12.153095 13257 ts_tablet_manager.cc:1403] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.397s	user 0.012s	sys 0.030s
I20260709 13:17:12.154727 13201 tablet_service.cc:1511] Processing CreateTablet for tablet 639492da5d6a4c6baaf3d0b8f30f76b9 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:12.156505 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639492da5d6a4c6baaf3d0b8f30f76b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.152963 13132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f045d0ee1dab4622a49c705aec5c2168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.145717 12956 leader_election.cc:304] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed; no voters: c538e5be22524c9a970f7a59c5379288
I20260709 13:17:12.164566 13267 raft_consensus.cc:2804] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.164964 13267 raft_consensus.cc:493] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.165330 13267 raft_consensus.cc:3060] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.156392 13257 raft_consensus.cc:359] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
W20260709 13:17:12.176348 13034 leader_election.cc:343] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.181378 13257 raft_consensus.cc:385] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.181442 13034 leader_election.cc:304] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:12.181871 13257 raft_consensus.cc:740] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
W20260709 13:17:12.182361 13033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:36831, user_credentials={real_user=slave}} blocked reactor thread for 99684.8us
I20260709 13:17:12.177736 12981 tablet_service.cc:1511] Processing CreateTablet for tablet 1b13e68f1bda46e6afb535f52545dc00 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:12.180540 13269 raft_consensus.cc:515] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:12.184661 13260 tablet_bootstrap.cc:492] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:12.188504 12979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b872974f73d3469981669da74502740b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.190369 12978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9d17ac0f6d4b9a9851a6aa26127256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.195324 12977 tablet_service.cc:1511] Processing CreateTablet for tablet 639492da5d6a4c6baaf3d0b8f30f76b9 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:12.196600 12977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639492da5d6a4c6baaf3d0b8f30f76b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.197510 12983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c00d97a4f0421d95d71476563154ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.181825 13267 raft_consensus.cc:515] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:12.201624 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:12.201654 12981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b13e68f1bda46e6afb535f52545dc00. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:12.203068 12958 leader_election.cc:343] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.205549 13058 tablet_service.cc:1511] Processing CreateTablet for tablet 639492da5d6a4c6baaf3d0b8f30f76b9 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:12.206821 13058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639492da5d6a4c6baaf3d0b8f30f76b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.223664 13205 tablet_service.cc:1511] Processing CreateTablet for tablet 581bf3becdab4773845a749f01ae77cf (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:12.225031 13205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581bf3becdab4773845a749f01ae77cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.225209 13126 tablet_service.cc:1511] Processing CreateTablet for tablet 581bf3becdab4773845a749f01ae77cf (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:12.226486 13126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581bf3becdab4773845a749f01ae77cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.234541 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:12.234828 13269 leader_election.cc:290] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:12.235209 13216 raft_consensus.cc:3060] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.235390 13269 raft_consensus.cc:2749] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:12.235885 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fa4a311cc64cd197ab6bdae52c3f96" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:12.238178 13280 raft_consensus.cc:515] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:12.239373 12992 raft_consensus.cc:2393] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c23c890764727a91d599e0d75604f in current term 1: Already voted for candidate 66218fb7f83e41ffa427b95015c3bf18 in this term.
I20260709 13:17:12.236507 13142 raft_consensus.cc:3060] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.243028 13260 tablet_bootstrap.cc:654] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.239389 13259 tablet_bootstrap.cc:492] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:12.253223 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fa4a311cc64cd197ab6bdae52c3f96" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:12.254038 12992 raft_consensus.cc:2393] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c23c890764727a91d599e0d75604f in current term 1: Already voted for candidate 66218fb7f83e41ffa427b95015c3bf18 in this term.
I20260709 13:17:12.255014 13258 tablet_bootstrap.cc:492] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:12.255546 13258 ts_tablet_manager.cc:1403] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.447s	user 0.015s	sys 0.004s
I20260709 13:17:12.258312 13216 raft_consensus.cc:2468] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 1.
I20260709 13:17:12.259549 12956 leader_election.cc:304] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed; no voters: c538e5be22524c9a970f7a59c5379288
I20260709 13:17:12.184691 13257 consensus_queue.cc:260] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:12.168035 12888 catalog_manager.cc:5697] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:12.261454 13050 tablet_service.cc:1511] Processing CreateTablet for tablet 2a8bbf6cae584ed28932e79f625a4026 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:12.262810 13050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a8bbf6cae584ed28932e79f625a4026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.266703 13258 raft_consensus.cc:359] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:12.267510 13258 raft_consensus.cc:385] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.267834 13258 raft_consensus.cc:740] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.270747 12979 tablet_service.cc:1511] Processing CreateTablet for tablet 581bf3becdab4773845a749f01ae77cf (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:12.271651 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fa4a311cc64cd197ab6bdae52c3f96" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:12.271965 12979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581bf3becdab4773845a749f01ae77cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.272466 13068 raft_consensus.cc:2393] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 66218fb7f83e41ffa427b95015c3bf18 in current term 1: Already voted for candidate 293c23c890764727a91d599e0d75604f in this term.
I20260709 13:17:12.243201 13267 leader_election.cc:290] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:12.273689 13267 raft_consensus.cc:2804] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:12.274150 13267 raft_consensus.cc:697] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 1 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:12.274960 13267 consensus_queue.cc:237] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:12.275419 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fa4a311cc64cd197ab6bdae52c3f96" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:12.277009 12958 leader_election.cc:304] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:12.283560 13280 leader_election.cc:290] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:12.286964 13200 tablet_service.cc:1511] Processing CreateTablet for tablet 2a8bbf6cae584ed28932e79f625a4026 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:12.288338 13200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a8bbf6cae584ed28932e79f625a4026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.294452 13302 raft_consensus.cc:2749] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:12.284123 13259 ts_tablet_manager.cc:1403] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.354s	user 0.011s	sys 0.002s
I20260709 13:17:12.299069 13257 ts_tablet_manager.cc:1434] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.146s	user 0.011s	sys 0.002s
I20260709 13:17:12.300028 13129 tablet_service.cc:1511] Processing CreateTablet for tablet 2a8bbf6cae584ed28932e79f625a4026 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:12.300132 13056 tablet_service.cc:1511] Processing CreateTablet for tablet c1b9b7d6e83f4063b1a0214df6346486 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:12.305905 13056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b9b7d6e83f4063b1a0214df6346486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.289564 13142 raft_consensus.cc:2468] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
W20260709 13:17:12.319484 12956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:36179, user_credentials={real_user=slave}} blocked reactor thread for 60022.3us
I20260709 13:17:12.320960 13297 raft_consensus.cc:493] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.321262 13206 tablet_service.cc:1511] Processing CreateTablet for tablet 104ab1e98709456eb4495544632b0eeb (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:12.321552 13297 raft_consensus.cc:515] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:12.322606 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104ab1e98709456eb4495544632b0eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.322746 12982 tablet_service.cc:1511] Processing CreateTablet for tablet 104ab1e98709456eb4495544632b0eeb (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:12.323905 13297 leader_election.cc:290] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:12.324051 12982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104ab1e98709456eb4495544632b0eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.325704 12978 tablet_service.cc:1511] Processing CreateTablet for tablet c1b9b7d6e83f4063b1a0214df6346486 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:12.327442 12978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b9b7d6e83f4063b1a0214df6346486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.321010 13132 tablet_service.cc:1511] Processing CreateTablet for tablet c1b9b7d6e83f4063b1a0214df6346486 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:12.336447 13033 leader_election.cc:304] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:12.336962 13058 tablet_service.cc:1511] Processing CreateTablet for tablet 104ab1e98709456eb4495544632b0eeb (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:12.337730 13297 raft_consensus.cc:2804] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:12.337503 13127 tablet_service.cc:1511] Processing CreateTablet for tablet c405efda88e2475f9916d4e89499e058 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:12.338268 13058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104ab1e98709456eb4495544632b0eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.338245 13297 raft_consensus.cc:697] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:12.339319 13297 consensus_queue.cc:237] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:12.295847 13258 consensus_queue.cc:260] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:12.341867 13258 ts_tablet_manager.cc:1434] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.002s
I20260709 13:17:12.342861 13258 tablet_bootstrap.cc:492] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:12.348729 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f418ed3813fa42608ed35304ac9d123b" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
W20260709 13:17:12.351102 13031 leader_election.cc:343] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.355418 13260 tablet_bootstrap.cc:492] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:12.356022 13260 ts_tablet_manager.cc:1403] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.172s	user 0.013s	sys 0.004s
I20260709 13:17:12.368083 13129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a8bbf6cae584ed28932e79f625a4026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.370438 13257 tablet_bootstrap.cc:492] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:12.359081 13050 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3e2b3b94fc464c8abc3f09cbb895d1 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:12.370055 13127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c405efda88e2475f9916d4e89499e058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.381062 13054 tablet_service.cc:1511] Processing CreateTablet for tablet 1005312f5ba04344b9dd149ba865a121 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:12.381489 13203 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3e2b3b94fc464c8abc3f09cbb895d1 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:12.382493 13054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1005312f5ba04344b9dd149ba865a121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.382678 13203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3e2b3b94fc464c8abc3f09cbb895d1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:12.332707 12958 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:36831, user_credentials={real_user=slave}} blocked reactor thread for 55789.7us
I20260709 13:17:12.363039 13130 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3e2b3b94fc464c8abc3f09cbb895d1 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:12.387053 13132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b9b7d6e83f4063b1a0214df6346486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.390940 13258 tablet_bootstrap.cc:654] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.397470 13130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3e2b3b94fc464c8abc3f09cbb895d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.400380 13201 tablet_service.cc:1511] Processing CreateTablet for tablet beda4eef244d40e08532d288c6a7c865 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:17:12.406525 13107 consensus_peers.cc:597] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:12.407282 13050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3e2b3b94fc464c8abc3f09cbb895d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.409504 13053 tablet_service.cc:1511] Processing CreateTablet for tablet beda4eef244d40e08532d288c6a7c865 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:12.437906 13053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beda4eef244d40e08532d288c6a7c865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.363966 13259 raft_consensus.cc:359] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:12.441325 13259 raft_consensus.cc:385] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.441648 13259 raft_consensus.cc:740] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.442329 13259 consensus_queue.cc:260] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:12.444546 13259 ts_tablet_manager.cc:1434] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.140s	user 0.006s	sys 0.000s
I20260709 13:17:12.448889 13126 tablet_service.cc:1511] Processing CreateTablet for tablet 4483482a9c42442eaea9bfe345f9c1f0 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:12.450259 13126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4483482a9c42442eaea9bfe345f9c1f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.369460 13260 raft_consensus.cc:359] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:12.421820 13199 tablet_service.cc:1511] Processing CreateTablet for tablet c405efda88e2475f9916d4e89499e058 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:12.423336 13128 tablet_service.cc:1511] Processing CreateTablet for tablet 1005312f5ba04344b9dd149ba865a121 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:12.424535 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f418ed3813fa42608ed35304ac9d123b" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:12.426566 12979 tablet_service.cc:1511] Processing CreateTablet for tablet beda4eef244d40e08532d288c6a7c865 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:12.430992 13257 tablet_bootstrap.cc:654] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.430541 12981 tablet_service.cc:1511] Processing CreateTablet for tablet 1005312f5ba04344b9dd149ba865a121 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:12.428921 12891 catalog_manager.cc:5697] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.466889 12887 catalog_manager.cc:5697] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:12.469463 13034 leader_election.cc:343] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.469759 13265 consensus_queue.cc:1048] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.469983 13034 leader_election.cc:304] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:12.463798 13205 tablet_service.cc:1511] Processing CreateTablet for tablet 4483482a9c42442eaea9bfe345f9c1f0 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:12.461550 13128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1005312f5ba04344b9dd149ba865a121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.435863 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beda4eef244d40e08532d288c6a7c865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.459045 12979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beda4eef244d40e08532d288c6a7c865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.456489 13260 raft_consensus.cc:385] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.478950 13267 raft_consensus.cc:493] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.478771 13260 raft_consensus.cc:740] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.479857 13267 raft_consensus.cc:515] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:12.480983 13260 consensus_queue.cc:260] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:12.483695 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e5c0d26b904f169897a58bdf500a3a" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:12.484580 13216 raft_consensus.cc:2468] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 0.
I20260709 13:17:12.485033 13260 ts_tablet_manager.cc:1434] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.129s	user 0.008s	sys 0.000s
I20260709 13:17:12.485424 12981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1005312f5ba04344b9dd149ba865a121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.486132 13260 tablet_bootstrap.cc:492] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:12.486809 12956 leader_election.cc:304] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:12.488199 13301 raft_consensus.cc:2804] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.488703 13301 raft_consensus.cc:493] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.489154 13301 raft_consensus.cc:3060] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.496758 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e5c0d26b904f169897a58bdf500a3a" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
W20260709 13:17:12.501201 12958 leader_election.cc:343] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.498817 13259 tablet_bootstrap.cc:492] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:12.490651 12977 tablet_service.cc:1511] Processing CreateTablet for tablet c405efda88e2475f9916d4e89499e058 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:12.504220 12977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c405efda88e2475f9916d4e89499e058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.511528 13266 consensus_queue.cc:1048] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.494529 13267 leader_election.cc:290] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:12.483709 13199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c405efda88e2475f9916d4e89499e058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.476966 13297 raft_consensus.cc:2749] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:12.567046 13053 tablet_service.cc:1511] Processing CreateTablet for tablet 1f853a78f0704cbea0a4794c62412b27 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:12.568229 13053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f853a78f0704cbea0a4794c62412b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.568157 13125 tablet_service.cc:1511] Processing CreateTablet for tablet 1f853a78f0704cbea0a4794c62412b27 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:12.571966 12981 tablet_service.cc:1511] Processing CreateTablet for tablet 4483482a9c42442eaea9bfe345f9c1f0 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:12.573812 12981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4483482a9c42442eaea9bfe345f9c1f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.562345 13265 raft_consensus.cc:493] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.563827 13205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4483482a9c42442eaea9bfe345f9c1f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.581472 13203 tablet_service.cc:1511] Processing CreateTablet for tablet 1f853a78f0704cbea0a4794c62412b27 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:12.579272 13125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f853a78f0704cbea0a4794c62412b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.583173 13265 raft_consensus.cc:515] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:12.597750 12979 tablet_service.cc:1511] Processing CreateTablet for tablet 9463f9fea2974209a5a12e4f4d3e07ea (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:12.599062 12979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9463f9fea2974209a5a12e4f4d3e07ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.601202 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:12.601406 13206 tablet_service.cc:1511] Processing CreateTablet for tablet a2b7a30cf34b4474939be4fcce8ae930 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:12.601429 13203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f853a78f0704cbea0a4794c62412b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.605057 13127 tablet_service.cc:1511] Processing CreateTablet for tablet 9463f9fea2974209a5a12e4f4d3e07ea (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:12.606259 13265 leader_election.cc:290] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:12.606945 13127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9463f9fea2974209a5a12e4f4d3e07ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.608225 12983 tablet_service.cc:1511] Processing CreateTablet for tablet a2b7a30cf34b4474939be4fcce8ae930 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:12.609562 13297 raft_consensus.cc:493] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.610064 13297 raft_consensus.cc:515] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:12.610288 13301 raft_consensus.cc:515] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:12.611667 12983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b7a30cf34b4474939be4fcce8ae930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.613154 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e5c0d26b904f169897a58bdf500a3a" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:12.613492 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b7a30cf34b4474939be4fcce8ae930. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:12.614738 12958 leader_election.cc:343] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.615777 13297 leader_election.cc:290] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:12.617509 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72a3ace6e8c4edfb0b28ddf70ceb000" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:12.619788 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e72a3ace6e8c4edfb0b28ddf70ceb000" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:12.621155 13034 leader_election.cc:304] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:12.622313 13297 raft_consensus.cc:2749] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:12.628000 13054 tablet_service.cc:1511] Processing CreateTablet for tablet a2b7a30cf34b4474939be4fcce8ae930 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:12.629453 13054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b7a30cf34b4474939be4fcce8ae930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.639937 13260 tablet_bootstrap.cc:654] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.646317 13257 tablet_bootstrap.cc:492] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:12.646987 13257 ts_tablet_manager.cc:1403] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.283s	user 0.029s	sys 0.033s
I20260709 13:17:12.655997 13301 leader_election.cc:290] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:12.657316 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e5c0d26b904f169897a58bdf500a3a" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:12.658083 13216 raft_consensus.cc:3060] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.660343 13053 tablet_service.cc:1511] Processing CreateTablet for tablet 9463f9fea2974209a5a12e4f4d3e07ea (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:12.665853 13053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9463f9fea2974209a5a12e4f4d3e07ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.691495 13257 raft_consensus.cc:359] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:12.692338 13257 raft_consensus.cc:385] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.692648 13257 raft_consensus.cc:740] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.693523 13257 consensus_queue.cc:260] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:12.697942 12982 tablet_service.cc:1511] Processing CreateTablet for tablet f1e13a599e4c415d829e003cdcd8d4d8 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:12.699589 12982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e13a599e4c415d829e003cdcd8d4d8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:12.693320 12877 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.4.254.2:39523, user_credentials={real_user=slave}} blocked reactor thread for 43993.4us
I20260709 13:17:12.704698 13131 tablet_service.cc:1511] Processing CreateTablet for tablet f1e13a599e4c415d829e003cdcd8d4d8 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:12.706024 13131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e13a599e4c415d829e003cdcd8d4d8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:12.711966 13181 consensus_peers.cc:597] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:12.721932 13050 tablet_service.cc:1511] Processing CreateTablet for tablet bef8dfbfd00748febd426f6a0a5b591b (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:12.723546 13050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef8dfbfd00748febd426f6a0a5b591b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.697949 13206 tablet_service.cc:1511] Processing CreateTablet for tablet f1e13a599e4c415d829e003cdcd8d4d8 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:12.727689 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e13a599e4c415d829e003cdcd8d4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.728808 13257 ts_tablet_manager.cc:1434] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.000s
I20260709 13:17:12.729262 13142 raft_consensus.cc:3060] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.731664 13258 tablet_bootstrap.cc:492] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:12.734917 13205 tablet_service.cc:1511] Processing CreateTablet for tablet bef8dfbfd00748febd426f6a0a5b591b (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:12.744817 13257 tablet_bootstrap.cc:492] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:12.734884 13216 raft_consensus.cc:2468] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 1.
I20260709 13:17:12.765566 13258 ts_tablet_manager.cc:1403] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.423s	user 0.011s	sys 0.010s
I20260709 13:17:12.773901 13205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef8dfbfd00748febd426f6a0a5b591b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.771221 13127 tablet_service.cc:1511] Processing CreateTablet for tablet bef8dfbfd00748febd426f6a0a5b591b (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:12.776090 13127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef8dfbfd00748febd426f6a0a5b591b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.780206 13054 tablet_service.cc:1511] Processing CreateTablet for tablet 39b407734f414540b3dc28b0c16a3476 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:12.781662 13054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b407734f414540b3dc28b0c16a3476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.782200 12956 leader_election.cc:304] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f
I20260709 13:17:12.783494 13301 raft_consensus.cc:2804] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:12.784000 13301 raft_consensus.cc:697] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 1 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:12.784791 13301 consensus_queue.cc:237] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:12.788726 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:12.789563 13216 raft_consensus.cc:2393] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c538e5be22524c9a970f7a59c5379288 in current term 1: Already voted for candidate 66218fb7f83e41ffa427b95015c3bf18 in this term.
I20260709 13:17:12.790874 13105 leader_election.cc:304] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:12.793788 13265 raft_consensus.cc:2749] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:12.800163 12979 tablet_service.cc:1511] Processing CreateTablet for tablet 39b407734f414540b3dc28b0c16a3476 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:12.801748 12979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b407734f414540b3dc28b0c16a3476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.803825 13132 tablet_service.cc:1511] Processing CreateTablet for tablet 39b407734f414540b3dc28b0c16a3476 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:12.807555 13267 consensus_queue.cc:1048] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.808043 13132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b407734f414540b3dc28b0c16a3476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.809738 13050 tablet_service.cc:1511] Processing CreateTablet for tablet ffa1f32b4b894946ab9f4cdac887ca19 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:12.803629 13201 tablet_service.cc:1511] Processing CreateTablet for tablet ffa1f32b4b894946ab9f4cdac887ca19 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:12.810891 13050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa1f32b4b894946ab9f4cdac887ca19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.811216 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa1f32b4b894946ab9f4cdac887ca19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.814116 13128 tablet_service.cc:1511] Processing CreateTablet for tablet 862cb9adf046414ea2ed1f18fd42ed07 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:12.815359 13128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862cb9adf046414ea2ed1f18fd42ed07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.819877 13321 raft_consensus.cc:493] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.820590 13321 raft_consensus.cc:515] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:12.823655 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a9a68cea89454584f50702e5bd032d" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:12.824285 12992 raft_consensus.cc:2468] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:12.825544 13182 leader_election.cc:304] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:12.825637 13258 raft_consensus.cc:359] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:12.811254 13257 tablet_bootstrap.cc:654] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.832123 12977 tablet_service.cc:1511] Processing CreateTablet for tablet ffa1f32b4b894946ab9f4cdac887ca19 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:12.826416 13258 raft_consensus.cc:385] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.835968 13259 tablet_bootstrap.cc:654] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.837184 13321 leader_election.cc:290] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:12.838779 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a9a68cea89454584f50702e5bd032d" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:12.842911 12981 tablet_service.cc:1511] Processing CreateTablet for tablet 862cb9adf046414ea2ed1f18fd42ed07 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:12.845667 12977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa1f32b4b894946ab9f4cdac887ca19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.848058 12981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862cb9adf046414ea2ed1f18fd42ed07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.834919 13258 raft_consensus.cc:740] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.853894 13266 raft_consensus.cc:2804] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.874948 13266 raft_consensus.cc:493] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.880193 13260 tablet_bootstrap.cc:492] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:12.880748 13260 ts_tablet_manager.cc:1403] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.395s	user 0.011s	sys 0.034s
W20260709 13:17:12.877431 13181 leader_election.cc:343] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.887539 13203 tablet_service.cc:1511] Processing CreateTablet for tablet 862cb9adf046414ea2ed1f18fd42ed07 (DEFAULT_TABLE table=test-workload [id=1173d2d1dfb8433da0ecddcab3fc26d4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:12.888873 13203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862cb9adf046414ea2ed1f18fd42ed07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.889640 13266 raft_consensus.cc:3060] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.895829 13260 raft_consensus.cc:359] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:12.896588 13260 raft_consensus.cc:385] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.897073 13258 consensus_queue.cc:260] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:12.898224 13267 consensus_queue.cc:1048] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.899416 13258 ts_tablet_manager.cc:1434] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.103s	user 0.003s	sys 0.003s
I20260709 13:17:12.900480 13258 tablet_bootstrap.cc:492] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:12.902408 13269 consensus_queue.cc:1048] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.884269 13068 raft_consensus.cc:3060] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.896893 13260 raft_consensus.cc:740] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.916816 12891 catalog_manager.cc:5697] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:12.921933 13297 consensus_queue.cc:1048] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:12.925724 13259 tablet_bootstrap.cc:492] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:12.934083 13259 ts_tablet_manager.cc:1403] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.475s	user 0.028s	sys 0.009s
I20260709 13:17:12.940024 13259 raft_consensus.cc:359] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:12.940928 13260 consensus_queue.cc:260] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:12.954877 13257 tablet_bootstrap.cc:492] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:12.955406 13257 ts_tablet_manager.cc:1403] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.218s	user 0.021s	sys 0.038s
I20260709 13:17:12.958441 13257 raft_consensus.cc:359] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:12.959169 13257 raft_consensus.cc:385] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.959470 13257 raft_consensus.cc:740] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.960309 13257 consensus_queue.cc:260] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:12.962733 13257 ts_tablet_manager.cc:1434] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:12.963843 13257 tablet_bootstrap.cc:492] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:12.985858 13257 tablet_bootstrap.cc:654] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.950591 13259 raft_consensus.cc:385] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.990546 13259 raft_consensus.cc:740] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.002372 13259 consensus_queue.cc:260] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.011785 13260 ts_tablet_manager.cc:1434] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.131s	user 0.006s	sys 0.004s
I20260709 13:17:13.017313 13260 tablet_bootstrap.cc:492] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:13.027447 13259 ts_tablet_manager.cc:1434] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.090s	user 0.003s	sys 0.004s
I20260709 13:17:13.040478 13259 tablet_bootstrap.cc:492] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:13.025619 13266 raft_consensus.cc:515] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.055894 13266 leader_election.cc:290] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:13.056969 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a9a68cea89454584f50702e5bd032d" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
W20260709 13:17:13.058491 13181 leader_election.cc:343] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.060032 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a9a68cea89454584f50702e5bd032d" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:13.060640 12992 raft_consensus.cc:3060] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.064865 13301 raft_consensus.cc:493] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.065641 13301 raft_consensus.cc:515] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.070526 13258 tablet_bootstrap.cc:654] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.071309 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:13.072306 13138 raft_consensus.cc:2468] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 0.
I20260709 13:17:13.073693 12958 leader_election.cc:304] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:13.074749 13301 leader_election.cc:290] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:13.075433 13260 tablet_bootstrap.cc:654] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.075707 13301 raft_consensus.cc:2804] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.076139 13301 raft_consensus.cc:493] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.076474 13301 raft_consensus.cc:3060] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:13.081525 13034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:42939, user_credentials={real_user=slave}} blocked reactor thread for 71748.2us
I20260709 13:17:13.088656 12992 raft_consensus.cc:2468] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:13.118778 13257 tablet_bootstrap.cc:492] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:13.119503 13257 ts_tablet_manager.cc:1403] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.156s	user 0.020s	sys 0.018s
I20260709 13:17:13.114507 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:13.121747 13067 raft_consensus.cc:2468] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 0.
I20260709 13:17:13.122705 13301 raft_consensus.cc:515] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.124770 13301 leader_election.cc:290] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:13.115024 13182 leader_election.cc:304] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f
I20260709 13:17:13.126564 13266 raft_consensus.cc:2804] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.126860 13259 tablet_bootstrap.cc:654] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.126935 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:13.127628 13138 raft_consensus.cc:3060] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.127099 13266 raft_consensus.cc:697] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:13.129108 13266 consensus_queue.cc:237] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.134958 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:13.135581 13067 raft_consensus.cc:3060] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:13.142462 12939 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:13.155436 13138 raft_consensus.cc:2468] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 1.
I20260709 13:17:13.156853 12958 leader_election.cc:304] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:13.157992 13333 raft_consensus.cc:2804] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.158666 13333 raft_consensus.cc:697] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:13.159603 13333 consensus_queue.cc:237] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.160543 13257 raft_consensus.cc:359] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.161572 13257 raft_consensus.cc:385] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.161957 13257 raft_consensus.cc:740] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.158345 13067 raft_consensus.cc:2468] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 1.
I20260709 13:17:13.165225 13257 consensus_queue.cc:260] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.168356 13257 ts_tablet_manager.cc:1434] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:17:13.172864 13301 consensus_queue.cc:1048] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.173491 13257 tablet_bootstrap.cc:492] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:13.175433 13258 tablet_bootstrap.cc:492] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:13.175988 13258 ts_tablet_manager.cc:1403] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.276s	user 0.032s	sys 0.037s
I20260709 13:17:13.176524 13260 tablet_bootstrap.cc:492] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:13.177085 13260 ts_tablet_manager.cc:1403] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.160s	user 0.011s	sys 0.000s
I20260709 13:17:13.180279 13260 raft_consensus.cc:359] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.181048 13260 raft_consensus.cc:385] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.180768 13258 raft_consensus.cc:359] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.181411 13260 raft_consensus.cc:740] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.181532 13257 tablet_bootstrap.cc:654] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.181691 13258 raft_consensus.cc:385] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.182220 13258 raft_consensus.cc:740] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.182325 13260 consensus_queue.cc:260] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.183539 12891 catalog_manager.cc:5697] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.184134 13258 consensus_queue.cc:260] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.185196 13260 ts_tablet_manager.cc:1434] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:13.186198 13260 tablet_bootstrap.cc:492] T 84a9a68cea89454584f50702e5bd032d P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:13.192763 13260 tablet_bootstrap.cc:654] T 84a9a68cea89454584f50702e5bd032d P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.200639 13258 ts_tablet_manager.cc:1434] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:17:13.204615 13067 raft_consensus.cc:3060] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.208676 13258 tablet_bootstrap.cc:492] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:13.213012 13338 raft_consensus.cc:493] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.213565 13338 raft_consensus.cc:515] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.218897 13258 tablet_bootstrap.cc:654] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.220016 13338 leader_election.cc:290] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:13.222172 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e5c0d26b904f169897a58bdf500a3a" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:13.225198 13260 tablet_bootstrap.cc:492] T 84a9a68cea89454584f50702e5bd032d P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:13.225011 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e5c0d26b904f169897a58bdf500a3a" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:13.225832 13260 ts_tablet_manager.cc:1403] T 84a9a68cea89454584f50702e5bd032d P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.000s
I20260709 13:17:13.227419 13031 leader_election.cc:304] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:13.228649 13338 raft_consensus.cc:2749] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:13.231045 13260 raft_consensus.cc:359] T 84a9a68cea89454584f50702e5bd032d P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.232115 13260 raft_consensus.cc:385] T 84a9a68cea89454584f50702e5bd032d P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.232407 13260 raft_consensus.cc:740] T 84a9a68cea89454584f50702e5bd032d P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.233551 13258 tablet_bootstrap.cc:492] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:13.233191 13260 consensus_queue.cc:260] T 84a9a68cea89454584f50702e5bd032d P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.234077 13258 ts_tablet_manager.cc:1403] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 13:17:13.235704 13260 ts_tablet_manager.cc:1434] T 84a9a68cea89454584f50702e5bd032d P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:17:13.237032 13260 tablet_bootstrap.cc:492] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:13.237217 13258 raft_consensus.cc:359] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.238471 13258 raft_consensus.cc:385] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.238758 13258 raft_consensus.cc:740] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.239635 13258 consensus_queue.cc:260] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.242206 12890 catalog_manager.cc:5697] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.243947 13260 tablet_bootstrap.cc:654] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.249787 13301 consensus_queue.cc:1048] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.251693 13258 ts_tablet_manager.cc:1434] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:17:13.256654 13259 tablet_bootstrap.cc:492] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:13.261933 13258 tablet_bootstrap.cc:492] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:13.269888 13338 raft_consensus.cc:493] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.270527 13338 raft_consensus.cc:515] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.270902 13259 ts_tablet_manager.cc:1403] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.231s	user 0.022s	sys 0.000s
I20260709 13:17:13.272825 13338 leader_election.cc:290] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:13.272943 13258 tablet_bootstrap.cc:654] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.274356 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9713e0bcb2b64111a73eaa424eb16574" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:13.274356 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9713e0bcb2b64111a73eaa424eb16574" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:13.278296 13260 tablet_bootstrap.cc:492] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:13.279012 13260 ts_tablet_manager.cc:1403] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.004s
I20260709 13:17:13.281231 13031 leader_election.cc:304] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed
I20260709 13:17:13.282311 13338 raft_consensus.cc:2749] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.282545 13260 raft_consensus.cc:359] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.283584 13260 raft_consensus.cc:385] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.284044 13260 raft_consensus.cc:740] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.284852 13260 consensus_queue.cc:260] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.286791 13260 ts_tablet_manager.cc:1434] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:17:13.287706 13260 tablet_bootstrap.cc:492] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:13.287802 13258 tablet_bootstrap.cc:492] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:13.288426 13258 ts_tablet_manager.cc:1403] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.010s
I20260709 13:17:13.291082 13258 raft_consensus.cc:359] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.293049 13259 raft_consensus.cc:359] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.293876 13259 raft_consensus.cc:385] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.294275 13259 raft_consensus.cc:740] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.293924 13258 raft_consensus.cc:385] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.294831 13258 raft_consensus.cc:740] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.295167 13259 consensus_queue.cc:260] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.296721 13260 tablet_bootstrap.cc:654] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.297405 13259 ts_tablet_manager.cc:1434] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 13:17:13.298512 13259 tablet_bootstrap.cc:492] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:13.296339 13258 consensus_queue.cc:260] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.304553 13258 ts_tablet_manager.cc:1434] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:17:13.305815 13258 tablet_bootstrap.cc:492] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:13.307250 13257 tablet_bootstrap.cc:492] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:13.310555 13257 ts_tablet_manager.cc:1403] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.137s	user 0.027s	sys 0.072s
I20260709 13:17:13.317615 13067 raft_consensus.cc:3060] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.313342 13257 raft_consensus.cc:359] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.318898 13257 raft_consensus.cc:385] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.319186 13257 raft_consensus.cc:740] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.317827 13260 tablet_bootstrap.cc:492] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:13.319867 13257 consensus_queue.cc:260] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.320844 13260 ts_tablet_manager.cc:1403] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.009s
I20260709 13:17:13.323412 13260 raft_consensus.cc:359] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.323918 13260 raft_consensus.cc:385] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.324146 13260 raft_consensus.cc:740] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.324738 13260 consensus_queue.cc:260] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.317900 13259 tablet_bootstrap.cc:654] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.313072 13258 tablet_bootstrap.cc:654] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.330724 13260 ts_tablet_manager.cc:1434] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:13.331568 13333 raft_consensus.cc:493] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.331787 13260 tablet_bootstrap.cc:492] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:13.325605 13257 ts_tablet_manager.cc:1434] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:17:13.332032 13259 tablet_bootstrap.cc:492] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:13.332775 13259 ts_tablet_manager.cc:1403] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.001s
I20260709 13:17:13.333734 13257 tablet_bootstrap.cc:492] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:13.335664 13259 raft_consensus.cc:359] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.336381 13259 raft_consensus.cc:385] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.336709 13259 raft_consensus.cc:740] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.337582 13259 consensus_queue.cc:260] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.339838 13257 tablet_bootstrap.cc:654] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.340750 13260 tablet_bootstrap.cc:654] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.332080 13333 raft_consensus.cc:515] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.345534 13333 leader_election.cc:290] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:13.346760 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f418ed3813fa42608ed35304ac9d123b" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:13.347066 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f418ed3813fa42608ed35304ac9d123b" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:13.347776 13068 raft_consensus.cc:2468] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 0.
I20260709 13:17:13.349273 12958 leader_election.cc:304] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18; no voters: 
I20260709 13:17:13.349905 13259 ts_tablet_manager.cc:1434] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:17:13.351507 13259 tablet_bootstrap.cc:492] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:13.347707 13216 raft_consensus.cc:2468] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 0.
I20260709 13:17:13.357942 13259 tablet_bootstrap.cc:654] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.361644 13338 raft_consensus.cc:493] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.362191 13338 raft_consensus.cc:515] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.363329 13258 tablet_bootstrap.cc:492] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:13.363852 13258 ts_tablet_manager.cc:1403] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.023s
I20260709 13:17:13.364284 13338 leader_election.cc:290] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:13.365275 13260 tablet_bootstrap.cc:492] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:13.365794 13260 ts_tablet_manager.cc:1403] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.002s
I20260709 13:17:13.365957 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2b72f78e37437ca470520c1736e2f0" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:13.366647 13258 raft_consensus.cc:359] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.367311 13258 raft_consensus.cc:385] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:17:13.367403 13033 leader_election.cc:343] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.367457 13259 tablet_bootstrap.cc:492] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:13.367614 13258 raft_consensus.cc:740] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.368492 13259 ts_tablet_manager.cc:1403] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:17:13.368578 13258 consensus_queue.cc:260] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.369022 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2b72f78e37437ca470520c1736e2f0" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:13.369557 13333 raft_consensus.cc:2804] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.369997 13333 raft_consensus.cc:493] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.370349 13333 raft_consensus.cc:3060] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:13.370401 13031 leader_election.cc:343] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.370956 13031 leader_election.cc:304] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed
I20260709 13:17:13.372062 13338 raft_consensus.cc:2749] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.371922 13259 raft_consensus.cc:359] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.372750 13259 raft_consensus.cc:385] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.373042 13259 raft_consensus.cc:740] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.373713 13259 consensus_queue.cc:260] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.375665 13259 ts_tablet_manager.cc:1434] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:13.374331 13258 ts_tablet_manager.cc:1434] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:17:13.368350 13260 raft_consensus.cc:359] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.377522 13260 raft_consensus.cc:385] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.377797 13260 raft_consensus.cc:740] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.378914 13259 tablet_bootstrap.cc:492] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:13.379083 13333 raft_consensus.cc:515] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.381853 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f418ed3813fa42608ed35304ac9d123b" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:13.382436 13216 raft_consensus.cc:3060] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.384351 13266 raft_consensus.cc:493] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.385257 13259 tablet_bootstrap.cc:654] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.384867 13266 raft_consensus.cc:515] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.388167 13266 leader_election.cc:290] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:13.388468 13258 tablet_bootstrap.cc:492] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:13.393093 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d38bed483b4fa18d0cf4242e2eb808" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:13.393814 13068 raft_consensus.cc:2468] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:13.394251 13333 leader_election.cc:290] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:13.394634 13258 tablet_bootstrap.cc:654] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.393147 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d38bed483b4fa18d0cf4242e2eb808" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:13.396157 13138 raft_consensus.cc:2468] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:13.397557 13181 leader_election.cc:304] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:13.398630 13216 raft_consensus.cc:2468] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 1.
I20260709 13:17:13.399808 13266 raft_consensus.cc:2804] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.400130 12956 leader_election.cc:304] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:13.400669 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f418ed3813fa42608ed35304ac9d123b" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:13.404109 13068 raft_consensus.cc:3060] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.404469 13260 consensus_queue.cc:260] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.405405 13301 raft_consensus.cc:493] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.401926 13333 raft_consensus.cc:2804] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.406031 13301 raft_consensus.cc:515] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.406710 13260 ts_tablet_manager.cc:1434] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:17:13.407159 13333 raft_consensus.cc:697] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:13.407744 13260 tablet_bootstrap.cc:492] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:13.408047 13333 consensus_queue.cc:237] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.408450 13301 leader_election.cc:290] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:13.410609 13215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5483c64ceb1f41e9a6eec70e2f257f96" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:13.411470 13215 raft_consensus.cc:2468] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 0.
I20260709 13:17:13.413074 12956 leader_election.cc:304] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:13.415177 13336 raft_consensus.cc:2804] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.415670 13336 raft_consensus.cc:493] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.415982 13336 raft_consensus.cc:3060] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.416644 13260 tablet_bootstrap.cc:654] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.417021 13259 tablet_bootstrap.cc:492] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:13.417526 13259 ts_tablet_manager.cc:1403] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.001s
I20260709 13:17:13.420197 13259 raft_consensus.cc:359] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.420825 13259 raft_consensus.cc:385] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.421092 13259 raft_consensus.cc:740] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.424257 13259 consensus_queue.cc:260] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.424674 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5483c64ceb1f41e9a6eec70e2f257f96" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:13.425662 13138 raft_consensus.cc:2468] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 0.
I20260709 13:17:13.401916 13266 raft_consensus.cc:493] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.427755 13259 ts_tablet_manager.cc:1434] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:17:13.427986 13266 raft_consensus.cc:3060] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.428771 13259 tablet_bootstrap.cc:492] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:13.428242 12890 catalog_manager.cc:5697] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.438655 13260 tablet_bootstrap.cc:492] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:13.439219 13260 ts_tablet_manager.cc:1403] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.003s
I20260709 13:17:13.445528 13260 raft_consensus.cc:359] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.446194 13260 raft_consensus.cc:385] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.446456 13260 raft_consensus.cc:740] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.449090 13259 tablet_bootstrap.cc:654] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.453851 13260 consensus_queue.cc:260] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.457649 13260 ts_tablet_manager.cc:1434] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:17:13.458590 13260 tablet_bootstrap.cc:492] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:13.462540 13336 raft_consensus.cc:515] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.463517 13068 raft_consensus.cc:2468] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 1.
I20260709 13:17:13.464845 13336 leader_election.cc:290] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:13.465584 13258 tablet_bootstrap.cc:492] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:13.466060 13258 ts_tablet_manager.cc:1403] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.078s	user 0.019s	sys 0.014s
I20260709 13:17:13.466820 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5483c64ceb1f41e9a6eec70e2f257f96" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:13.467427 13216 raft_consensus.cc:3060] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.468906 13258 raft_consensus.cc:359] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.469609 13258 raft_consensus.cc:385] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.469887 13258 raft_consensus.cc:740] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.469923 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5483c64ceb1f41e9a6eec70e2f257f96" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:13.470870 13138 raft_consensus.cc:3060] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.474530 13260 tablet_bootstrap.cc:654] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.477164 13324 raft_consensus.cc:493] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.477635 13324 raft_consensus.cc:515] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.460289 13266 raft_consensus.cc:515] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.470698 13258 consensus_queue.cc:260] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.481149 13324 leader_election.cc:290] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:13.482547 13266 leader_election.cc:290] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:13.484097 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d38bed483b4fa18d0cf4242e2eb808" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:13.484556 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2b72f78e37437ca470520c1736e2f0" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:13.484730 13067 raft_consensus.cc:3060] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.485630 13258 ts_tablet_manager.cc:1434] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:17:13.485606 13138 raft_consensus.cc:2468] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 1.
I20260709 13:17:13.485217 13142 raft_consensus.cc:2468] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:13.487563 13258 tablet_bootstrap.cc:492] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:13.484943 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2b72f78e37437ca470520c1736e2f0" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:13.485630 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d38bed483b4fa18d0cf4242e2eb808" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:13.497887 13139 raft_consensus.cc:3060] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.496829 13068 raft_consensus.cc:2468] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:13.489926 13259 tablet_bootstrap.cc:492] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:13.493489 13181 leader_election.cc:304] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:13.499473 13259 ts_tablet_manager.cc:1403] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.071s	user 0.022s	sys 0.004s
I20260709 13:17:13.494462 12958 leader_election.cc:304] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:13.500213 13260 tablet_bootstrap.cc:492] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:13.500758 13260 ts_tablet_manager.cc:1403] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.009s
I20260709 13:17:13.489214 13257 tablet_bootstrap.cc:492] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:13.501441 13257 ts_tablet_manager.cc:1403] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.168s	user 0.029s	sys 0.018s
I20260709 13:17:13.502472 13259 raft_consensus.cc:359] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.503180 13259 raft_consensus.cc:385] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.503438 13259 raft_consensus.cc:740] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.504108 13257 raft_consensus.cc:359] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.504177 13259 consensus_queue.cc:260] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.505353 13324 raft_consensus.cc:2804] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.505402 13216 raft_consensus.cc:2468] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 1.
I20260709 13:17:13.505847 13324 raft_consensus.cc:493] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.506198 13324 raft_consensus.cc:3060] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.506392 13259 ts_tablet_manager.cc:1434] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:17:13.507365 13259 tablet_bootstrap.cc:492] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:13.500638 13336 raft_consensus.cc:2804] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.509545 13336 raft_consensus.cc:697] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:13.509897 13258 tablet_bootstrap.cc:654] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.510397 13336 consensus_queue.cc:237] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.495922 13067 raft_consensus.cc:2468] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:13.513181 13259 tablet_bootstrap.cc:654] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.513835 13181 leader_election.cc:304] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:13.527779 13324 raft_consensus.cc:515] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.556807 13259 tablet_bootstrap.cc:492] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:13.504894 13257 raft_consensus.cc:385] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.557380 13259 ts_tablet_manager.cc:1403] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.050s	user 0.025s	sys 0.023s
I20260709 13:17:13.557397 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2b72f78e37437ca470520c1736e2f0" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:13.557403 13257 raft_consensus.cc:740] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.558421 13067 raft_consensus.cc:3060] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.559192 13257 consensus_queue.cc:260] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.564224 13257 ts_tablet_manager.cc:1434] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.062s	user 0.002s	sys 0.004s
I20260709 13:17:13.565448 13257 tablet_bootstrap.cc:492] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:13.564458 12888 catalog_manager.cc:5697] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:13.566653 13067 raft_consensus.cc:2468] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:13.567459 13338 raft_consensus.cc:493] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.567947 13338 raft_consensus.cc:515] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.568809 13068 raft_consensus.cc:3060] T 84a9a68cea89454584f50702e5bd032d P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.570078 13338 leader_election.cc:290] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:13.549439 13367 raft_consensus.cc:2804] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.553289 13139 raft_consensus.cc:2468] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:13.570806 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9198523b1084931b95003027883ba99" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:13.561074 13259 raft_consensus.cc:359] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.571434 13259 raft_consensus.cc:385] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.572048 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9198523b1084931b95003027883ba99" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:13.572312 13031 leader_election.cc:343] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.572312 13259 raft_consensus.cc:740] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.547070 13260 raft_consensus.cc:359] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.577415 13260 raft_consensus.cc:385] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.577502 13181 leader_election.cc:304] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:13.577947 13260 raft_consensus.cc:740] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.576689 13259 consensus_queue.cc:260] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.575786 13257 tablet_bootstrap.cc:654] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.580027 13324 leader_election.cc:290] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:13.581951 13324 raft_consensus.cc:2804] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.582415 13324 raft_consensus.cc:697] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
W20260709 13:17:13.573553 13034 leader_election.cc:343] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.579788 13260 consensus_queue.cc:260] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.583115 13034 leader_election.cc:304] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:13.583986 13338 raft_consensus.cc:2749] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.585803 13260 ts_tablet_manager.cc:1434] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 13:17:13.586794 13260 tablet_bootstrap.cc:492] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:13.571883 13367 raft_consensus.cc:697] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:13.590548 13367 consensus_queue.cc:237] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.592586 13260 tablet_bootstrap.cc:654] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.594368 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2b72f78e37437ca470520c1736e2f0" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:13.595216 13139 raft_consensus.cc:3060] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.604348 13139 raft_consensus.cc:2468] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:13.583101 13258 tablet_bootstrap.cc:492] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:13.605762 13258 ts_tablet_manager.cc:1403] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.119s	user 0.033s	sys 0.037s
I20260709 13:17:13.606501 13324 consensus_queue.cc:237] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.607524 13266 consensus_queue.cc:1048] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.613248 13258 raft_consensus.cc:359] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.614286 13258 raft_consensus.cc:385] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.614621 13258 raft_consensus.cc:740] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.615432 13258 consensus_queue.cc:260] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.615327 12890 catalog_manager.cc:5697] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:13.617957 13258 ts_tablet_manager.cc:1434] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:17:13.618937 13258 tablet_bootstrap.cc:492] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:13.624115 13333 consensus_queue.cc:1048] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.631282 13315 raft_consensus.cc:493] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.631882 13315 raft_consensus.cc:515] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.635934 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d833eb39cd9d47c28d825a09d0bb7d56" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:13.636790 13068 raft_consensus.cc:2468] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:13.638339 13107 leader_election.cc:304] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:13.639640 13359 raft_consensus.cc:2804] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.640136 13359 raft_consensus.cc:493] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.640617 13359 raft_consensus.cc:3060] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.648468 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d833eb39cd9d47c28d825a09d0bb7d56" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:13.649272 13367 consensus_queue.cc:1048] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.649272 12992 raft_consensus.cc:2468] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:13.650377 13377 raft_consensus.cc:493] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.652205 13377 raft_consensus.cc:515] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.655107 13315 leader_election.cc:290] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:13.658584 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33a739979c3244169c69c7c9d1c223c0" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:13.658793 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33a739979c3244169c69c7c9d1c223c0" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:13.659693 12887 catalog_manager.cc:5697] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:13.640154 13260 tablet_bootstrap.cc:492] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
W20260709 13:17:13.661031 13108 leader_election.cc:343] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.659382 13216 raft_consensus.cc:2468] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:13.661675 13260 ts_tablet_manager.cc:1403] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.000s
I20260709 13:17:13.662595 13105 leader_election.cc:304] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:13.663558 13259 ts_tablet_manager.cc:1434] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.106s	user 0.013s	sys 0.023s
I20260709 13:17:13.663511 13315 raft_consensus.cc:2804] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.664130 13315 raft_consensus.cc:493] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.664518 13315 raft_consensus.cc:3060] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.664355 13260 raft_consensus.cc:359] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.664809 13259 tablet_bootstrap.cc:492] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:13.665098 13260 raft_consensus.cc:385] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.671828 13377 leader_election.cc:290] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:13.667106 13359 raft_consensus.cc:515] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.676383 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d833eb39cd9d47c28d825a09d0bb7d56" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:13.677111 13068 raft_consensus.cc:3060] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.676383 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d833eb39cd9d47c28d825a09d0bb7d56" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:13.678953 12993 raft_consensus.cc:3060] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.671711 13259 tablet_bootstrap.cc:654] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.688403 12993 raft_consensus.cc:2468] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:13.693569 13315 raft_consensus.cc:515] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.695195 13259 tablet_bootstrap.cc:492] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:13.696547 13259 ts_tablet_manager.cc:1403] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.006s
I20260709 13:17:13.696477 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33a739979c3244169c69c7c9d1c223c0" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:13.697686 13315 leader_election.cc:290] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:13.697850 13216 raft_consensus.cc:3060] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.699162 13336 consensus_queue.cc:1048] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.701503 13367 raft_consensus.cc:493] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.701997 13367 raft_consensus.cc:515] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.703747 13068 raft_consensus.cc:2468] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:13.703999 13367 leader_election.cc:290] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:13.704885 13107 leader_election.cc:304] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:13.706702 13315 raft_consensus.cc:2804] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.706748 13216 raft_consensus.cc:2468] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:13.709578 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33a739979c3244169c69c7c9d1c223c0" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:13.710315 13105 leader_election.cc:304] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:13.710880 13258 tablet_bootstrap.cc:654] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:13.711633 13108 leader_election.cc:343] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.706840 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4903a5109902424b919c33e97f22b096" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:13.707007 13359 leader_election.cc:290] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:13.713338 13377 raft_consensus.cc:2804] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.707238 13315 raft_consensus.cc:697] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
W20260709 13:17:13.714648 13181 leader_election.cc:343] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.714859 13315 consensus_queue.cc:237] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.712922 13257 tablet_bootstrap.cc:492] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:13.719452 13257 ts_tablet_manager.cc:1403] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.154s	user 0.021s	sys 0.028s
I20260709 13:17:13.715317 13377 raft_consensus.cc:697] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:13.722728 13257 raft_consensus.cc:359] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.723520 13257 raft_consensus.cc:385] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.723891 13257 raft_consensus.cc:740] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.725071 13257 consensus_queue.cc:260] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.723152 13377 consensus_queue.cc:237] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.727743 13257 ts_tablet_manager.cc:1434] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:13.728690 13257 tablet_bootstrap.cc:492] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:13.729360 13259 raft_consensus.cc:359] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.730083 13259 raft_consensus.cc:385] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.730369 13259 raft_consensus.cc:740] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.736114 13257 tablet_bootstrap.cc:654] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.706923 13260 raft_consensus.cc:740] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.746595 13334 raft_consensus.cc:493] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.747117 13334 raft_consensus.cc:515] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.747028 13260 consensus_queue.cc:260] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.748093 13257 tablet_bootstrap.cc:492] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:13.748584 13257 ts_tablet_manager.cc:1403] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:17:13.750802 13260 ts_tablet_manager.cc:1434] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.000s
I20260709 13:17:13.751204 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4903a5109902424b919c33e97f22b096" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:13.751417 13334 leader_election.cc:290] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:13.751899 13216 raft_consensus.cc:2468] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:13.752157 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4903a5109902424b919c33e97f22b096" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:13.752388 13260 tablet_bootstrap.cc:492] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:13.753230 13031 leader_election.cc:304] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
W20260709 13:17:13.754186 13033 leader_election.cc:343] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.707602 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4903a5109902424b919c33e97f22b096" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:13.755276 13334 raft_consensus.cc:2804] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.756003 13334 raft_consensus.cc:493] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.756353 13334 raft_consensus.cc:3060] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.756287 13259 consensus_queue.cc:260] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.766374 13259 ts_tablet_manager.cc:1434] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
I20260709 13:17:13.767364 13259 tablet_bootstrap.cc:492] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:13.769636 13257 raft_consensus.cc:359] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.770390 13257 raft_consensus.cc:385] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.770709 13257 raft_consensus.cc:740] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.777689 13257 consensus_queue.cc:260] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.780977 13257 ts_tablet_manager.cc:1434] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:17:13.782007 13257 tablet_bootstrap.cc:492] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:13.778949 12887 catalog_manager.cc:5697] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 0 to 1, leader changed from <none> to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:13.784356 13259 tablet_bootstrap.cc:654] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.768515 13334 raft_consensus.cc:515] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.787747 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4903a5109902424b919c33e97f22b096" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:13.789708 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4903a5109902424b919c33e97f22b096" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:13.790125 13338 raft_consensus.cc:493] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.790526 13216 raft_consensus.cc:3060] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:13.790627 13033 leader_election.cc:343] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.790670 13338 raft_consensus.cc:515] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.794971 13338 leader_election.cc:290] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:13.796056 13215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cb17552f904cb5b72197a75fa78b6f" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:13.797820 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cb17552f904cb5b72197a75fa78b6f" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
W20260709 13:17:13.800608 13033 leader_election.cc:343] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:13.802815 13031 leader_election.cc:343] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.787628 13068 raft_consensus.cc:2393] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6c79a100f9043f590697441315084ed in current term 1: Already voted for candidate 293c23c890764727a91d599e0d75604f in this term.
I20260709 13:17:13.805236 13031 leader_election.cc:304] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed
I20260709 13:17:13.806836 13338 raft_consensus.cc:2749] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.807782 13259 tablet_bootstrap.cc:492] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:13.808285 13259 ts_tablet_manager.cc:1403] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.005s
I20260709 13:17:13.811066 13259 raft_consensus.cc:359] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.811721 13259 raft_consensus.cc:385] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.811995 13259 raft_consensus.cc:740] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.801950 13334 leader_election.cc:290] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:13.799436 13216 raft_consensus.cc:2468] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:13.813995 13031 leader_election.cc:304] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: c538e5be22524c9a970f7a59c5379288
I20260709 13:17:13.815214 13334 raft_consensus.cc:2804] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.816236 13259 consensus_queue.cc:260] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.820875 13259 ts_tablet_manager.cc:1434] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:17:13.823235 13259 tablet_bootstrap.cc:492] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:13.824388 13267 raft_consensus.cc:493] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.824903 13267 raft_consensus.cc:515] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.827059 13267 leader_election.cc:290] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:13.828969 13259 tablet_bootstrap.cc:654] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.829610 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb4737defc94214adbcf8b7639f3087" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
W20260709 13:17:13.840157 12958 leader_election.cc:343] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.845701 13257 tablet_bootstrap.cc:654] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.841181 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb4737defc94214adbcf8b7639f3087" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:13.851786 12891 catalog_manager.cc:5697] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 0 to 1, leader changed from <none> to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.860433 13260 tablet_bootstrap.cc:654] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.865309 13377 raft_consensus.cc:493] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.867352 13377 raft_consensus.cc:515] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
W20260709 13:17:13.865561 12958 leader_election.cc:343] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.873313 13377 leader_election.cc:290] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:13.878273 13334 raft_consensus.cc:697] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:13.879436 13334 consensus_queue.cc:237] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:13.872499 13267 raft_consensus.cc:493] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.881500 13267 raft_consensus.cc:515] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.883908 13267 leader_election.cc:290] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:13.871812 13181 leader_election.cc:304] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:13.888077 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df6e641d04594c2797442b2393549f6c" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:13.890865 13266 raft_consensus.cc:2749] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.892499 13215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33a739979c3244169c69c7c9d1c223c0" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:13.892786 12958 leader_election.cc:304] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:13.893709 13215 raft_consensus.cc:2393] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66218fb7f83e41ffa427b95015c3bf18 in current term 1: Already voted for candidate c538e5be22524c9a970f7a59c5379288 in this term.
I20260709 13:17:13.895570 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33a739979c3244169c69c7c9d1c223c0" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:13.897505 13267 raft_consensus.cc:2749] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.889039 13216 raft_consensus.cc:2468] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:13.913756 13336 consensus_queue.cc:1048] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:13.917798 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df6e641d04594c2797442b2393549f6c" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:13.918345 13105 leader_election.cc:304] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
W20260709 13:17:13.919498 13108 leader_election.cc:343] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.919648 13377 raft_consensus.cc:2804] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.920287 13377 raft_consensus.cc:493] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.920735 13377 raft_consensus.cc:3060] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.921236 12958 leader_election.cc:304] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed
I20260709 13:17:13.922403 13301 raft_consensus.cc:3060] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.933691 13258 tablet_bootstrap.cc:492] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:13.934223 13258 ts_tablet_manager.cc:1403] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.315s	user 0.067s	sys 0.073s
I20260709 13:17:13.935810 13301 raft_consensus.cc:2749] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.937094 13258 raft_consensus.cc:359] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.938066 13258 raft_consensus.cc:385] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.938489 13258 raft_consensus.cc:740] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.939438 13258 consensus_queue.cc:260] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.943353 13259 tablet_bootstrap.cc:492] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:13.943874 13259 ts_tablet_manager.cc:1403] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.121s	user 0.008s	sys 0.021s
I20260709 13:17:13.944620 13258 ts_tablet_manager.cc:1434] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:17:13.947170 13258 tablet_bootstrap.cc:492] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:13.947610 13257 tablet_bootstrap.cc:492] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:13.949347 13257 ts_tablet_manager.cc:1403] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.168s	user 0.028s	sys 0.016s
I20260709 13:17:13.952111 13257 raft_consensus.cc:359] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.948136 13301 consensus_queue.cc:1048] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.952769 13257 raft_consensus.cc:385] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.953179 13257 raft_consensus.cc:740] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.953900 13257 consensus_queue.cc:260] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.955021 13266 raft_consensus.cc:493] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.955291 13258 tablet_bootstrap.cc:654] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.955533 13266 raft_consensus.cc:515] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.958860 13266 leader_election.cc:290] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:13.956456 13259 raft_consensus.cc:359] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.960139 13259 raft_consensus.cc:385] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.960409 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9198523b1084931b95003027883ba99" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:13.961067 13066 raft_consensus.cc:2468] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:13.960410 13259 raft_consensus.cc:740] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.963510 13259 consensus_queue.cc:260] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:13.966184 13257 ts_tablet_manager.cc:1434] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:17:13.967254 13266 raft_consensus.cc:493] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.967726 13266 raft_consensus.cc:515] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:13.968474 13260 tablet_bootstrap.cc:492] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:13.968924 13260 ts_tablet_manager.cc:1403] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.217s	user 0.013s	sys 0.010s
I20260709 13:17:13.969892 13266 leader_election.cc:290] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:13.962335 13181 leader_election.cc:304] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:13.971163 13266 raft_consensus.cc:2804] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.971498 13266 raft_consensus.cc:493] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.971827 13266 raft_consensus.cc:3060] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.971714 13260 raft_consensus.cc:359] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.972397 13260 raft_consensus.cc:385] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.972235 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a154faa8adb64071b0226241e5c5fd24" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:13.972754 13260 raft_consensus.cc:740] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.973963 13259 ts_tablet_manager.cc:1434] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.004s
I20260709 13:17:13.974444 13257 tablet_bootstrap.cc:492] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:13.974318 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9198523b1084931b95003027883ba99" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:13.975322 13259 tablet_bootstrap.cc:492] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:13.976781 13315 raft_consensus.cc:493] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:13.977475 13182 leader_election.cc:343] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.977542 13315 raft_consensus.cc:515] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.979028 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a154faa8adb64071b0226241e5c5fd24" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:13.976917 13260 consensus_queue.cc:260] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:13.983793 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb4737defc94214adbcf8b7639f3087" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:13.984663 13066 raft_consensus.cc:2468] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:13.987846 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb4737defc94214adbcf8b7639f3087" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:13.981547 13315 leader_election.cc:290] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:13.988545 12992 raft_consensus.cc:2468] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:13.989845 13260 ts_tablet_manager.cc:1434] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:17:13.990815 13260 tablet_bootstrap.cc:492] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
W20260709 13:17:13.980917 13181 leader_election.cc:343] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.993078 12891 catalog_manager.cc:5697] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.995798 13107 leader_election.cc:304] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:13.996738 13315 raft_consensus.cc:2804] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.997112 13315 raft_consensus.cc:493] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.997478 13315 raft_consensus.cc:3060] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:13.994892 13182 leader_election.cc:343] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.994328 13377 raft_consensus.cc:515] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.001566 13182 leader_election.cc:304] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:14.002063 13267 consensus_queue.cc:1048] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.003459 13215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df6e641d04594c2797442b2393549f6c" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:14.003966 13377 leader_election.cc:290] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:14.004081 13215 raft_consensus.cc:3060] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.004534 13370 raft_consensus.cc:2749] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.007582 13266 raft_consensus.cc:515] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.008349 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df6e641d04594c2797442b2393549f6c" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:14.012066 13266 leader_election.cc:290] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:14.016299 13257 tablet_bootstrap.cc:654] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:14.017015 13108 leader_election.cc:343] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.020437 13258 tablet_bootstrap.cc:492] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:14.020931 13258 ts_tablet_manager.cc:1403] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.015s
I20260709 13:17:14.023744 13258 raft_consensus.cc:359] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.024441 13258 raft_consensus.cc:385] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.024711 13258 raft_consensus.cc:740] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.025377 13258 consensus_queue.cc:260] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.027318 13258 ts_tablet_manager.cc:1434] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:17:14.028199 13258 tablet_bootstrap.cc:492] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:14.031062 13257 tablet_bootstrap.cc:492] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:14.031558 13257 ts_tablet_manager.cc:1403] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.005s
I20260709 13:17:14.034231 13257 raft_consensus.cc:359] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.034905 13257 raft_consensus.cc:385] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.035204 13257 raft_consensus.cc:740] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.035718 13260 tablet_bootstrap.cc:654] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.035872 13257 consensus_queue.cc:260] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.039217 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9198523b1084931b95003027883ba99" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:14.039871 12992 raft_consensus.cc:3060] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.041886 13258 tablet_bootstrap.cc:654] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.045343 13257 ts_tablet_manager.cc:1434] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:17:14.047124 13257 tablet_bootstrap.cc:492] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:14.052274 13370 consensus_queue.cc:1048] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.052579 13259 tablet_bootstrap.cc:654] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.055361 13258 tablet_bootstrap.cc:492] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:14.055876 13258 ts_tablet_manager.cc:1403] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:17:14.058547 13258 raft_consensus.cc:359] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.058889 13370 consensus_queue.cc:1048] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.059212 13258 raft_consensus.cc:385] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.059520 13258 raft_consensus.cc:740] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.060176 13258 consensus_queue.cc:260] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.052690 13257 tablet_bootstrap.cc:654] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.068572 13260 tablet_bootstrap.cc:492] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:14.069033 13258 ts_tablet_manager.cc:1434] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:17:14.069114 13260 ts_tablet_manager.cc:1403] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.022s
I20260709 13:17:14.070040 13258 tablet_bootstrap.cc:492] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:14.070451 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9198523b1084931b95003027883ba99" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:14.071077 13068 raft_consensus.cc:3060] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.072638 13260 raft_consensus.cc:359] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.073674 13260 raft_consensus.cc:385] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.074085 13260 raft_consensus.cc:740] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.075316 13260 consensus_queue.cc:260] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.077085 13258 tablet_bootstrap.cc:654] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.077721 13260 ts_tablet_manager.cc:1434] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:14.078824 13260 tablet_bootstrap.cc:492] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:14.083736 13267 consensus_queue.cc:1048] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.085367 12992 raft_consensus.cc:2468] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:14.085928 13260 tablet_bootstrap.cc:654] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.091531 13258 tablet_bootstrap.cc:492] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:14.092011 13258 ts_tablet_manager.cc:1403] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 13:17:14.094615 13258 raft_consensus.cc:359] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.095244 13260 tablet_bootstrap.cc:492] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:14.095269 13258 raft_consensus.cc:385] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.095810 13258 raft_consensus.cc:740] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.095927 13260 ts_tablet_manager.cc:1403] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.001s
I20260709 13:17:14.096514 13258 consensus_queue.cc:260] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.098892 13260 raft_consensus.cc:359] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.099645 13260 raft_consensus.cc:385] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.099965 13260 raft_consensus.cc:740] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.100629 13258 ts_tablet_manager.cc:1434] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:17:14.100684 13260 consensus_queue.cc:260] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.101883 13258 tablet_bootstrap.cc:492] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:14.103495 13260 ts_tablet_manager.cc:1434] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:14.104537 13260 tablet_bootstrap.cc:492] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:14.108393 13258 tablet_bootstrap.cc:654] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.110478 13260 tablet_bootstrap.cc:654] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.119702 13258 tablet_bootstrap.cc:492] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:14.119928 13215 raft_consensus.cc:2468] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:14.120227 13258 ts_tablet_manager.cc:1403] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.009s
I20260709 13:17:14.121912 13182 leader_election.cc:304] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:14.123181 13258 raft_consensus.cc:359] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.123921 13258 raft_consensus.cc:385] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.124203 13258 raft_consensus.cc:740] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.125175 13370 raft_consensus.cc:2804] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.125211 13258 consensus_queue.cc:260] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.125875 13370 raft_consensus.cc:697] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:14.126701 13370 consensus_queue.cc:237] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.127820 13258 ts_tablet_manager.cc:1434] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:14.122138 13105 leader_election.cc:304] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:14.128885 13258 tablet_bootstrap.cc:492] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:14.133528 13359 raft_consensus.cc:2804] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.134263 13359 raft_consensus.cc:697] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:14.134861 13258 tablet_bootstrap.cc:654] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.135377 13359 consensus_queue.cc:237] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.068750 13315 raft_consensus.cc:515] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.142582 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb4737defc94214adbcf8b7639f3087" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:14.143379 12992 raft_consensus.cc:3060] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.145021 13367 consensus_queue.cc:1048] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.146414 13258 tablet_bootstrap.cc:492] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:14.147018 13258 ts_tablet_manager.cc:1403] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 13:17:14.149829 13258 raft_consensus.cc:359] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.150513 13258 raft_consensus.cc:385] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.150799 13258 raft_consensus.cc:740] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.151530 13258 consensus_queue.cc:260] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.153679 13258 ts_tablet_manager.cc:1434] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:17:14.154181 13315 leader_election.cc:290] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:14.154626 13258 tablet_bootstrap.cc:492] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:14.160981 13258 tablet_bootstrap.cc:654] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.163921 13068 raft_consensus.cc:2468] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:14.165525 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb4737defc94214adbcf8b7639f3087" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:14.166463 13066 raft_consensus.cc:3060] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.169646 13267 raft_consensus.cc:493] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.170150 13267 raft_consensus.cc:515] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.172113 13257 tablet_bootstrap.cc:492] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:14.172226 13267 leader_election.cc:290] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:14.172921 13257 ts_tablet_manager.cc:1403] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.126s	user 0.011s	sys 0.001s
I20260709 13:17:14.175148 13258 tablet_bootstrap.cc:492] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:14.175621 13258 ts_tablet_manager.cc:1403] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.006s
I20260709 13:17:14.172907 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668888eb645947b9a0eeb86f97889199" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:14.176919 13315 raft_consensus.cc:493] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.178814 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668888eb645947b9a0eeb86f97889199" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:14.177417 13138 raft_consensus.cc:2468] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 0.
I20260709 13:17:14.178534 13315 raft_consensus.cc:515] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.178455 13258 raft_consensus.cc:359] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.179634 13216 raft_consensus.cc:2468] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 0.
I20260709 13:17:14.176337 12992 raft_consensus.cc:2468] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:14.180712 12958 leader_election.cc:304] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:14.177014 13257 raft_consensus.cc:359] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.181896 13267 raft_consensus.cc:2804] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.182183 13257 raft_consensus.cc:385] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.182307 13267 raft_consensus.cc:493] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.182505 13257 raft_consensus.cc:740] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.182706 13267 raft_consensus.cc:3060] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.183753 13315 leader_election.cc:290] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:14.183554 13257 consensus_queue.cc:260] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.185909 13260 tablet_bootstrap.cc:492] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:14.186487 13260 ts_tablet_manager.cc:1403] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.045s
I20260709 13:17:14.186729 13257 ts_tablet_manager.cc:1434] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:17:14.187737 13257 tablet_bootstrap.cc:492] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:14.189682 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbaec0edb4d7fbd364d37ccac32ab" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:14.189735 13260 raft_consensus.cc:359] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.190711 13260 raft_consensus.cc:385] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.190066 13108 leader_election.cc:304] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:14.192903 13267 raft_consensus.cc:515] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
W20260709 13:17:14.191263 13107 leader_election.cc:343] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.193617 13315 raft_consensus.cc:2804] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.191900 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbaec0edb4d7fbd364d37ccac32ab" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:14.194064 13377 consensus_queue.cc:1048] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.195119 13260 raft_consensus.cc:740] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
W20260709 13:17:14.195499 13108 leader_election.cc:343] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.196000 13108 leader_election.cc:304] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:14.196144 13260 consensus_queue.cc:260] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.197291 13377 raft_consensus.cc:2749] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.197162 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668888eb645947b9a0eeb86f97889199" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:14.198179 13138 raft_consensus.cc:3060] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.198699 13260 ts_tablet_manager.cc:1434] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:17:14.180034 13258 raft_consensus.cc:385] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.201184 13258 raft_consensus.cc:740] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.201978 13258 consensus_queue.cc:260] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.203255 13267 leader_election.cc:290] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:14.209573 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668888eb645947b9a0eeb86f97889199" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:14.210258 13216 raft_consensus.cc:3060] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.211592 13258 ts_tablet_manager.cc:1434] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:17:14.212040 13138 raft_consensus.cc:2468] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 1.
I20260709 13:17:14.212704 13258 tablet_bootstrap.cc:492] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:14.213405 12958 leader_election.cc:304] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:14.215459 13333 raft_consensus.cc:2804] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.216428 13333 raft_consensus.cc:697] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:14.217170 13334 raft_consensus.cc:493] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.217659 13334 raft_consensus.cc:515] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.219818 13334 leader_election.cc:290] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:14.221191 13215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a154faa8adb64071b0226241e5c5fd24" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:14.217671 13333 consensus_queue.cc:237] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.222246 13215 raft_consensus.cc:2468] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:14.223481 13416 raft_consensus.cc:493] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.223626 13031 leader_election.cc:304] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:14.224002 13416 raft_consensus.cc:515] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.224496 13334 raft_consensus.cc:2804] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.225031 13334 raft_consensus.cc:493] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.225488 13334 raft_consensus.cc:3060] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.193409 13257 tablet_bootstrap.cc:654] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.228171 13367 consensus_queue.cc:1048] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.233012 13334 raft_consensus.cc:515] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.235369 13334 leader_election.cc:290] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:14.236647 13416 leader_election.cc:290] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:14.236989 13215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a154faa8adb64071b0226241e5c5fd24" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:14.237160 13065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668942e4495f4e6ca677aa883843b165" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:14.237736 13215 raft_consensus.cc:3060] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.238185 13258 tablet_bootstrap.cc:654] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:14.241868 13107 leader_election.cc:343] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.245216 13416 consensus_queue.cc:1048] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.247962 12890 catalog_manager.cc:5697] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.251070 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668942e4495f4e6ca677aa883843b165" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:14.251480 12891 catalog_manager.cc:5697] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 0 to 1, leader changed from <none> to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.252537 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a154faa8adb64071b0226241e5c5fd24" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:14.253705 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a154faa8adb64071b0226241e5c5fd24" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:14.255625 13260 tablet_bootstrap.cc:492] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:14.257969 13215 raft_consensus.cc:2468] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:14.262408 13031 leader_election.cc:304] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:14.263407 13260 tablet_bootstrap.cc:654] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.264300 13388 raft_consensus.cc:2804] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:14.264519 13105 leader_election.cc:343] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.264838 13388 raft_consensus.cc:697] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:14.265051 13105 leader_election.cc:304] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed
I20260709 13:17:14.265784 13388 consensus_queue.cc:237] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.266299 13359 raft_consensus.cc:2749] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.280200 13416 raft_consensus.cc:493] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.280771 13416 raft_consensus.cc:515] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.283349 13416 leader_election.cc:290] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:14.285013 13259 tablet_bootstrap.cc:492] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:14.285558 13259 ts_tablet_manager.cc:1403] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.310s	user 0.009s	sys 0.007s
I20260709 13:17:14.290294 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4903a5109902424b919c33e97f22b096" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:14.291172 13214 raft_consensus.cc:2393] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c538e5be22524c9a970f7a59c5379288 in current term 1: Already voted for candidate 293c23c890764727a91d599e0d75604f in this term.
I20260709 13:17:14.294646 13259 raft_consensus.cc:359] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.295372 13259 raft_consensus.cc:385] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.295655 13259 raft_consensus.cc:740] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
W20260709 13:17:14.296687 13034 leader_election.cc:343] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.297434 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4903a5109902424b919c33e97f22b096" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
W20260709 13:17:14.297979 13034 leader_election.cc:343] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.299095 13107 leader_election.cc:304] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed
I20260709 13:17:14.300396 13359 raft_consensus.cc:3060] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.301488 13260 tablet_bootstrap.cc:492] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:14.302016 13260 ts_tablet_manager.cc:1403] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.001s
I20260709 13:17:14.306708 13216 raft_consensus.cc:2468] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 1.
I20260709 13:17:14.307641 13359 raft_consensus.cc:2749] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.304747 13260 raft_consensus.cc:359] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.308456 13260 raft_consensus.cc:385] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.308772 13260 raft_consensus.cc:740] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.309508 13260 consensus_queue.cc:260] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.311748 13260 ts_tablet_manager.cc:1434] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:17:14.312990 13260 tablet_bootstrap.cc:492] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:14.319972 13260 tablet_bootstrap.cc:654] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.327394 13257 tablet_bootstrap.cc:492] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:14.328148 13257 ts_tablet_manager.cc:1403] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.141s	user 0.007s	sys 0.005s
I20260709 13:17:14.328248 12891 catalog_manager.cc:5697] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.333235 13315 raft_consensus.cc:697] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:14.334174 13315 consensus_queue.cc:237] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.336540 13359 consensus_queue.cc:1048] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.337891 13416 consensus_queue.cc:1048] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.338526 13415 raft_consensus.cc:493] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.339027 13415 raft_consensus.cc:515] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.341178 13415 leader_election.cc:290] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:14.342011 13388 consensus_queue.cc:1048] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.343478 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cb17552f904cb5b72197a75fa78b6f" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
W20260709 13:17:14.344969 13105 leader_election.cc:343] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.357388 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cb17552f904cb5b72197a75fa78b6f" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:14.359345 13388 raft_consensus.cc:493] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.359987 13388 raft_consensus.cc:515] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.363543 13259 consensus_queue.cc:260] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.364161 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0384e7d3a9d74a11bb77367cbaea5476" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
W20260709 13:17:14.366720 13033 leader_election.cc:343] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.365274 13066 raft_consensus.cc:2468] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:14.358305 13068 raft_consensus.cc:2468] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:14.372718 13107 leader_election.cc:304] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: c6c79a100f9043f590697441315084ed
I20260709 13:17:14.374027 13359 raft_consensus.cc:2804] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.374622 13359 raft_consensus.cc:493] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.375070 13359 raft_consensus.cc:3060] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.375819 13215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0384e7d3a9d74a11bb77367cbaea5476" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
W20260709 13:17:14.378348 13031 leader_election.cc:343] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.378974 13031 leader_election.cc:304] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed
I20260709 13:17:14.380041 13334 raft_consensus.cc:2749] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.379200 13259 ts_tablet_manager.cc:1434] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.002s
I20260709 13:17:14.381830 13259 tablet_bootstrap.cc:492] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
W20260709 13:17:14.395293 12939 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:14.381625 13257 raft_consensus.cc:359] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.398000 13257 raft_consensus.cc:385] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.382527 13388 leader_election.cc:290] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:14.399873 13259 tablet_bootstrap.cc:654] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.398450 13257 raft_consensus.cc:740] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.401862 13257 consensus_queue.cc:260] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.402812 13260 tablet_bootstrap.cc:492] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:14.403420 13260 ts_tablet_manager.cc:1403] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.018s
I20260709 13:17:14.404501 13258 tablet_bootstrap.cc:492] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:14.405027 13258 ts_tablet_manager.cc:1403] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.193s	user 0.046s	sys 0.050s
I20260709 13:17:14.404723 13359 raft_consensus.cc:515] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.406417 13260 raft_consensus.cc:359] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.407755 13359 leader_election.cc:290] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:14.407615 13258 raft_consensus.cc:359] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.408093 13215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cb17552f904cb5b72197a75fa78b6f" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:14.408387 13258 raft_consensus.cc:385] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.408735 13258 raft_consensus.cc:740] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
W20260709 13:17:14.409709 13105 leader_election.cc:343] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.409793 13258 consensus_queue.cc:260] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.407636 13260 raft_consensus.cc:385] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.411832 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cb17552f904cb5b72197a75fa78b6f" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:14.415261 13259 tablet_bootstrap.cc:492] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:14.415512 13066 raft_consensus.cc:3060] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.415771 13259 ts_tablet_manager.cc:1403] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.008s
I20260709 13:17:14.415550 13260 raft_consensus.cc:740] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.417003 13260 consensus_queue.cc:260] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.418984 13260 ts_tablet_manager.cc:1434] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:17:14.419891 13260 tablet_bootstrap.cc:492] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:14.419801 13259 raft_consensus.cc:359] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.420607 13259 raft_consensus.cc:385] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.420884 13259 raft_consensus.cc:740] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.421880 13259 consensus_queue.cc:260] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.412177 13258 ts_tablet_manager.cc:1434] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:14.423352 13066 raft_consensus.cc:2468] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:14.423946 13258 tablet_bootstrap.cc:492] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:14.424645 13259 ts_tablet_manager.cc:1434] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:17:14.424527 13107 leader_election.cc:304] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: c6c79a100f9043f590697441315084ed
I20260709 13:17:14.425738 13415 raft_consensus.cc:2804] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.426201 13415 raft_consensus.cc:697] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:14.426890 13260 tablet_bootstrap.cc:654] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.427047 13415 consensus_queue.cc:237] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.430330 13258 tablet_bootstrap.cc:654] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.434065 13259 tablet_bootstrap.cc:492] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:14.437259 13338 consensus_queue.cc:1048] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.449391 13267 raft_consensus.cc:493] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.450194 13267 raft_consensus.cc:515] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.453974 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a154faa8adb64071b0226241e5c5fd24" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:14.454897 13214 raft_consensus.cc:2393] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66218fb7f83e41ffa427b95015c3bf18 in current term 1: Already voted for candidate 293c23c890764727a91d599e0d75604f in this term.
I20260709 13:17:14.455586 13267 leader_election.cc:290] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:14.456090 13259 tablet_bootstrap.cc:654] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.457698 13338 raft_consensus.cc:493] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.458613 13338 raft_consensus.cc:515] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.458866 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a154faa8adb64071b0226241e5c5fd24" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:14.461372 12958 leader_election.cc:304] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed
I20260709 13:17:14.462164 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3b9e0089ed417d857d2dacb7cdc85f" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:14.462977 13301 raft_consensus.cc:3060] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.463507 13338 leader_election.cc:290] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:14.464018 13338 raft_consensus.cc:493] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:14.464120 13034 leader_election.cc:343] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.464478 13338 raft_consensus.cc:515] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.469463 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:14.469797 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:14.469681 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3b9e0089ed417d857d2dacb7cdc85f" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
W20260709 13:17:14.471182 13034 leader_election.cc:343] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.472384 13257 ts_tablet_manager.cc:1434] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.142s	user 0.007s	sys 0.000s
I20260709 13:17:14.467768 13338 leader_election.cc:290] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
W20260709 13:17:14.472985 13031 leader_election.cc:343] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.473261 13139 raft_consensus.cc:2468] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:14.474112 13031 leader_election.cc:304] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:14.475082 13033 leader_election.cc:304] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:14.475769 13334 raft_consensus.cc:2749] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.476284 13388 raft_consensus.cc:2804] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.476677 13388 raft_consensus.cc:493] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.476976 13388 raft_consensus.cc:3060] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.478108 13301 raft_consensus.cc:2749] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.473512 13257 tablet_bootstrap.cc:492] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:14.481281 13258 tablet_bootstrap.cc:492] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:14.481765 13258 ts_tablet_manager.cc:1403] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.058s	user 0.030s	sys 0.016s
I20260709 13:17:14.483515 13260 tablet_bootstrap.cc:492] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:14.484066 13260 ts_tablet_manager.cc:1403] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.012s
I20260709 13:17:14.483651 12886 catalog_manager.cc:5697] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.486289 13258 raft_consensus.cc:359] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.486984 13258 raft_consensus.cc:385] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.487291 13258 raft_consensus.cc:740] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.487385 13257 tablet_bootstrap.cc:654] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.488103 13258 consensus_queue.cc:260] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.490767 13258 ts_tablet_manager.cc:1434] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:14.490806 13388 raft_consensus.cc:515] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.492130 13258 tablet_bootstrap.cc:492] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:14.486563 13260 raft_consensus.cc:359] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.493624 13260 raft_consensus.cc:385] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.493945 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3b9e0089ed417d857d2dacb7cdc85f" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:14.494293 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3b9e0089ed417d857d2dacb7cdc85f" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:14.493935 13260 raft_consensus.cc:740] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.495074 13139 raft_consensus.cc:3060] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.495504 13259 tablet_bootstrap.cc:492] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:14.495973 13259 ts_tablet_manager.cc:1403] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.003s
I20260709 13:17:14.495632 13260 consensus_queue.cc:260] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.498651 13258 tablet_bootstrap.cc:654] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.499302 13388 leader_election.cc:290] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:14.498572 13259 raft_consensus.cc:359] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.500047 13259 raft_consensus.cc:385] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.500329 13259 raft_consensus.cc:740] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.500454 13260 ts_tablet_manager.cc:1434] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:17:14.501150 13259 consensus_queue.cc:260] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
W20260709 13:17:14.501302 13034 leader_election.cc:343] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.503113 13259 ts_tablet_manager.cc:1434] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:14.504006 13259 tablet_bootstrap.cc:492] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:14.509508 13259 tablet_bootstrap.cc:654] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.501398 13260 tablet_bootstrap.cc:492] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:14.512320 13139 raft_consensus.cc:2468] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:14.514511 12891 catalog_manager.cc:5697] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 0 to 1, leader changed from <none> to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.515060 13033 leader_election.cc:304] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:14.518283 13260 tablet_bootstrap.cc:654] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.518728 13388 raft_consensus.cc:2804] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.519268 13388 raft_consensus.cc:697] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:14.520063 13388 consensus_queue.cc:237] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.526054 13257 tablet_bootstrap.cc:492] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:14.526674 13257 ts_tablet_manager.cc:1403] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.000s
I20260709 13:17:14.530025 13257 raft_consensus.cc:359] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.530898 13257 raft_consensus.cc:385] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.531216 13257 raft_consensus.cc:740] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.547055 13258 tablet_bootstrap.cc:492] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:14.547660 13258 ts_tablet_manager.cc:1403] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.012s
I20260709 13:17:14.549661 13257 consensus_queue.cc:260] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.552603 13257 ts_tablet_manager.cc:1434] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:17:14.555029 13258 raft_consensus.cc:359] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.555960 13258 raft_consensus.cc:385] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.556264 13258 raft_consensus.cc:740] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.557904 13257 tablet_bootstrap.cc:492] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:14.559712 13415 raft_consensus.cc:493] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.560217 13415 raft_consensus.cc:515] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.563340 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a2dad5f61d4971a5a7ae53bfe10ca3" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:14.563994 13214 raft_consensus.cc:2468] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:14.565201 13105 leader_election.cc:304] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:14.566067 13315 raft_consensus.cc:2804] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.566450 13315 raft_consensus.cc:493] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.566794 13315 raft_consensus.cc:3060] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.567992 12891 catalog_manager.cc:5697] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 0 to 1, leader changed from <none> to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.569329 13258 consensus_queue.cc:260] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.572198 13258 ts_tablet_manager.cc:1434] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 13:17:14.574368 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a2dad5f61d4971a5a7ae53bfe10ca3" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:14.575819 13259 tablet_bootstrap.cc:492] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:14.576345 13259 ts_tablet_manager.cc:1403] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.017s
W20260709 13:17:14.576207 13108 leader_election.cc:343] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.576666 13258 tablet_bootstrap.cc:492] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:14.569487 13415 leader_election.cc:290] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:14.579192 13260 tablet_bootstrap.cc:492] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:14.579728 13260 ts_tablet_manager.cc:1403] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.079s	user 0.006s	sys 0.030s
I20260709 13:17:14.582967 13258 tablet_bootstrap.cc:654] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.576289 13257 tablet_bootstrap.cc:654] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.584779 13260 raft_consensus.cc:359] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.584584 12887 catalog_manager.cc:5697] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.585201 13315 raft_consensus.cc:515] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.586614 13259 raft_consensus.cc:359] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.587392 13259 raft_consensus.cc:385] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.587644 13259 raft_consensus.cc:740] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.588423 13259 consensus_queue.cc:260] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.590416 13259 ts_tablet_manager.cc:1434] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:17:14.590891 13324 consensus_queue.cc:1048] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.591383 13259 tablet_bootstrap.cc:492] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:14.585556 13260 raft_consensus.cc:385] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.592473 13260 raft_consensus.cc:740] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.593333 13260 consensus_queue.cc:260] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.595397 13260 ts_tablet_manager.cc:1434] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:17:14.596297 13260 tablet_bootstrap.cc:492] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:14.598059 13259 tablet_bootstrap.cc:654] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.598946 13257 tablet_bootstrap.cc:492] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:14.599460 13257 ts_tablet_manager.cc:1403] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.001s
I20260709 13:17:14.604655 13258 tablet_bootstrap.cc:492] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:14.605221 13258 ts_tablet_manager.cc:1403] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.005s
I20260709 13:17:14.608120 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a2dad5f61d4971a5a7ae53bfe10ca3" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:14.608771 13214 raft_consensus.cc:3060] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.609333 13257 raft_consensus.cc:359] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.610044 13257 raft_consensus.cc:385] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.610306 13257 raft_consensus.cc:740] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.611071 13257 consensus_queue.cc:260] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.613320 13260 tablet_bootstrap.cc:654] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.613318 13258 raft_consensus.cc:359] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.614100 13258 raft_consensus.cc:385] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.614382 13258 raft_consensus.cc:740] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.618430 13257 ts_tablet_manager.cc:1434] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 13:17:14.618168 13324 consensus_queue.cc:1048] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.619451 13257 tablet_bootstrap.cc:492] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:14.620492 13258 consensus_queue.cc:260] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.625082 12993 raft_consensus.cc:3060] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.629261 13258 ts_tablet_manager.cc:1434] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:17:14.630302 13258 tablet_bootstrap.cc:492] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:14.631008 13338 raft_consensus.cc:493] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.631520 13338 raft_consensus.cc:515] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.633526 13338 leader_election.cc:290] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:14.635943 13258 tablet_bootstrap.cc:654] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.636718 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbaec0edb4d7fbd364d37ccac32ab" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:14.637419 13301 raft_consensus.cc:493] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.638005 13301 raft_consensus.cc:515] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
W20260709 13:17:14.638690 13034 leader_election.cc:343] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.636719 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbaec0edb4d7fbd364d37ccac32ab" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:14.639982 13139 raft_consensus.cc:2468] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:14.641583 13033 leader_election.cc:304] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:14.642694 13338 raft_consensus.cc:2804] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.643450 13338 raft_consensus.cc:493] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.644233 13338 raft_consensus.cc:3060] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.646509 13257 tablet_bootstrap.cc:654] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.644654 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3b9e0089ed417d857d2dacb7cdc85f" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:14.648422 13415 consensus_queue.cc:1048] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.646123 13388 raft_consensus.cc:493] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.651086 13388 raft_consensus.cc:515] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.653789 13215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ad68b455024af5a1dfcc5dd42cc600" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:14.654429 13215 raft_consensus.cc:2468] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:14.640036 13301 leader_election.cc:290] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:14.655730 13031 leader_election.cc:304] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:14.656560 13334 raft_consensus.cc:2804] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.656930 13334 raft_consensus.cc:493] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.657317 13334 raft_consensus.cc:3060] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.643507 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3b9e0089ed417d857d2dacb7cdc85f" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:14.666294 13139 raft_consensus.cc:2393] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66218fb7f83e41ffa427b95015c3bf18 in current term 1: Already voted for candidate 293c23c890764727a91d599e0d75604f in this term.
I20260709 13:17:14.668006 13359 consensus_queue.cc:1048] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.668632 13258 tablet_bootstrap.cc:492] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:14.668140 12958 leader_election.cc:304] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:14.671706 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ad68b455024af5a1dfcc5dd42cc600" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:14.670317 13388 leader_election.cc:290] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:14.672560 13359 raft_consensus.cc:493] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.673178 13359 raft_consensus.cc:515] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.675689 13359 leader_election.cc:290] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:14.675910 13333 raft_consensus.cc:3060] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.676821 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8526082d24944a48aab1c0d78d626587" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:14.677084 12991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8526082d24944a48aab1c0d78d626587" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:14.677384 13258 ts_tablet_manager.cc:1403] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.005s
I20260709 13:17:14.677557 13216 raft_consensus.cc:2468] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
W20260709 13:17:14.678434 13108 leader_election.cc:343] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.679925 13105 leader_election.cc:304] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:14.680377 13258 raft_consensus.cc:359] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.681077 13258 raft_consensus.cc:385] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.682092 13258 raft_consensus.cc:740] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.681475 13416 raft_consensus.cc:2804] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.682899 13416 raft_consensus.cc:493] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.683350 13416 raft_consensus.cc:3060] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.683753 13258 consensus_queue.cc:260] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.685506 13301 consensus_queue.cc:1048] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.685889 13258 ts_tablet_manager.cc:1434] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:14.672569 12992 raft_consensus.cc:2468] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:14.690966 13214 raft_consensus.cc:2468] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:14.691325 13258 tablet_bootstrap.cc:492] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:14.694348 13334 raft_consensus.cc:515] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.697853 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ad68b455024af5a1dfcc5dd42cc600" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:14.698374 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ad68b455024af5a1dfcc5dd42cc600" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:14.699069 12992 raft_consensus.cc:3060] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.698493 13216 raft_consensus.cc:3060] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.700027 13105 leader_election.cc:304] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:14.698840 13315 leader_election.cc:290] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:14.707254 13315 raft_consensus.cc:2804] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.707122 13388 consensus_queue.cc:1048] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.707859 13315 raft_consensus.cc:697] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:14.708846 13315 consensus_queue.cc:237] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.691080 13333 raft_consensus.cc:2749] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.711964 12991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a2dad5f61d4971a5a7ae53bfe10ca3" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
W20260709 13:17:14.713555 13108 leader_election.cc:343] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.676694 13338 raft_consensus.cc:515] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.715536 13267 consensus_queue.cc:1048] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.717453 12992 raft_consensus.cc:2468] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:14.718559 13034 leader_election.cc:304] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18; no voters: 
I20260709 13:17:14.719525 13388 raft_consensus.cc:2804] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.720000 13388 raft_consensus.cc:697] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:14.709050 13416 raft_consensus.cc:515] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.721118 13388 consensus_queue.cc:237] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.723124 13258 tablet_bootstrap.cc:654] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.724079 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8526082d24944a48aab1c0d78d626587" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:14.724941 13212 raft_consensus.cc:3060] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.726585 13216 raft_consensus.cc:2468] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:14.719832 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbaec0edb4d7fbd364d37ccac32ab" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:14.733837 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbaec0edb4d7fbd364d37ccac32ab" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:14.734541 13138 raft_consensus.cc:3060] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.734673 13212 raft_consensus.cc:2468] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:14.735615 13258 tablet_bootstrap.cc:492] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:14.735754 13105 leader_election.cc:304] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:14.736119 13258 ts_tablet_manager.cc:1403] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.000s
I20260709 13:17:14.736821 13359 raft_consensus.cc:2804] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.737383 13359 raft_consensus.cc:697] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
W20260709 13:17:14.738643 13034 leader_election.cc:343] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.738498 13359 consensus_queue.cc:237] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.741575 13258 raft_consensus.cc:359] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.742280 13258 raft_consensus.cc:385] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.742543 13258 raft_consensus.cc:740] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.743265 13258 consensus_queue.cc:260] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.696959 13334 leader_election.cc:290] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:14.718470 13259 tablet_bootstrap.cc:492] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:14.746486 13259 ts_tablet_manager.cc:1403] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.155s	user 0.016s	sys 0.004s
I20260709 13:17:14.748665 13138 raft_consensus.cc:2468] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:14.752471 13033 leader_election.cc:304] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:14.756582 13416 leader_election.cc:290] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:14.758275 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8526082d24944a48aab1c0d78d626587" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:14.758849 13388 raft_consensus.cc:2804] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.759380 13388 raft_consensus.cc:697] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
W20260709 13:17:14.759548 13108 leader_election.cc:343] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.760426 13388 consensus_queue.cc:237] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.762519 13257 tablet_bootstrap.cc:492] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:14.733170 13338 leader_election.cc:290] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:14.764607 13257 ts_tablet_manager.cc:1403] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.145s	user 0.012s	sys 0.007s
I20260709 13:17:14.772431 13450 consensus_queue.cc:1048] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.763916 13259 raft_consensus.cc:359] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.773382 13259 raft_consensus.cc:385] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.773741 13259 raft_consensus.cc:740] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.750568 13258 ts_tablet_manager.cc:1434] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:17:14.781901 13258 tablet_bootstrap.cc:492] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:14.778605 13259 consensus_queue.cc:260] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.785794 13260 tablet_bootstrap.cc:492] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:14.772248 13257 raft_consensus.cc:359] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.786455 13260 ts_tablet_manager.cc:1403] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.190s	user 0.024s	sys 0.030s
I20260709 13:17:14.786679 13257 raft_consensus.cc:385] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.787025 13257 raft_consensus.cc:740] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.787791 13259 ts_tablet_manager.cc:1434] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:17:14.788856 13259 tablet_bootstrap.cc:492] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:14.788559 13257 consensus_queue.cc:260] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.792168 13260 raft_consensus.cc:359] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.793591 13260 raft_consensus.cc:385] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.793861 13260 raft_consensus.cc:740] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.794545 13260 consensus_queue.cc:260] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.796589 13260 ts_tablet_manager.cc:1434] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.001s
I20260709 13:17:14.797487 13260 tablet_bootstrap.cc:492] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:14.798167 13258 tablet_bootstrap.cc:654] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.800794 13257 ts_tablet_manager.cc:1434] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 13:17:14.801803 13257 tablet_bootstrap.cc:492] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:14.804803 13259 tablet_bootstrap.cc:654] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.809593 13257 tablet_bootstrap.cc:654] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.823258 13416 raft_consensus.cc:493] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.823764 13416 raft_consensus.cc:515] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.825804 13416 leader_election.cc:290] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:14.827596 13260 tablet_bootstrap.cc:654] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.831985 12891 catalog_manager.cc:5697] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 0 to 1, leader changed from <none> to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.833366 12891 catalog_manager.cc:5697] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 0 to 1, leader changed from <none> to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.836716 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf030a2e0b44f30ace670a840933368" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:14.841678 13108 leader_election.cc:343] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.844717 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf030a2e0b44f30ace670a840933368" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:14.845577 13066 raft_consensus.cc:2468] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:14.850538 13107 leader_election.cc:304] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:14.851873 13359 raft_consensus.cc:2804] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.852041 13259 tablet_bootstrap.cc:492] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:14.851918 13416 consensus_queue.cc:1048] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.852416 13359 raft_consensus.cc:493] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.852707 13259 ts_tablet_manager.cc:1403] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.016s
I20260709 13:17:14.852799 13359 raft_consensus.cc:3060] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.852684 12886 catalog_manager.cc:5697] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.855134 12886 catalog_manager.cc:5697] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.855708 13259 raft_consensus.cc:359] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.856369 13259 raft_consensus.cc:385] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.856647 13259 raft_consensus.cc:740] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.857437 13259 consensus_queue.cc:260] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.859453 13259 ts_tablet_manager.cc:1434] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:14.860396 13259 tablet_bootstrap.cc:492] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:14.862978 13257 tablet_bootstrap.cc:492] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:14.863544 13257 ts_tablet_manager.cc:1403] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.002s
I20260709 13:17:14.863576 13315 raft_consensus.cc:493] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.863644 13416 consensus_queue.cc:1048] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.864328 13315 raft_consensus.cc:515] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.865758 13259 tablet_bootstrap.cc:654] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.866418 13315 leader_election.cc:290] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:14.866364 13257 raft_consensus.cc:359] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.867214 13257 raft_consensus.cc:385] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.867525 13257 raft_consensus.cc:740] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.868214 13257 consensus_queue.cc:260] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.870671 13065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0384e7d3a9d74a11bb77367cbaea5476" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:14.871337 13065 raft_consensus.cc:2468] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:14.862980 13359 raft_consensus.cc:515] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.872814 13107 leader_election.cc:304] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:14.868666 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0384e7d3a9d74a11bb77367cbaea5476" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:14.873962 13315 raft_consensus.cc:2804] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.874850 13315 raft_consensus.cc:493] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.875324 13315 raft_consensus.cc:3060] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.875519 13212 raft_consensus.cc:3060] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.879729 13258 tablet_bootstrap.cc:492] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:14.880240 13258 ts_tablet_manager.cc:1403] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.099s	user 0.018s	sys 0.003s
I20260709 13:17:14.881403 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf030a2e0b44f30ace670a840933368" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:14.882280 13257 ts_tablet_manager.cc:1434] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:17:14.882920 13214 raft_consensus.cc:2468] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
W20260709 13:17:14.885381 13108 leader_election.cc:343] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.888970 13370 raft_consensus.cc:493] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.883241 13257 tablet_bootstrap.cc:492] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:14.899639 13370 raft_consensus.cc:515] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:14.900771 13415 consensus_queue.cc:1048] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.902060 13370 leader_election.cc:290] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:14.903918 13258 raft_consensus.cc:359] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.904191 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cb17552f904cb5b72197a75fa78b6f" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:14.904637 13258 raft_consensus.cc:385] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.906294 13257 tablet_bootstrap.cc:654] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.906976 13065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cb17552f904cb5b72197a75fa78b6f" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:14.888717 13416 consensus_queue.cc:1048] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:17:14.904963 13258 raft_consensus.cc:740] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.909760 13181 leader_election.cc:304] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:14.910063 13258 consensus_queue.cc:260] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.912567 13258 ts_tablet_manager.cc:1434] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 13:17:14.913024 13359 leader_election.cc:290] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:14.914300 13258 tablet_bootstrap.cc:492] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:14.918641 13324 raft_consensus.cc:2749] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:14.919344 13324 raft_consensus.cc:493] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.919754 13324 raft_consensus.cc:515] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.923892 13258 tablet_bootstrap.cc:654] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.928345 13065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf030a2e0b44f30ace670a840933368" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:14.929004 13065 raft_consensus.cc:3060] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.933612 13324 leader_election.cc:290] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:14.935966 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:14.937485 13182 leader_election.cc:343] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.944693 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:14.945632 13066 raft_consensus.cc:2468] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:14.951423 13181 leader_election.cc:304] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:14.953151 13450 consensus_queue.cc:1048] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.954161 13266 raft_consensus.cc:2804] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.954766 13266 raft_consensus.cc:493] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.955219 13266 raft_consensus.cc:3060] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.893102 13260 tablet_bootstrap.cc:492] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:14.959554 13260 ts_tablet_manager.cc:1403] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.162s	user 0.011s	sys 0.019s
I20260709 13:17:14.961361 13065 raft_consensus.cc:2468] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:14.897838 13259 tablet_bootstrap.cc:492] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:14.963665 13259 ts_tablet_manager.cc:1403] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.103s	user 0.011s	sys 0.000s
I20260709 13:17:14.964345 13266 raft_consensus.cc:515] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.966575 13259 raft_consensus.cc:359] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:14.966965 13266 leader_election.cc:290] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:14.967286 13259 raft_consensus.cc:385] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.967146 12991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:14.967658 13259 raft_consensus.cc:740] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.968580 13259 consensus_queue.cc:260] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
W20260709 13:17:14.969357 13182 leader_election.cc:343] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.962297 13260 raft_consensus.cc:359] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.970178 13260 raft_consensus.cc:385] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.970476 13260 raft_consensus.cc:740] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.970726 13259 ts_tablet_manager.cc:1434] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:14.971148 13260 consensus_queue.cc:260] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:14.971632 13259 tablet_bootstrap.cc:492] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:14.973229 13260 ts_tablet_manager.cc:1434] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:17:14.974301 13260 tablet_bootstrap.cc:492] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:14.974316 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:14.975220 13068 raft_consensus.cc:3060] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.974390 13450 raft_consensus.cc:493] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.978681 13450 raft_consensus.cc:515] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:15.002573 13415 raft_consensus.cc:493] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.003198 13415 raft_consensus.cc:515] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:14.890355 13315 raft_consensus.cc:515] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:15.017154 13370 raft_consensus.cc:493] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.019611 13370 raft_consensus.cc:515] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:15.022154 13370 leader_election.cc:290] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:15.025326 13388 raft_consensus.cc:493] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.025985 13388 raft_consensus.cc:515] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:15.028903 13388 leader_election.cc:290] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:15.050585 13315 leader_election.cc:290] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:15.149446 13068 raft_consensus.cc:2468] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:15.161509 13259 tablet_bootstrap.cc:654] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.185652 13260 tablet_bootstrap.cc:654] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.193868 13107 leader_election.cc:304] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:15.195315 13359 raft_consensus.cc:2804] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:15.195822 13359 raft_consensus.cc:697] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:15.196484 13315 raft_consensus.cc:493] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.196615 13359 consensus_queue.cc:237] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:15.197036 13315 raft_consensus.cc:515] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:15.198973 13315 leader_election.cc:290] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:15.209612 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668942e4495f4e6ca677aa883843b165" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
W20260709 13:17:15.227521 13031 leader_election.cc:343] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.230327 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:15.231045 13138 raft_consensus.cc:2468] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:15.231246 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0384e7d3a9d74a11bb77367cbaea5476" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:15.231855 13214 raft_consensus.cc:3060] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.233347 13257 tablet_bootstrap.cc:492] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:15.233840 13257 ts_tablet_manager.cc:1403] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.351s	user 0.026s	sys 0.036s
I20260709 13:17:15.233856 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50831cc643d24f00880db6263d32d280" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
W20260709 13:17:15.236374 13105 leader_election.cc:343] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.236438 13257 raft_consensus.cc:359] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:15.238626 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0384e7d3a9d74a11bb77367cbaea5476" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:15.238902 13065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:15.247394 13065 raft_consensus.cc:2468] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:15.239264 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720ddf9396de4255ba8105124c624739" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:15.203022 13450 leader_election.cc:290] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:15.241955 13033 leader_election.cc:304] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:15.243819 13333 raft_consensus.cc:493] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.243887 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668942e4495f4e6ca677aa883843b165" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:15.244660 13301 raft_consensus.cc:493] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.245417 13257 raft_consensus.cc:385] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.252729 13257 raft_consensus.cc:740] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.251104 13068 raft_consensus.cc:3060] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.254133 13139 raft_consensus.cc:2468] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:15.254441 13257 consensus_queue.cc:260] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:15.254453 13450 raft_consensus.cc:2804] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:15.252636 13333 raft_consensus.cc:515] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:15.261549 13450 raft_consensus.cc:493] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.264009 13450 raft_consensus.cc:3060] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.265082 13257 ts_tablet_manager.cc:1434] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:17:15.265352 13333 leader_election.cc:290] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:15.266105 13257 tablet_bootstrap.cc:492] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
W20260709 13:17:15.266639 13468 log.cc:927] Time spent T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 13:17:15.258184 13415 leader_election.cc:290] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:15.257369 13107 leader_election.cc:304] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:15.270429 13258 tablet_bootstrap.cc:492] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:15.270972 13258 ts_tablet_manager.cc:1403] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.357s	user 0.020s	sys 0.056s
I20260709 13:17:15.254310 13301 raft_consensus.cc:515] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:15.272306 13214 raft_consensus.cc:2468] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:15.273770 13301 leader_election.cc:290] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:15.274351 13450 raft_consensus.cc:515] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:15.275503 13258 raft_consensus.cc:359] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:15.275871 13450 leader_election.cc:290] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:15.276039 13258 raft_consensus.cc:385] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.269763 13415 raft_consensus.cc:2804] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:15.276432 13258 raft_consensus.cc:740] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.276585 13415 raft_consensus.cc:493] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.277184 13258 consensus_queue.cc:260] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:15.277902 13181 leader_election.cc:304] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:15.279573 13324 raft_consensus.cc:2804] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:15.278261 13415 raft_consensus.cc:3060] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.280139 13324 raft_consensus.cc:697] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:15.281769 13258 ts_tablet_manager.cc:1434] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:15.283434 13258 tablet_bootstrap.cc:492] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:15.283385 13324 consensus_queue.cc:237] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:15.292366 13258 tablet_bootstrap.cc:654] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.295759 13260 tablet_bootstrap.cc:492] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:15.296434 13260 ts_tablet_manager.cc:1403] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.322s	user 0.017s	sys 0.017s
I20260709 13:17:15.297500 13259 tablet_bootstrap.cc:492] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:15.297984 13259 ts_tablet_manager.cc:1403] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.327s	user 0.018s	sys 0.015s
I20260709 13:17:15.299053 13258 tablet_bootstrap.cc:492] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:15.299546 13258 ts_tablet_manager.cc:1403] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.002s
I20260709 13:17:15.300086 13260 raft_consensus.cc:359] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:15.301301 13260 raft_consensus.cc:385] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.301674 13260 raft_consensus.cc:740] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.302304 13258 raft_consensus.cc:359] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:15.303083 13258 raft_consensus.cc:385] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.302557 13260 consensus_queue.cc:260] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:15.303416 13258 raft_consensus.cc:740] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.304203 13258 consensus_queue.cc:260] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:15.304689 13260 ts_tablet_manager.cc:1434] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:17:15.306034 13260 tablet_bootstrap.cc:492] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:15.306720 13258 ts_tablet_manager.cc:1434] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:17:15.300515 13259 raft_consensus.cc:359] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:15.307281 13259 raft_consensus.cc:385] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.307407 13415 raft_consensus.cc:515] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:15.307850 13258 tablet_bootstrap.cc:492] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:15.309015 13257 tablet_bootstrap.cc:654] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.307888 13259 raft_consensus.cc:740] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.313990 13259 consensus_queue.cc:260] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:15.314474 13415 leader_election.cc:290] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:15.366534 12989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:15.370045 12991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720ddf9396de4255ba8105124c624739" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:15.383266 13258 tablet_bootstrap.cc:654] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.404021 13260 tablet_bootstrap.cc:654] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:15.409643 13181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39523, user_credentials={real_user=slave}} blocked reactor thread for 117887us
I20260709 13:17:15.415354 13259 ts_tablet_manager.cc:1434] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.004s
I20260709 13:17:15.419453 13259 tablet_bootstrap.cc:492] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:15.419304 13033 leader_election.cc:304] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: c6c79a100f9043f590697441315084ed
I20260709 13:17:15.419889 13334 consensus_queue.cc:1048] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:17:15.421348 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:15.422768 13067 raft_consensus.cc:2393] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c538e5be22524c9a970f7a59c5379288 in current term 1: Already voted for candidate 293c23c890764727a91d599e0d75604f in this term.
I20260709 13:17:15.422917 13334 consensus_queue.cc:1048] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:15.439118 13388 raft_consensus.cc:2804] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:15.439847 13388 raft_consensus.cc:493] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.440295 13388 raft_consensus.cc:3060] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.441608 13450 raft_consensus.cc:493] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.442551 13450 raft_consensus.cc:515] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:15.449231 13334 consensus_queue.cc:1048] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:15.453442 13413 raft_consensus.cc:493] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.454348 13413 raft_consensus.cc:515] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:15.462218 13413 leader_election.cc:290] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:15.465742 13257 tablet_bootstrap.cc:492] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:15.484586 13065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9cc31f16c2467c84113f244fcea75f" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:15.503923 13450 leader_election.cc:290] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:15.466812 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbaec0edb4d7fbd364d37ccac32ab" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:15.469771 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:15.463639 12890 catalog_manager.cc:5697] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 0 to 1, leader changed from <none> to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:15.456593 12891 catalog_manager.cc:5697] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:15.472623 13034 leader_election.cc:343] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:15.469518 13182 leader_election.cc:343] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:15.505143 13181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39523, user_credentials={real_user=slave}} blocked reactor thread for 93791.7us
I20260709 13:17:15.517554 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5505b452a14d41e1877484ca6696497a" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:15.526173 13259 tablet_bootstrap.cc:654] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:15.525349 13031 leader_election.cc:343] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.536396 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a2dad5f61d4971a5a7ae53bfe10ca3" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
W20260709 13:17:15.537678 12939 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:17:15.542637 13033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:36831, user_credentials={real_user=slave}} blocked reactor thread for 123789us
I20260709 13:17:15.544185 13257 ts_tablet_manager.cc:1403] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.278s	user 0.018s	sys 0.000s
W20260709 13:17:15.525985 13181 leader_election.cc:343] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.522475 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbaec0edb4d7fbd364d37ccac32ab" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
W20260709 13:17:15.528045 13107 leader_election.cc:343] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.550724 13068 raft_consensus.cc:2468] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:15.550985 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:15.553340 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50831cc643d24f00880db6263d32d280" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:15.516044 13182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:42939, user_credentials={real_user=slave}} blocked reactor thread for 46904us
W20260709 13:17:15.556902 13034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:42939, user_credentials={real_user=slave}} blocked reactor thread for 84515us
I20260709 13:17:15.558665 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:15.559324 13258 tablet_bootstrap.cc:492] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:15.586798 13258 ts_tablet_manager.cc:1403] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.279s	user 0.011s	sys 0.008s
I20260709 13:17:15.598323 13258 raft_consensus.cc:359] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:15.599319 13258 raft_consensus.cc:385] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.599727 13258 raft_consensus.cc:740] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.602604 13324 raft_consensus.cc:493] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.603497 13324 raft_consensus.cc:515] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:15.611922 13324 leader_election.cc:290] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:15.563243 13260 tablet_bootstrap.cc:492] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:15.570147 13257 raft_consensus.cc:359] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:15.613004 13257 raft_consensus.cc:385] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.613404 13257 raft_consensus.cc:740] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.614416 13257 consensus_queue.cc:260] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:15.573231 13388 raft_consensus.cc:515] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
W20260709 13:17:15.616966 13108 consensus_peers.cc:597] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.619508 13388 leader_election.cc:290] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
W20260709 13:17:15.576467 13107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39523, user_credentials={real_user=slave}} blocked reactor thread for 48575.8us
I20260709 13:17:15.577785 13139 raft_consensus.cc:2393] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66218fb7f83e41ffa427b95015c3bf18 in current term 1: Already voted for candidate 293c23c890764727a91d599e0d75604f in this term.
I20260709 13:17:15.582141 12989 raft_consensus.cc:3060] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.600742 13258 consensus_queue.cc:260] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:15.633358 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668942e4495f4e6ca677aa883843b165" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
W20260709 13:17:15.634258 13108 leader_election.cc:343] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.635229 13108 leader_election.cc:304] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:15.636147 13214 raft_consensus.cc:3060] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:15.634533 13034 leader_election.cc:343] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.640497 13260 ts_tablet_manager.cc:1403] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.335s	user 0.011s	sys 0.013s
I20260709 13:17:15.639650 13257 ts_tablet_manager.cc:1434] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.095s	user 0.011s	sys 0.000s
I20260709 13:17:15.643831 13257 tablet_bootstrap.cc:492] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:15.648010 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5505b452a14d41e1877484ca6696497a" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:15.647804 13260 raft_consensus.cc:359] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:15.655458 13257 tablet_bootstrap.cc:654] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.655247 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:15.658854 13139 raft_consensus.cc:2393] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c23c890764727a91d599e0d75604f in current term 1: Already voted for candidate c538e5be22524c9a970f7a59c5379288 in this term.
I20260709 13:17:15.560542 13181 leader_election.cc:304] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:15.657539 12990 raft_consensus.cc:3060] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.648939 13260 raft_consensus.cc:385] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.665910 13260 raft_consensus.cc:740] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
W20260709 13:17:15.663410 13034 leader_election.cc:343] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.671754 12958 leader_election.cc:304] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
W20260709 13:17:15.682017 13108 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:42939, user_credentials={real_user=slave}} blocked reactor thread for 47857.9us
I20260709 13:17:15.685048 13324 raft_consensus.cc:2749] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:15.685423 13181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39523, user_credentials={real_user=slave}} blocked reactor thread for 159520us
I20260709 13:17:15.684087 13260 consensus_queue.cc:260] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:15.678984 13413 raft_consensus.cc:2749] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.688602 13141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668942e4495f4e6ca677aa883843b165" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:15.676964 13034 leader_election.cc:304] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:15.689365 13141 raft_consensus.cc:3060] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.690057 13259 tablet_bootstrap.cc:492] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:15.690568 13259 ts_tablet_manager.cc:1403] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.272s	user 0.031s	sys 0.053s
I20260709 13:17:15.695657 13105 leader_election.cc:304] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:15.697086 13259 raft_consensus.cc:359] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:15.697878 13259 raft_consensus.cc:385] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.698143 13259 raft_consensus.cc:740] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.698649 13415 raft_consensus.cc:2804] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:15.699080 13108 leader_election.cc:343] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.699307 13415 raft_consensus.cc:697] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
W20260709 13:17:15.702178 13108 leader_election.cc:343] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.703720 13108 leader_election.cc:304] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:15.702862 13259 consensus_queue.cc:260] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:15.705802 13214 raft_consensus.cc:2468] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:15.707082 13416 raft_consensus.cc:2749] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.708635 13260 ts_tablet_manager.cc:1434] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 13:17:15.708539 13483 raft_consensus.cc:2749] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.709028 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668942e4495f4e6ca677aa883843b165" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:15.712093 13067 raft_consensus.cc:2393] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6c79a100f9043f590697441315084ed in current term 1: Already voted for candidate 293c23c890764727a91d599e0d75604f in this term.
I20260709 13:17:15.712800 13258 ts_tablet_manager.cc:1434] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.125s	user 0.011s	sys 0.000s
W20260709 13:17:15.709406 13034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:42939, user_credentials={real_user=slave}} blocked reactor thread for 46060.3us
I20260709 13:17:15.714169 13258 tablet_bootstrap.cc:492] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:15.714730 13483 consensus_queue.cc:1048] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:15.700701 13415 consensus_queue.cc:237] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:15.710757 13259 ts_tablet_manager.cc:1434] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:17:15.729395 13260 tablet_bootstrap.cc:492] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:15.730970 13476 raft_consensus.cc:2749] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.731769 13416 raft_consensus.cc:493] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.732445 13416 raft_consensus.cc:515] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:15.732981 13388 consensus_queue.cc:1048] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:15.734303 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668942e4495f4e6ca677aa883843b165" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:15.734771 13416 leader_election.cc:290] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:15.737469 13141 raft_consensus.cc:2468] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:15.749018 13259 tablet_bootstrap.cc:492] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed: Bootstrap starting.
W20260709 13:17:15.766058 13108 consensus_peers.cc:597] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.767239 13033 leader_election.cc:304] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:15.768194 13483 raft_consensus.cc:2749] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.768589 12989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d17ac0f6d4b9a9851a6aa26127256" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:15.756033 13416 consensus_queue.cc:1048] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260709 13:17:15.770620 13108 leader_election.cc:343] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.774227 13257 tablet_bootstrap.cc:492] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:15.774794 13257 ts_tablet_manager.cc:1403] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.131s	user 0.026s	sys 0.005s
I20260709 13:17:15.784765 12991 raft_consensus.cc:3060] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.787539 13260 tablet_bootstrap.cc:654] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.797221 13216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9cc31f16c2467c84113f244fcea75f" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:15.799525 13259 tablet_bootstrap.cc:654] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.794410 13257 raft_consensus.cc:359] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:15.801331 13257 raft_consensus.cc:385] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.801637 13257 raft_consensus.cc:740] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.800901 13258 tablet_bootstrap.cc:654] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.766582 13031 leader_election.cc:304] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:15.822177 13257 consensus_queue.cc:260] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:15.829613 13257 ts_tablet_manager.cc:1434] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:17:15.830825 13257 tablet_bootstrap.cc:492] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
W20260709 13:17:15.834249 13031 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:36179, user_credentials={real_user=slave}} blocked reactor thread for 71429.2us
I20260709 13:17:15.834756 13388 raft_consensus.cc:2804] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:15.835327 13388 raft_consensus.cc:697] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:15.836159 13415 raft_consensus.cc:493] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.836306 13388 consensus_queue.cc:237] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:15.836784 13415 raft_consensus.cc:515] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:15.837735 13416 consensus_queue.cc:1048] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:15.840582 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7205bc9d20124044a1f1e9be55845ed6" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:15.841640 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a2dad5f61d4971a5a7ae53bfe10ca3" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:15.842614 13209 raft_consensus.cc:2393] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66218fb7f83e41ffa427b95015c3bf18 in current term 1: Already voted for candidate c538e5be22524c9a970f7a59c5379288 in this term.
W20260709 13:17:15.826969 13181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39523, user_credentials={real_user=slave}} blocked reactor thread for 43682.9us
W20260709 13:17:15.865156 13498 log.cc:927] Time spent T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
I20260709 13:17:15.866637 13416 consensus_queue.cc:1048] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:15.868152 12956 leader_election.cc:304] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed
W20260709 13:17:15.868420 13108 leader_election.cc:343] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:15.868745 13033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:36831, user_credentials={real_user=slave}} blocked reactor thread for 99359.7us
W20260709 13:17:15.864977 13105 leader_election.cc:343] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.854916 13415 leader_election.cc:290] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:15.918676 13259 tablet_bootstrap.cc:492] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:15.919251 13259 ts_tablet_manager.cc:1403] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.171s	user 0.018s	sys 0.007s
I20260709 13:17:15.885936 13105 leader_election.cc:304] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed
I20260709 13:17:15.922416 13259 raft_consensus.cc:359] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:15.926265 13259 raft_consensus.cc:385] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.926595 13259 raft_consensus.cc:740] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.927325 13259 consensus_queue.cc:260] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
W20260709 13:17:15.927793 13497 log.cc:927] Time spent T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18: Append to log took a long time: real 0.103s	user 0.002s	sys 0.001s
I20260709 13:17:15.868219 13484 consensus_queue.cc:1048] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.070s
I20260709 13:17:15.935230 13259 ts_tablet_manager.cc:1434] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:17:15.936388 13259 tablet_bootstrap.cc:492] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:15.913947 13181 leader_election.cc:304] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:15.944835 13257 tablet_bootstrap.cc:654] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.946632 13333 raft_consensus.cc:493] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.947999 13259 tablet_bootstrap.cc:654] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.949651 13324 raft_consensus.cc:2749] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.949934 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d17ac0f6d4b9a9851a6aa26127256" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:15.951088 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7205bc9d20124044a1f1e9be55845ed6" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:15.952384 13370 raft_consensus.cc:493] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.982409 13267 raft_consensus.cc:2749] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.982550 13315 raft_consensus.cc:2749] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:15.973227 13105 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:36179, user_credentials={real_user=slave}} blocked reactor thread for 108300us
I20260709 13:17:15.969411 13333 raft_consensus.cc:515] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
W20260709 13:17:15.994007 12956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:36179, user_credentials={real_user=slave}} blocked reactor thread for 124889us
I20260709 13:17:15.996459 13333 leader_election.cc:290] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:15.974469 13370 raft_consensus.cc:515] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:15.997977 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:15.998407 13370 leader_election.cc:290] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:15.998715 13068 raft_consensus.cc:2468] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 1.
I20260709 13:17:15.999931 12958 leader_election.cc:304] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18; no voters: 
W20260709 13:17:16.001015 13105 leader_election.cc:343] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.001701 13105 leader_election.cc:304] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:16.003438 13260 tablet_bootstrap.cc:492] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:16.003949 13260 ts_tablet_manager.cc:1403] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.275s	user 0.023s	sys 0.009s
I20260709 13:17:16.004491 13416 consensus_queue.cc:1048] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:17:16.009855 13416 raft_consensus.cc:2749] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.011651 13260 raft_consensus.cc:359] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.012626 13260 raft_consensus.cc:385] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.012703 13315 raft_consensus.cc:493] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:16.014402 13105 leader_election.cc:343] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.014532 13315 raft_consensus.cc:515] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:16.014906 13105 leader_election.cc:304] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:16.007195 13508 raft_consensus.cc:2804] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:16.019356 13260 raft_consensus.cc:740] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.019532 13416 raft_consensus.cc:2749] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.024015 13258 tablet_bootstrap.cc:492] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:16.024538 13258 ts_tablet_manager.cc:1403] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.311s	user 0.011s	sys 0.015s
I20260709 13:17:16.028810 13315 leader_election.cc:290] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:16.024459 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5505b452a14d41e1877484ca6696497a" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:16.032766 13068 raft_consensus.cc:2468] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:16.020538 13508 raft_consensus.cc:493] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.033732 13508 raft_consensus.cc:3060] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.039023 13259 tablet_bootstrap.cc:492] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:16.039587 13259 ts_tablet_manager.cc:1403] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.103s	user 0.008s	sys 0.005s
I20260709 13:17:16.039925 13258 raft_consensus.cc:359] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.040715 13258 raft_consensus.cc:385] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.041069 13258 raft_consensus.cc:740] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.041764 13258 consensus_queue.cc:260] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.044155 13258 ts_tablet_manager.cc:1434] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:17:16.048316 13181 leader_election.cc:304] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:16.049223 13260 consensus_queue.cc:260] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.052146 13260 ts_tablet_manager.cc:1434] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260709 13:17:16.056237 13260 tablet_bootstrap.cc:492] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:16.057572 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5505b452a14d41e1877484ca6696497a" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:16.061619 13258 tablet_bootstrap.cc:492] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:16.072280 13370 raft_consensus.cc:493] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.073032 13370 raft_consensus.cc:515] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.073763 13500 raft_consensus.cc:2804] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.074373 13500 raft_consensus.cc:493] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.074797 13500 raft_consensus.cc:3060] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.078157 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c00d97a4f0421d95d71476563154ed" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:16.080919 13370 leader_election.cc:290] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:16.095528 13259 raft_consensus.cc:359] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.096235 13259 raft_consensus.cc:385] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.096537 13259 raft_consensus.cc:740] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.108376 12887 catalog_manager.cc:5697] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.110445 13257 tablet_bootstrap.cc:492] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:16.110956 13257 ts_tablet_manager.cc:1403] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.280s	user 0.011s	sys 0.005s
I20260709 13:17:16.114027 13267 raft_consensus.cc:493] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.114534 13267 raft_consensus.cc:515] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.116662 13267 leader_election.cc:290] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:16.112948 13450 raft_consensus.cc:493] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.117712 13450 raft_consensus.cc:515] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.119796 13450 leader_election.cc:290] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:16.133586 13258 tablet_bootstrap.cc:654] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.150827 13260 tablet_bootstrap.cc:654] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:16.136092 13107 leader_election.cc:343] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.128073 13257 raft_consensus.cc:359] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:16.152454 13257 raft_consensus.cc:385] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.152694 13257 raft_consensus.cc:740] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.129524 12990 raft_consensus.cc:3060] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.125226 13259 consensus_queue.cc:260] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.142275 12992 raft_consensus.cc:3060] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.130071 12991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c00d97a4f0421d95d71476563154ed" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:16.140769 13182 leader_election.cc:343] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.125651 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b872974f73d3469981669da74502740b" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:16.136273 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf41f772abd4db09c73e0c6619642fe" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:16.130829 13141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8526082d24944a48aab1c0d78d626587" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:16.126660 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf41f772abd4db09c73e0c6619642fe" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:16.160056 13215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:16.163018 13259 ts_tablet_manager.cc:1434] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.123s	user 0.007s	sys 0.002s
I20260709 13:17:16.164232 13259 tablet_bootstrap.cc:492] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:16.149526 13370 consensus_queue.cc:1048] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:17:16.157007 13257 consensus_queue.cc:260] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:16.138590 13508 raft_consensus.cc:515] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
W20260709 13:17:16.166507 13031 leader_election.cc:343] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.166790 12989 raft_consensus.cc:1240] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Rejecting Update request from peer c6c79a100f9043f590697441315084ed for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:17:16.167243 13257 ts_tablet_manager.cc:1434] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.002s
I20260709 13:17:16.167762 13508 leader_election.cc:290] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:16.157310 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b872974f73d3469981669da74502740b" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:16.169632 13257 tablet_bootstrap.cc:492] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:16.170099 13065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:16.170732 13065 raft_consensus.cc:3060] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.171669 13259 tablet_bootstrap.cc:654] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:16.174345 13108 leader_election.cc:343] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.174834 13108 leader_election.cc:304] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
W20260709 13:17:16.175694 13033 leader_election.cc:343] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.176169 13033 leader_election.cc:304] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed
W20260709 13:17:16.177307 13181 leader_election.cc:343] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.177561 13413 raft_consensus.cc:2749] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.181016 13338 raft_consensus.cc:2749] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.187337 13513 consensus_queue.cc:1048] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:16.194937 13500 raft_consensus.cc:515] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.197685 13500 leader_election.cc:290] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:16.199867 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8526082d24944a48aab1c0d78d626587" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:16.201225 13257 tablet_bootstrap.cc:654] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:16.210421 13182 leader_election.cc:343] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.211145 13182 leader_election.cc:304] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:16.212491 13370 raft_consensus.cc:2749] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.211588 13338 raft_consensus.cc:493] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.220717 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:16.226433 13370 consensus_queue.cc:1059] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.227339 13370 raft_consensus.cc:3055] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:16.227667 13370 raft_consensus.cc:740] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:16.217824 12891 catalog_manager.cc:5697] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 0 to 1, leader changed from <none> to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.236896 13258 tablet_bootstrap.cc:492] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:16.237636 13258 ts_tablet_manager.cc:1403] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.193s	user 0.007s	sys 0.017s
I20260709 13:17:16.241521 13258 raft_consensus.cc:359] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.242240 13258 raft_consensus.cc:385] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.242498 13258 raft_consensus.cc:740] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.243250 13259 tablet_bootstrap.cc:492] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:16.243170 13258 consensus_queue.cc:260] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.243745 13259 ts_tablet_manager.cc:1403] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.000s
I20260709 13:17:16.228535 13370 consensus_queue.cc:260] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.245625 13257 tablet_bootstrap.cc:492] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:16.246088 13257 ts_tablet_manager.cc:1403] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.007s
I20260709 13:17:16.245184 13370 raft_consensus.cc:3060] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.223573 13338 raft_consensus.cc:515] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.250779 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5505b452a14d41e1877484ca6696497a" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:16.255813 12956 leader_election.cc:304] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed
I20260709 13:17:16.256858 13513 consensus_queue.cc:1048] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.254777 13068 raft_consensus.cc:3060] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.261651 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720ddf9396de4255ba8105124c624739" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:16.262373 13212 raft_consensus.cc:2468] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:16.265439 12987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720ddf9396de4255ba8105124c624739" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:16.265640 13031 leader_election.cc:304] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:16.266708 12991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5505b452a14d41e1877484ca6696497a" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:16.266858 13483 raft_consensus.cc:2804] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.267300 13483 raft_consensus.cc:493] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.254385 13065 raft_consensus.cc:2468] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:16.267676 13483 raft_consensus.cc:3060] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.268546 13067 raft_consensus.cc:1240] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Rejecting Update request from peer c6c79a100f9043f590697441315084ed for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:17:16.269830 13258 ts_tablet_manager.cc:1434] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:17:16.271862 13259 raft_consensus.cc:359] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.272573 13259 raft_consensus.cc:385] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.272861 13259 raft_consensus.cc:740] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.273537 12958 leader_election.cc:304] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18; no voters: 
I20260709 13:17:16.274410 13333 raft_consensus.cc:2804] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:16.274322 13259 consensus_queue.cc:260] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.274955 13333 raft_consensus.cc:697] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:16.276291 13259 ts_tablet_manager.cc:1434] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.001s
I20260709 13:17:16.275874 13333 consensus_queue.cc:237] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.274150 13260 tablet_bootstrap.cc:492] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:16.280061 13260 ts_tablet_manager.cc:1403] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.227s	user 0.025s	sys 0.010s
I20260709 13:17:16.257051 13338 leader_election.cc:290] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
W20260709 13:17:16.287081 13182 leader_election.cc:343] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.295575 13259 tablet_bootstrap.cc:492] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:16.300695 13258 tablet_bootstrap.cc:492] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:16.298525 13068 raft_consensus.cc:2468] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:16.308856 13181 leader_election.cc:304] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:16.313314 13508 raft_consensus.cc:2749] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.310685 13257 raft_consensus.cc:359] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.319224 13257 raft_consensus.cc:385] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.319500 13257 raft_consensus.cc:740] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.320320 13257 consensus_queue.cc:260] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.311951 13500 raft_consensus.cc:2804] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.321218 12987 raft_consensus.cc:2468] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:16.321707 13500 raft_consensus.cc:697] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:16.322574 13500 consensus_queue.cc:237] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.323881 13257 ts_tablet_manager.cc:1434] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.078s	user 0.004s	sys 0.003s
I20260709 13:17:16.325106 13257 tablet_bootstrap.cc:492] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:16.313370 13260 raft_consensus.cc:359] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.325886 13260 raft_consensus.cc:385] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.326529 13260 raft_consensus.cc:740] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.314507 13483 raft_consensus.cc:515] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.348249 13483 leader_election.cc:290] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:16.349035 13260 consensus_queue.cc:260] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.356124 13257 tablet_bootstrap.cc:654] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.360198 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720ddf9396de4255ba8105124c624739" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:16.360869 13209 raft_consensus.cc:3060] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.361515 13450 consensus_queue.cc:1048] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.362383 13258 tablet_bootstrap.cc:654] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.373783 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720ddf9396de4255ba8105124c624739" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:16.374437 12990 raft_consensus.cc:3060] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.374856 13260 ts_tablet_manager.cc:1434] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.000s
I20260709 13:17:16.376538 13260 tablet_bootstrap.cc:492] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:16.382035 13450 consensus_queue.cc:1048] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.407406 13259 tablet_bootstrap.cc:654] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.415460 12990 raft_consensus.cc:2468] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:16.419109 13508 raft_consensus.cc:493] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.420125 13500 raft_consensus.cc:493] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.428311 13260 tablet_bootstrap.cc:654] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.422780 13034 leader_election.cc:304] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18; no voters: 
I20260709 13:17:16.431346 13450 raft_consensus.cc:2804] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.431839 13450 raft_consensus.cc:697] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:16.432315 13508 raft_consensus.cc:515] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:16.434486 13508 leader_election.cc:290] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:16.435930 13209 raft_consensus.cc:2468] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:16.437759 13500 raft_consensus.cc:515] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.439975 13500 leader_election.cc:290] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:16.442193 13141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:16.443069 13141 raft_consensus.cc:2393] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66218fb7f83e41ffa427b95015c3bf18 in current term 1: Already voted for candidate c538e5be22524c9a970f7a59c5379288 in this term.
I20260709 13:17:16.443491 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:16.444344 13067 raft_consensus.cc:2393] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66218fb7f83e41ffa427b95015c3bf18 in current term 1: Already voted for candidate 293c23c890764727a91d599e0d75604f in this term.
I20260709 13:17:16.446987 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50831cc643d24f00880db6263d32d280" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:16.447847 12958 leader_election.cc:304] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:16.452997 13267 raft_consensus.cc:3060] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:16.454710 13182 leader_election.cc:343] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.456418 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50831cc643d24f00880db6263d32d280" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:16.450613 12891 catalog_manager.cc:5697] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.461390 13258 tablet_bootstrap.cc:492] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:16.462036 13258 ts_tablet_manager.cc:1403] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.175s	user 0.014s	sys 0.009s
I20260709 13:17:16.449328 12886 catalog_manager.cc:5697] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 1 to 2, leader changed from c6c79a100f9043f590697441315084ed (127.4.254.4) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.459672 13140 raft_consensus.cc:2468] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:16.442812 13450 consensus_queue.cc:237] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.471246 13181 leader_election.cc:304] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:16.472982 13500 raft_consensus.cc:2804] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:17:16.473174 13528 log.cc:927] Time spent T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:17:16.473620 13500 raft_consensus.cc:493] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.474215 13500 raft_consensus.cc:3060] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.495510 13267 raft_consensus.cc:2749] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.521450 13260 tablet_bootstrap.cc:492] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:16.522240 13260 ts_tablet_manager.cc:1403] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.146s	user 0.013s	sys 0.030s
I20260709 13:17:16.516433 13258 raft_consensus.cc:359] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.526144 13258 raft_consensus.cc:385] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.526539 13258 raft_consensus.cc:740] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.527285 13259 tablet_bootstrap.cc:492] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:16.527947 13259 ts_tablet_manager.cc:1403] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.233s	user 0.023s	sys 0.041s
I20260709 13:17:16.531183 13511 raft_consensus.cc:493] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.531714 13511 raft_consensus.cc:515] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.531456 13258 consensus_queue.cc:260] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.533571 13260 raft_consensus.cc:359] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.534536 13260 raft_consensus.cc:385] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.534853 13511 leader_election.cc:290] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:16.536450 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045d0ee1dab4622a49c705aec5c2168" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:16.541512 13258 ts_tablet_manager.cc:1434] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.079s	user 0.010s	sys 0.000s
I20260709 13:17:16.542037 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045d0ee1dab4622a49c705aec5c2168" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
W20260709 13:17:16.546131 13105 leader_election.cc:343] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.534881 13260 raft_consensus.cc:740] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.542568 13259 raft_consensus.cc:359] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.548220 13259 raft_consensus.cc:385] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.548520 13259 raft_consensus.cc:740] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.550379 13257 tablet_bootstrap.cc:492] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:16.549211 13260 consensus_queue.cc:260] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.551962 13068 raft_consensus.cc:2468] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:16.550997 13258 tablet_bootstrap.cc:492] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:16.555896 13107 leader_election.cc:304] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: c6c79a100f9043f590697441315084ed
I20260709 13:17:16.557380 13416 raft_consensus.cc:2804] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.557757 13416 raft_consensus.cc:493] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.558094 13416 raft_consensus.cc:3060] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.562443 13500 raft_consensus.cc:515] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.564662 13500 leader_election.cc:290] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:16.565924 13141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50831cc643d24f00880db6263d32d280" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:16.566636 13141 raft_consensus.cc:3060] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.551136 13257 ts_tablet_manager.cc:1403] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.226s	user 0.008s	sys 0.015s
I20260709 13:17:16.573019 13258 tablet_bootstrap.cc:654] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.569283 13259 consensus_queue.cc:260] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.575042 13259 ts_tablet_manager.cc:1434] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.001s
I20260709 13:17:16.576059 13259 tablet_bootstrap.cc:492] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:16.567982 13416 raft_consensus.cc:515] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.572892 13257 raft_consensus.cc:359] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.570698 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50831cc643d24f00880db6263d32d280" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:16.593032 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045d0ee1dab4622a49c705aec5c2168" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:16.593358 13257 raft_consensus.cc:385] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.593744 13064 raft_consensus.cc:3060] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.593865 13257 raft_consensus.cc:740] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.589100 13511 raft_consensus.cc:493] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.594866 13257 consensus_queue.cc:260] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.595764 13511 raft_consensus.cc:515] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.596182 12990 raft_consensus.cc:3060] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.598707 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581bf3becdab4773845a749f01ae77cf" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:16.599614 13511 leader_election.cc:290] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:16.590206 13260 ts_tablet_manager.cc:1434] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 13:17:16.591739 13141 raft_consensus.cc:2468] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:16.588994 13500 raft_consensus.cc:493] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.601104 13416 leader_election.cc:290] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
W20260709 13:17:16.600975 13105 leader_election.cc:343] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.601784 12987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581bf3becdab4773845a749f01ae77cf" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:16.607502 13260 tablet_bootstrap.cc:492] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:16.609144 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045d0ee1dab4622a49c705aec5c2168" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
W20260709 13:17:16.609203 13108 leader_election.cc:343] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.609961 13108 leader_election.cc:304] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
W20260709 13:17:16.610744 13105 leader_election.cc:343] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.613233 13181 leader_election.cc:304] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:16.612295 13416 raft_consensus.cc:2749] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.614506 13484 raft_consensus.cc:2804] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.617578 13484 raft_consensus.cc:697] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:16.618496 13484 consensus_queue.cc:237] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.619397 12990 raft_consensus.cc:2468] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:16.621912 13260 tablet_bootstrap.cc:654] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.614837 13258 tablet_bootstrap.cc:492] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:16.624542 13258 ts_tablet_manager.cc:1403] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.001s
I20260709 13:17:16.627624 13370 raft_consensus.cc:493] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.628196 13370 raft_consensus.cc:515] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.611608 13500 raft_consensus.cc:515] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.606882 12887 catalog_manager.cc:5697] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:16.616073 13064 raft_consensus.cc:2468] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:16.633870 13500 leader_election.cc:290] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:16.634130 13107 leader_election.cc:304] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: c6c79a100f9043f590697441315084ed
I20260709 13:17:16.636260 12987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7205bc9d20124044a1f1e9be55845ed6" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:16.637042 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9cc31f16c2467c84113f244fcea75f" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:16.637867 13068 raft_consensus.cc:2468] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:16.638654 13510 raft_consensus.cc:2804] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.639215 13510 raft_consensus.cc:697] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:16.640022 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9cc31f16c2467c84113f244fcea75f" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:16.640120 13510 consensus_queue.cc:237] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.640872 13140 raft_consensus.cc:2468] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:16.630767 13370 leader_election.cc:290] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:16.631500 13141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7205bc9d20124044a1f1e9be55845ed6" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:16.630211 13259 tablet_bootstrap.cc:654] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:16.637902 13182 leader_election.cc:343] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.630692 13258 raft_consensus.cc:359] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.641650 12891 catalog_manager.cc:5697] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.644361 13258 raft_consensus.cc:385] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.644761 13258 raft_consensus.cc:740] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.650079 13258 consensus_queue.cc:260] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.652837 13258 ts_tablet_manager.cc:1434] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.005s
I20260709 13:17:16.647405 13181 leader_election.cc:304] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:16.655210 13258 tablet_bootstrap.cc:492] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:16.656149 13257 ts_tablet_manager.cc:1434] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.001s
I20260709 13:17:16.656924 13511 raft_consensus.cc:493] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.668730 13511 raft_consensus.cc:515] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.674064 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf41f772abd4db09c73e0c6619642fe" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:16.674993 13068 raft_consensus.cc:2468] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:16.647711 13141 raft_consensus.cc:2468] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:16.660945 13370 raft_consensus.cc:2804] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.682101 13370 raft_consensus.cc:493] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.682462 13370 raft_consensus.cc:3060] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.686143 13214 raft_consensus.cc:1275] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:17:16.686590 13214 pending_rounds.cc:85] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed: Aborting all ops after (but not including) 0
I20260709 13:17:16.686841 13214 pending_rounds.cc:107] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:17:16.687126 13214 raft_consensus.cc:2889] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.688254 13107 leader_election.cc:304] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:16.688668 13258 tablet_bootstrap.cc:654] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.689498 13181 leader_election.cc:304] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:16.689615 13267 consensus_queue.cc:1048] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:16.693017 12886 catalog_manager.cc:5697] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 0 to 1, leader changed from <none> to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.694630 13511 leader_election.cc:290] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:16.694810 13484 raft_consensus.cc:2804] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.700428 13484 raft_consensus.cc:493] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.700909 13484 raft_consensus.cc:3060] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.694649 13416 raft_consensus.cc:2804] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.713529 13416 raft_consensus.cc:493] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.713893 13257 tablet_bootstrap.cc:492] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:16.713945 13416 raft_consensus.cc:3060] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.711833 13260 tablet_bootstrap.cc:492] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:16.716217 13260 ts_tablet_manager.cc:1403] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.110s	user 0.017s	sys 0.007s
I20260709 13:17:16.719007 13260 raft_consensus.cc:359] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.719707 13260 raft_consensus.cc:385] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.719985 13260 raft_consensus.cc:740] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.720667 13260 consensus_queue.cc:260] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.723172 13260 ts_tablet_manager.cc:1434] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:16.725490 13260 tablet_bootstrap.cc:492] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
W20260709 13:17:16.732859 12939 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:16.736991 13258 tablet_bootstrap.cc:492] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:16.739511 13484 raft_consensus.cc:515] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.740446 13258 ts_tablet_manager.cc:1403] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.032s
I20260709 13:17:16.738035 13416 raft_consensus.cc:515] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.739856 13257 tablet_bootstrap.cc:654] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.745777 13260 tablet_bootstrap.cc:654] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.748836 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf41f772abd4db09c73e0c6619642fe" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:16.768287 13259 tablet_bootstrap.cc:492] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:16.768741 13259 ts_tablet_manager.cc:1403] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.193s	user 0.016s	sys 0.009s
I20260709 13:17:16.769582 13258 raft_consensus.cc:359] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:16.770217 13141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7205bc9d20124044a1f1e9be55845ed6" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:16.770444 13258 raft_consensus.cc:385] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.770282 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7205bc9d20124044a1f1e9be55845ed6" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:16.770974 13258 raft_consensus.cc:740] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.770999 13141 raft_consensus.cc:3060] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:16.771955 13182 leader_election.cc:343] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:16.773082 13105 leader_election.cc:343] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.773023 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf41f772abd4db09c73e0c6619642fe" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:16.766005 13370 raft_consensus.cc:515] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.775825 13064 raft_consensus.cc:3060] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.778669 13257 tablet_bootstrap.cc:492] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:16.779314 13257 ts_tablet_manager.cc:1403] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.002s
I20260709 13:17:16.782307 13068 raft_consensus.cc:1275] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:16.782321 13257 raft_consensus.cc:359] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.783233 13064 raft_consensus.cc:2468] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:16.783411 13257 raft_consensus.cc:385] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.784258 13508 consensus_queue.cc:1048] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.784543 13107 leader_election.cc:304] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:16.783866 13257 raft_consensus.cc:740] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.785805 13511 raft_consensus.cc:2804] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.786329 13511 raft_consensus.cc:697] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:16.786913 13257 consensus_queue.cc:260] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.787163 13511 consensus_queue.cc:237] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.767552 13484 leader_election.cc:290] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:16.789013 13141 raft_consensus.cc:2468] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:16.790194 13258 consensus_queue.cc:260] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:16.792430 13258 ts_tablet_manager.cc:1434] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.000s
I20260709 13:17:16.793488 13258 tablet_bootstrap.cc:492] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:16.796692 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf41f772abd4db09c73e0c6619642fe" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:16.775434 13416 leader_election.cc:290] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:16.799906 13259 raft_consensus.cc:359] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.800663 13259 raft_consensus.cc:385] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.800959 13259 raft_consensus.cc:740] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.804994 13370 leader_election.cc:290] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:16.805528 13257 ts_tablet_manager.cc:1434] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:17:16.801661 13259 consensus_queue.cc:260] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.815961 13483 raft_consensus.cc:493] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.816829 13483 raft_consensus.cc:515] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.818463 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9cc31f16c2467c84113f244fcea75f" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:16.818986 13181 leader_election.cc:304] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:16.819229 13483 leader_election.cc:290] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:16.819082 13068 raft_consensus.cc:3060] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.819834 13484 raft_consensus.cc:2804] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.820334 13484 raft_consensus.cc:697] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:16.821097 13484 consensus_queue.cc:237] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
W20260709 13:17:16.822266 13105 leader_election.cc:343] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.824297 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9cc31f16c2467c84113f244fcea75f" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:16.828102 13257 tablet_bootstrap.cc:492] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:16.824211 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b872974f73d3469981669da74502740b" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:16.833433 13140 raft_consensus.cc:3060] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.835501 13259 ts_tablet_manager.cc:1434] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.000s
I20260709 13:17:16.837841 13259 tablet_bootstrap.cc:492] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:16.838008 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b872974f73d3469981669da74502740b" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:16.846619 13068 raft_consensus.cc:2468] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:16.833180 12891 catalog_manager.cc:5697] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 0 to 1, leader changed from <none> to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.857237 13258 tablet_bootstrap.cc:654] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.833439 13209 raft_consensus.cc:2468] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:16.859287 13031 leader_election.cc:304] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:16.850617 13511 raft_consensus.cc:493] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.860342 13511 raft_consensus.cc:515] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:16.860685 13181 leader_election.cc:304] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:16.860615 13450 raft_consensus.cc:2804] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.864491 13450 raft_consensus.cc:493] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.865875 13450 raft_consensus.cc:3060] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.870034 13500 raft_consensus.cc:2804] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.873764 13500 raft_consensus.cc:697] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:16.874652 13500 consensus_queue.cc:237] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:16.894905 12886 catalog_manager.cc:5697] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.904343 13511 leader_election.cc:290] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
W20260709 13:17:16.889174 12956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:36179, user_credentials={real_user=slave}} blocked reactor thread for 53710.2us
I20260709 13:17:16.908088 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b13e68f1bda46e6afb535f52545dc00" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:16.910079 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b13e68f1bda46e6afb535f52545dc00" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
W20260709 13:17:16.912418 13108 leader_election.cc:343] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:16.918114 13107 leader_election.cc:343] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.918596 13107 leader_election.cc:304] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:16.919090 13140 raft_consensus.cc:2468] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:16.920730 13416 raft_consensus.cc:2749] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.921172 13450 raft_consensus.cc:515] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:16.921209 13483 consensus_queue.cc:1048] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:16.927953 13257 tablet_bootstrap.cc:654] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.923673 13260 tablet_bootstrap.cc:492] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:16.928725 13260 ts_tablet_manager.cc:1403] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.203s	user 0.014s	sys 0.008s
W20260709 13:17:16.935700 13034 leader_election.cc:343] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.937758 13450 leader_election.cc:290] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:16.938143 13258 tablet_bootstrap.cc:492] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:16.938643 13258 ts_tablet_manager.cc:1403] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.145s	user 0.034s	sys 0.007s
I20260709 13:17:16.944784 13260 raft_consensus.cc:359] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:16.946888 13260 raft_consensus.cc:385] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.947073 13260 raft_consensus.cc:740] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.952350 13259 tablet_bootstrap.cc:654] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.954137 12991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b872974f73d3469981669da74502740b" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:16.949242 13260 consensus_queue.cc:260] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:16.959340 13258 raft_consensus.cc:359] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:16.961491 13258 raft_consensus.cc:385] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.961733 13258 raft_consensus.cc:740] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.963349 13258 consensus_queue.cc:260] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:16.966723 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b872974f73d3469981669da74502740b" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:16.967398 13207 raft_consensus.cc:3060] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.970019 13258 ts_tablet_manager.cc:1434] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:17:16.973575 13551 raft_consensus.cc:493] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.974138 13551 raft_consensus.cc:515] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:16.975065 13207 raft_consensus.cc:2468] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:16.977051 13141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7205bc9d20124044a1f1e9be55845ed6" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:16.977864 13141 raft_consensus.cc:2393] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66218fb7f83e41ffa427b95015c3bf18 in current term 1: Already voted for candidate c6c79a100f9043f590697441315084ed in this term.
I20260709 13:17:16.978181 13551 leader_election.cc:290] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
W20260709 13:17:16.980281 13182 consensus_peers.cc:597] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.981545 13484 consensus_queue.cc:1048] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:16.984915 13258 tablet_bootstrap.cc:492] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:16.985945 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7205bc9d20124044a1f1e9be55845ed6" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:16.987107 13031 leader_election.cc:304] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:16.988368 12956 leader_election.cc:304] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed
I20260709 13:17:16.990481 13260 ts_tablet_manager.cc:1434] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.061s	user 0.002s	sys 0.005s
W20260709 13:17:16.997489 13034 leader_election.cc:343] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.001151 13551 raft_consensus.cc:3060] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.004197 13557 raft_consensus.cc:2804] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:17.007419 13557 raft_consensus.cc:697] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:17.006536 13260 tablet_bootstrap.cc:492] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:17.012518 13551 raft_consensus.cc:2749] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.004190 13258 tablet_bootstrap.cc:654] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.008761 13557 consensus_queue.cc:237] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.021607 12886 catalog_manager.cc:5697] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:17.039744 13259 tablet_bootstrap.cc:492] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:17.040283 13259 ts_tablet_manager.cc:1403] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.203s	user 0.035s	sys 0.026s
I20260709 13:17:17.033638 13511 raft_consensus.cc:493] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.041561 13511 raft_consensus.cc:515] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:17.042989 13259 raft_consensus.cc:359] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.043673 13259 raft_consensus.cc:385] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.043968 13259 raft_consensus.cc:740] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.046520 13511 leader_election.cc:290] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:17.048112 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405efda88e2475f9916d4e89499e058" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:17.048225 12991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405efda88e2475f9916d4e89499e058" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:17.049914 13257 tablet_bootstrap.cc:492] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:17.050457 13257 ts_tablet_manager.cc:1403] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.223s	user 0.017s	sys 0.013s
I20260709 13:17:17.044596 13259 consensus_queue.cc:260] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
W20260709 13:17:17.051322 13105 leader_election.cc:343] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.057906 13260 tablet_bootstrap.cc:654] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:17.058442 13108 leader_election.cc:343] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.059928 13108 leader_election.cc:304] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:17.061842 13388 consensus_queue.cc:1048] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.062139 13510 raft_consensus.cc:2749] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.064643 13259 ts_tablet_manager.cc:1434] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:17:17.066028 13259 tablet_bootstrap.cc:492] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:17.082134 13259 tablet_bootstrap.cc:654] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.090925 13260 tablet_bootstrap.cc:492] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:17.091457 13258 tablet_bootstrap.cc:492] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:17.091554 13260 ts_tablet_manager.cc:1403] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.003s
I20260709 13:17:17.092031 13258 ts_tablet_manager.cc:1403] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.107s	user 0.011s	sys 0.006s
I20260709 13:17:17.094851 13258 raft_consensus.cc:359] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.095127 13510 raft_consensus.cc:493] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.084812 13257 raft_consensus.cc:359] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.095693 13510 raft_consensus.cc:515] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.096236 13257 raft_consensus.cc:385] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.096576 13257 raft_consensus.cc:740] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.097414 13257 consensus_queue.cc:260] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.100373 13510 leader_election.cc:290] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:17.100955 13258 raft_consensus.cc:385] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.101289 13258 raft_consensus.cc:740] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.102154 13258 consensus_queue.cc:260] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.104532 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f9fea2974209a5a12e4f4d3e07ea" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
W20260709 13:17:17.106065 13107 leader_election.cc:343] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.100669 13257 ts_tablet_manager.cc:1434] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:17:17.108388 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f9fea2974209a5a12e4f4d3e07ea" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:17.108644 13257 tablet_bootstrap.cc:492] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
W20260709 13:17:17.109805 13108 leader_election.cc:343] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.110255 13108 leader_election.cc:304] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:17.111337 13511 raft_consensus.cc:2749] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.104557 13258 ts_tablet_manager.cc:1434] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:17:17.114727 13258 tablet_bootstrap.cc:492] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:17.115695 13260 raft_consensus.cc:359] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.117365 13260 raft_consensus.cc:385] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.117726 13260 raft_consensus.cc:740] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.126307 13260 consensus_queue.cc:260] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.127420 13259 tablet_bootstrap.cc:492] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:17.127928 13259 ts_tablet_manager.cc:1403] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.003s
I20260709 13:17:17.120227 12890 catalog_manager.cc:5697] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:17.129038 13260 ts_tablet_manager.cc:1434] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.003s
I20260709 13:17:17.130172 13260 tablet_bootstrap.cc:492] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:17.130661 13259 raft_consensus.cc:359] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:17.131333 13259 raft_consensus.cc:385] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.131608 13259 raft_consensus.cc:740] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.132256 13259 consensus_queue.cc:260] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:17.124238 13258 tablet_bootstrap.cc:654] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.134757 13259 ts_tablet_manager.cc:1434] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:17.139900 13370 consensus_queue.cc:1048] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.143596 13260 tablet_bootstrap.cc:654] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.154078 13551 raft_consensus.cc:493] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.154760 13551 raft_consensus.cc:515] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.157354 13551 leader_election.cc:290] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:17.159569 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5505b452a14d41e1877484ca6696497a" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:17.160306 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5505b452a14d41e1877484ca6696497a" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:17.162081 13257 tablet_bootstrap.cc:654] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.163641 13259 tablet_bootstrap.cc:492] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:17.167119 13258 tablet_bootstrap.cc:492] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:17.167677 13258 ts_tablet_manager.cc:1403] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.012s
W20260709 13:17:17.170132 13105 consensus_peers.cc:597] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 -> Peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Couldn't send request to peer c6c79a100f9043f590697441315084ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:17.171015 12956 leader_election.cc:304] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed
I20260709 13:17:17.172029 13551 raft_consensus.cc:2749] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.172079 13258 raft_consensus.cc:359] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.173607 13258 raft_consensus.cc:385] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.173935 13258 raft_consensus.cc:740] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.174770 13258 consensus_queue.cc:260] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.177654 13370 consensus_queue.cc:1048] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.178691 13259 tablet_bootstrap.cc:654] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.179271 13258 ts_tablet_manager.cc:1434] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 13:17:17.180465 13258 tablet_bootstrap.cc:492] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:17.183347 13260 tablet_bootstrap.cc:492] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:17.183876 13260 ts_tablet_manager.cc:1403] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.012s
I20260709 13:17:17.184365 13259 tablet_bootstrap.cc:492] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:17.184871 13259 ts_tablet_manager.cc:1403] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.002s
I20260709 13:17:17.186800 13260 raft_consensus.cc:359] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.187485 13259 raft_consensus.cc:359] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.187530 13260 raft_consensus.cc:385] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.188171 13259 raft_consensus.cc:385] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.188643 13260 raft_consensus.cc:740] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.188654 13259 raft_consensus.cc:740] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.189662 13259 consensus_queue.cc:260] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.189831 13260 consensus_queue.cc:260] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.194574 13258 tablet_bootstrap.cc:654] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.196774 13259 ts_tablet_manager.cc:1434] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:17:17.197839 13259 tablet_bootstrap.cc:492] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:17.204386 13260 ts_tablet_manager.cc:1434] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:17:17.205687 13260 tablet_bootstrap.cc:492] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:17.206489 13259 tablet_bootstrap.cc:654] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.209956 13510 raft_consensus.cc:493] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.210644 13510 raft_consensus.cc:515] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.214869 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b9b7d6e83f4063b1a0214df6346486" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:17.216737 13108 leader_election.cc:343] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.219003 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b9b7d6e83f4063b1a0214df6346486" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
W20260709 13:17:17.220558 13107 leader_election.cc:343] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.221160 13107 leader_election.cc:304] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:17.226097 13511 raft_consensus.cc:2749] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.233590 13510 leader_election.cc:290] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:17.243510 13260 tablet_bootstrap.cc:654] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.261327 13258 tablet_bootstrap.cc:492] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:17.261859 13258 ts_tablet_manager.cc:1403] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.018s
I20260709 13:17:17.265115 13258 raft_consensus.cc:359] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.266001 13258 raft_consensus.cc:385] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.266258 13258 raft_consensus.cc:740] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.266933 13258 consensus_queue.cc:260] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.269057 13258 ts_tablet_manager.cc:1434] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:17.269383 13511 consensus_queue.cc:1048] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.271276 13258 tablet_bootstrap.cc:492] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:17.275513 13324 raft_consensus.cc:493] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.276017 13324 raft_consensus.cc:515] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.278060 13484 raft_consensus.cc:493] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.278662 13258 tablet_bootstrap.cc:654] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.280717 13260 tablet_bootstrap.cc:492] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:17.278582 13484 raft_consensus.cc:515] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.281239 13260 ts_tablet_manager.cc:1403] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.000s
I20260709 13:17:17.280915 13259 tablet_bootstrap.cc:492] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:17.284188 13259 ts_tablet_manager.cc:1403] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.025s
I20260709 13:17:17.285871 13260 raft_consensus.cc:359] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.286566 13260 raft_consensus.cc:385] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.286849 13260 raft_consensus.cc:740] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.286945 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639492da5d6a4c6baaf3d0b8f30f76b9" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:17.287510 13260 consensus_queue.cc:260] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.287540 13068 raft_consensus.cc:2468] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:17.289858 13181 leader_election.cc:304] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:17.291654 13500 raft_consensus.cc:2804] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.293653 13260 ts_tablet_manager.cc:1434] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:17:17.291785 13259 raft_consensus.cc:359] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:17.294835 13500 raft_consensus.cc:493] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.295456 13500 raft_consensus.cc:3060] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.295106 13259 raft_consensus.cc:385] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.296473 13259 raft_consensus.cc:740] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.297840 13259 consensus_queue.cc:260] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:17.302189 13259 ts_tablet_manager.cc:1434] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:17:17.294696 13260 tablet_bootstrap.cc:492] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:17.302280 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf41f772abd4db09c73e0c6619642fe" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:17.313731 13510 consensus_queue.cc:1048] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:17.321105 13259 tablet_bootstrap.cc:492] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:17.322042 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf41f772abd4db09c73e0c6619642fe" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:17.283257 13484 leader_election.cc:290] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:17.297848 13324 leader_election.cc:290] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:17.332387 13260 tablet_bootstrap.cc:654] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.329039 13259 tablet_bootstrap.cc:654] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.366253 13260 tablet_bootstrap.cc:492] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:17.366937 13260 ts_tablet_manager.cc:1403] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.000s
I20260709 13:17:17.383497 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639492da5d6a4c6baaf3d0b8f30f76b9" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:17.384685 13259 tablet_bootstrap.cc:492] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:17.385423 13259 ts_tablet_manager.cc:1403] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.004s
I20260709 13:17:17.390512 13260 raft_consensus.cc:359] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.391595 13260 raft_consensus.cc:385] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.391971 13260 raft_consensus.cc:740] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.392881 13260 consensus_queue.cc:260] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.345176 13181 leader_election.cc:304] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:17.397783 13324 raft_consensus.cc:2749] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:17.399708 13181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:36831, user_credentials={real_user=slave}} blocked reactor thread for 54647.8us
I20260709 13:17:17.399863 13260 ts_tablet_manager.cc:1434] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:17:17.401558 13260 tablet_bootstrap.cc:492] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:17.411109 13324 consensus_queue.cc:1048] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.422410 13557 raft_consensus.cc:493] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.423025 13557 raft_consensus.cc:515] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.425207 13259 raft_consensus.cc:359] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.425901 13259 raft_consensus.cc:385] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.426172 13259 raft_consensus.cc:740] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.426731 13557 leader_election.cc:290] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:17.428311 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c00d97a4f0421d95d71476563154ed" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:17.426816 13259 consensus_queue.cc:260] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.430984 13259 ts_tablet_manager.cc:1434] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.045s	user 0.011s	sys 0.001s
I20260709 13:17:17.429555 13138 raft_consensus.cc:2468] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:17.432065 13259 tablet_bootstrap.cc:492] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:17.432525 13033 leader_election.cc:304] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:17.434366 13388 raft_consensus.cc:2804] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.434701 13388 raft_consensus.cc:493] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.435019 13388 raft_consensus.cc:3060] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.435742 13260 tablet_bootstrap.cc:654] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.444975 13416 raft_consensus.cc:493] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.445914 13416 raft_consensus.cc:515] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.452772 13416 leader_election.cc:290] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:17.463846 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f853a78f0704cbea0a4794c62412b27" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:17.460913 13260 tablet_bootstrap.cc:492] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
W20260709 13:17:17.465270 13107 leader_election.cc:343] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.468277 13259 tablet_bootstrap.cc:654] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.465641 13260 ts_tablet_manager.cc:1403] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.000s
I20260709 13:17:17.470973 13500 raft_consensus.cc:515] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.482203 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c00d97a4f0421d95d71476563154ed" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:17.476773 13450 raft_consensus.cc:493] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.474016 13260 raft_consensus.cc:359] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.483863 13260 raft_consensus.cc:385] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.483065 13450 raft_consensus.cc:515] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.484251 13260 raft_consensus.cc:740] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.487649 13260 consensus_queue.cc:260] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.488355 13450 leader_election.cc:290] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:17.489794 13260 ts_tablet_manager.cc:1434] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:17:17.491003 13260 tablet_bootstrap.cc:492] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:17.473101 13500 leader_election.cc:290] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:17.501549 13388 raft_consensus.cc:515] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.510313 13214 raft_consensus.cc:3060] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.496482 13450 consensus_queue.cc:1048] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:17:17.503079 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b13e68f1bda46e6afb535f52545dc00" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:17.513525 13324 raft_consensus.cc:493] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.519143 13557 raft_consensus.cc:493] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.519827 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b13e68f1bda46e6afb535f52545dc00" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
W20260709 13:17:17.520550 13182 leader_election.cc:343] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.523021 13260 tablet_bootstrap.cc:654] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.529299 13324 raft_consensus.cc:515] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.529968 13557 raft_consensus.cc:515] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.530730 13140 raft_consensus.cc:2468] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:17.533084 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c00d97a4f0421d95d71476563154ed" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:17.529855 13388 leader_election.cc:290] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:17.547609 13257 tablet_bootstrap.cc:492] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:17.550619 13258 tablet_bootstrap.cc:492] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:17.556790 13257 ts_tablet_manager.cc:1403] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.448s	user 0.119s	sys 0.109s
I20260709 13:17:17.556799 13258 ts_tablet_manager.cc:1403] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.286s	user 0.072s	sys 0.116s
I20260709 13:17:17.559168 13138 raft_consensus.cc:3060] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.562335 13324 leader_election.cc:290] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:17.565333 13416 raft_consensus.cc:493] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.565891 13416 raft_consensus.cc:515] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.568109 13416 leader_election.cc:290] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:17.569591 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639492da5d6a4c6baaf3d0b8f30f76b9" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:17.572160 13557 leader_election.cc:290] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:17.556545 13450 raft_consensus.cc:493] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.576092 13450 raft_consensus.cc:515] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.576372 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1005312f5ba04344b9dd149ba865a121" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:17.580530 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f853a78f0704cbea0a4794c62412b27" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
W20260709 13:17:17.560308 13034 leader_election.cc:343] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.583355 13259 tablet_bootstrap.cc:492] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:17.552320 13484 consensus_queue.cc:1048] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 13:17:17.583703 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8bbf6cae584ed28932e79f625a4026" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:17.583921 13259 ts_tablet_manager.cc:1403] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.152s	user 0.020s	sys 0.030s
I20260709 13:17:17.580945 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8bbf6cae584ed28932e79f625a4026" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:17.591105 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639492da5d6a4c6baaf3d0b8f30f76b9" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:17.591207 13209 raft_consensus.cc:2468] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
W20260709 13:17:17.583334 13034 consensus_peers.cc:597] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:17.591920 13067 raft_consensus.cc:3060] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:17.583351 13107 leader_election.cc:343] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.603408 12987 raft_consensus.cc:3060] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:17.603503 13182 leader_election.cc:343] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.607353 13258 raft_consensus.cc:359] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.608959 13258 raft_consensus.cc:385] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.609335 13258 raft_consensus.cc:740] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.595587 13033 leader_election.cc:304] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:17.613476 13450 leader_election.cc:290] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:17.614679 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c00d97a4f0421d95d71476563154ed" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:17.614805 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1005312f5ba04344b9dd149ba865a121" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:17.614579 13258 consensus_queue.cc:260] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.617605 13258 ts_tablet_manager.cc:1434] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.000s
I20260709 13:17:17.621696 13259 raft_consensus.cc:359] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.622556 13259 raft_consensus.cc:385] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.622926 13259 raft_consensus.cc:740] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.623808 13259 consensus_queue.cc:260] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.625598 13557 raft_consensus.cc:2804] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.626053 13557 raft_consensus.cc:493] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.626423 13557 raft_consensus.cc:3060] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.640403 13324 raft_consensus.cc:493] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:17.645081 13108 leader_election.cc:343] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.645725 13108 leader_election.cc:304] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:17.647392 13138 raft_consensus.cc:2468] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:17.647707 13585 raft_consensus.cc:2749] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.651829 13258 tablet_bootstrap.cc:492] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:17.641006 13324 raft_consensus.cc:515] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:17.654768 13324 leader_election.cc:290] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:17.655910 13140 raft_consensus.cc:2468] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:17.660655 13258 tablet_bootstrap.cc:654] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.662873 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104ab1e98709456eb4495544632b0eeb" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:17.663643 13209 raft_consensus.cc:2468] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:17.664964 13031 leader_election.cc:304] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:17.674268 13259 ts_tablet_manager.cc:1434] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.000s
I20260709 13:17:17.678234 13388 raft_consensus.cc:2804] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.678731 13388 raft_consensus.cc:493] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.679104 13388 raft_consensus.cc:3060] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.684484 13257 raft_consensus.cc:359] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
W20260709 13:17:17.694893 13034 leader_election.cc:343] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:17.695955 13034 leader_election.cc:343] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.696903 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d17ac0f6d4b9a9851a6aa26127256" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:17.685500 13257 raft_consensus.cc:385] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.698185 13257 raft_consensus.cc:740] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.699409 13257 consensus_queue.cc:260] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.702875 13257 ts_tablet_manager.cc:1434] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.146s	user 0.005s	sys 0.002s
I20260709 13:17:17.704389 13257 tablet_bootstrap.cc:492] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:17.698536 13388 raft_consensus.cc:515] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.706130 13259 tablet_bootstrap.cc:492] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:17.707233 13388 leader_election.cc:290] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:17.710439 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104ab1e98709456eb4495544632b0eeb" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:17.734618 13033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:36831, user_credentials={real_user=slave}} blocked reactor thread for 145178us
W20260709 13:17:17.702929 13182 leader_election.cc:343] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.740015 13033 leader_election.cc:304] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:17.741005 13450 raft_consensus.cc:2804] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:17.741554 13450 raft_consensus.cc:697] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:17.742451 13450 consensus_queue.cc:237] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.737669 13067 raft_consensus.cc:2468] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
W20260709 13:17:17.749305 13182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:42939, user_credentials={real_user=slave}} blocked reactor thread for 46387us
I20260709 13:17:17.751211 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8bbf6cae584ed28932e79f625a4026" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:17.752063 13138 raft_consensus.cc:3060] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:17.760993 13034 leader_election.cc:343] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.776053 13181 leader_election.cc:304] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:17.798173 13500 raft_consensus.cc:2804] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:17.776507 13370 consensus_queue.cc:1048] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:17:17.798735 13500 raft_consensus.cc:697] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:17.799575 13500 consensus_queue.cc:237] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.818264 13138 raft_consensus.cc:2468] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
W20260709 13:17:17.793265 13031 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:36179, user_credentials={real_user=slave}} blocked reactor thread for 128396us
I20260709 13:17:17.833618 13260 tablet_bootstrap.cc:492] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:17.834169 13260 ts_tablet_manager.cc:1403] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.343s	user 0.017s	sys 0.016s
I20260709 13:17:17.838969 13260 raft_consensus.cc:359] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.840492 13260 raft_consensus.cc:385] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.840783 13260 raft_consensus.cc:740] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.841555 13260 consensus_queue.cc:260] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.844470 13260 ts_tablet_manager.cc:1434] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:17.844391 13033 leader_election.cc:304] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:17.845719 13450 raft_consensus.cc:2804] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:17.846207 13450 raft_consensus.cc:697] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:17.846997 13450 consensus_queue.cc:237] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.850485 13258 tablet_bootstrap.cc:492] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:17.851348 13258 ts_tablet_manager.cc:1403] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.200s	user 0.035s	sys 0.030s
I20260709 13:17:17.852039 13259 tablet_bootstrap.cc:654] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.860704 13508 raft_consensus.cc:493] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.861260 13508 raft_consensus.cc:515] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:17.863348 13508 leader_election.cc:290] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:17.864696 13258 raft_consensus.cc:359] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.865428 13258 raft_consensus.cc:385] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.865685 13258 raft_consensus.cc:740] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.866366 13258 consensus_queue.cc:260] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:17.868441 13258 ts_tablet_manager.cc:1434] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:17:17.870656 13258 tablet_bootstrap.cc:492] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:17.874886 13557 raft_consensus.cc:515] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.879055 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b13e68f1bda46e6afb535f52545dc00" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
W20260709 13:17:17.881448 13034 leader_election.cc:343] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.882108 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b872974f73d3469981669da74502740b" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:17.886344 13257 tablet_bootstrap.cc:654] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:17.887360 13181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.2:39523, user_credentials={real_user=slave}} blocked reactor thread for 111424us
I20260709 13:17:17.864435 13031 leader_election.cc:304] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
W20260709 13:17:17.900723 12939 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:17.902535 13212 raft_consensus.cc:3060] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.903154 13584 raft_consensus.cc:493] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.903868 13584 raft_consensus.cc:515] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.907452 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8bbf6cae584ed28932e79f625a4026" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:17.907666 13584 leader_election.cc:290] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:17.908133 13207 raft_consensus.cc:3060] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:17.896178 13182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:42939, user_credentials={real_user=slave}} blocked reactor thread for 104754us
I20260709 13:17:17.896301 13594 raft_consensus.cc:493] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.909421 13594 raft_consensus.cc:515] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:17.911409 13594 leader_election.cc:290] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:17.895466 13484 raft_consensus.cc:493] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.921175 13258 tablet_bootstrap.cc:654] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.916818 13260 tablet_bootstrap.cc:492] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:17.895021 13557 leader_election.cc:290] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:17.917338 12987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:17.918829 13105 leader_election.cc:343] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.919093 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:17.922042 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:17.922191 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045d0ee1dab4622a49c705aec5c2168" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:17.921191 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b13e68f1bda46e6afb535f52545dc00" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:17.901031 13589 raft_consensus.cc:2804] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:17:17.923445 13031 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:36179, user_credentials={real_user=slave}} blocked reactor thread for 59177us
I20260709 13:17:17.924356 13484 raft_consensus.cc:515] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:17.943192 13599 consensus_queue.cc:1048] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:17.945367 13207 raft_consensus.cc:2468] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:17.948650 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:17.936321 12987 raft_consensus.cc:2468] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:17.936496 13589 raft_consensus.cc:493] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.950202 13108 leader_election.cc:304] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:17.950832 13589 raft_consensus.cc:3060] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.949604 13068 raft_consensus.cc:2468] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:17.940481 13140 raft_consensus.cc:2468] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:17.934995 13105 leader_election.cc:304] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed
I20260709 13:17:17.953878 13511 raft_consensus.cc:2804] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:17.940670 13138 raft_consensus.cc:3060] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.956537 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d17ac0f6d4b9a9851a6aa26127256" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:17.956866 13511 raft_consensus.cc:493] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.957238 13139 raft_consensus.cc:2468] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:17.958160 13582 raft_consensus.cc:2749] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.959022 13582 consensus_queue.cc:1048] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.957551 13511 raft_consensus.cc:3060] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:17.964237 13484 leader_election.cc:290] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:17.967001 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045d0ee1dab4622a49c705aec5c2168" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:17.971912 12987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581bf3becdab4773845a749f01ae77cf" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:17.974632 12891 catalog_manager.cc:5697] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:17.988267 12887 catalog_manager.cc:5697] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:17.995548 13182 leader_election.cc:343] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.005313 13033 leader_election.cc:304] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:18.006307 13592 raft_consensus.cc:2804] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.006690 13592 raft_consensus.cc:493] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.007027 13592 raft_consensus.cc:3060] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.016589 13592 raft_consensus.cc:515] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:18.018607 13592 leader_election.cc:290] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:18.030125 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:18.045817 13260 tablet_bootstrap.cc:654] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.048516 13557 raft_consensus.cc:493] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.048857 12987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:18.050238 12987 raft_consensus.cc:3060] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.050089 13557 raft_consensus.cc:515] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:18.054057 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b872974f73d3469981669da74502740b" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:18.054867 13557 leader_election.cc:290] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:18.056869 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b9b7d6e83f4063b1a0214df6346486" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:18.057586 13139 raft_consensus.cc:2468] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:18.058674 13589 raft_consensus.cc:515] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:18.061494 13589 leader_election.cc:290] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:18.062116 13033 leader_election.cc:304] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:18.065604 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104ab1e98709456eb4495544632b0eeb" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:18.069836 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104ab1e98709456eb4495544632b0eeb" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:18.070113 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b9b7d6e83f4063b1a0214df6346486" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:18.059084 12987 raft_consensus.cc:2468] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 2.
I20260709 13:17:18.074923 13138 raft_consensus.cc:2468] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:18.076450 13511 raft_consensus.cc:515] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:18.082811 13259 tablet_bootstrap.cc:492] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:18.085390 12990 raft_consensus.cc:3060] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.088232 13259 ts_tablet_manager.cc:1403] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.382s	user 0.024s	sys 0.014s
I20260709 13:17:18.088755 13140 raft_consensus.cc:2393] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c23c890764727a91d599e0d75604f in current term 2: Already voted for candidate c538e5be22524c9a970f7a59c5379288 in this term.
I20260709 13:17:18.089030 13034 leader_election.cc:304] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18; no voters: 
W20260709 13:17:18.091023 13034 leader_election.cc:343] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.091091 13259 raft_consensus.cc:359] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:18.091850 13259 raft_consensus.cc:385] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.092140 13259 raft_consensus.cc:740] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.086858 13589 raft_consensus.cc:2804] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.093468 13259 consensus_queue.cc:260] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:18.093755 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:18.097570 12992 raft_consensus.cc:2393] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c538e5be22524c9a970f7a59c5379288 in current term 2: Already voted for candidate 293c23c890764727a91d599e0d75604f in this term.
I20260709 13:17:18.087260 13214 raft_consensus.cc:3060] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.096163 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9bc9d818fc44989bdc08e740dfcd1b3" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:18.094396 13589 raft_consensus.cc:493] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.103492 12956 leader_election.cc:304] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed
I20260709 13:17:18.096891 13511 leader_election.cc:290] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:18.101259 13258 tablet_bootstrap.cc:492] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:18.105147 13589 raft_consensus.cc:3060] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.100172 13557 raft_consensus.cc:2804] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:18.108196 13557 raft_consensus.cc:697] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 2 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:18.108590 13258 ts_tablet_manager.cc:1403] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.237s	user 0.008s	sys 0.009s
I20260709 13:17:18.109295 13257 tablet_bootstrap.cc:492] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:18.109730 13257 ts_tablet_manager.cc:1403] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.406s	user 0.016s	sys 0.001s
I20260709 13:17:18.110605 13181 leader_election.cc:304] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:18.111089 13259 ts_tablet_manager.cc:1434] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:17:18.115026 13181 leader_election.cc:304] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
W20260709 13:17:18.109844 13034 leader_election.cc:343] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.121981 13598 raft_consensus.cc:2749] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.122314 13260 tablet_bootstrap.cc:492] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:18.122885 13260 ts_tablet_manager.cc:1403] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.224s	user 0.012s	sys 0.006s
I20260709 13:17:18.125648 13260 raft_consensus.cc:359] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:18.126327 13260 raft_consensus.cc:385] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.126595 13260 raft_consensus.cc:740] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.127365 13260 consensus_queue.cc:260] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:18.126596 13557 consensus_queue.cc:237] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:18.127604 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581bf3becdab4773845a749f01ae77cf" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:18.130913 13140 raft_consensus.cc:2468] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:18.135776 13259 tablet_bootstrap.cc:492] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:18.136229 13601 raft_consensus.cc:2804] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.136710 13601 raft_consensus.cc:493] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.137054 13601 raft_consensus.cc:3060] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.148389 13258 raft_consensus.cc:359] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:18.149220 13258 raft_consensus.cc:385] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.149772 13181 leader_election.cc:304] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:18.149535 13258 raft_consensus.cc:740] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.153538 13260 ts_tablet_manager.cc:1434] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:17:18.156186 13258 consensus_queue.cc:260] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:18.159040 13598 raft_consensus.cc:2804] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.164307 13260 tablet_bootstrap.cc:492] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:18.174803 13257 raft_consensus.cc:359] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:18.175805 13257 raft_consensus.cc:385] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.176149 13257 raft_consensus.cc:740] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.149513 13033 leader_election.cc:304] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:18.162060 13598 raft_consensus.cc:493] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.179525 13257 consensus_queue.cc:260] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:18.169243 13590 raft_consensus.cc:493] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.183948 13598 raft_consensus.cc:3060] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.192804 13258 ts_tablet_manager.cc:1434] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
W20260709 13:17:18.180546 12958 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:36831, user_credentials={real_user=slave}} blocked reactor thread for 54444.4us
I20260709 13:17:18.195297 13557 raft_consensus.cc:2804] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.197909 13416 raft_consensus.cc:493] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.208673 13416 raft_consensus.cc:515] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:18.215487 13257 ts_tablet_manager.cc:1434] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.003s
W20260709 13:17:18.198079 13033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:36831, user_credentials={real_user=slave}} blocked reactor thread for 58752.6us
I20260709 13:17:18.194489 13590 raft_consensus.cc:515] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:18.200354 13214 raft_consensus.cc:2468] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:18.223300 13510 raft_consensus.cc:493] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.223826 13510 raft_consensus.cc:515] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:18.226351 13416 leader_election.cc:290] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:18.209659 13107 leader_election.cc:304] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:18.230695 13582 raft_consensus.cc:2749] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:18.237929 13260 tablet_bootstrap.cc:654] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.238735 13259 tablet_bootstrap.cc:654] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.214977 13589 raft_consensus.cc:515] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:18.237049 13510 leader_election.cc:290] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:18.220454 13258 tablet_bootstrap.cc:492] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:18.217896 13557 raft_consensus.cc:697] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:18.244941 13592 raft_consensus.cc:493] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.249804 13592 raft_consensus.cc:515] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:18.249383 13257 tablet_bootstrap.cc:492] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:18.256249 13557 consensus_queue.cc:237] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:18.257602 13592 leader_election.cc:290] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:18.258074 13601 raft_consensus.cc:515] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:18.259234 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1005312f5ba04344b9dd149ba865a121" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:18.260666 13034 leader_election.cc:343] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.261047 13601 leader_election.cc:290] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:18.265542 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d17ac0f6d4b9a9851a6aa26127256" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:18.266196 12988 raft_consensus.cc:3060] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.270539 13258 tablet_bootstrap.cc:654] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.273036 13590 leader_election.cc:290] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:18.281427 13068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2b3b94fc464c8abc3f09cbb895d1" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:18.292980 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2b3b94fc464c8abc3f09cbb895d1" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:18.293962 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d17ac0f6d4b9a9851a6aa26127256" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:18.295028 13140 raft_consensus.cc:3060] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:18.299901 13182 consensus_peers.cc:597] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.301272 13065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2b3b94fc464c8abc3f09cbb895d1" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:18.304459 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1005312f5ba04344b9dd149ba865a121" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:18.305418 13142 raft_consensus.cc:2468] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:18.306178 13031 leader_election.cc:304] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:18.294055 13139 raft_consensus.cc:2468] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:18.280974 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2b3b94fc464c8abc3f09cbb895d1" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:18.308924 13212 raft_consensus.cc:2468] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:18.309830 13483 raft_consensus.cc:2804] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:18.311070 13107 leader_election.cc:343] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.311960 13181 leader_election.cc:304] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
W20260709 13:17:18.314946 13181 leader_election.cc:343] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.318140 13598 raft_consensus.cc:515] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:18.280058 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4483482a9c42442eaea9bfe345f9c1f0" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:18.324115 13590 raft_consensus.cc:2804] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.325409 13267 raft_consensus.cc:2749] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.324522 13598 leader_election.cc:290] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:18.338677 13590 raft_consensus.cc:493] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.337586 12987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581bf3becdab4773845a749f01ae77cf" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:18.351905 13590 raft_consensus.cc:3060] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.353438 13589 leader_election.cc:290] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:18.362883 13105 leader_election.cc:304] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f
I20260709 13:17:18.378108 13260 tablet_bootstrap.cc:492] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:18.378888 13260 ts_tablet_manager.cc:1403] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.215s	user 0.003s	sys 0.013s
I20260709 13:17:18.365432 12991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4483482a9c42442eaea9bfe345f9c1f0" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:18.360878 13141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581bf3becdab4773845a749f01ae77cf" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:18.386826 13258 tablet_bootstrap.cc:492] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:18.349488 13483 raft_consensus.cc:697] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
W20260709 13:17:18.389453 13031 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.4:36179, user_credentials={real_user=slave}} blocked reactor thread for 64336.9us
I20260709 13:17:18.388592 13258 ts_tablet_manager.cc:1403] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.173s	user 0.028s	sys 0.017s
I20260709 13:17:18.386870 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b9b7d6e83f4063b1a0214df6346486" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:18.386041 13511 raft_consensus.cc:2804] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.392257 13141 raft_consensus.cc:3060] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.393808 13033 leader_election.cc:304] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:18.477819 13140 raft_consensus.cc:2468] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
W20260709 13:17:18.478236 13033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:36831, user_credentials={real_user=slave}} blocked reactor thread for 90656.4us
I20260709 13:17:18.480477 13594 raft_consensus.cc:2804] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.480901 13594 raft_consensus.cc:493] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.479784 13483 consensus_queue.cc:237] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:18.394677 13511 raft_consensus.cc:493] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.482409 13511 raft_consensus.cc:3060] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.481248 13594 raft_consensus.cc:3060] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:18.473949 13181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:36831, user_credentials={real_user=slave}} blocked reactor thread for 80542.5us
I20260709 13:17:18.391363 13623 consensus_queue.cc:1048] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
W20260709 13:17:18.474279 13107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39523, user_credentials={real_user=slave}} blocked reactor thread for 79271us
W20260709 13:17:18.392742 13182 leader_election.cc:343] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.489349 13257 tablet_bootstrap.cc:654] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.500983 13627 raft_consensus.cc:493] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.501526 13627 raft_consensus.cc:515] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:18.503571 13627 leader_election.cc:290] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
W20260709 13:17:18.474642 13108 leader_election.cc:343] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.500218 13258 raft_consensus.cc:359] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:18.505080 13258 raft_consensus.cc:385] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.505579 13258 raft_consensus.cc:740] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.507159 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beda4eef244d40e08532d288c6a7c865" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
W20260709 13:17:18.496064 13182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:42939, user_credentials={real_user=slave}} blocked reactor thread for 106827us
W20260709 13:17:18.508749 13031 leader_election.cc:343] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.505685 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b9b7d6e83f4063b1a0214df6346486" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:18.509754 13140 raft_consensus.cc:3060] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.511193 13259 tablet_bootstrap.cc:492] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:18.518755 13258 consensus_queue.cc:260] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
W20260709 13:17:18.520892 13105 leader_election.cc:343] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.522609 12988 raft_consensus.cc:2468] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:18.523079 13105 leader_election.cc:304] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:18.520875 13258 ts_tablet_manager.cc:1434] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.130s	user 0.005s	sys 0.005s
I20260709 13:17:18.524235 13259 ts_tablet_manager.cc:1403] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.408s	user 0.021s	sys 0.008s
I20260709 13:17:18.528642 13510 raft_consensus.cc:2749] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:18.525534 13105 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:36179, user_credentials={real_user=slave}} blocked reactor thread for 88067.8us
I20260709 13:17:18.530732 13181 leader_election.cc:304] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:18.531551 13484 raft_consensus.cc:2804] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.532114 13484 raft_consensus.cc:697] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:18.533038 13484 consensus_queue.cc:237] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:18.538973 13557 consensus_queue.cc:1048] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:18.542310 13594 raft_consensus.cc:515] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:18.544684 13594 leader_election.cc:290] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
W20260709 13:17:18.548715 13108 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.1:42939, user_credentials={real_user=slave}} blocked reactor thread for 139074us
I20260709 13:17:18.549372 13590 raft_consensus.cc:515] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:18.551688 13258 tablet_bootstrap.cc:492] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:18.523454 13511 raft_consensus.cc:515] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:18.553110 13260 raft_consensus.cc:359] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:18.555814 13260 raft_consensus.cc:385] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.556193 13260 raft_consensus.cc:740] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.557823 13260 consensus_queue.cc:260] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:18.576387 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2b3b94fc464c8abc3f09cbb895d1" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:18.578940 13624 consensus_queue.cc:1048] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
W20260709 13:17:18.583443 13107 leader_election.cc:343] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.594784 12993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beda4eef244d40e08532d288c6a7c865" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:18.595266 13590 leader_election.cc:290] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:18.599749 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1005312f5ba04344b9dd149ba865a121" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:18.588002 13500 consensus_queue.cc:1048] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:17:18.602169 13139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1005312f5ba04344b9dd149ba865a121" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:18.602810 13139 raft_consensus.cc:3060] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.604414 13260 ts_tablet_manager.cc:1434] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.225s	user 0.008s	sys 0.008s
I20260709 13:17:18.604539 13140 raft_consensus.cc:2468] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:18.605510 13260 tablet_bootstrap.cc:492] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:18.609146 13511 leader_election.cc:290] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:18.618053 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2b3b94fc464c8abc3f09cbb895d1" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:18.614301 13584 raft_consensus.cc:493] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.618911 13207 raft_consensus.cc:2393] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c538e5be22524c9a970f7a59c5379288 in current term 1: Already voted for candidate c6c79a100f9043f590697441315084ed in this term.
I20260709 13:17:18.620622 13105 leader_election.cc:304] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed
I20260709 13:17:18.619218 13584 raft_consensus.cc:515] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:18.619557 13139 raft_consensus.cc:2468] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
W20260709 13:17:18.609234 13034 leader_election.cc:343] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.643150 13584 leader_election.cc:290] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:18.644783 13511 raft_consensus.cc:2749] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:17:18.648134 13034 leader_election.cc:343] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.625052 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2b3b94fc464c8abc3f09cbb895d1" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:18.648803 13034 leader_election.cc:304] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
W20260709 13:17:18.675151 13105 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.4:36179, user_credentials={real_user=slave}} blocked reactor thread for 54625.1us
I20260709 13:17:18.675345 13259 raft_consensus.cc:359] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:18.676374 13259 raft_consensus.cc:385] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.676739 13259 raft_consensus.cc:740] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.677580 13259 consensus_queue.cc:260] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:18.688907 13483 raft_consensus.cc:2749] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.690165 13259 ts_tablet_manager.cc:1434] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.165s	user 0.004s	sys 0.003s
I20260709 13:17:18.687915 13260 tablet_bootstrap.cc:654] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.692438 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e13a599e4c415d829e003cdcd8d4d8" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:18.693507 13140 raft_consensus.cc:2393] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c6c79a100f9043f590697441315084ed in current term 1: Already voted for candidate c538e5be22524c9a970f7a59c5379288 in this term.
I20260709 13:17:18.683184 13258 tablet_bootstrap.cc:654] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.695298 13033 leader_election.cc:304] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:18.696346 13259 tablet_bootstrap.cc:492] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
W20260709 13:17:18.697467 13107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:39523, user_credentials={real_user=slave}} blocked reactor thread for 77489.4us
W20260709 13:17:18.694099 13105 leader_election.cc:343] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:18.678220 13108 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:42939, user_credentials={real_user=slave}} blocked reactor thread for 54421.3us
I20260709 13:17:18.697969 13483 raft_consensus.cc:2804] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:18.696249 13033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:36831, user_credentials={real_user=slave}} blocked reactor thread for 57663.7us
I20260709 13:17:18.721983 13483 raft_consensus.cc:697] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:18.730144 13483 consensus_queue.cc:237] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
W20260709 13:17:18.736729 13034 leader_election.cc:343] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:18.737583 13034 consensus_peers.cc:597] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.747387 12989 raft_consensus.cc:1275] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Refusing update from remote peer 293c23c890764727a91d599e0d75604f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:18.722620 13141 raft_consensus.cc:2468] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:18.750607 13181 leader_election.cc:304] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:18.751693 13598 raft_consensus.cc:2804] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.752161 13598 raft_consensus.cc:697] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:18.753026 13624 consensus_queue.cc:1048] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:18.752969 13598 consensus_queue.cc:237] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:18.761469 13257 tablet_bootstrap.cc:492] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:18.761767 13258 tablet_bootstrap.cc:492] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:18.762357 13258 ts_tablet_manager.cc:1403] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.218s	user 0.011s	sys 0.005s
I20260709 13:17:18.762722 13257 ts_tablet_manager.cc:1403] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.518s	user 0.013s	sys 0.014s
I20260709 13:17:18.765219 13258 raft_consensus.cc:359] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:18.765836 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2b3b94fc464c8abc3f09cbb895d1" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:18.766222 13258 raft_consensus.cc:385] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.766575 13258 raft_consensus.cc:740] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.767347 13258 consensus_queue.cc:260] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:18.768512 13257 raft_consensus.cc:359] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:18.769942 13258 ts_tablet_manager.cc:1434] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:18.771369 13257 raft_consensus.cc:385] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.768149 13033 leader_election.cc:304] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:18.795197 13260 tablet_bootstrap.cc:492] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:18.806137 13260 ts_tablet_manager.cc:1403] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.201s	user 0.020s	sys 0.027s
I20260709 13:17:18.808923 13630 raft_consensus.cc:2804] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.809448 13630 raft_consensus.cc:697] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:18.771745 13257 raft_consensus.cc:740] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.804548 13259 tablet_bootstrap.cc:654] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.815743 13260 raft_consensus.cc:359] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:18.816679 13260 raft_consensus.cc:385] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.817026 13260 raft_consensus.cc:740] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
W20260709 13:17:18.814577 13181 leader_election.cc:343] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.819886 13181 leader_election.cc:304] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:18.817874 13260 consensus_queue.cc:260] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:18.790346 12891 catalog_manager.cc:5697] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } }
I20260709 13:17:18.826254 13257 consensus_queue.cc:260] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:18.827577 13258 tablet_bootstrap.cc:492] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:18.828827 12891 catalog_manager.cc:5697] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.810289 13630 consensus_queue.cc:237] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
W20260709 13:17:18.840219 13034 consensus_peers.cc:597] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.841068 13258 tablet_bootstrap.cc:654] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.841270 13642 raft_consensus.cc:493] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.841842 13642 raft_consensus.cc:515] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:18.824257 13590 raft_consensus.cc:2749] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.855420 13260 ts_tablet_manager.cc:1434] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:17:18.840222 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e13a599e4c415d829e003cdcd8d4d8" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:18.868513 13260 tablet_bootstrap.cc:492] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:18.873306 13257 ts_tablet_manager.cc:1434] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.107s	user 0.006s	sys 0.002s
I20260709 13:17:18.874424 13257 tablet_bootstrap.cc:492] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:18.878731 13324 raft_consensus.cc:493] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.879285 13324 raft_consensus.cc:515] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:18.880025 13141 raft_consensus.cc:1275] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer 293c23c890764727a91d599e0d75604f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:18.882500 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b7a30cf34b4474939be4fcce8ae930" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:18.884160 13182 leader_election.cc:343] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.896073 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862cb9adf046414ea2ed1f18fd42ed07" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:18.899364 12889 catalog_manager.cc:5697] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.902602 13635 consensus_queue.cc:1048] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:18.904865 13630 consensus_queue.cc:1048] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 13:17:18.906167 13108 leader_election.cc:343] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.907629 13108 leader_election.cc:304] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:18.909513 13642 leader_election.cc:290] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:18.910463 13324 leader_election.cc:290] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:18.911966 12890 catalog_manager.cc:5697] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:18.916435 13105 leader_election.cc:343] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.922741 13257 tablet_bootstrap.cc:654] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.923977 12890 catalog_manager.cc:5697] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 2, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 2 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.927495 12890 catalog_manager.cc:5697] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.926544 13624 raft_consensus.cc:493] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.935720 13624 raft_consensus.cc:515] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:18.936311 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b7a30cf34b4474939be4fcce8ae930" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
W20260709 13:17:18.939303 13181 leader_election.cc:343] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.939486 13259 tablet_bootstrap.cc:492] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:18.939623 13181 leader_election.cc:304] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:18.940105 13259 ts_tablet_manager.cc:1403] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.249s	user 0.020s	sys 0.022s
I20260709 13:17:18.929558 13642 raft_consensus.cc:2749] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:18.946092 13653 log.cc:927] Time spent T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:18.951341 12987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862cb9adf046414ea2ed1f18fd42ed07" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:18.941568 13324 raft_consensus.cc:2749] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.957810 13511 raft_consensus.cc:493] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.958357 13511 raft_consensus.cc:515] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
W20260709 13:17:18.960894 12939 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:18.962440 13624 leader_election.cc:290] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
W20260709 13:17:18.967633 13108 leader_election.cc:343] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.968160 13108 leader_election.cc:304] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:18.968817 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f853a78f0704cbea0a4794c62412b27" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:18.969508 13140 raft_consensus.cc:2468] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:18.969547 13511 leader_election.cc:290] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:18.971647 13416 raft_consensus.cc:2749] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.971864 13215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405efda88e2475f9916d4e89499e058" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
W20260709 13:17:18.976796 13105 leader_election.cc:343] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.975142 13033 leader_election.cc:304] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:18.978981 13635 consensus_queue.cc:1048] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:17:18.983702 13624 raft_consensus.cc:2804] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.984153 13624 raft_consensus.cc:493] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.984485 13624 raft_consensus.cc:3060] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:18.981269 13034 consensus_peers.cc:597] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.990597 13258 tablet_bootstrap.cc:492] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:18.992192 13258 ts_tablet_manager.cc:1403] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.168s	user 0.020s	sys 0.011s
I20260709 13:17:18.997699 13258 raft_consensus.cc:359] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:18.998215 13258 raft_consensus.cc:385] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.998473 13258 raft_consensus.cc:740] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.999123 13258 consensus_queue.cc:260] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.001942 13260 tablet_bootstrap.cc:654] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.004300 13214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f853a78f0704cbea0a4794c62412b27" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
W20260709 13:17:19.005537 13031 leader_election.cc:343] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.009881 13259 raft_consensus.cc:359] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.010865 13259 raft_consensus.cc:385] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.011188 13259 raft_consensus.cc:740] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.011993 13259 consensus_queue.cc:260] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.015434 13258 ts_tablet_manager.cc:1434] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:17:19.020444 13259 ts_tablet_manager.cc:1434] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.080s	user 0.002s	sys 0.005s
I20260709 13:17:19.019049 13584 raft_consensus.cc:493] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.026238 13258 tablet_bootstrap.cc:492] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288: Bootstrap starting.
I20260709 13:17:19.029531 13259 tablet_bootstrap.cc:492] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:19.031870 13257 tablet_bootstrap.cc:492] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:19.032421 13257 ts_tablet_manager.cc:1403] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.158s	user 0.010s	sys 0.017s
I20260709 13:17:19.020533 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405efda88e2475f9916d4e89499e058" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:19.033330 13258 tablet_bootstrap.cc:654] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:19.034157 13108 leader_election.cc:343] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.034646 13108 leader_election.cc:304] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:19.035737 13642 raft_consensus.cc:2749] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.025720 13584 raft_consensus.cc:515] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.044799 13584 leader_election.cc:290] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:19.050546 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f9fea2974209a5a12e4f4d3e07ea" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:19.058611 13257 raft_consensus.cc:359] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.059377 13257 raft_consensus.cc:385] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.059186 13624 raft_consensus.cc:515] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.051532 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f9fea2974209a5a12e4f4d3e07ea" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:19.060928 13107 leader_election.cc:343] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:19.061399 13108 leader_election.cc:343] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.061847 13108 leader_election.cc:304] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:19.062332 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f853a78f0704cbea0a4794c62412b27" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:19.062917 13138 raft_consensus.cc:3060] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.063813 13259 tablet_bootstrap.cc:654] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.064878 13510 raft_consensus.cc:2749] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.059849 13257 raft_consensus.cc:740] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.074505 13257 consensus_queue.cc:260] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.077009 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f853a78f0704cbea0a4794c62412b27" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
W20260709 13:17:19.079078 13031 leader_election.cc:343] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.080549 13257 ts_tablet_manager.cc:1434] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.003s
I20260709 13:17:19.083361 13258 tablet_bootstrap.cc:492] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288: No bootstrap required, opened a new log
I20260709 13:17:19.083870 13258 ts_tablet_manager.cc:1403] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.007s
I20260709 13:17:19.077538 12889 catalog_manager.cc:5697] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.086095 12889 catalog_manager.cc:5697] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.086650 13258 raft_consensus.cc:359] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.088440 13258 raft_consensus.cc:385] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.088762 13258 raft_consensus.cc:740] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.088582 13370 consensus_queue.cc:1048] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.088027 13257 tablet_bootstrap.cc:492] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:19.100044 13630 raft_consensus.cc:493] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.100128 13258 consensus_queue.cc:260] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.100754 13630 raft_consensus.cc:515] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.101549 13624 leader_election.cc:290] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:19.102738 13630 leader_election.cc:290] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:19.107934 13141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2b3b94fc464c8abc3f09cbb895d1" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:19.108284 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2b3b94fc464c8abc3f09cbb895d1" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:19.110355 13207 raft_consensus.cc:2393] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c23c890764727a91d599e0d75604f in current term 1: Already voted for candidate c6c79a100f9043f590697441315084ed in this term.
I20260709 13:17:19.108781 13141 raft_consensus.cc:2393] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c23c890764727a91d599e0d75604f in current term 1: Already voted for candidate c538e5be22524c9a970f7a59c5379288 in this term.
I20260709 13:17:19.114794 13267 raft_consensus.cc:493] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.115157 13260 tablet_bootstrap.cc:492] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:19.115643 13260 ts_tablet_manager.cc:1403] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.247s	user 0.012s	sys 0.000s
I20260709 13:17:19.115314 13267 raft_consensus.cc:515] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.117348 13267 leader_election.cc:290] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:19.118453 13258 ts_tablet_manager.cc:1434] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.003s
I20260709 13:17:19.121692 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b13e68f1bda46e6afb535f52545dc00" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:19.122725 13031 leader_election.cc:304] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed
I20260709 13:17:19.125149 13138 raft_consensus.cc:2468] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:19.122995 13257 tablet_bootstrap.cc:654] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.126672 13033 leader_election.cc:304] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: c6c79a100f9043f590697441315084ed
I20260709 13:17:19.127437 13630 raft_consensus.cc:3060] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.135893 13260 raft_consensus.cc:359] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.139430 13260 raft_consensus.cc:385] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.141812 13260 raft_consensus.cc:740] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.140240 13257 tablet_bootstrap.cc:492] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:19.137348 13141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b13e68f1bda46e6afb535f52545dc00" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:19.143625 13257 ts_tablet_manager.cc:1403] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.002s
I20260709 13:17:19.144706 12958 leader_election.cc:304] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:19.146057 13634 raft_consensus.cc:2749] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.148913 13257 raft_consensus.cc:359] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:19.149614 13257 raft_consensus.cc:385] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.149887 13257 raft_consensus.cc:740] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.150517 13257 consensus_queue.cc:260] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:19.157703 13260 consensus_queue.cc:260] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.152976 13257 ts_tablet_manager.cc:1434] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
I20260709 13:17:19.160409 13257 tablet_bootstrap.cc:492] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:19.162365 13260 ts_tablet_manager.cc:1434] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:17:19.167408 13260 tablet_bootstrap.cc:492] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:19.173746 13370 consensus_queue.cc:1048] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.174896 13257 tablet_bootstrap.cc:654] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.194974 13584 raft_consensus.cc:493] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.195578 13584 raft_consensus.cc:515] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.201514 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b407734f414540b3dc28b0c16a3476" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:19.203024 13108 leader_election.cc:343] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.206367 13584 leader_election.cc:290] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:19.137450 13624 raft_consensus.cc:2804] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.209192 13624 raft_consensus.cc:697] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:19.214437 13624 consensus_queue.cc:237] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.219408 13630 raft_consensus.cc:2749] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.231956 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b407734f414540b3dc28b0c16a3476" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:19.237032 12992 raft_consensus.cc:3060] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.241403 13483 consensus_queue.cc:1048] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:19.257849 13107 leader_election.cc:343] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.258447 13107 leader_election.cc:304] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:19.261284 13584 raft_consensus.cc:2749] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.266475 13260 tablet_bootstrap.cc:654] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.272192 13257 tablet_bootstrap.cc:492] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:19.272743 13257 ts_tablet_manager.cc:1403] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.113s	user 0.024s	sys 0.020s
I20260709 13:17:19.272962 13590 raft_consensus.cc:493] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.273483 13590 raft_consensus.cc:515] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.275283 13257 raft_consensus.cc:359] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.275554 13590 leader_election.cc:290] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:19.276156 13257 raft_consensus.cc:385] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.276463 13257 raft_consensus.cc:740] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.277253 13257 consensus_queue.cc:260] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.278666 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beda4eef244d40e08532d288c6a7c865" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:19.279809 13257 ts_tablet_manager.cc:1434] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:17:19.279902 13182 leader_election.cc:343] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.280936 13257 tablet_bootstrap.cc:492] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:19.281522 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beda4eef244d40e08532d288c6a7c865" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:19.282166 13064 raft_consensus.cc:2468] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:19.283568 13181 leader_election.cc:304] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:19.284689 13590 raft_consensus.cc:2804] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.284734 12891 catalog_manager.cc:5697] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.286696 13590 raft_consensus.cc:493] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.292302 13590 raft_consensus.cc:3060] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.293663 13630 consensus_queue.cc:1048] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:17:19.302071 13641 raft_consensus.cc:493] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.302582 13641 raft_consensus.cc:515] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.304567 13641 leader_election.cc:290] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:19.309084 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef8dfbfd00748febd426f6a0a5b591b" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
W20260709 13:17:19.312824 13105 leader_election.cc:343] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.312646 13590 raft_consensus.cc:515] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
W20260709 13:17:19.335034 13034 consensus_peers.cc:597] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.336988 13257 tablet_bootstrap.cc:654] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.337598 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef8dfbfd00748febd426f6a0a5b591b" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:19.333860 12989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beda4eef244d40e08532d288c6a7c865" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:19.343747 13484 consensus_queue.cc:1048] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:19.345849 13107 leader_election.cc:343] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.346254 13107 leader_election.cc:304] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed
W20260709 13:17:19.346768 13182 leader_election.cc:343] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.348062 13584 raft_consensus.cc:2749] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.372630 13590 leader_election.cc:290] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:19.378211 13260 tablet_bootstrap.cc:492] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:19.379249 13260 ts_tablet_manager.cc:1403] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.212s	user 0.015s	sys 0.000s
I20260709 13:17:19.382087 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beda4eef244d40e08532d288c6a7c865" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:19.382740 13064 raft_consensus.cc:3060] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.387938 13267 raft_consensus.cc:493] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.388466 13267 raft_consensus.cc:515] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:19.383107 13260 raft_consensus.cc:359] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.389854 13260 raft_consensus.cc:385] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.390098 12989 raft_consensus.cc:3060] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.390257 13260 raft_consensus.cc:740] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.391829 13260 consensus_queue.cc:260] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.396450 13259 tablet_bootstrap.cc:492] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:19.396890 13259 ts_tablet_manager.cc:1403] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.368s	user 0.051s	sys 0.079s
I20260709 13:17:19.399427 13267 leader_election.cc:290] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:19.399187 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581bf3becdab4773845a749f01ae77cf" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
W20260709 13:17:19.400178 13034 consensus_peers.cc:597] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.406077 13260 ts_tablet_manager.cc:1434] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 13:17:19.409106 13594 raft_consensus.cc:493] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.406999 13215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581bf3becdab4773845a749f01ae77cf" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:19.409637 13594 raft_consensus.cc:515] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.411899 13594 leader_election.cc:290] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:19.413229 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f9fea2974209a5a12e4f4d3e07ea" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:19.414794 13260 tablet_bootstrap.cc:492] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:19.415165 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f9fea2974209a5a12e4f4d3e07ea" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:19.415838 13137 raft_consensus.cc:2468] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:19.416990 13033 leader_election.cc:304] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:19.418140 13633 raft_consensus.cc:2804] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.418499 13633 raft_consensus.cc:493] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.418815 13633 raft_consensus.cc:3060] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:19.419318 13034 leader_election.cc:343] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.421970 13634 raft_consensus.cc:493] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.422506 13634 raft_consensus.cc:515] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.424409 13257 tablet_bootstrap.cc:492] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:19.427559 13257 ts_tablet_manager.cc:1403] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.147s	user 0.027s	sys 0.018s
I20260709 13:17:19.424543 13634 leader_election.cc:290] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:19.426198 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c00d97a4f0421d95d71476563154ed" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:19.426206 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c00d97a4f0421d95d71476563154ed" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:19.421067 13260 tablet_bootstrap.cc:654] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.430295 12956 leader_election.cc:304] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed
I20260709 13:17:19.435717 13064 raft_consensus.cc:2468] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:19.438444 12992 raft_consensus.cc:3060] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.448429 13267 raft_consensus.cc:2749] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.438407 13181 leader_election.cc:304] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:19.443765 12958 leader_election.cc:304] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:19.446302 13324 consensus_queue.cc:1048] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.450611 13267 raft_consensus.cc:2749] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.460700 13257 raft_consensus.cc:359] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.461812 13257 raft_consensus.cc:385] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.454655 13484 raft_consensus.cc:2804] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.462056 13257 raft_consensus.cc:740] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.471949 13257 consensus_queue.cc:260] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.460582 13633 raft_consensus.cc:515] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.474642 13633 leader_election.cc:290] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:19.465433 13484 raft_consensus.cc:697] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:19.475497 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f9fea2974209a5a12e4f4d3e07ea" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:19.475594 13484 consensus_queue.cc:237] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
W20260709 13:17:19.477042 13034 leader_election.cc:343] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.477114 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f9fea2974209a5a12e4f4d3e07ea" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:19.477789 13137 raft_consensus.cc:3060] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.482807 13257 ts_tablet_manager.cc:1434] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.001s
I20260709 13:17:19.483771 13257 tablet_bootstrap.cc:492] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:19.490926 13594 raft_consensus.cc:493] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.491478 13594 raft_consensus.cc:515] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.492631 12890 catalog_manager.cc:5697] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.493623 13594 leader_election.cc:290] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:19.494414 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b7a30cf34b4474939be4fcce8ae930" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:19.495465 13207 raft_consensus.cc:2468] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:19.495709 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b7a30cf34b4474939be4fcce8ae930" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:19.496565 13031 leader_election.cc:304] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
W20260709 13:17:19.497097 13034 leader_election.cc:343] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.497601 13594 raft_consensus.cc:2804] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.486608 13137 raft_consensus.cc:2468] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:19.497990 13594 raft_consensus.cc:493] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.498383 13594 raft_consensus.cc:3060] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.498821 13033 leader_election.cc:304] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:19.499890 13633 raft_consensus.cc:2804] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.500605 13633 raft_consensus.cc:697] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:19.501458 13633 consensus_queue.cc:237] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.510016 13259 raft_consensus.cc:359] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:19.510751 13259 raft_consensus.cc:385] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.511014 13259 raft_consensus.cc:740] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.511770 13594 raft_consensus.cc:515] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.515795 13260 tablet_bootstrap.cc:492] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:19.515714 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b7a30cf34b4474939be4fcce8ae930" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:19.516322 13260 ts_tablet_manager.cc:1403] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.025s
I20260709 13:17:19.516346 13207 raft_consensus.cc:3060] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.518172 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b7a30cf34b4474939be4fcce8ae930" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:19.511744 13259 consensus_queue.cc:260] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:19.532382 13259 ts_tablet_manager.cc:1434] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.135s	user 0.003s	sys 0.004s
I20260709 13:17:19.535984 13259 tablet_bootstrap.cc:492] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
W20260709 13:17:19.541268 13034 leader_election.cc:343] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.554437 13260 raft_consensus.cc:359] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.555315 13260 raft_consensus.cc:385] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.555590 13260 raft_consensus.cc:740] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.555971 12992 raft_consensus.cc:3060] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.558391 13260 consensus_queue.cc:260] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.561758 13257 tablet_bootstrap.cc:654] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.522483 13594 leader_election.cc:290] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:19.572083 13260 ts_tablet_manager.cc:1434] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.044s	user 0.011s	sys 0.000s
I20260709 13:17:19.571990 12890 catalog_manager.cc:5697] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.573319 13260 tablet_bootstrap.cc:492] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:19.525578 13207 raft_consensus.cc:2468] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:19.600319 13259 tablet_bootstrap.cc:654] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.600963 13260 tablet_bootstrap.cc:654] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.610255 13031 leader_election.cc:304] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:19.611761 13633 raft_consensus.cc:2804] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.613114 13633 raft_consensus.cc:697] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:19.614280 13633 consensus_queue.cc:237] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.639353 13257 tablet_bootstrap.cc:492] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:19.639923 13257 ts_tablet_manager.cc:1403] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.156s	user 0.021s	sys 0.022s
I20260709 13:17:19.641700 13259 tablet_bootstrap.cc:492] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:19.642306 13259 ts_tablet_manager.cc:1403] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.107s	user 0.011s	sys 0.001s
I20260709 13:17:19.643859 13257 raft_consensus.cc:359] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.644671 13257 raft_consensus.cc:385] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.644922 13259 raft_consensus.cc:359] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.645732 13259 raft_consensus.cc:385] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.645975 13259 raft_consensus.cc:740] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.644996 13257 raft_consensus.cc:740] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.646617 13259 consensus_queue.cc:260] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.646984 13257 consensus_queue.cc:260] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.649559 13257 ts_tablet_manager.cc:1434] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:17:19.650622 13257 tablet_bootstrap.cc:492] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:19.659832 13257 tablet_bootstrap.cc:654] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.660127 13260 tablet_bootstrap.cc:492] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:19.660727 13260 ts_tablet_manager.cc:1403] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.088s	user 0.023s	sys 0.032s
I20260709 13:17:19.648772 13259 ts_tablet_manager.cc:1434] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:19.663885 13260 raft_consensus.cc:359] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.664556 13260 raft_consensus.cc:385] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.664832 13260 raft_consensus.cc:740] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.665585 13260 consensus_queue.cc:260] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.667544 13259 tablet_bootstrap.cc:492] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:19.675489 13259 tablet_bootstrap.cc:654] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.675382 13260 ts_tablet_manager.cc:1434] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:17:19.677073 13260 tablet_bootstrap.cc:492] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f: Bootstrap starting.
I20260709 13:17:19.682822 13634 raft_consensus.cc:493] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.683015 13260 tablet_bootstrap.cc:654] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.683418 13634 raft_consensus.cc:515] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.692938 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beda4eef244d40e08532d288c6a7c865" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:19.694113 13067 raft_consensus.cc:2393] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66218fb7f83e41ffa427b95015c3bf18 in current term 1: Already voted for candidate c6c79a100f9043f590697441315084ed in this term.
I20260709 13:17:19.697290 13259 tablet_bootstrap.cc:492] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:19.697834 13259 ts_tablet_manager.cc:1403] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.000s
I20260709 13:17:19.697460 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beda4eef244d40e08532d288c6a7c865" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:19.699263 12956 leader_election.cc:304] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed
I20260709 13:17:19.699718 13634 leader_election.cc:290] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:19.701658 13683 raft_consensus.cc:3060] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.701380 13259 raft_consensus.cc:359] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.709460 13259 raft_consensus.cc:385] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.709812 13259 raft_consensus.cc:740] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.710548 13259 consensus_queue.cc:260] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.711987 13683 raft_consensus.cc:2749] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.698530 13257 tablet_bootstrap.cc:492] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:19.712988 13259 ts_tablet_manager.cc:1434] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:17:19.731777 13635 raft_consensus.cc:493] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.779336 13635 raft_consensus.cc:515] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.781464 13635 leader_election.cc:290] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:19.782738 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa1f32b4b894946ab9f4cdac887ca19" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
W20260709 13:17:19.785022 13031 leader_election.cc:343] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6c79a100f9043f590697441315084ed (127.4.254.4:36179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.713038 13257 ts_tablet_manager.cc:1403] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.010s
I20260709 13:17:19.724642 13483 consensus_queue.cc:1048] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.063s
I20260709 13:17:19.790787 13257 raft_consensus.cc:359] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.799543 13257 raft_consensus.cc:385] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.799883 13257 raft_consensus.cc:740] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.795166 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa1f32b4b894946ab9f4cdac887ca19" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:19.795461 13259 tablet_bootstrap.cc:492] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
W20260709 13:17:19.804363 13034 leader_election.cc:343] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.804909 13034 leader_election.cc:304] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:19.771646 12891 catalog_manager.cc:5697] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:19.791132 13590 raft_consensus.cc:493] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.800669 13257 consensus_queue.cc:260] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.805830 13483 raft_consensus.cc:493] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.809290 13590 raft_consensus.cc:515] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.809592 13483 raft_consensus.cc:515] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.812283 13483 leader_election.cc:290] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:19.812373 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f853a78f0704cbea0a4794c62412b27" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:19.813285 13215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef8dfbfd00748febd426f6a0a5b591b" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:19.813964 13215 raft_consensus.cc:2468] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:19.814174 13259 tablet_bootstrap.cc:654] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.814121 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef8dfbfd00748febd426f6a0a5b591b" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:19.816015 13031 leader_election.cc:304] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:19.815299 13137 raft_consensus.cc:2468] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:19.817909 13483 raft_consensus.cc:2749] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.817046 13207 raft_consensus.cc:3060] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.818084 13260 tablet_bootstrap.cc:492] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f: No bootstrap required, opened a new log
I20260709 13:17:19.822746 13260 ts_tablet_manager.cc:1403] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f: Time spent bootstrapping tablet: real 0.146s	user 0.033s	sys 0.060s
I20260709 13:17:19.824121 13630 raft_consensus.cc:2804] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.824534 13630 raft_consensus.cc:493] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.824849 13630 raft_consensus.cc:3060] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.825809 13260 raft_consensus.cc:359] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.826481 13260 raft_consensus.cc:385] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.826745 13260 raft_consensus.cc:740] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.828675 13590 leader_election.cc:290] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:19.831598 13257 ts_tablet_manager.cc:1434] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
I20260709 13:17:19.832515 13630 raft_consensus.cc:515] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.835884 13257 tablet_bootstrap.cc:492] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:19.838917 13260 consensus_queue.cc:260] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.840993 13260 ts_tablet_manager.cc:1434] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 13:17:19.842098 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef8dfbfd00748febd426f6a0a5b591b" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:19.842696 13137 raft_consensus.cc:3060] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.844070 13141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f853a78f0704cbea0a4794c62412b27" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:19.845929 13257 tablet_bootstrap.cc:654] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.851841 13181 leader_election.cc:304] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:19.854074 13137 raft_consensus.cc:2468] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:19.856444 13259 tablet_bootstrap.cc:492] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:19.856997 13259 ts_tablet_manager.cc:1403] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.062s	user 0.021s	sys 0.006s
I20260709 13:17:19.859946 13259 raft_consensus.cc:359] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.860653 13259 raft_consensus.cc:385] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.860934 13259 raft_consensus.cc:740] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.856993 13633 consensus_queue.cc:1048] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:17:19.861775 13259 consensus_queue.cc:260] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.862675 13590 raft_consensus.cc:2749] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.865016 13259 ts_tablet_manager.cc:1434] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:17:19.866251 13259 tablet_bootstrap.cc:492] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:19.870034 13634 raft_consensus.cc:493] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.870607 13033 leader_election.cc:304] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:19.870576 13634 raft_consensus.cc:515] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:19.872646 13634 leader_election.cc:290] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:19.873214 13483 raft_consensus.cc:2804] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.873762 13483 raft_consensus.cc:697] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:19.874033 13259 tablet_bootstrap.cc:654] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.882612 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104ab1e98709456eb4495544632b0eeb" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:19.885202 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104ab1e98709456eb4495544632b0eeb" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:19.876416 13483 consensus_queue.cc:237] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:19.890033 12956 leader_election.cc:304] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed
I20260709 13:17:19.891541 13634 raft_consensus.cc:2749] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.917107 13630 leader_election.cc:290] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:19.919682 13630 consensus_queue.cc:1048] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.946007 13634 raft_consensus.cc:493] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.946784 13634 raft_consensus.cc:515] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:19.991149 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef8dfbfd00748febd426f6a0a5b591b" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:19.991981 13207 raft_consensus.cc:3060] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.998817 13370 raft_consensus.cc:493] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.999429 13370 raft_consensus.cc:515] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.001986 13370 leader_election.cc:290] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:20.003652 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1005312f5ba04344b9dd149ba865a121" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:20.005985 13634 leader_election.cc:290] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:20.014873 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4483482a9c42442eaea9bfe345f9c1f0" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:20.015628 13207 raft_consensus.cc:2468] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
W20260709 13:17:20.016815 13182 leader_election.cc:343] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.022647 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4483482a9c42442eaea9bfe345f9c1f0" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:20.023391 13137 raft_consensus.cc:2468] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:20.025451 13181 leader_election.cc:304] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
W20260709 13:17:20.041396 12939 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:20.031599 13484 raft_consensus.cc:2804] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.049005 13484 raft_consensus.cc:493] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.065233 13630 raft_consensus.cc:493] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.079913 12890 catalog_manager.cc:5697] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.065600 13484 raft_consensus.cc:3060] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.087057 12989 raft_consensus.cc:3060] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.082289 13630 raft_consensus.cc:515] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:20.100823 13630 leader_election.cc:290] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:20.101603 13259 tablet_bootstrap.cc:492] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:20.101930 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1005312f5ba04344b9dd149ba865a121" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:20.102195 13259 ts_tablet_manager.cc:1403] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.236s	user 0.043s	sys 0.085s
I20260709 13:17:20.104482 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b407734f414540b3dc28b0c16a3476" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:20.107189 13034 leader_election.cc:343] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:20.109238 13034 consensus_peers.cc:597] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:20.115176 13257 tablet_bootstrap.cc:492] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:20.115731 13257 ts_tablet_manager.cc:1403] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.280s	user 0.066s	sys 0.051s
I20260709 13:17:20.121392 12990 raft_consensus.cc:3060] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.096869 13590 consensus_queue.cc:1048] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:17:20.125617 13702 consensus_queue.cc:1048] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.124150 13257 raft_consensus.cc:359] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:20.130347 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b407734f414540b3dc28b0c16a3476" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:20.130367 13257 raft_consensus.cc:385] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.131065 13140 raft_consensus.cc:2468] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 0.
I20260709 13:17:20.131214 13257 raft_consensus.cc:740] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.126549 13259 raft_consensus.cc:359] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.136897 13259 raft_consensus.cc:385] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.136353 13257 consensus_queue.cc:260] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:20.137322 13259 raft_consensus.cc:740] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.130736 13484 raft_consensus.cc:515] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.147053 12958 leader_election.cc:304] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:20.139130 13259 consensus_queue.cc:260] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.155030 13033 leader_election.cc:304] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:20.156555 13483 raft_consensus.cc:2804] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.157070 13483 raft_consensus.cc:493] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.157550 13483 raft_consensus.cc:3060] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:20.161901 13034 consensus_peers.cc:597] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:20.162410 13259 ts_tablet_manager.cc:1434] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.002s
I20260709 13:17:20.166761 13257 ts_tablet_manager.cc:1434] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:17:20.171227 13259 tablet_bootstrap.cc:492] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:20.172088 13257 tablet_bootstrap.cc:492] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:20.178211 13484 leader_election.cc:290] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:20.179845 12992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4483482a9c42442eaea9bfe345f9c1f0" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:20.180441 13624 consensus_queue.cc:1048] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:20.181381 13182 leader_election.cc:343] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.181661 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4483482a9c42442eaea9bfe345f9c1f0" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:20.182294 13142 raft_consensus.cc:3060] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.203135 13142 raft_consensus.cc:2468] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:20.205579 13181 leader_election.cc:304] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:20.206691 13484 raft_consensus.cc:2804] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.207248 13484 raft_consensus.cc:697] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:20.208302 13484 consensus_queue.cc:237] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.238734 13702 raft_consensus.cc:493] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.248615 13702 raft_consensus.cc:515] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.249537 13259 tablet_bootstrap.cc:654] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.251243 13702 leader_election.cc:290] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:20.261734 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e13a599e4c415d829e003cdcd8d4d8" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:20.262799 13140 raft_consensus.cc:2468] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:20.265028 13181 leader_election.cc:304] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:20.267179 13590 raft_consensus.cc:2804] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.267604 13590 raft_consensus.cc:493] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.267966 13590 raft_consensus.cc:3060] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.270330 13370 raft_consensus.cc:493] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.264254 13483 raft_consensus.cc:515] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:20.275660 13483 leader_election.cc:290] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:20.271019 13370 raft_consensus.cc:515] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:20.281311 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b407734f414540b3dc28b0c16a3476" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:20.281958 12987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e13a599e4c415d829e003cdcd8d4d8" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:20.286218 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa1f32b4b894946ab9f4cdac887ca19" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:20.291132 13066 raft_consensus.cc:2468] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:20.291481 13257 tablet_bootstrap.cc:654] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.282821 12991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b407734f414540b3dc28b0c16a3476" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:20.291144 13140 raft_consensus.cc:3060] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:20.294229 13182 leader_election.cc:343] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.295501 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa1f32b4b894946ab9f4cdac887ca19" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:20.300241 13034 leader_election.cc:343] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.301426 13181 leader_election.cc:304] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:20.284545 13370 leader_election.cc:290] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:20.302770 13370 raft_consensus.cc:2804] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.303162 13370 raft_consensus.cc:493] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:20.303504 13182 leader_election.cc:343] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.305810 13634 raft_consensus.cc:2749] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:20.303561 13370 raft_consensus.cc:3060] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.318956 13590 raft_consensus.cc:515] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.324574 13140 raft_consensus.cc:2468] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:20.325831 13033 leader_election.cc:304] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:20.328313 13633 raft_consensus.cc:2804] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.330885 13633 raft_consensus.cc:697] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:20.331739 13633 consensus_queue.cc:237] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:20.338328 13590 leader_election.cc:290] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:20.339663 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e13a599e4c415d829e003cdcd8d4d8" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:20.342214 12989 raft_consensus.cc:3060] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:20.343021 13182 leader_election.cc:343] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.346170 13259 tablet_bootstrap.cc:492] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:20.346796 13259 ts_tablet_manager.cc:1403] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.017s
I20260709 13:17:20.348241 13257 tablet_bootstrap.cc:492] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:20.348745 13257 ts_tablet_manager.cc:1403] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.177s	user 0.011s	sys 0.003s
I20260709 13:17:20.349776 13259 raft_consensus.cc:359] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.350538 13259 raft_consensus.cc:385] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.350970 13259 raft_consensus.cc:740] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.351862 13257 raft_consensus.cc:359] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:20.351806 13259 consensus_queue.cc:260] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.352646 13257 raft_consensus.cc:385] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.352993 13257 raft_consensus.cc:740] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.354202 13257 consensus_queue.cc:260] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:20.346170 13370 raft_consensus.cc:515] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:20.357801 13259 ts_tablet_manager.cc:1434] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:20.358997 13259 tablet_bootstrap.cc:492] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed: Bootstrap starting.
I20260709 13:17:20.359647 13257 ts_tablet_manager.cc:1434] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:17:20.360755 13257 tablet_bootstrap.cc:492] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:20.364915 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa1f32b4b894946ab9f4cdac887ca19" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:20.366852 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa1f32b4b894946ab9f4cdac887ca19" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:20.367506 13066 raft_consensus.cc:3060] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:20.369485 13182 leader_election.cc:343] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.371229 13259 tablet_bootstrap.cc:654] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.371683 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e13a599e4c415d829e003cdcd8d4d8" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:20.372284 13142 raft_consensus.cc:3060] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.378939 13142 raft_consensus.cc:2468] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:20.381269 13370 leader_election.cc:290] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:20.383468 13066 raft_consensus.cc:2468] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:20.383888 12890 catalog_manager.cc:5697] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 0 to 1, leader changed from <none> to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.380265 13181 leader_election.cc:304] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:20.387673 13257 tablet_bootstrap.cc:654] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.388880 12889 catalog_manager.cc:5697] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.403040 13370 raft_consensus.cc:2804] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.403818 13370 raft_consensus.cc:697] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:20.404886 13370 consensus_queue.cc:237] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.388952 13181 leader_election.cc:304] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:20.411402 13484 raft_consensus.cc:2804] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.411978 13484 raft_consensus.cc:697] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:20.412205 13712 raft_consensus.cc:493] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.412853 13712 raft_consensus.cc:515] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:20.413003 13484 consensus_queue.cc:237] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:20.415189 13712 leader_election.cc:290] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:20.422650 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2b3b94fc464c8abc3f09cbb895d1" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:20.423053 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2b3b94fc464c8abc3f09cbb895d1" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:20.423449 13066 raft_consensus.cc:2468] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:20.423722 13138 raft_consensus.cc:2468] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:20.432665 13483 consensus_queue.cc:1048] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.438887 13181 leader_election.cc:304] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:20.439934 13712 raft_consensus.cc:2804] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:20.440327 13712 raft_consensus.cc:493] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.440653 13712 raft_consensus.cc:3060] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.451766 13594 consensus_queue.cc:1048] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:20.454610 13712 raft_consensus.cc:515] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:20.456669 13712 leader_election.cc:290] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:20.464165 13259 tablet_bootstrap.cc:492] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed: No bootstrap required, opened a new log
I20260709 13:17:20.464740 13259 ts_tablet_manager.cc:1403] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed: Time spent bootstrapping tablet: real 0.106s	user 0.025s	sys 0.023s
I20260709 13:17:20.472307 13259 raft_consensus.cc:359] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.473754 13259 raft_consensus.cc:385] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.474097 13259 raft_consensus.cc:740] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.475257 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2b3b94fc464c8abc3f09cbb895d1" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:20.475405 13259 consensus_queue.cc:260] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.476293 13067 raft_consensus.cc:3060] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.479324 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3e2b3b94fc464c8abc3f09cbb895d1" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:20.480159 13140 raft_consensus.cc:3060] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.492416 13257 tablet_bootstrap.cc:492] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:20.492972 13257 ts_tablet_manager.cc:1403] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.132s	user 0.017s	sys 0.000s
I20260709 13:17:20.495587 13257 raft_consensus.cc:359] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.496237 13257 raft_consensus.cc:385] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.496492 13257 raft_consensus.cc:740] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.502858 13257 consensus_queue.cc:260] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.504738 13257 ts_tablet_manager.cc:1434] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:17:20.500713 13140 raft_consensus.cc:2468] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 2.
I20260709 13:17:20.506387 13257 tablet_bootstrap.cc:492] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:20.512975 13257 tablet_bootstrap.cc:654] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.513216 13259 ts_tablet_manager.cc:1434] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:17:20.514828 13067 raft_consensus.cc:2468] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 2.
I20260709 13:17:20.514439 13181 leader_election.cc:304] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:20.522015 12890 catalog_manager.cc:5697] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.523243 12890 catalog_manager.cc:5697] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.523988 13257 tablet_bootstrap.cc:492] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:20.524521 13257 ts_tablet_manager.cc:1403] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:17:20.525378 13701 raft_consensus.cc:2804] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.525921 13701 raft_consensus.cc:697] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 2 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:20.526724 13701 consensus_queue.cc:237] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:20.527102 13257 raft_consensus.cc:359] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:20.527760 13257 raft_consensus.cc:385] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.528012 13257 raft_consensus.cc:740] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.528615 13257 consensus_queue.cc:260] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:20.531770 13257 ts_tablet_manager.cc:1434] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:17:20.532747 13257 tablet_bootstrap.cc:492] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:20.538575 13257 tablet_bootstrap.cc:654] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.585177 13712 raft_consensus.cc:493] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.585767 13712 raft_consensus.cc:515] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.587565 13712 leader_election.cc:290] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:20.588191 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405efda88e2475f9916d4e89499e058" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:20.589107 13142 raft_consensus.cc:2468] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 0.
I20260709 13:17:20.589540 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405efda88e2475f9916d4e89499e058" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:20.590512 13181 leader_election.cc:304] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
W20260709 13:17:20.591204 13182 leader_election.cc:343] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.592331 13484 raft_consensus.cc:2804] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.592866 13484 raft_consensus.cc:493] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.593307 13484 raft_consensus.cc:3060] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.596536 13257 tablet_bootstrap.cc:492] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:20.597175 13257 ts_tablet_manager.cc:1403] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.036s
I20260709 13:17:20.600244 13257 raft_consensus.cc:359] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.600955 13257 raft_consensus.cc:385] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.601281 13257 raft_consensus.cc:740] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.601038 13484 raft_consensus.cc:515] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.603057 13257 consensus_queue.cc:260] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.603468 13484 leader_election.cc:290] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:20.604362 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405efda88e2475f9916d4e89499e058" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:20.604951 12988 raft_consensus.cc:3060] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.603487 12889 catalog_manager.cc:5697] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 2, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 2 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:20.606117 13257 ts_tablet_manager.cc:1434] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:20.607174 13257 tablet_bootstrap.cc:492] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:20.610584 12989 raft_consensus.cc:3060] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.612146 12988 raft_consensus.cc:2468] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:20.612813 13257 tablet_bootstrap.cc:654] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.617606 13182 leader_election.cc:304] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:20.619617 13701 raft_consensus.cc:2804] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.620091 13701 raft_consensus.cc:697] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:20.620486 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405efda88e2475f9916d4e89499e058" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:20.621081 13142 raft_consensus.cc:3060] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.620899 13701 consensus_queue.cc:237] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.626612 13257 tablet_bootstrap.cc:492] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:20.627108 13257 ts_tablet_manager.cc:1403] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:17:20.629671 13257 raft_consensus.cc:359] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:20.630300 13257 raft_consensus.cc:385] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.630559 13257 raft_consensus.cc:740] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.631160 13257 consensus_queue.cc:260] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:20.633176 13257 ts_tablet_manager.cc:1434] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:17:20.634171 13257 tablet_bootstrap.cc:492] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:20.644227 13257 tablet_bootstrap.cc:654] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.646843 12890 catalog_manager.cc:5697] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 0 to 1, leader changed from <none> to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 1 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.654639 13142 raft_consensus.cc:2468] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:20.656028 13257 tablet_bootstrap.cc:492] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:20.657531 13257 ts_tablet_manager.cc:1403] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.012s
I20260709 13:17:20.659796 13257 raft_consensus.cc:359] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.660281 13257 raft_consensus.cc:385] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.660509 13257 raft_consensus.cc:740] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.661159 13257 consensus_queue.cc:260] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.672837 13257 ts_tablet_manager.cc:1434] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:17:20.673417 12990 raft_consensus.cc:3060] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.674047 13257 tablet_bootstrap.cc:492] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:20.680353 13257 tablet_bootstrap.cc:654] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.697574 13257 tablet_bootstrap.cc:492] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:20.698051 13257 ts_tablet_manager.cc:1403] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.024s	user 0.003s	sys 0.017s
I20260709 13:17:20.699606 13484 consensus_queue.cc:1048] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:20.700615 13257 raft_consensus.cc:359] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.701380 13257 raft_consensus.cc:385] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.701854 13257 raft_consensus.cc:740] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.702543 13257 consensus_queue.cc:260] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.704972 13257 ts_tablet_manager.cc:1434] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:17:20.706290 13257 tablet_bootstrap.cc:492] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:20.706802 13634 raft_consensus.cc:493] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.707357 13634 raft_consensus.cc:515] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.709295 13634 leader_election.cc:290] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:20.709954 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4483482a9c42442eaea9bfe345f9c1f0" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:20.711095 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4483482a9c42442eaea9bfe345f9c1f0" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:20.712695 12956 leader_election.cc:304] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18; no voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed
I20260709 13:17:20.713989 13634 raft_consensus.cc:2749] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:20.718019 12990 raft_consensus.cc:3060] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.720914 13257 tablet_bootstrap.cc:654] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.724972 13484 consensus_queue.cc:1048] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.725394 13257 tablet_bootstrap.cc:492] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18: No bootstrap required, opened a new log
I20260709 13:17:20.726830 13257 ts_tablet_manager.cc:1403] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 13:17:20.735731 13257 raft_consensus.cc:359] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:20.736251 13257 raft_consensus.cc:385] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.736461 13257 raft_consensus.cc:740] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.737048 13257 consensus_queue.cc:260] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:20.739706 13257 ts_tablet_manager.cc:1434] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:17:20.747145 12988 raft_consensus.cc:3060] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.755447 13633 consensus_queue.cc:1048] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.769019 13641 raft_consensus.cc:493] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.769613 13641 raft_consensus.cc:515] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.771907 13624 consensus_queue.cc:1048] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:20.775637 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862cb9adf046414ea2ed1f18fd42ed07" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:20.776278 13207 raft_consensus.cc:2468] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:20.777470 13105 leader_election.cc:304] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:20.778146 13584 raft_consensus.cc:2804] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.778483 13584 raft_consensus.cc:493] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.778735 12990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862cb9adf046414ea2ed1f18fd42ed07" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:20.779481 12990 raft_consensus.cc:2468] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 0.
I20260709 13:17:20.779094 13641 leader_election.cc:290] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:20.778806 13584 raft_consensus.cc:3060] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.816411 13584 raft_consensus.cc:515] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.818588 13584 leader_election.cc:290] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:20.819574 12988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862cb9adf046414ea2ed1f18fd42ed07" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:20.820298 12988 raft_consensus.cc:3060] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.820209 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862cb9adf046414ea2ed1f18fd42ed07" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:20.821046 13212 raft_consensus.cc:3060] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.828024 13212 raft_consensus.cc:2468] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:20.829191 13105 leader_election.cc:304] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:20.829967 13584 raft_consensus.cc:2804] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.830425 13584 raft_consensus.cc:697] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:20.831171 12988 raft_consensus.cc:2468] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:20.831161 13584 consensus_queue.cc:237] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:20.839258 12890 catalog_manager.cc:5697] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 0 to 1, leader changed from <none> to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.849210 13484 consensus_queue.cc:1048] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.857882 12988 raft_consensus.cc:3060] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.866979 13370 consensus_queue.cc:1048] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.894309 12990 raft_consensus.cc:3060] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.905616 13712 consensus_queue.cc:1048] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.917735 13370 consensus_queue.cc:1048] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.966544 13140 raft_consensus.cc:1275] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer c6c79a100f9043f590697441315084ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:20.967710 13370 consensus_queue.cc:1048] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.977604 13066 raft_consensus.cc:1275] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer c6c79a100f9043f590697441315084ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:20.980489 13370 consensus_queue.cc:1048] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:21.094548  5112 tablet_server.cc:179] TabletServer@127.4.254.1:0 shutting down...
I20260709 13:17:21.100317 13701 consensus_queue.cc:1048] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:21.109504 13034 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 405 similar messages]
W20260709 13:17:21.115432 13034 consensus_peers.cc:597] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.148842 13182 consensus_peers.cc:597] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.150517 13108 consensus_peers.cc:597] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.157992 13034 consensus_peers.cc:597] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.171140 13108 consensus_peers.cc:597] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.171819  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:17:21.171953 13182 consensus_peers.cc:597] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.173146  5112 tablet_replica.cc:333] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.173800  5112 raft_consensus.cc:2243] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.174147  5112 raft_consensus.cc:2272] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.175963  5112 tablet_replica.cc:333] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.176513  5112 raft_consensus.cc:2243] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.176868  5112 raft_consensus.cc:2272] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.179589  5112 tablet_replica.cc:333] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.180415  5112 raft_consensus.cc:2243] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.180895  5112 raft_consensus.cc:2272] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:21.181231 13034 consensus_peers.cc:597] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.183717  5112 tablet_replica.cc:333] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.184448  5112 raft_consensus.cc:2243] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.184923  5112 raft_consensus.cc:2272] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.187801  5112 tablet_replica.cc:333] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
W20260709 13:17:21.187980 13108 consensus_peers.cc:597] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.188452 13182 consensus_peers.cc:597] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.188570  5112 raft_consensus.cc:2243] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.189169  5112 raft_consensus.cc:2272] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.191438  5112 tablet_replica.cc:333] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.192124  5112 raft_consensus.cc:2243] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.192550  5112 raft_consensus.cc:2272] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.194869  5112 tablet_replica.cc:333] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.195626  5112 raft_consensus.cc:2243] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.196038  5112 raft_consensus.cc:2272] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.198946  5112 tablet_replica.cc:333] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.199759  5112 raft_consensus.cc:2243] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:21.200127 13034 consensus_peers.cc:597] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.200214  5112 raft_consensus.cc:2272] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.203375  5112 tablet_replica.cc:333] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.204013  5112 raft_consensus.cc:2243] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.204422  5112 raft_consensus.cc:2272] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.206316  5112 tablet_replica.cc:333] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.206854  5112 raft_consensus.cc:2243] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.207245  5112 raft_consensus.cc:2272] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.208818  5112 tablet_replica.cc:333] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.209708  5112 raft_consensus.cc:2243] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.210197  5112 raft_consensus.cc:2272] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.211843  5112 tablet_replica.cc:333] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.212559  5112 raft_consensus.cc:2243] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.212893  5112 raft_consensus.cc:2272] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.215075  5112 tablet_replica.cc:333] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.215621  5112 raft_consensus.cc:2243] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.215977  5112 raft_consensus.cc:2272] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.217603  5112 tablet_replica.cc:333] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.218130  5112 raft_consensus.cc:2243] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.218514  5112 raft_consensus.cc:2272] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.220188  5112 tablet_replica.cc:333] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.220745  5112 raft_consensus.cc:2243] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.221217  5112 raft_consensus.cc:2272] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.223078  5112 tablet_replica.cc:333] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.223634  5112 raft_consensus.cc:2243] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.224115  5112 raft_consensus.cc:2272] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.227007  5112 tablet_replica.cc:333] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.227586  5112 raft_consensus.cc:2243] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.227988  5112 raft_consensus.cc:2272] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.229995  5112 tablet_replica.cc:333] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.230774  5112 raft_consensus.cc:2243] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.231225  5112 raft_consensus.cc:2272] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.233578  5112 tablet_replica.cc:333] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.234304  5112 raft_consensus.cc:2243] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.234804  5112 raft_consensus.cc:2272] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.237505  5112 tablet_replica.cc:333] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.237547 13584 consensus_queue.cc:1048] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:21.238399  5112 raft_consensus.cc:2243] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.238992  5112 raft_consensus.cc:2272] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.241365  5112 tablet_replica.cc:333] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
W20260709 13:17:21.241603 13034 consensus_peers.cc:597] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.242446  5112 raft_consensus.cc:2243] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.243669  5112 raft_consensus.cc:2272] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.246838  5112 tablet_replica.cc:333] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.247582  5112 raft_consensus.cc:2243] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.248080  5112 raft_consensus.cc:2272] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.250535  5112 tablet_replica.cc:333] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.251324  5112 raft_consensus.cc:2243] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.251809  5112 raft_consensus.cc:2272] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.254137  5112 tablet_replica.cc:333] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.254885  5112 raft_consensus.cc:2243] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.255385  5112 raft_consensus.cc:2272] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.258250  5112 tablet_replica.cc:333] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.258992  5112 raft_consensus.cc:2243] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.259483  5112 raft_consensus.cc:2272] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:21.260207 13108 consensus_peers.cc:597] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.261976  5112 tablet_replica.cc:333] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.262806  5112 raft_consensus.cc:2243] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.266520  5112 raft_consensus.cc:2272] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.268819  5112 tablet_replica.cc:333] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.269613  5112 raft_consensus.cc:2243] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.271184  5112 raft_consensus.cc:2272] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:21.273180 13034 consensus_peers.cc:597] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.274784  5112 tablet_replica.cc:333] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.275660  5112 raft_consensus.cc:2243] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.276157  5112 raft_consensus.cc:2272] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:21.276247 13182 consensus_peers.cc:597] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.278262  5112 tablet_replica.cc:333] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.278998  5112 raft_consensus.cc:2243] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.279487  5112 raft_consensus.cc:2272] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.281389  5112 tablet_replica.cc:333] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.281911  5112 raft_consensus.cc:2243] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.282286  5112 raft_consensus.cc:2272] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.284629  5112 tablet_replica.cc:333] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
W20260709 13:17:21.284991 13182 consensus_peers.cc:597] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.285233  5112 raft_consensus.cc:2243] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.285750  5112 raft_consensus.cc:2272] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.287560  5112 tablet_replica.cc:333] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.288082  5112 raft_consensus.cc:2243] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.288762  5112 raft_consensus.cc:2272] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.290592  5112 tablet_replica.cc:333] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.291112  5112 raft_consensus.cc:2243] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.291528  5112 raft_consensus.cc:2272] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.293761  5112 tablet_replica.cc:333] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.294361  5112 raft_consensus.cc:2243] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.294747  5112 raft_consensus.cc:2272] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.296777  5112 tablet_replica.cc:333] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
W20260709 13:17:21.297200 13034 consensus_peers.cc:597] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.297468  5112 raft_consensus.cc:2243] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.298120  5112 raft_consensus.cc:2272] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.300856  5112 tablet_replica.cc:333] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
W20260709 13:17:21.301240 13034 consensus_peers.cc:597] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.301627  5112 raft_consensus.cc:2243] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.302224  5112 raft_consensus.cc:2272] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.304833  5112 tablet_replica.cc:333] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.305509  5112 raft_consensus.cc:2243] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:21.305784 13034 consensus_peers.cc:597] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.305995  5112 raft_consensus.cc:2272] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.308059  5112 tablet_replica.cc:333] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.308598  5112 raft_consensus.cc:2243] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.309046  5112 raft_consensus.cc:2272] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.311558  5112 tablet_replica.cc:333] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.312074  5112 raft_consensus.cc:2243] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.312855  5112 raft_consensus.cc:2272] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.314643  5112 tablet_replica.cc:333] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.315150  5112 raft_consensus.cc:2243] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.315546  5112 raft_consensus.cc:2272] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.317787  5112 tablet_replica.cc:333] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.318399  5112 raft_consensus.cc:2243] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.319340  5112 raft_consensus.cc:2272] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.321094  5112 tablet_replica.cc:333] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.321660  5112 raft_consensus.cc:2243] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.322063  5112 raft_consensus.cc:2272] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.324340  5112 tablet_replica.cc:333] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.324950  5112 raft_consensus.cc:2243] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.325917  5112 raft_consensus.cc:2272] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:21.326790 13182 consensus_peers.cc:597] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.327984  5112 tablet_replica.cc:333] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.328637  5112 raft_consensus.cc:2243] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.329495  5112 raft_consensus.cc:2272] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:21.331466 13108 consensus_peers.cc:597] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.332032  5112 tablet_replica.cc:333] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18: stopping tablet replica
I20260709 13:17:21.332592  5112 raft_consensus.cc:2243] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.333047  5112 raft_consensus.cc:2272] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:21.341526 13034 consensus_peers.cc:597] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.365517 13108 consensus_peers.cc:597] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.374404 13108 consensus_peers.cc:597] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.403563 13182 consensus_peers.cc:597] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.406665  5112 tablet_server.cc:196] TabletServer@127.4.254.1:0 shutdown complete.
W20260709 13:17:21.411324 13182 consensus_peers.cc:597] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.432061 13182 consensus_peers.cc:597] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.436879 13182 consensus_peers.cc:597] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.460806 13182 consensus_peers.cc:597] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.475337 13034 consensus_peers.cc:597] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.479598  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:21.487447 13752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:21.487524 13753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:21.489030 13755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:21.490828 13034 consensus_peers.cc:597] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.491210  5112 server_base.cc:1061] running on GCE node
I20260709 13:17:21.493257  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:21.493554  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:21.493878  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603041493849 us; error 0 us; skew 500 ppm
I20260709 13:17:21.494570  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:17:21.497727 13108 consensus_peers.cc:597] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.500131 13182 consensus_peers.cc:597] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.502866  5112 webserver.cc:533] Webserver started at http://127.4.254.1:39453/ using document root <none> and password file <none>
I20260709 13:17:21.503456  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:21.503675  5112 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:17:21.506523 13182 consensus_peers.cc:597] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.507711  5112 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:17:21.520707 13761 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:21.527132  5112 fs_manager.cc:730] Time spent opening block manager: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:17:21.527639  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-0-root
uuid: "66218fb7f83e41ffa427b95015c3bf18"
format_stamp: "Formatted at 2026-07-09 13:17:10 on dist-test-slave-k73n"
W20260709 13:17:21.529184 13034 consensus_peers.cc:597] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.528252  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602796139571-5112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:17:21.548830 13034 consensus_peers.cc:597] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.553035  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:21.555452  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:21.558008  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:17:21.562191 13034 consensus_peers.cc:597] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.566258 13034 consensus_peers.cc:597] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.573267 13768 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:17:21.601864 13108 consensus_peers.cc:597] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.819993  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:17:21.820397  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.256s	user 0.009s	sys 0.008s
I20260709 13:17:21.820680  5112 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:17:21.824787 13768 tablet_bootstrap.cc:492] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:21.865667 13768 tablet_bootstrap.cc:492] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:21.866648 13768 tablet_bootstrap.cc:492] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:21.867313 13768 ts_tablet_manager.cc:1403] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.012s
I20260709 13:17:21.869699 13768 raft_consensus.cc:359] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:21.870512 13768 raft_consensus.cc:740] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.871233 13768 consensus_queue.cc:260] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:21.890522 13768 ts_tablet_manager.cc:1434] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.004s
I20260709 13:17:21.891470 13768 tablet_bootstrap.cc:492] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:21.904770 13768 tablet_bootstrap.cc:492] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:21.905714 13768 tablet_bootstrap.cc:492] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:21.906318 13768 ts_tablet_manager.cc:1403] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:17:21.908350 13768 raft_consensus.cc:359] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:21.908830 13768 raft_consensus.cc:740] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.909447 13768 consensus_queue.cc:260] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:21.910837 13768 ts_tablet_manager.cc:1434] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:17:21.911562 13768 tablet_bootstrap.cc:492] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:21.930634 13768 tablet_bootstrap.cc:492] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:21.931628 13768 tablet_bootstrap.cc:492] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:21.932282 13768 ts_tablet_manager.cc:1403] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.012s
I20260709 13:17:21.934840 13768 raft_consensus.cc:359] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:21.935539 13768 raft_consensus.cc:740] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.936223 13768 consensus_queue.cc:260] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:21.938155 13768 ts_tablet_manager.cc:1434] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:21.938962 13768 tablet_bootstrap.cc:492] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:21.968293 13768 tablet_bootstrap.cc:492] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:21.969343 13768 tablet_bootstrap.cc:492] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:21.969959 13768 ts_tablet_manager.cc:1403] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.012s
I20260709 13:17:21.972280 13768 raft_consensus.cc:359] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:21.973193 13768 raft_consensus.cc:740] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.974344 13768 consensus_queue.cc:260] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:21.976835 13768 ts_tablet_manager.cc:1434] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:21.977574 13768 tablet_bootstrap.cc:492] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:21.995343 13768 tablet_bootstrap.cc:492] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:21.996215 13768 tablet_bootstrap.cc:492] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:21.996807 13768 ts_tablet_manager.cc:1403] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 13:17:21.999150 13768 raft_consensus.cc:359] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:21.999822 13768 raft_consensus.cc:740] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.000449 13768 consensus_queue.cc:260] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.002373 13768 ts_tablet_manager.cc:1434] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:17:22.003123 13768 tablet_bootstrap.cc:492] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.026419 13768 tablet_bootstrap.cc:492] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.027318 13768 tablet_bootstrap.cc:492] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.027928 13768 ts_tablet_manager.cc:1403] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.011s
I20260709 13:17:22.030299 13768 raft_consensus.cc:359] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.030941 13768 raft_consensus.cc:740] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.031630 13768 consensus_queue.cc:260] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.033496 13768 ts_tablet_manager.cc:1434] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:17:22.034257 13768 tablet_bootstrap.cc:492] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.060115 13768 tablet_bootstrap.cc:492] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.061010 13768 tablet_bootstrap.cc:492] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.061635 13768 ts_tablet_manager.cc:1403] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.008s
I20260709 13:17:22.064481 13768 raft_consensus.cc:359] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.065194 13768 raft_consensus.cc:740] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.065958 13768 consensus_queue.cc:260] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.068046 13768 ts_tablet_manager.cc:1434] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:22.068748 13768 tablet_bootstrap.cc:492] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.083455 13768 tablet_bootstrap.cc:492] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.084326 13768 tablet_bootstrap.cc:492] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.084924 13768 ts_tablet_manager.cc:1403] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:17:22.087234 13768 raft_consensus.cc:359] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.087878 13768 raft_consensus.cc:740] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.088538 13768 consensus_queue.cc:260] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.090471 13768 ts_tablet_manager.cc:1434] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:22.091202 13768 tablet_bootstrap.cc:492] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.112527 13768 tablet_bootstrap.cc:492] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.113487 13768 tablet_bootstrap.cc:492] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.114130 13768 ts_tablet_manager.cc:1403] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 13:17:22.116689 13768 raft_consensus.cc:359] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.117398 13768 raft_consensus.cc:740] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.118135 13768 consensus_queue.cc:260] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.120428 13768 ts_tablet_manager.cc:1434] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:22.121181 13768 tablet_bootstrap.cc:492] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.123791  5112 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:17:22.124133  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.303s	user 0.238s	sys 0.000s
I20260709 13:17:22.169535 13641 raft_consensus.cc:493] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.170135 13641 raft_consensus.cc:515] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
W20260709 13:17:22.176609 13108 leader_election.cc:336] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111)
I20260709 13:17:22.180998 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:22.182494 13107 leader_election.cc:304] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:22.184265 13768 tablet_bootstrap.cc:492] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.185339 13768 tablet_bootstrap.cc:492] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.186368 13699 raft_consensus.cc:2749] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:22.187220 13641 leader_election.cc:290] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:22.186390 13768 ts_tablet_manager.cc:1403] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.065s	user 0.026s	sys 0.023s
I20260709 13:17:22.192389 13768 raft_consensus.cc:359] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.193014 13768 raft_consensus.cc:740] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.193735 13768 consensus_queue.cc:260] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.195834 13768 ts_tablet_manager.cc:1434] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:22.196630 13768 tablet_bootstrap.cc:492] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.226296 13768 tablet_bootstrap.cc:492] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.227236 13768 tablet_bootstrap.cc:492] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.228075 13768 ts_tablet_manager.cc:1403] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.014s
I20260709 13:17:22.230629 13768 raft_consensus.cc:359] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.231392 13768 raft_consensus.cc:740] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.232045 13768 consensus_queue.cc:260] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.233975 13768 ts_tablet_manager.cc:1434] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:22.234746 13768 tablet_bootstrap.cc:492] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.259616 13768 tablet_bootstrap.cc:492] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.260464 13768 tablet_bootstrap.cc:492] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.261225 13768 ts_tablet_manager.cc:1403] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.003s
I20260709 13:17:22.264570 13768 raft_consensus.cc:359] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.265261 13768 raft_consensus.cc:740] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.265971 13768 consensus_queue.cc:260] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.268060 13768 ts_tablet_manager.cc:1434] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 13:17:22.268761 13768 tablet_bootstrap.cc:492] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.281347 13768 tablet_bootstrap.cc:492] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.282168 13768 tablet_bootstrap.cc:492] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.282776 13768 ts_tablet_manager.cc:1403] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.014s	user 0.001s	sys 0.011s
I20260709 13:17:22.285234 13768 raft_consensus.cc:359] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.285872 13768 raft_consensus.cc:740] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.286496 13768 consensus_queue.cc:260] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.288471 13768 ts_tablet_manager.cc:1434] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:22.289258 13768 tablet_bootstrap.cc:492] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.303514 13768 tablet_bootstrap.cc:492] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.304596 13768 tablet_bootstrap.cc:492] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.305414 13768 ts_tablet_manager.cc:1403] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.003s
I20260709 13:17:22.308228 13768 raft_consensus.cc:359] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.308905 13768 raft_consensus.cc:740] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.309630 13768 consensus_queue.cc:260] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.311906 13768 ts_tablet_manager.cc:1434] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:22.312855 13768 tablet_bootstrap.cc:492] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.321528  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.1:42939
I20260709 13:17:22.321658 13840 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.1:42939 every 8 connection(s)
I20260709 13:17:22.360066 13768 tablet_bootstrap.cc:492] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.361400 13768 tablet_bootstrap.cc:492] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.362296 13768 ts_tablet_manager.cc:1403] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.019s
I20260709 13:17:22.365831 13768 raft_consensus.cc:359] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.366753 13768 raft_consensus.cc:740] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.367798 13768 consensus_queue.cc:260] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.371070 13768 ts_tablet_manager.cc:1434] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:22.372174 13768 tablet_bootstrap.cc:492] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.388264 13484 raft_consensus.cc:493] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.388914 13484 raft_consensus.cc:515] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.392571 13484 leader_election.cc:290] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:22.393237 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:22.397929 13768 tablet_bootstrap.cc:492] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.399464 13768 tablet_bootstrap.cc:492] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.400302 13768 ts_tablet_manager.cc:1403] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.004s
I20260709 13:17:22.403474 13768 raft_consensus.cc:359] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.404227 13768 raft_consensus.cc:740] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.404984 13768 consensus_queue.cc:260] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.397910 13484 raft_consensus.cc:493] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.406317 13484 raft_consensus.cc:515] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:22.408756 13484 leader_election.cc:290] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:22.411315 13768 ts_tablet_manager.cc:1434] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:22.412475 13768 tablet_bootstrap.cc:492] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.416671 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:22.438298 13630 raft_consensus.cc:493] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.438889 13630 raft_consensus.cc:515] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.440914 13630 leader_election.cc:290] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:22.441463 13768 tablet_bootstrap.cc:492] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.442729 13768 tablet_bootstrap.cc:492] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.442797 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:22.443527 13140 raft_consensus.cc:2468] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:22.443684 13768 ts_tablet_manager.cc:1403] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.005s
I20260709 13:17:22.445117 13033 leader_election.cc:304] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:22.447245 13633 raft_consensus.cc:2804] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:22.447605 13633 raft_consensus.cc:493] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.447932 13633 raft_consensus.cc:3060] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.448609 13768 raft_consensus.cc:359] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.449595 13768 raft_consensus.cc:740] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.449874 13630 raft_consensus.cc:493] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.450518 13630 raft_consensus.cc:515] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.450505 13768 consensus_queue.cc:260] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.452965 13630 leader_election.cc:290] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:22.454663 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:22.456485 13207 raft_consensus.cc:2468] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 2.
I20260709 13:17:22.455310 13768 ts_tablet_manager.cc:1434] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:17:22.457746 13031 leader_election.cc:304] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:22.458184 13768 tablet_bootstrap.cc:492] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.458634 13630 raft_consensus.cc:2804] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:22.459097 13630 raft_consensus.cc:493] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.459508 13630 raft_consensus.cc:3060] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:22.471174 13633 raft_consensus.cc:515] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.475291 13630 raft_consensus.cc:515] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.483934 13768 tablet_bootstrap.cc:492] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.485294 13768 tablet_bootstrap.cc:492] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.486163 13768 ts_tablet_manager.cc:1403] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.011s
I20260709 13:17:22.489562 13768 raft_consensus.cc:359] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.490461 13768 raft_consensus.cc:740] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.491276 13768 consensus_queue.cc:260] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.495829 13768 ts_tablet_manager.cc:1434] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:22.496869 13768 tablet_bootstrap.cc:492] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.503365 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:22.503988 13207 raft_consensus.cc:3060] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:22.508441 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:22.508998 13140 raft_consensus.cc:3060] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.511049 13207 raft_consensus.cc:2468] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 3.
I20260709 13:17:22.512166 13031 leader_election.cc:304] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:22.513696 13483 raft_consensus.cc:2804] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:22.514117 13483 raft_consensus.cc:697] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 3 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:22.514781 13483 consensus_queue.cc:237] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.515450 13140 raft_consensus.cc:2468] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 2.
I20260709 13:17:22.516547 13633 leader_election.cc:290] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:22.522339 13033 leader_election.cc:304] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:22.522058 13768 tablet_bootstrap.cc:492] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.526613 13768 tablet_bootstrap.cc:492] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.527297 13768 ts_tablet_manager.cc:1403] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.031s	user 0.025s	sys 0.000s
I20260709 13:17:22.527689 13850 raft_consensus.cc:2804] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:22.528323 13850 raft_consensus.cc:697] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 2 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:22.529917 13768 raft_consensus.cc:359] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.530675 13768 raft_consensus.cc:740] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.531508 13768 consensus_queue.cc:260] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.542251 13768 ts_tablet_manager.cc:1434] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:17:22.545765 13630 leader_election.cc:290] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 3 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:22.550549 13768 tablet_bootstrap.cc:492] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.551110 12889 catalog_manager.cc:5697] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 2 to 3, leader changed from 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1) to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 3 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:22.529314 13850 consensus_queue.cc:237] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:22.556470 13807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:22.557485 13808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:22.560580 13808 raft_consensus.cc:3060] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.561306 13812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:22.558372 13809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:22.568849 13034 leader_election.cc:343] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:22.569890 13034 leader_election.cc:343] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.571545 13814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c270ee9d9bf4efaa6f866fe2f248663" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:22.574741 13812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:22.579972 13182 leader_election.cc:343] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.581962 13182 leader_election.cc:304] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:22.584002 13484 raft_consensus.cc:2749] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:22.593144 13033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:36831, user_credentials={real_user=slave}} blocked reactor thread for 62812.9us
I20260709 13:17:22.604249 13842 heartbeater.cc:344] Connected to a master server at 127.4.254.62:45155
I20260709 13:17:22.604734 13842 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:22.605684 13842 heartbeater.cc:507] Master 127.4.254.62:45155 requested a full tablet report, sending...
W20260709 13:17:22.608649 13182 leader_election.cc:343] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.609583 13182 leader_election.cc:304] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:22.610481 13484 raft_consensus.cc:2749] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:22.613826 13641 raft_consensus.cc:493] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.624531 13641 raft_consensus.cc:515] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.626555 13641 leader_election.cc:290] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:22.628436 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668888eb645947b9a0eeb86f97889199" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:22.628916 13808 raft_consensus.cc:2468] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 2.
I20260709 13:17:22.632759 13807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668888eb645947b9a0eeb86f97889199" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:22.637374 13108 leader_election.cc:343] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.637811 13108 leader_election.cc:304] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c538e5be22524c9a970f7a59c5379288; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:22.640386 13584 raft_consensus.cc:2749] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:22.646847 13370 raft_consensus.cc:493] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.647418 13370 raft_consensus.cc:515] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.652171 13370 leader_election.cc:290] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:22.653465 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f418ed3813fa42608ed35304ac9d123b" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:22.664497 13633 raft_consensus.cc:493] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.667016 13809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f418ed3813fa42608ed35304ac9d123b" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:22.665302 13633 raft_consensus.cc:515] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.669626 13484 raft_consensus.cc:493] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.670246 13484 raft_consensus.cc:515] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.671423 13633 leader_election.cc:290] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:22.672180 13484 leader_election.cc:290] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:22.674602 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e5c0d26b904f169897a58bdf500a3a" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:22.686901 12891 ts_manager.cc:194] Re-registered known tserver with Master: 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:22.690078 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668888eb645947b9a0eeb86f97889199" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:22.690903 13142 raft_consensus.cc:2468] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:22.692061 13181 leader_election.cc:304] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:22.679373 13813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e5c0d26b904f169897a58bdf500a3a" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:22.693010 13484 raft_consensus.cc:2804] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:22.682356 13768 tablet_bootstrap.cc:492] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.693470 13484 raft_consensus.cc:493] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.693989 13484 raft_consensus.cc:3060] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.683880 13809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668888eb645947b9a0eeb86f97889199" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:22.698673 13034 leader_election.cc:343] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.699138 13034 leader_election.cc:304] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c23c890764727a91d599e0d75604f; no voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed
I20260709 13:17:22.699563 13768 tablet_bootstrap.cc:492] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.700121 13633 raft_consensus.cc:2749] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:22.700493 13768 ts_tablet_manager.cc:1403] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.150s	user 0.021s	sys 0.040s
W20260709 13:17:22.683487 13182 leader_election.cc:343] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.701016 13182 leader_election.cc:304] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:22.701304 13641 raft_consensus.cc:493] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.701781 13370 raft_consensus.cc:2749] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:22.701678 13484 raft_consensus.cc:515] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.701970 13641 raft_consensus.cc:515] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
W20260709 13:17:22.702980 13182 leader_election.cc:343] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.703593 13484 leader_election.cc:290] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:22.704705 13809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668888eb645947b9a0eeb86f97889199" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:22.705426 13641 leader_election.cc:290] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:22.706372 13809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5483c64ceb1f41e9a6eec70e2f257f96" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:22.706738 13182 leader_election.cc:343] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.707068 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668888eb645947b9a0eeb86f97889199" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:22.707619 13142 raft_consensus.cc:3060] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.707846 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5483c64ceb1f41e9a6eec70e2f257f96" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:22.710543 13768 raft_consensus.cc:359] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.711442 13768 raft_consensus.cc:740] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.712292 13768 consensus_queue.cc:260] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.707042 13809 raft_consensus.cc:2468] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:22.712672 13142 raft_consensus.cc:2468] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 2.
I20260709 13:17:22.717733 13108 leader_election.cc:304] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: c6c79a100f9043f590697441315084ed
I20260709 13:17:22.717978 13181 leader_election.cc:304] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:22.718829 13768 ts_tablet_manager.cc:1434] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:17:22.718957 13641 raft_consensus.cc:2804] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:22.719262 13484 raft_consensus.cc:2804] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:22.719347 13641 raft_consensus.cc:493] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.720088 13484 raft_consensus.cc:697] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 2 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:22.720288 13641 raft_consensus.cc:3060] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.719729 13768 tablet_bootstrap.cc:492] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.723601 13484 consensus_queue.cc:237] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.728993 13641 raft_consensus.cc:515] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.732896 13370 raft_consensus.cc:493] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.734169 13370 raft_consensus.cc:515] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.737283 13370 leader_election.cc:290] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:22.737344 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e5c0d26b904f169897a58bdf500a3a" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f" is_pre_election: true
I20260709 13:17:22.737563 13814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e5c0d26b904f169897a58bdf500a3a" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:22.737953 13067 raft_consensus.cc:2468] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 1.
I20260709 13:17:22.739065 13641 leader_election.cc:290] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:22.740034 13370 raft_consensus.cc:493] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.740383 13814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5483c64ceb1f41e9a6eec70e2f257f96" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:22.740623 13370 raft_consensus.cc:515] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
W20260709 13:17:22.740419 13182 leader_election.cc:343] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.741010 13814 raft_consensus.cc:3060] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.741847 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5483c64ceb1f41e9a6eec70e2f257f96" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:22.742440 13207 raft_consensus.cc:3060] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.742895 13370 leader_election.cc:290] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:22.744410 13809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5483c64ceb1f41e9a6eec70e2f257f96" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
I20260709 13:17:22.748137 13181 leader_election.cc:304] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:22.749162 13484 raft_consensus.cc:2804] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:22.749605 13484 raft_consensus.cc:493] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.749982 13484 raft_consensus.cc:3060] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.752679 13207 raft_consensus.cc:2468] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 2.
I20260709 13:17:22.752727 13142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5483c64ceb1f41e9a6eec70e2f257f96" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c538e5be22524c9a970f7a59c5379288" is_pre_election: true
I20260709 13:17:22.753783 13142 raft_consensus.cc:2393] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6c79a100f9043f590697441315084ed in current term 2: Already voted for candidate c538e5be22524c9a970f7a59c5379288 in this term.
I20260709 13:17:22.757530 13768 tablet_bootstrap.cc:492] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.758204 13105 leader_election.cc:304] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:22.758530 13768 tablet_bootstrap.cc:492] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.759261 13768 ts_tablet_manager.cc:1403] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.000s
I20260709 13:17:22.759513 13864 raft_consensus.cc:2804] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:22.759838 13181 leader_election.cc:304] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:22.760052 13864 raft_consensus.cc:697] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 2 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:22.760591 13370 raft_consensus.cc:2749] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:22.760890 13864 consensus_queue.cc:237] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.761519 13768 raft_consensus.cc:359] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.762216 13768 raft_consensus.cc:740] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.762903 13768 consensus_queue.cc:260] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.764925 13768 ts_tablet_manager.cc:1434] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:22.766160 13768 tablet_bootstrap.cc:492] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.748834 13814 raft_consensus.cc:2468] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 2.
I20260709 13:17:22.769671 12890 catalog_manager.cc:5697] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 1 to 2, leader changed from 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1) to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 2 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:22.770834 13856 raft_consensus.cc:493] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.768528 12889 catalog_manager.cc:5697] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 1 to 2, leader changed from 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1) to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 2 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:22.771332 13856 raft_consensus.cc:515] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.775182 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f418ed3813fa42608ed35304ac9d123b" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:22.775805 13207 raft_consensus.cc:2468] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 1.
I20260709 13:17:22.778882 13031 leader_election.cc:304] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:22.779976 13850 raft_consensus.cc:2804] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:22.780332 13850 raft_consensus.cc:493] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.780687 13850 raft_consensus.cc:3060] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.788887 13768 tablet_bootstrap.cc:492] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.790020 13768 tablet_bootstrap.cc:492] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.790778 13768 ts_tablet_manager.cc:1403] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 13:17:22.793550 13768 raft_consensus.cc:359] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.794193 13768 raft_consensus.cc:740] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.795301 13768 consensus_queue.cc:260] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.797247 13768 ts_tablet_manager.cc:1434] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:22.801208 13584 raft_consensus.cc:493] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.801721 13584 raft_consensus.cc:515] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:22.802949 13768 tablet_bootstrap.cc:492] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.804158 13814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:22.805488 13108 leader_election.cc:343] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.807879 12891 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51780
I20260709 13:17:22.810071 13856 leader_election.cc:290] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:22.811787 13814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f418ed3813fa42608ed35304ac9d123b" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18" is_pre_election: true
W20260709 13:17:22.813242 13034 leader_election.cc:343] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.813573 13842 heartbeater.cc:499] Master 127.4.254.62:45155 was elected leader, sending a full tablet report...
I20260709 13:17:22.814278 13850 raft_consensus.cc:515] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.816176 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed" is_pre_election: true
I20260709 13:17:22.816710 13850 leader_election.cc:290] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:22.818034 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f418ed3813fa42608ed35304ac9d123b" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:22.818642 13212 raft_consensus.cc:3060] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.819171 13207 raft_consensus.cc:2468] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 1.
I20260709 13:17:22.820833 13105 leader_election.cc:304] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:22.823148 13814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f418ed3813fa42608ed35304ac9d123b" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
W20260709 13:17:22.824764 13034 leader_election.cc:343] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.829084 13584 leader_election.cc:290] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:22.830145 13212 raft_consensus.cc:2468] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 2.
I20260709 13:17:22.830174 13584 raft_consensus.cc:2804] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:22.831264 13584 raft_consensus.cc:493] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:22.831656 13031 leader_election.cc:304] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:22.832921 13850 raft_consensus.cc:2804] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:22.833423 13850 raft_consensus.cc:697] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 2 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:22.834259 13850 consensus_queue.cc:237] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.835822 13768 tablet_bootstrap.cc:492] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.835783 13484 raft_consensus.cc:515] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.837002 13768 tablet_bootstrap.cc:492] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.831667 13584 raft_consensus.cc:3060] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.838541 13768 ts_tablet_manager.cc:1403] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.036s	user 0.029s	sys 0.004s
I20260709 13:17:22.841085 13768 raft_consensus.cc:359] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.841775 13768 raft_consensus.cc:740] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.842525 13768 consensus_queue.cc:260] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.844647 13768 ts_tablet_manager.cc:1434] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:22.845510 13768 tablet_bootstrap.cc:492] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.846107 13484 leader_election.cc:290] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939)
I20260709 13:17:22.847147 13814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e5c0d26b904f169897a58bdf500a3a" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:22.848383 12891 catalog_manager.cc:5697] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 1 to 2, leader changed from 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1) to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:22.849967 13182 leader_election.cc:343] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.852320 13066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e5c0d26b904f169897a58bdf500a3a" candidate_uuid: "c6c79a100f9043f590697441315084ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:22.852943 13066 raft_consensus.cc:3060] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.860975 12889 catalog_manager.cc:5697] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 1 to 2, leader changed from 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1) to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 2 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:22.874146 13066 raft_consensus.cc:2468] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6c79a100f9043f590697441315084ed in term 2.
I20260709 13:17:22.882112 13181 leader_election.cc:304] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:22.882877 13768 tablet_bootstrap.cc:492] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.883174 13590 raft_consensus.cc:2804] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:22.883985 13768 tablet_bootstrap.cc:492] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.884442 13590 raft_consensus.cc:697] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 2 LEADER]: Becoming Leader. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:22.884716 13768 ts_tablet_manager.cc:1403] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.011s
I20260709 13:17:22.885367 13590 consensus_queue.cc:237] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.887393 13768 raft_consensus.cc:359] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.890175 13768 raft_consensus.cc:740] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.890851 13768 consensus_queue.cc:260] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.893378 13768 ts_tablet_manager.cc:1434] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:17:22.894171 13768 tablet_bootstrap.cc:492] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.896359 13584 raft_consensus.cc:515] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:22.914717 13814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
I20260709 13:17:22.915163 13584 leader_election.cc:290] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 election: Requested vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
W20260709 13:17:22.915940 13108 leader_election.cc:343] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:22.918440 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:22.919112 13212 raft_consensus.cc:3060] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.926992 13212 raft_consensus.cc:2468] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 2.
I20260709 13:17:22.932196 13105 leader_election.cc:304] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:22.931532 12889 catalog_manager.cc:5697] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed reported cstate change: term changed from 1 to 2, leader changed from 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1) to c6c79a100f9043f590697441315084ed (127.4.254.4). New cstate: current_term: 2 leader_uuid: "c6c79a100f9043f590697441315084ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:22.933322 13584 raft_consensus.cc:2804] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:17:22.933703 13034 consensus_peers.cc:597] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:22.933775 13584 raft_consensus.cc:697] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 2 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:22.934706 13584 consensus_queue.cc:237] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:22.935137 13768 tablet_bootstrap.cc:492] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.936086 13768 tablet_bootstrap.cc:492] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.936724 13768 ts_tablet_manager.cc:1403] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.018s
I20260709 13:17:22.939245 13768 raft_consensus.cc:359] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.940101 13768 raft_consensus.cc:740] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.941001 13768 consensus_queue.cc:260] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:22.943013 13768 ts_tablet_manager.cc:1434] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:22.947062 13768 tablet_bootstrap.cc:492] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.958536 12890 catalog_manager.cc:5697] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 1 to 2, leader changed from 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1) to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:22.959743 13768 tablet_bootstrap.cc:492] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.960672 13768 tablet_bootstrap.cc:492] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.961311 13768 ts_tablet_manager.cc:1403] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.003s
I20260709 13:17:22.963661 13768 raft_consensus.cc:359] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.964323 13768 raft_consensus.cc:740] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.964965 13768 consensus_queue.cc:260] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.967177 13768 ts_tablet_manager.cc:1434] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:22.967912 13768 tablet_bootstrap.cc:492] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:22.993239 13768 tablet_bootstrap.cc:492] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.994148 13768 tablet_bootstrap.cc:492] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:22.995074 13768 ts_tablet_manager.cc:1403] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.008s
I20260709 13:17:22.997356 13212 raft_consensus.cc:1275] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 3 FOLLOWER]: Refusing update from remote peer 293c23c890764727a91d599e0d75604f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:22.997612 13768 raft_consensus.cc:359] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.998301 13768 raft_consensus.cc:740] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.998980 13768 consensus_queue.cc:260] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:22.999276 13856 consensus_queue.cc:1048] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.001399 13768 ts_tablet_manager.cc:1434] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:23.002195 13768 tablet_bootstrap.cc:492] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.031895 13768 tablet_bootstrap.cc:492] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.032797 13768 tablet_bootstrap.cc:492] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.033411 13768 ts_tablet_manager.cc:1403] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.012s
I20260709 13:17:23.035599 13768 raft_consensus.cc:359] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:23.036273 13768 raft_consensus.cc:740] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.036960 13768 consensus_queue.cc:260] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:23.038944 13768 ts_tablet_manager.cc:1434] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:23.039724 13768 tablet_bootstrap.cc:492] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.069888 13768 tablet_bootstrap.cc:492] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.070822 13768 tablet_bootstrap.cc:492] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.071508 13768 ts_tablet_manager.cc:1403] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.015s
I20260709 13:17:23.073316 13768 raft_consensus.cc:359] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:23.073832 13768 raft_consensus.cc:740] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.074396 13768 consensus_queue.cc:260] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:23.076267 13768 ts_tablet_manager.cc:1434] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:17:23.077358 13768 tablet_bootstrap.cc:492] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.089951 13814 raft_consensus.cc:1275] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Refusing update from remote peer 293c23c890764727a91d599e0d75604f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.091449 13855 consensus_queue.cc:1048] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.093456 13768 tablet_bootstrap.cc:492] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.094308 13768 tablet_bootstrap.cc:492] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.094882 13768 ts_tablet_manager.cc:1403] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:17:23.097096 13768 raft_consensus.cc:359] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:23.097711 13768 raft_consensus.cc:740] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.098374 13768 consensus_queue.cc:260] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:23.100301 13768 ts_tablet_manager.cc:1434] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:17:23.100848 13768 tablet_bootstrap.cc:492] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.126053 13140 raft_consensus.cc:1275] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer 293c23c890764727a91d599e0d75604f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.127593 13856 consensus_queue.cc:1048] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.128710 13768 tablet_bootstrap.cc:492] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.144104 13768 tablet_bootstrap.cc:492] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.144821 13768 ts_tablet_manager.cc:1403] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.000s
I20260709 13:17:23.154743 13142 raft_consensus.cc:1275] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer c6c79a100f9043f590697441315084ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.154101 13768 raft_consensus.cc:359] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:23.156067 13768 raft_consensus.cc:740] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.160181 13370 consensus_queue.cc:1048] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.160040 13768 consensus_queue.cc:260] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:23.172765 13768 ts_tablet_manager.cc:1434] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:17:23.174242 13768 tablet_bootstrap.cc:492] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.176281 13212 raft_consensus.cc:1275] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer c538e5be22524c9a970f7a59c5379288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.177759 13641 consensus_queue.cc:1048] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.182806 13814 raft_consensus.cc:1275] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Refusing update from remote peer c538e5be22524c9a970f7a59c5379288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.184880 13584 consensus_queue.cc:1048] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:23.201683 13809 raft_consensus.cc:3060] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:23.216486 13809 raft_consensus.cc:1275] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Refusing update from remote peer c6c79a100f9043f590697441315084ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.225096 13370 consensus_queue.cc:1048] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.285944 13212 raft_consensus.cc:1275] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer 293c23c890764727a91d599e0d75604f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.287675 13633 consensus_queue.cc:1048] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.312546 13768 tablet_bootstrap.cc:492] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.330540 13768 tablet_bootstrap.cc:492] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.331323 13768 ts_tablet_manager.cc:1403] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.157s	user 0.029s	sys 0.032s
I20260709 13:17:23.357038 13768 raft_consensus.cc:359] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:23.357813 13768 raft_consensus.cc:740] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.358501 13768 consensus_queue.cc:260] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:23.367017 13768 ts_tablet_manager.cc:1434] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.035s	user 0.011s	sys 0.000s
I20260709 13:17:23.368671 13768 tablet_bootstrap.cc:492] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.375993 13814 raft_consensus.cc:3060] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.406174 13215 raft_consensus.cc:1275] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer c538e5be22524c9a970f7a59c5379288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.411836 13806 raft_consensus.cc:3060] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:23.425343 13864 consensus_queue.cc:1048] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:23.458326 13108 consensus_peers.cc:597] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:23.467947 13806 raft_consensus.cc:1275] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Refusing update from remote peer 293c23c890764727a91d599e0d75604f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.487537 13850 consensus_queue.cc:1048] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:17:23.475629 13768 tablet_bootstrap.cc:492] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.494577 13768 tablet_bootstrap.cc:492] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.499119 13768 ts_tablet_manager.cc:1403] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.131s	user 0.027s	sys 0.002s
W20260709 13:17:23.510154 13182 consensus_peers.cc:597] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:23.510385 13768 raft_consensus.cc:359] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:23.511415 13768 raft_consensus.cc:740] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.515522 13768 consensus_queue.cc:260] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
W20260709 13:17:23.512816 13181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.3:36831, user_credentials={real_user=slave}} blocked reactor thread for 73676.3us
I20260709 13:17:23.521888 13768 ts_tablet_manager.cc:1434] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:17:23.523260 13768 tablet_bootstrap.cc:492] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
W20260709 13:17:23.534795 13182 consensus_peers.cc:597] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:23.538838 13067 raft_consensus.cc:1275] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer c6c79a100f9043f590697441315084ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.545792 13484 consensus_queue.cc:1048] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.562078 13768 tablet_bootstrap.cc:492] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.563556 13768 tablet_bootstrap.cc:492] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.564489 13768 ts_tablet_manager.cc:1403] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.003s
I20260709 13:17:23.571151 13768 raft_consensus.cc:359] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:23.571894 13768 raft_consensus.cc:740] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.572757 13768 consensus_queue.cc:260] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:23.574977 13768 ts_tablet_manager.cc:1434] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:23.576057 13768 tablet_bootstrap.cc:492] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
W20260709 13:17:23.585866 13034 consensus_peers.cc:597] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:23.602932 13768 tablet_bootstrap.cc:492] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.603874 13768 tablet_bootstrap.cc:492] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.604594 13768 ts_tablet_manager.cc:1403] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.003s
I20260709 13:17:23.606602 13768 raft_consensus.cc:359] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:23.607106 13768 raft_consensus.cc:740] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.607622 13768 consensus_queue.cc:260] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:23.609674 13768 ts_tablet_manager.cc:1434] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:17:23.611142 13768 tablet_bootstrap.cc:492] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.644845 13768 tablet_bootstrap.cc:492] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.645907 13768 tablet_bootstrap.cc:492] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.646617 13768 ts_tablet_manager.cc:1403] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.012s
I20260709 13:17:23.649575 13768 raft_consensus.cc:359] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:23.650648 13768 raft_consensus.cc:740] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.651325 13768 consensus_queue.cc:260] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:23.653538 13768 ts_tablet_manager.cc:1434] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:23.654708 13768 tablet_bootstrap.cc:492] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.666633 13768 tablet_bootstrap.cc:492] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.667413 13768 tablet_bootstrap.cc:492] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.667997 13768 ts_tablet_manager.cc:1403] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:17:23.669765 13768 raft_consensus.cc:359] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:23.670269 13768 raft_consensus.cc:740] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.670820 13768 consensus_queue.cc:260] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:23.672475 13768 ts_tablet_manager.cc:1434] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:17:23.673540 13768 tablet_bootstrap.cc:492] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.686275 13768 tablet_bootstrap.cc:492] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.687186 13768 tablet_bootstrap.cc:492] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.687857 13768 ts_tablet_manager.cc:1403] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.006s
I20260709 13:17:23.690171 13768 raft_consensus.cc:359] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:23.690683 13768 raft_consensus.cc:740] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.691233 13768 consensus_queue.cc:260] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:23.693048 13768 ts_tablet_manager.cc:1434] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:17:23.695431 13768 tablet_bootstrap.cc:492] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.709647 13768 tablet_bootstrap.cc:492] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.710665 13768 tablet_bootstrap.cc:492] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.711330 13768 ts_tablet_manager.cc:1403] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.001s
I20260709 13:17:23.712971 13768 raft_consensus.cc:359] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:23.713558 13768 raft_consensus.cc:740] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.714176 13768 consensus_queue.cc:260] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:23.716354 13768 ts_tablet_manager.cc:1434] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:23.717993 13768 tablet_bootstrap.cc:492] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.732661 13768 tablet_bootstrap.cc:492] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.733574 13768 tablet_bootstrap.cc:492] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.734218 13768 ts_tablet_manager.cc:1403] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 13:17:23.736464 13768 raft_consensus.cc:359] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:23.737112 13768 raft_consensus.cc:740] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.737810 13768 consensus_queue.cc:260] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:23.739147 13768 ts_tablet_manager.cc:1434] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:23.739905 13768 tablet_bootstrap.cc:492] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.752146 13768 tablet_bootstrap.cc:492] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.753068 13768 tablet_bootstrap.cc:492] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.753720 13768 ts_tablet_manager.cc:1403] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:17:23.756026 13768 raft_consensus.cc:359] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:23.756671 13768 raft_consensus.cc:740] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.757419 13768 consensus_queue.cc:260] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:23.759505 13768 ts_tablet_manager.cc:1434] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:23.760296 13768 tablet_bootstrap.cc:492] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.772728 13768 tablet_bootstrap.cc:492] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.773519 13768 tablet_bootstrap.cc:492] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.774122 13768 ts_tablet_manager.cc:1403] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.006s
I20260709 13:17:23.776345 13768 raft_consensus.cc:359] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:23.776981 13768 raft_consensus.cc:740] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.777650 13768 consensus_queue.cc:260] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:23.780241 13768 ts_tablet_manager.cc:1434] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:17:23.781280 13768 tablet_bootstrap.cc:492] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.793818 13768 tablet_bootstrap.cc:492] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.794530 13768 tablet_bootstrap.cc:492] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.795051 13768 ts_tablet_manager.cc:1403] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:17:23.796839 13768 raft_consensus.cc:359] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:23.797405 13768 raft_consensus.cc:740] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.798012 13768 consensus_queue.cc:260] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:23.800058 13768 ts_tablet_manager.cc:1434] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:23.801652 13768 tablet_bootstrap.cc:492] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.813107 13768 tablet_bootstrap.cc:492] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.813874 13768 tablet_bootstrap.cc:492] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.814406 13768 ts_tablet_manager.cc:1403] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:17:23.816146 13768 raft_consensus.cc:359] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:23.816651 13768 raft_consensus.cc:740] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.817245 13768 consensus_queue.cc:260] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:23.818996 13768 ts_tablet_manager.cc:1434] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:17:23.820056 13768 tablet_bootstrap.cc:492] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap starting.
I20260709 13:17:23.832767 13768 tablet_bootstrap.cc:492] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.833580 13768 tablet_bootstrap.cc:492] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18: Bootstrap complete.
I20260709 13:17:23.834326 13768 ts_tablet_manager.cc:1403] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:17:23.836580 13768 raft_consensus.cc:359] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:23.837247 13768 raft_consensus.cc:740] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.837906 13768 consensus_queue.cc:260] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:23.839780 13768 ts_tablet_manager.cc:1434] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:17:23.939545 13809 raft_consensus.cc:3060] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.087195 13809 raft_consensus.cc:3060] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.525520  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:32.578522 13064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b13e68f1bda46e6afb535f52545dc00"
dest_uuid: "293c23c890764727a91d599e0d75604f"
mode: GRACEFUL
new_leader_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:34262
I20260709 13:17:32.579424 13064 raft_consensus.cc:606] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Received request to transfer leadership to TS 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:32.582170 13064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "668942e4495f4e6ca677aa883843b165"
dest_uuid: "293c23c890764727a91d599e0d75604f"
mode: GRACEFUL
new_leader_uuid: "c538e5be22524c9a970f7a59c5379288"
 from {username='slave'} at 127.0.0.1:34262
I20260709 13:17:32.582664 13064 raft_consensus.cc:606] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Received request to transfer leadership to TS c538e5be22524c9a970f7a59c5379288
I20260709 13:17:32.585170 13064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66acbaec0edb4d7fbd364d37ccac32ab"
dest_uuid: "293c23c890764727a91d599e0d75604f"
mode: GRACEFUL
new_leader_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:34262
I20260709 13:17:32.585568 13064 raft_consensus.cc:606] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Received request to transfer leadership to TS 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:32.587484 13064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755"
dest_uuid: "293c23c890764727a91d599e0d75604f"
mode: GRACEFUL
new_leader_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:34262
I20260709 13:17:32.587839 13064 raft_consensus.cc:606] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 2 LEADER]: Received request to transfer leadership to TS 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:32.589830 13064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b9b7d6e83f4063b1a0214df6346486"
dest_uuid: "293c23c890764727a91d599e0d75604f"
mode: GRACEFUL
new_leader_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:34262
I20260709 13:17:32.590173 13064 raft_consensus.cc:606] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Received request to transfer leadership to TS 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:32.602540 13215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9198523b1084931b95003027883ba99"
dest_uuid: "c6c79a100f9043f590697441315084ed"
mode: GRACEFUL
new_leader_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:33566
I20260709 13:17:32.603004 13215 raft_consensus.cc:606] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Received request to transfer leadership to TS 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:32.604166  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:32.605418  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:32.722545 13947 raft_consensus.cc:993] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f: : Instructing follower 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:32.723186 13945 raft_consensus.cc:1081] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Signalling peer 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:32.724867 13807 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1b9b7d6e83f4063b1a0214df6346486"
dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:43324
I20260709 13:17:32.725456 13807 raft_consensus.cc:493] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.725844 13807 raft_consensus.cc:3060] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.734064 13807 raft_consensus.cc:515] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:32.740950 13807 leader_election.cc:290] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:32.749466 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b9b7d6e83f4063b1a0214df6346486" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:32.750217 13064 raft_consensus.cc:3055] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.750519 13064 raft_consensus.cc:740] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:32.751341 13064 consensus_queue.cc:260] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:32.752573 13064 raft_consensus.cc:3060] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.759011 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b9b7d6e83f4063b1a0214df6346486" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:32.759616 13140 raft_consensus.cc:3060] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.766776 13064 raft_consensus.cc:2468] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:32.770922 13764 leader_election.cc:304] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18; no voters: 
I20260709 13:17:32.780843 13140 raft_consensus.cc:2468] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:32.785995 13957 raft_consensus.cc:2804] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.787117 13957 raft_consensus.cc:697] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:32.788062 13957 consensus_queue.cc:237] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:32.794672 13947 raft_consensus.cc:993] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f: : Instructing follower 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:32.795255 13956 raft_consensus.cc:1081] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 2 LEADER]: Signalling peer 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:32.797001 13806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755"
dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:43324
I20260709 13:17:32.797544 13806 raft_consensus.cc:493] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.797887 13806 raft_consensus.cc:3060] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:32.799952 12891 catalog_manager.cc:5697] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 1 to 2, leader changed from 293c23c890764727a91d599e0d75604f (127.4.254.2) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.808404 13806 raft_consensus.cc:515] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:32.810380 13806 leader_election.cc:290] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 3 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:32.811327 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:32.811738 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de0a1c110064cd8b8cecc8c4728e755" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:32.811941 13064 raft_consensus.cc:3055] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:32.812283 13140 raft_consensus.cc:3060] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:32.812302 13064 raft_consensus.cc:740] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:32.813467 13064 consensus_queue.cc:260] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:32.814807 13064 raft_consensus.cc:3060] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:32.819284 13140 raft_consensus.cc:2468] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 3.
I20260709 13:17:32.820726 13764 leader_election.cc:304] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:32.821733 13957 raft_consensus.cc:2804] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:32.822072 13064 raft_consensus.cc:2468] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 3.
I20260709 13:17:32.822240 13957 raft_consensus.cc:697] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 3 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:32.823369 13957 consensus_queue.cc:237] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:32.831960 13947 raft_consensus.cc:993] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f: : Instructing follower c538e5be22524c9a970f7a59c5379288 to start an election
I20260709 13:17:32.832489 13956 raft_consensus.cc:1081] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Signalling peer c538e5be22524c9a970f7a59c5379288 to start an election
I20260709 13:17:32.833977 13140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "668942e4495f4e6ca677aa883843b165"
dest_uuid: "c538e5be22524c9a970f7a59c5379288"
 from {username='slave'} at 127.0.0.1:41662
I20260709 13:17:32.834396 13140 raft_consensus.cc:493] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.834671 13140 raft_consensus.cc:3060] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.838577 12891 catalog_manager.cc:5697] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 2 to 3, leader changed from 293c23c890764727a91d599e0d75604f (127.4.254.2) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 3 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.839176 13140 raft_consensus.cc:515] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:32.841737 13140 leader_election.cc:290] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:32.842242 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668942e4495f4e6ca677aa883843b165" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:32.842231 13215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668942e4495f4e6ca677aa883843b165" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:32.842981 13064 raft_consensus.cc:3055] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.843189 13215 raft_consensus.cc:3060] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.843348 13064 raft_consensus.cc:740] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:32.844187 13064 consensus_queue.cc:260] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:32.845554 13064 raft_consensus.cc:3060] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.850366 13215 raft_consensus.cc:2468] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 2.
I20260709 13:17:32.851610 13105 leader_election.cc:304] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:32.852320 13930 raft_consensus.cc:2804] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.852451 13064 raft_consensus.cc:2468] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 2.
I20260709 13:17:32.852685 13930 raft_consensus.cc:697] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 2 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:32.853565 13930 consensus_queue.cc:237] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:32.864899 12891 catalog_manager.cc:5697] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 1 to 2, leader changed from 293c23c890764727a91d599e0d75604f (127.4.254.2) to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.933601 13946 raft_consensus.cc:993] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed: : Instructing follower 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:32.934120 13949 raft_consensus.cc:1081] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Signalling peer 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:32.935459 13806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9198523b1084931b95003027883ba99"
dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:43314
I20260709 13:17:32.935940 13806 raft_consensus.cc:493] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.936208 13806 raft_consensus.cc:3060] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.942580 13806 raft_consensus.cc:515] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:32.946197 13806 leader_election.cc:290] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:32.948236 13956 raft_consensus.cc:993] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f: : Instructing follower 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:32.948745 13956 raft_consensus.cc:1081] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Signalling peer 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:32.950351 13806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66acbaec0edb4d7fbd364d37ccac32ab"
dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:43324
I20260709 13:17:32.950907 13806 raft_consensus.cc:493] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.951289 13806 raft_consensus.cc:3060] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.958082 13806 raft_consensus.cc:515] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:32.958729 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9198523b1084931b95003027883ba99" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:32.959275 13207 raft_consensus.cc:3055] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.959549 13207 raft_consensus.cc:740] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:32.960263 13207 consensus_queue.cc:260] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:32.961758 13207 raft_consensus.cc:3060] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.962073 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbaec0edb4d7fbd364d37ccac32ab" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:32.962625 13140 raft_consensus.cc:3060] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.958118 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9198523b1084931b95003027883ba99" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:32.963586 13064 raft_consensus.cc:3060] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.962603 13065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66acbaec0edb4d7fbd364d37ccac32ab" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:32.966351 13065 raft_consensus.cc:3055] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.966671 13065 raft_consensus.cc:740] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:32.967478 13065 consensus_queue.cc:260] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:32.968683 13065 raft_consensus.cc:3060] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.974714 13140 raft_consensus.cc:2468] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:32.975895 13764 leader_election.cc:304] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:32.976770 13957 raft_consensus.cc:2804] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.977293 13957 raft_consensus.cc:697] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:32.976946 13207 raft_consensus.cc:2468] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:32.978188 13064 raft_consensus.cc:2468] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:32.978499 13806 leader_election.cc:290] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:32.978157 13957 consensus_queue.cc:237] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:32.979219 13762 leader_election.cc:304] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:32.979341 13065 raft_consensus.cc:2468] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:32.980234 13958 raft_consensus.cc:2804] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.983071 13958 raft_consensus.cc:697] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:32.984253 13958 consensus_queue.cc:237] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:32.991586 12891 catalog_manager.cc:5697] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 1 to 2, leader changed from 293c23c890764727a91d599e0d75604f (127.4.254.2) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.004662 12891 catalog_manager.cc:5697] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 1 to 2, leader changed from c6c79a100f9043f590697441315084ed (127.4.254.4) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.020884 13947 raft_consensus.cc:993] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f: : Instructing follower 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:33.021347 13945 raft_consensus.cc:1081] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Signalling peer 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:33.022727 13814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b13e68f1bda46e6afb535f52545dc00"
dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:43324
I20260709 13:17:33.023243 13814 raft_consensus.cc:493] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:33.023571 13814 raft_consensus.cc:3060] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.033181 13814 raft_consensus.cc:515] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:33.036041 13064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b13e68f1bda46e6afb535f52545dc00" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:33.036593 13064 raft_consensus.cc:3055] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.036855 13064 raft_consensus.cc:740] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:33.037590 13064 consensus_queue.cc:260] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:33.038641 13064 raft_consensus.cc:3060] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.046896 13064 raft_consensus.cc:2468] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:33.048115 13814 leader_election.cc:290] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:33.049623 13764 leader_election.cc:304] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18; no voters: 
I20260709 13:17:33.050508 13958 raft_consensus.cc:2804] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.050952 13958 raft_consensus.cc:697] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:33.051783 13958 consensus_queue.cc:237] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:33.062620 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b13e68f1bda46e6afb535f52545dc00" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:33.063177 13138 raft_consensus.cc:3060] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.070297 13138 raft_consensus.cc:2468] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:33.083098 12891 catalog_manager.cc:5697] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 1 to 2, leader changed from 293c23c890764727a91d599e0d75604f (127.4.254.2) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.166301 13064 raft_consensus.cc:1275] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.167459 13958 consensus_queue.cc:1048] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.180186 13138 raft_consensus.cc:1275] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.181594 13958 consensus_queue.cc:1048] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.276988 13065 raft_consensus.cc:1275] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer c538e5be22524c9a970f7a59c5379288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.278435 13938 consensus_queue.cc:1048] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.290009 13207 raft_consensus.cc:1275] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer c538e5be22524c9a970f7a59c5379288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.291465 13930 consensus_queue.cc:1048] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.296073 13138 raft_consensus.cc:1275] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 3 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:33.297549 13958 consensus_queue.cc:1048] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:33.334919 13065 raft_consensus.cc:1275] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 3 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:33.337572 13957 consensus_queue.cc:1048] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:33.369026 13207 raft_consensus.cc:1275] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.370410 13957 consensus_queue.cc:1048] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.382405 13065 raft_consensus.cc:1275] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.383724 13966 consensus_queue.cc:1048] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.460095 13065 raft_consensus.cc:1275] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.461377 13966 consensus_queue.cc:1048] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.471657 13138 raft_consensus.cc:1275] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.472891 13958 consensus_queue.cc:1048] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.542062 13138 raft_consensus.cc:1275] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.543452 13958 consensus_queue.cc:1048] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.554889 13065 raft_consensus.cc:1275] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.556339 13957 consensus_queue.cc:1048] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.606273  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:33.657474  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:33.690883 13064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f853a78f0704cbea0a4794c62412b27"
dest_uuid: "293c23c890764727a91d599e0d75604f"
mode: GRACEFUL
new_leader_uuid: "c538e5be22524c9a970f7a59c5379288"
 from {username='slave'} at 127.0.0.1:34262
I20260709 13:17:33.691437 13064 raft_consensus.cc:606] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Received request to transfer leadership to TS c538e5be22524c9a970f7a59c5379288
I20260709 13:17:33.693995 13064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4903a5109902424b919c33e97f22b096"
dest_uuid: "293c23c890764727a91d599e0d75604f"
mode: GRACEFUL
new_leader_uuid: "c538e5be22524c9a970f7a59c5379288"
 from {username='slave'} at 127.0.0.1:34262
I20260709 13:17:33.694453 13064 raft_consensus.cc:606] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Received request to transfer leadership to TS c538e5be22524c9a970f7a59c5379288
I20260709 13:17:33.696852 13065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f3b9e0089ed417d857d2dacb7cdc85f"
dest_uuid: "293c23c890764727a91d599e0d75604f"
mode: GRACEFUL
new_leader_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:34262
I20260709 13:17:33.697405 13065 raft_consensus.cc:606] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Received request to transfer leadership to TS 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:33.700537 13207 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9713e0bcb2b64111a73eaa424eb16574"
dest_uuid: "c6c79a100f9043f590697441315084ed"
mode: GRACEFUL
new_leader_uuid: "293c23c890764727a91d599e0d75604f"
 from {username='slave'} at 127.0.0.1:33566
I20260709 13:17:33.701074 13207 raft_consensus.cc:606] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Received request to transfer leadership to TS 293c23c890764727a91d599e0d75604f
I20260709 13:17:33.703483 13065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3fa4a311cc64cd197ab6bdae52c3f96"
dest_uuid: "293c23c890764727a91d599e0d75604f"
mode: GRACEFUL
new_leader_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:34262
I20260709 13:17:33.703960 13065 raft_consensus.cc:606] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Received request to transfer leadership to TS 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:33.715553 13138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f045d0ee1dab4622a49c705aec5c2168"
dest_uuid: "c538e5be22524c9a970f7a59c5379288"
mode: GRACEFUL
new_leader_uuid: "293c23c890764727a91d599e0d75604f"
 from {username='slave'} at 127.0.0.1:46980
I20260709 13:17:33.716058 13138 raft_consensus.cc:606] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Received request to transfer leadership to TS 293c23c890764727a91d599e0d75604f
I20260709 13:17:33.717193  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:33.718653  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:33.791581 13945 raft_consensus.cc:993] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f: : Instructing follower c538e5be22524c9a970f7a59c5379288 to start an election
I20260709 13:17:33.792030 13947 raft_consensus.cc:1081] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Signalling peer c538e5be22524c9a970f7a59c5379288 to start an election
I20260709 13:17:33.793329 13138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f853a78f0704cbea0a4794c62412b27"
dest_uuid: "c538e5be22524c9a970f7a59c5379288"
 from {username='slave'} at 127.0.0.1:41662
I20260709 13:17:33.793793 13138 raft_consensus.cc:493] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:33.794106 13138 raft_consensus.cc:3060] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.797119 13945 raft_consensus.cc:993] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f: : Instructing follower 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:33.797637 13947 raft_consensus.cc:1081] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Signalling peer 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:33.798961 13806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f3b9e0089ed417d857d2dacb7cdc85f"
dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:43324
I20260709 13:17:33.799433 13806 raft_consensus.cc:493] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:33.799459 13138 raft_consensus.cc:515] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:33.799927 13806 raft_consensus.cc:3060] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.801951 13065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f853a78f0704cbea0a4794c62412b27" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:33.802423 13065 raft_consensus.cc:3055] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.802449 13138 leader_election.cc:290] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:33.802793 13065 raft_consensus.cc:740] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:33.803587 13065 consensus_queue.cc:260] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:33.804476 13065 raft_consensus.cc:3060] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.806083 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f853a78f0704cbea0a4794c62412b27" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:33.805928 13806 raft_consensus.cc:515] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:33.806650 13207 raft_consensus.cc:3060] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.807888 13806 leader_election.cc:290] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:33.809094 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3b9e0089ed417d857d2dacb7cdc85f" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:33.809687 13067 raft_consensus.cc:3055] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.809787 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3b9e0089ed417d857d2dacb7cdc85f" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:33.810027 13067 raft_consensus.cc:740] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:33.810388 13065 raft_consensus.cc:2468] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 2.
I20260709 13:17:33.810927 13067 consensus_queue.cc:260] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:33.810426 13138 raft_consensus.cc:3060] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.812274 13067 raft_consensus.cc:3060] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.812712 13107 leader_election.cc:304] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:33.813459 13207 raft_consensus.cc:2468] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 2.
I20260709 13:17:33.813647 13969 raft_consensus.cc:2804] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.814229 13969 raft_consensus.cc:697] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 2 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:33.815054 13969 consensus_queue.cc:237] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:33.818866 13138 raft_consensus.cc:2468] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:33.820186 13764 leader_election.cc:304] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:33.822403 13949 raft_consensus.cc:993] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed: : Instructing follower 293c23c890764727a91d599e0d75604f to start an election
I20260709 13:17:33.822952 13946 raft_consensus.cc:1081] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Signalling peer 293c23c890764727a91d599e0d75604f to start an election
I20260709 13:17:33.822962 13067 raft_consensus.cc:2468] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:33.824599 13067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9713e0bcb2b64111a73eaa424eb16574"
dest_uuid: "293c23c890764727a91d599e0d75604f"
 from {username='slave'} at 127.0.0.1:55680
I20260709 13:17:33.824643 13958 raft_consensus.cc:2804] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.825076 13067 raft_consensus.cc:493] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:33.825244 13958 raft_consensus.cc:697] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:33.825517 13067 raft_consensus.cc:3060] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.826155 13958 consensus_queue.cc:237] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:33.827764 12891 catalog_manager.cc:5697] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 1 to 2, leader changed from 293c23c890764727a91d599e0d75604f (127.4.254.2) to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.842051 13067 raft_consensus.cc:515] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:33.844673 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9713e0bcb2b64111a73eaa424eb16574" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:33.845265 13138 raft_consensus.cc:3060] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.849741 12886 catalog_manager.cc:5697] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 1 to 2, leader changed from 293c23c890764727a91d599e0d75604f (127.4.254.2) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.851769 13138 raft_consensus.cc:2468] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 2.
I20260709 13:17:33.845219 13067 leader_election.cc:290] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:33.844995 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9713e0bcb2b64111a73eaa424eb16574" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:33.853829 13207 raft_consensus.cc:3055] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.854173 13207 raft_consensus.cc:740] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:33.855086 13207 consensus_queue.cc:260] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:33.856158 13207 raft_consensus.cc:3060] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.861821 13033 leader_election.cc:304] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:33.862634 13947 raft_consensus.cc:2804] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.863066 13947 raft_consensus.cc:697] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [term 2 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:33.864240 13207 raft_consensus.cc:2468] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 2.
I20260709 13:17:33.863847 13947 consensus_queue.cc:237] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:33.906226 12886 catalog_manager.cc:5697] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 1 to 2, leader changed from c6c79a100f9043f590697441315084ed (127.4.254.4) to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 2 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.928800 13945 raft_consensus.cc:993] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f: : Instructing follower c538e5be22524c9a970f7a59c5379288 to start an election
I20260709 13:17:33.929246 13945 raft_consensus.cc:1081] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Signalling peer c538e5be22524c9a970f7a59c5379288 to start an election
I20260709 13:17:33.930371 13138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4903a5109902424b919c33e97f22b096"
dest_uuid: "c538e5be22524c9a970f7a59c5379288"
 from {username='slave'} at 127.0.0.1:41662
I20260709 13:17:33.930814 13138 raft_consensus.cc:493] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:33.931105 13138 raft_consensus.cc:3060] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.936944 13138 raft_consensus.cc:515] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:33.938352 13138 leader_election.cc:290] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:33.939077 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4903a5109902424b919c33e97f22b096" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:33.939740 13067 raft_consensus.cc:3055] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.939617 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4903a5109902424b919c33e97f22b096" candidate_uuid: "c538e5be22524c9a970f7a59c5379288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:33.940147 13067 raft_consensus.cc:740] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:33.940310 13207 raft_consensus.cc:3060] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.940953 13067 consensus_queue.cc:260] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:33.942173 13067 raft_consensus.cc:3060] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.947676 13207 raft_consensus.cc:2468] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 2.
I20260709 13:17:33.948323 13067 raft_consensus.cc:2468] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c538e5be22524c9a970f7a59c5379288 in term 2.
I20260709 13:17:33.948714 13105 leader_election.cc:304] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c538e5be22524c9a970f7a59c5379288, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:33.949546 13969 raft_consensus.cc:2804] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.950052 13969 raft_consensus.cc:697] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [term 2 LEADER]: Becoming Leader. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:33.950865 13969 consensus_queue.cc:237] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:33.960570 12886 catalog_manager.cc:5697] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 reported cstate change: term changed from 1 to 2, leader changed from 293c23c890764727a91d599e0d75604f (127.4.254.2) to c538e5be22524c9a970f7a59c5379288 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "c538e5be22524c9a970f7a59c5379288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.992444 13956 raft_consensus.cc:993] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f: : Instructing follower 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:33.992985 13945 raft_consensus.cc:1081] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Signalling peer 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:33.994179 13806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3fa4a311cc64cd197ab6bdae52c3f96"
dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:43324
I20260709 13:17:33.994630 13806 raft_consensus.cc:493] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:33.994903 13806 raft_consensus.cc:3060] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.000488 13806 raft_consensus.cc:515] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:34.002024 13806 leader_election.cc:290] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:34.003021 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fa4a311cc64cd197ab6bdae52c3f96" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:34.003633 13067 raft_consensus.cc:3055] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.003691 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3fa4a311cc64cd197ab6bdae52c3f96" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:34.003970 13067 raft_consensus.cc:740] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:34.004272 13138 raft_consensus.cc:3060] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.004745 13067 consensus_queue.cc:260] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:34.006096 13067 raft_consensus.cc:3060] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.011430 13138 raft_consensus.cc:2468] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:34.012467 13764 leader_election.cc:304] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:34.013216 13966 raft_consensus.cc:2804] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.013674 13966 raft_consensus.cc:697] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:34.014966 13067 raft_consensus.cc:2468] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:34.017653 13966 consensus_queue.cc:237] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:34.027455 12886 catalog_manager.cc:5697] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 1 to 2, leader changed from 293c23c890764727a91d599e0d75604f (127.4.254.2) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.096069 13938 raft_consensus.cc:993] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288: : Instructing follower 293c23c890764727a91d599e0d75604f to start an election
I20260709 13:17:34.096558 13969 raft_consensus.cc:1081] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Signalling peer 293c23c890764727a91d599e0d75604f to start an election
I20260709 13:17:34.097998 13067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f045d0ee1dab4622a49c705aec5c2168"
dest_uuid: "293c23c890764727a91d599e0d75604f"
 from {username='slave'} at 127.0.0.1:55670
I20260709 13:17:34.098436 13067 raft_consensus.cc:493] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:34.098706 13067 raft_consensus.cc:3060] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.103228 13067 raft_consensus.cc:515] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:34.104592 13067 leader_election.cc:290] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:34.105422 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045d0ee1dab4622a49c705aec5c2168" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:34.106115 13138 raft_consensus.cc:3055] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.105588 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045d0ee1dab4622a49c705aec5c2168" candidate_uuid: "293c23c890764727a91d599e0d75604f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:34.106498 13138 raft_consensus.cc:740] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:34.106705 13207 raft_consensus.cc:3060] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.107461 13138 consensus_queue.cc:260] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:34.110510 13138 raft_consensus.cc:3060] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.113478 13207 raft_consensus.cc:2468] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 2.
I20260709 13:17:34.114539 13031 leader_election.cc:304] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:34.115165 13945 raft_consensus.cc:2804] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.115525 13945 raft_consensus.cc:697] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [term 2 LEADER]: Becoming Leader. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:34.117179 13138 raft_consensus.cc:2468] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c23c890764727a91d599e0d75604f in term 2.
I20260709 13:17:34.117348 13945 consensus_queue.cc:237] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:34.127507 12886 catalog_manager.cc:5697] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f reported cstate change: term changed from 1 to 2, leader changed from c538e5be22524c9a970f7a59c5379288 (127.4.254.3) to 293c23c890764727a91d599e0d75604f (127.4.254.2). New cstate: current_term: 2 leader_uuid: "293c23c890764727a91d599e0d75604f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.252446 13138 raft_consensus.cc:1275] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.253564 13958 consensus_queue.cc:1048] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.255174 13207 raft_consensus.cc:1275] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer c538e5be22524c9a970f7a59c5379288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.256486 13938 consensus_queue.cc:1048] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.280709 13067 raft_consensus.cc:1275] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.287905 13958 consensus_queue.cc:1048] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.289781 13065 raft_consensus.cc:1275] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer c538e5be22524c9a970f7a59c5379288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.291887 13969 consensus_queue.cc:1048] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.293486 13215 raft_consensus.cc:1275] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer 293c23c890764727a91d599e0d75604f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.297755 13956 consensus_queue.cc:1048] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.319821 13138 raft_consensus.cc:1275] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer 293c23c890764727a91d599e0d75604f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.329563 13947 consensus_queue.cc:1048] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.482398 13065 raft_consensus.cc:1275] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer c538e5be22524c9a970f7a59c5379288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.486668 14013 consensus_queue.cc:1048] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.498034 13212 raft_consensus.cc:1275] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer c538e5be22524c9a970f7a59c5379288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.499595 14015 consensus_queue.cc:1048] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:34.533797 13138 raft_consensus.cc:1275] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.534927 13958 consensus_queue.cc:1048] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.543753 13065 raft_consensus.cc:1275] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.545358 13966 consensus_queue.cc:1048] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.644295 13138 raft_consensus.cc:1275] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer 293c23c890764727a91d599e0d75604f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.645695 14016 consensus_queue.cc:1048] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:34.653812 13207 raft_consensus.cc:1275] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer 293c23c890764727a91d599e0d75604f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.655493 14018 consensus_queue.cc:1048] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:34.719478  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:34.764287  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:34.800649 13065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1005312f5ba04344b9dd149ba865a121"
dest_uuid: "293c23c890764727a91d599e0d75604f"
mode: GRACEFUL
new_leader_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:34262
I20260709 13:17:34.801286 13065 raft_consensus.cc:606] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Received request to transfer leadership to TS 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:34.803586 13140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11a2dad5f61d4971a5a7ae53bfe10ca3"
dest_uuid: "c538e5be22524c9a970f7a59c5379288"
mode: GRACEFUL
new_leader_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:46980
I20260709 13:17:34.803992 13140 raft_consensus.cc:606] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Received request to transfer leadership to TS 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:34.806124 13140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c"
dest_uuid: "c538e5be22524c9a970f7a59c5379288"
mode: GRACEFUL
new_leader_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:46980
I20260709 13:17:34.806583 13140 raft_consensus.cc:606] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 2 LEADER]: Received request to transfer leadership to TS 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:34.808804 13065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "720ddf9396de4255ba8105124c624739"
dest_uuid: "293c23c890764727a91d599e0d75604f"
mode: GRACEFUL
new_leader_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:34262
I20260709 13:17:34.809264 13065 raft_consensus.cc:606] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Received request to transfer leadership to TS 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:34.811329 13212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffa1f32b4b894946ab9f4cdac887ca19"
dest_uuid: "c6c79a100f9043f590697441315084ed"
mode: GRACEFUL
new_leader_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:33566
I20260709 13:17:34.811757 13212 raft_consensus.cc:606] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Received request to transfer leadership to TS 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:34.812831  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:34.813942  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:34.843412 14016 raft_consensus.cc:993] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f: : Instructing follower 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:34.844044 14017 raft_consensus.cc:1081] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Signalling peer 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:34.846135 13814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "720ddf9396de4255ba8105124c624739"
dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:43324
I20260709 13:17:34.846796 13814 raft_consensus.cc:493] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:34.847133 13814 raft_consensus.cc:3060] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.852953 13814 raft_consensus.cc:515] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:34.854528 13814 leader_election.cc:290] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:34.855185 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720ddf9396de4255ba8105124c624739" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:34.855429 13065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720ddf9396de4255ba8105124c624739" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:34.855847 13212 raft_consensus.cc:3060] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.856014 13065 raft_consensus.cc:3055] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.856400 13065 raft_consensus.cc:740] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:34.857012 13065 consensus_queue.cc:260] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:34.858019 13065 raft_consensus.cc:3060] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.861017 13212 raft_consensus.cc:2468] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:34.862185 13762 leader_election.cc:304] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:34.862843 13065 raft_consensus.cc:2468] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:34.862991 13966 raft_consensus.cc:2804] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.863569 13966 raft_consensus.cc:697] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:34.864447 13966 consensus_queue.cc:237] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:34.873785 12891 catalog_manager.cc:5697] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 1 to 2, leader changed from 293c23c890764727a91d599e0d75604f (127.4.254.2) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.023913 14015 raft_consensus.cc:993] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288: : Instructing follower 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:35.024369 14013 raft_consensus.cc:1081] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 2 LEADER]: Signalling peer 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:35.025645 13814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c"
dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:43338
I20260709 13:17:35.026086 13814 raft_consensus.cc:493] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.026367 13814 raft_consensus.cc:3060] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.033564 14013 raft_consensus.cc:993] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288: : Instructing follower 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:35.034170 14013 raft_consensus.cc:1081] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Signalling peer 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:35.032083 13814 raft_consensus.cc:515] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:35.035802 13809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11a2dad5f61d4971a5a7ae53bfe10ca3"
dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:43338
I20260709 13:17:35.036386 13809 raft_consensus.cc:493] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.037052 13814 leader_election.cc:290] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 3 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:35.036533 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:35.039863 13809 raft_consensus.cc:3060] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.037581 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3989a176cafa4e99bb287f8dbd9a9f1c" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:35.040323 13140 raft_consensus.cc:3055] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:35.040633 13212 raft_consensus.cc:3060] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.040694 13140 raft_consensus.cc:740] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:35.041730 13140 consensus_queue.cc:260] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:35.043025 13140 raft_consensus.cc:3060] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.048049 13140 raft_consensus.cc:2468] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 3.
I20260709 13:17:35.048089 13212 raft_consensus.cc:2468] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 3.
I20260709 13:17:35.048125 13809 raft_consensus.cc:515] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:35.049172 13764 leader_election.cc:304] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:35.050084 13958 raft_consensus.cc:2804] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:35.050570 13958 raft_consensus.cc:697] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 3 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:35.051213 13140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a2dad5f61d4971a5a7ae53bfe10ca3" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:35.051268 13809 leader_election.cc:290] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:35.051905 13140 raft_consensus.cc:3055] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.051438 13958 consensus_queue.cc:237] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:35.052217 13140 raft_consensus.cc:740] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c538e5be22524c9a970f7a59c5379288, State: Running, Role: LEADER
I20260709 13:17:35.053000 13140 consensus_queue.cc:260] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:35.054303 13140 raft_consensus.cc:3060] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.059690 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a2dad5f61d4971a5a7ae53bfe10ca3" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:35.060304 13212 raft_consensus.cc:3060] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.060966 13140 raft_consensus.cc:2468] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:35.062000 13764 leader_election.cc:304] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:35.062875 13958 raft_consensus.cc:2804] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:35.063411 13958 raft_consensus.cc:697] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:35.062937 12891 catalog_manager.cc:5697] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 2 to 3, leader changed from c538e5be22524c9a970f7a59c5379288 (127.4.254.3) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 3 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.065471 13958 consensus_queue.cc:237] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:35.072773 13212 raft_consensus.cc:2468] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:35.078317 12891 catalog_manager.cc:5697] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 1 to 2, leader changed from c538e5be22524c9a970f7a59c5379288 (127.4.254.3) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.220336 13997 raft_consensus.cc:993] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed: : Instructing follower 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:35.220870 13997 raft_consensus.cc:1081] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Signalling peer 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:35.222527 13814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffa1f32b4b894946ab9f4cdac887ca19"
dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:43314
I20260709 13:17:35.223037 13814 raft_consensus.cc:493] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.223356 13814 raft_consensus.cc:3060] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.228410 13814 raft_consensus.cc:515] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:35.230057 13814 leader_election.cc:290] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Requested vote from peers c6c79a100f9043f590697441315084ed (127.4.254.4:36179), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
I20260709 13:17:35.231078 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa1f32b4b894946ab9f4cdac887ca19" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:35.231069 13065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa1f32b4b894946ab9f4cdac887ca19" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:35.231858 13207 raft_consensus.cc:3055] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.231948 13065 raft_consensus.cc:3060] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.232146 13207 raft_consensus.cc:740] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:35.232870 13207 consensus_queue.cc:260] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:35.233860 13207 raft_consensus.cc:3060] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.237473 13065 raft_consensus.cc:2468] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:35.238572 13764 leader_election.cc:304] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18; no voters: 
I20260709 13:17:35.239403 13958 raft_consensus.cc:2804] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:35.239866 13958 raft_consensus.cc:697] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:35.240628 13958 consensus_queue.cc:237] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:35.241276 13207 raft_consensus.cc:2468] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:35.250602 12891 catalog_manager.cc:5697] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 1 to 2, leader changed from c6c79a100f9043f590697441315084ed (127.4.254.4) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.300843 14017 raft_consensus.cc:993] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f: : Instructing follower 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:35.301333 14016 raft_consensus.cc:1081] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Signalling peer 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:35.302819 13814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1005312f5ba04344b9dd149ba865a121"
dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:43324
I20260709 13:17:35.303433 13814 raft_consensus.cc:493] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.303828 13814 raft_consensus.cc:3060] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.309569 13814 raft_consensus.cc:515] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:35.311807 13814 leader_election.cc:290] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Requested vote from peers 293c23c890764727a91d599e0d75604f (127.4.254.2:39523), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
I20260709 13:17:35.312963 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1005312f5ba04344b9dd149ba865a121" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:35.313696 13138 raft_consensus.cc:3060] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.312975 13065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1005312f5ba04344b9dd149ba865a121" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293c23c890764727a91d599e0d75604f"
I20260709 13:17:35.314765 13065 raft_consensus.cc:3055] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.315069 13065 raft_consensus.cc:740] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293c23c890764727a91d599e0d75604f, State: Running, Role: LEADER
I20260709 13:17:35.315817 13065 consensus_queue.cc:260] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:35.317004 13065 raft_consensus.cc:3060] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.320266 13138 raft_consensus.cc:2468] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:35.321367 13764 leader_election.cc:304] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:35.322145 13958 raft_consensus.cc:2804] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:35.322558 13958 raft_consensus.cc:697] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:35.322919 13065 raft_consensus.cc:2468] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:35.323267 13958 consensus_queue.cc:237] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } }
I20260709 13:17:35.332177 12891 catalog_manager.cc:5697] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 1 to 2, leader changed from 293c23c890764727a91d599e0d75604f (127.4.254.2) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.394025 13212 raft_consensus.cc:1275] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.395362 13957 consensus_queue.cc:1048] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.406482 13067 raft_consensus.cc:1275] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.407711 13958 consensus_queue.cc:1048] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.489089 13138 raft_consensus.cc:1275] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.490301 13957 consensus_queue.cc:1048] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.498404 13207 raft_consensus.cc:1275] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.499907 13957 consensus_queue.cc:1048] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.601953 13207 raft_consensus.cc:1275] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 3 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:35.603911 13957 consensus_queue.cc:1048] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:35.633350 13138 raft_consensus.cc:1275] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 3 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:35.635711 13957 consensus_queue.cc:1048] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:35.669486 13067 raft_consensus.cc:1275] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.671482 13957 consensus_queue.cc:1048] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:35.717386 13212 raft_consensus.cc:1275] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.721165 13966 consensus_queue.cc:1048] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:35.741190 13138 raft_consensus.cc:1275] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.742748 13957 consensus_queue.cc:1048] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:35.809412 13108 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:42939, user_credentials={real_user=slave}} blocked reactor thread for 44515.3us
I20260709 13:17:35.815980  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:35.828637 13065 raft_consensus.cc:1275] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.830842 13958 consensus_queue.cc:1048] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:35.902302  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:35.943569 13212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50831cc643d24f00880db6263d32d280"
dest_uuid: "c6c79a100f9043f590697441315084ed"
mode: GRACEFUL
new_leader_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:33566
I20260709 13:17:35.944370 13212 raft_consensus.cc:606] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Received request to transfer leadership to TS 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:35.947814 13212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7205bc9d20124044a1f1e9be55845ed6"
dest_uuid: "c6c79a100f9043f590697441315084ed"
mode: GRACEFUL
new_leader_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:33566
I20260709 13:17:35.948374 13212 raft_consensus.cc:606] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Received request to transfer leadership to TS 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:35.950261  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:35.951998  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:36.376581 14043 raft_consensus.cc:993] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed: : Instructing follower 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:36.377224 14048 raft_consensus.cc:1081] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Signalling peer 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:36.379470 13807 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50831cc643d24f00880db6263d32d280"
dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:43314
I20260709 13:17:36.380026 13807 raft_consensus.cc:493] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:36.380349 13807 raft_consensus.cc:3060] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.389155 13807 raft_consensus.cc:515] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:36.391146 13807 leader_election.cc:290] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:36.398379 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50831cc643d24f00880db6263d32d280" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:36.399142 13207 raft_consensus.cc:3055] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:36.399363 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50831cc643d24f00880db6263d32d280" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:36.399824 14048 raft_consensus.cc:993] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed: : Instructing follower 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:36.400029 13138 raft_consensus.cc:3060] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.400338 14048 raft_consensus.cc:1081] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Signalling peer 66218fb7f83e41ffa427b95015c3bf18 to start an election
I20260709 13:17:36.399446 13207 raft_consensus.cc:740] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:36.402150 13207 consensus_queue.cc:260] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:36.402575 13807 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7205bc9d20124044a1f1e9be55845ed6"
dest_uuid: "66218fb7f83e41ffa427b95015c3bf18"
 from {username='slave'} at 127.0.0.1:43314
I20260709 13:17:36.403280 13807 raft_consensus.cc:493] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:36.408393 13807 raft_consensus.cc:3060] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.403731 13207 raft_consensus.cc:3060] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.409793 13138 raft_consensus.cc:2468] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:36.411970 13764 leader_election.cc:304] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288; no voters: 
I20260709 13:17:36.412885 13957 raft_consensus.cc:2804] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:36.413357 13957 raft_consensus.cc:697] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:36.414307 13957 consensus_queue.cc:237] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:36.417553 13807 raft_consensus.cc:515] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:36.419482 13207 raft_consensus.cc:2468] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:36.420796 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7205bc9d20124044a1f1e9be55845ed6" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6c79a100f9043f590697441315084ed"
I20260709 13:17:36.419637 13807 leader_election.cc:290] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Requested vote from peers c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831), c6c79a100f9043f590697441315084ed (127.4.254.4:36179)
I20260709 13:17:36.421581 13212 raft_consensus.cc:3055] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:36.421908 13212 raft_consensus.cc:740] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6c79a100f9043f590697441315084ed, State: Running, Role: LEADER
I20260709 13:17:36.422696 13212 consensus_queue.cc:260] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:36.423785 13212 raft_consensus.cc:3060] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.424860 13138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7205bc9d20124044a1f1e9be55845ed6" candidate_uuid: "66218fb7f83e41ffa427b95015c3bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c538e5be22524c9a970f7a59c5379288"
I20260709 13:17:36.426149 13138 raft_consensus.cc:3060] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.428260 12889 catalog_manager.cc:5697] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 1 to 2, leader changed from c6c79a100f9043f590697441315084ed (127.4.254.4) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.433097 13212 raft_consensus.cc:2468] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:36.434435 13762 leader_election.cc:304] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66218fb7f83e41ffa427b95015c3bf18, c6c79a100f9043f590697441315084ed; no voters: 
I20260709 13:17:36.433796 13138 raft_consensus.cc:2468] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66218fb7f83e41ffa427b95015c3bf18 in term 2.
I20260709 13:17:36.435362 13957 raft_consensus.cc:2804] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:36.436409 13957 raft_consensus.cc:697] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Becoming Leader. State: Replica: 66218fb7f83e41ffa427b95015c3bf18, State: Running, Role: LEADER
I20260709 13:17:36.437919 13957 consensus_queue.cc:237] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } }
I20260709 13:17:36.486582 12889 catalog_manager.cc:5697] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 reported cstate change: term changed from 1 to 2, leader changed from c6c79a100f9043f590697441315084ed (127.4.254.4) to 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "66218fb7f83e41ffa427b95015c3bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.855798 13142 raft_consensus.cc:1275] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:36.857038 13957 consensus_queue.cc:1048] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:36.883843 13207 raft_consensus.cc:1275] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:36.886998 14063 consensus_queue.cc:1048] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:36.893421 13138 raft_consensus.cc:1275] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:36.896505 13958 consensus_queue.cc:1048] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:36.927330 13207 raft_consensus.cc:1275] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Refusing update from remote peer 66218fb7f83e41ffa427b95015c3bf18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:36.929327 14063 consensus_queue.cc:1048] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:36.952803  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:36.992627  5112 tablet_server.cc:179] TabletServer@127.4.254.1:42939 shutting down...
W20260709 13:17:36.994760 13182 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 93 similar messages]
W20260709 13:17:37.004470 13182 consensus_peers.cc:597] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.006031 13182 consensus_peers.cc:597] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.029997 13034 consensus_peers.cc:597] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.031808 13182 consensus_peers.cc:597] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.035131  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:37.036196  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.036975  5112 raft_consensus.cc:2243] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.037518  5112 raft_consensus.cc:2272] T 862cb9adf046414ea2ed1f18fd42ed07 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.039914  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.040606  5112 raft_consensus.cc:2243] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.041564  5112 raft_consensus.cc:2272] T e9198523b1084931b95003027883ba99 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.044579  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.045305  5112 raft_consensus.cc:2243] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.045783  5112 raft_consensus.cc:2272] T c9bc9d818fc44989bdc08e740dfcd1b3 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.047837  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.048444  5112 raft_consensus.cc:2243] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.049050  5112 raft_consensus.cc:2272] T 4d9d17ac0f6d4b9a9851a6aa26127256 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.052258  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.053013  5112 raft_consensus.cc:2243] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.053783  5112 raft_consensus.cc:2272] T 3989a176cafa4e99bb287f8dbd9a9f1c P 66218fb7f83e41ffa427b95015c3bf18 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.055835  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.056368  5112 raft_consensus.cc:2243] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.056793  5112 raft_consensus.cc:2272] T beda4eef244d40e08532d288c6a7c865 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.059412  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.060043  5112 raft_consensus.cc:2243] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.060534  5112 raft_consensus.cc:2272] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.061317 13108 consensus_peers.cc:597] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.062803  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.063498  5112 raft_consensus.cc:2243] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.063928  5112 raft_consensus.cc:2272] T 96e5c0d26b904f169897a58bdf500a3a P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.066107  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.066913  5112 raft_consensus.cc:2243] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.067379  5112 raft_consensus.cc:2272] T f418ed3813fa42608ed35304ac9d123b P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.069953  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.070575  5112 raft_consensus.cc:2243] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.071038  5112 raft_consensus.cc:2272] T 6c270ee9d9bf4efaa6f866fe2f248663 P 66218fb7f83e41ffa427b95015c3bf18 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.073720  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.074301  5112 raft_consensus.cc:2243] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.074702  5112 raft_consensus.cc:2272] T f1e13a599e4c415d829e003cdcd8d4d8 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.077687  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.078688  5112 raft_consensus.cc:2243] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.079718  5112 raft_consensus.cc:2272] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.081682 13182 consensus_peers.cc:597] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.082543  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.083211  5112 raft_consensus.cc:2243] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.083696  5112 raft_consensus.cc:2272] T 8526082d24944a48aab1c0d78d626587 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.086017  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.086757  5112 raft_consensus.cc:2243] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.087141  5112 raft_consensus.cc:2272] T a2b7a30cf34b4474939be4fcce8ae930 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.089177  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.089956  5112 raft_consensus.cc:2243] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.090387  5112 raft_consensus.cc:2272] T 5505b452a14d41e1877484ca6696497a P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.093030  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.093762  5112 raft_consensus.cc:2243] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.094164  5112 raft_consensus.cc:2272] T 581bf3becdab4773845a749f01ae77cf P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.096124  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.096731  5112 raft_consensus.cc:2243] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.097227  5112 raft_consensus.cc:2272] T 39b407734f414540b3dc28b0c16a3476 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.100031  5112 tablet_replica.cc:333] stopping tablet replica
W20260709 13:17:37.100194 13034 consensus_peers.cc:597] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.100716  5112 raft_consensus.cc:2243] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.101656  5112 raft_consensus.cc:2272] T 1b13e68f1bda46e6afb535f52545dc00 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.103734  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.104341  5112 raft_consensus.cc:2243] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.105209  5112 raft_consensus.cc:2272] T 7f3b9e0089ed417d857d2dacb7cdc85f P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.108006  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.108796  5112 raft_consensus.cc:2243] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.109360  5112 raft_consensus.cc:2272] T d833eb39cd9d47c28d825a09d0bb7d56 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.110939 13182 consensus_peers.cc:597] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.112234  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.112879  5112 raft_consensus.cc:2243] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:17:37.113058 13182 consensus_peers.cc:597] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.113758  5112 raft_consensus.cc:2272] T 66acbaec0edb4d7fbd364d37ccac32ab P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.116150  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.116801  5112 raft_consensus.cc:2243] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.117352  5112 raft_consensus.cc:2272] T b872974f73d3469981669da74502740b P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.119849  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.120637  5112 raft_consensus.cc:2243] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.121753  5112 raft_consensus.cc:2272] T 8de0a1c110064cd8b8cecc8c4728e755 P 66218fb7f83e41ffa427b95015c3bf18 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.124650  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.125406  5112 raft_consensus.cc:2243] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.125886  5112 raft_consensus.cc:2272] T b5ad68b455024af5a1dfcc5dd42cc600 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.126119 13182 consensus_peers.cc:597] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.128544  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.129349  5112 raft_consensus.cc:2243] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.130334  5112 raft_consensus.cc:2272] T ffa1f32b4b894946ab9f4cdac887ca19 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.132254  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.132757  5112 raft_consensus.cc:2243] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.133073  5112 raft_consensus.cc:2272] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.134995  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.135561  5112 raft_consensus.cc:2243] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.135969  5112 raft_consensus.cc:2272] T 4483482a9c42442eaea9bfe345f9c1f0 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.137854  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.138373  5112 raft_consensus.cc:2243] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.138772  5112 raft_consensus.cc:2272] T 9463f9fea2974209a5a12e4f4d3e07ea P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.140733  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.141327  5112 raft_consensus.cc:2243] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.142236  5112 raft_consensus.cc:2272] T c1b9b7d6e83f4063b1a0214df6346486 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.144778  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.145262  5112 raft_consensus.cc:2243] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.145735  5112 raft_consensus.cc:2272] T 668888eb645947b9a0eeb86f97889199 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.147773  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.148283  5112 raft_consensus.cc:2243] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.148865  5112 raft_consensus.cc:2272] T c405efda88e2475f9916d4e89499e058 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.151525  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.152273  5112 raft_consensus.cc:2243] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.152848  5112 raft_consensus.cc:2272] T 59c00d97a4f0421d95d71476563154ed P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.155542  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.156075  5112 raft_consensus.cc:2243] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.156606  5112 raft_consensus.cc:2272] T a154faa8adb64071b0226241e5c5fd24 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.158589 13108 consensus_peers.cc:597] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.159250  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.159924  5112 raft_consensus.cc:2243] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.160389  5112 raft_consensus.cc:2272] T 4bf030a2e0b44f30ace670a840933368 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.163419  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.164215  5112 raft_consensus.cc:2243] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.164700  5112 raft_consensus.cc:2272] T 33a739979c3244169c69c7c9d1c223c0 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.167234  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.167779  5112 raft_consensus.cc:2243] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.168200  5112 raft_consensus.cc:2272] T df6e641d04594c2797442b2393549f6c P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.171092  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.171622  5112 raft_consensus.cc:2243] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.172345  5112 raft_consensus.cc:2272] T 720ddf9396de4255ba8105124c624739 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.174631  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.175351  5112 raft_consensus.cc:2243] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.176283  5112 raft_consensus.cc:2272] T 1005312f5ba04344b9dd149ba865a121 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.178711 13034 consensus_peers.cc:597] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.179014  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.179800  5112 raft_consensus.cc:2243] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.180773  5112 raft_consensus.cc:2272] T 7205bc9d20124044a1f1e9be55845ed6 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.185262 13108 consensus_peers.cc:597] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.186757 13108 consensus_peers.cc:597] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.187923  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.188699  5112 raft_consensus.cc:2243] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.189236  5112 raft_consensus.cc:2272] T fcb4737defc94214adbcf8b7639f3087 P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.192363  5112 tablet_replica.cc:333] stopping tablet replica
W20260709 13:17:37.192859 13034 consensus_peers.cc:597] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.193032  5112 raft_consensus.cc:2243] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.194087  5112 raft_consensus.cc:2272] T 50831cc643d24f00880db6263d32d280 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.194402 13182 consensus_peers.cc:597] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.196815  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.197422  5112 raft_consensus.cc:2243] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.197754  5112 raft_consensus.cc:2272] T 104ab1e98709456eb4495544632b0eeb P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.199631  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.200126  5112 raft_consensus.cc:2243] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.200565  5112 raft_consensus.cc:2272] T 5483c64ceb1f41e9a6eec70e2f257f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.202836  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.203450  5112 raft_consensus.cc:2243] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.204243  5112 raft_consensus.cc:2272] T a3fa4a311cc64cd197ab6bdae52c3f96 P 66218fb7f83e41ffa427b95015c3bf18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.206806  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:37.207490  5112 raft_consensus.cc:2243] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.207950  5112 raft_consensus.cc:2272] T 84a9a68cea89454584f50702e5bd032d P 66218fb7f83e41ffa427b95015c3bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.220461 13108 consensus_peers.cc:597] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.252805 13108 consensus_peers.cc:597] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.278446  5112 tablet_server.cc:196] TabletServer@127.4.254.1:42939 shutdown complete.
W20260709 13:17:37.303112 13182 consensus_peers.cc:597] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.366852 13034 consensus_peers.cc:597] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.372587 13034 consensus_peers.cc:597] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.372946  5112 tablet_server.cc:179] TabletServer@127.4.254.2:0 shutting down...
W20260709 13:17:37.385658 13182 consensus_peers.cc:597] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.399181 13034 consensus_peers.cc:597] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.406392 13108 consensus_peers.cc:597] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.422276  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:37.423264  5112 tablet_replica.cc:333] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f: stopping tablet replica
W20260709 13:17:37.424026 13181 consensus_peers.cc:597] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.424367  5112 raft_consensus.cc:2243] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.425417  5112 raft_consensus.cc:2272] T bef8dfbfd00748febd426f6a0a5b591b P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.428202  5112 tablet_replica.cc:333] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
W20260709 13:17:37.428287 13107 consensus_peers.cc:597] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.428865  5112 raft_consensus.cc:2243] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.429711  5112 raft_consensus.cc:2272] T a2b7a30cf34b4474939be4fcce8ae930 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.431592  5112 tablet_replica.cc:333] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.432199  5112 raft_consensus.cc:2243] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.432610  5112 raft_consensus.cc:2272] T beda4eef244d40e08532d288c6a7c865 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.435175  5112 tablet_replica.cc:333] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.436018  5112 raft_consensus.cc:2243] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.437161  5112 raft_consensus.cc:2272] T 9463f9fea2974209a5a12e4f4d3e07ea P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.439399  5112 tablet_replica.cc:333] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
W20260709 13:17:37.439550 13182 consensus_peers.cc:597] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.440064  5112 raft_consensus.cc:2243] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.440582  5112 raft_consensus.cc:2272] T c1b9b7d6e83f4063b1a0214df6346486 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.442617  5112 tablet_replica.cc:333] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.443212  5112 raft_consensus.cc:2243] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.443980  5112 raft_consensus.cc:2272] T 104ab1e98709456eb4495544632b0eeb P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.446029  5112 tablet_replica.cc:333] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.446594  5112 raft_consensus.cc:2243] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.447012  5112 raft_consensus.cc:2272] T ffa1f32b4b894946ab9f4cdac887ca19 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.448964  5112 tablet_replica.cc:333] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.449638  5112 raft_consensus.cc:2243] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.450052  5112 raft_consensus.cc:2272] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.452144  5112 tablet_replica.cc:333] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.452943  5112 raft_consensus.cc:2243] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.453488  5112 raft_consensus.cc:2272] T 639492da5d6a4c6baaf3d0b8f30f76b9 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.455467 13181 consensus_peers.cc:597] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.456269  5112 tablet_replica.cc:333] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.457173  5112 raft_consensus.cc:2243] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.458161  5112 raft_consensus.cc:2272] T 39b407734f414540b3dc28b0c16a3476 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.459524 13181 consensus_peers.cc:597] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.460620  5112 tablet_replica.cc:333] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.461326  5112 raft_consensus.cc:2243] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.461781  5112 raft_consensus.cc:2272] T 1b13e68f1bda46e6afb535f52545dc00 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.463753  5112 tablet_replica.cc:333] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.464306  5112 raft_consensus.cc:2243] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.465070  5112 raft_consensus.cc:2272] T 59c00d97a4f0421d95d71476563154ed P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.466952  5112 tablet_replica.cc:333] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.467509  5112 raft_consensus.cc:2243] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.468472  5112 raft_consensus.cc:2272] T f045d0ee1dab4622a49c705aec5c2168 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.470934  5112 tablet_replica.cc:333] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.471737  5112 raft_consensus.cc:2243] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.472239  5112 raft_consensus.cc:2272] T 0b9cc31f16c2467c84113f244fcea75f P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.473639 13034 consensus_peers.cc:597] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.474747  5112 tablet_replica.cc:333] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.475299  5112 raft_consensus.cc:2243] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.475658  5112 raft_consensus.cc:2272] T 1005312f5ba04344b9dd149ba865a121 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.477541  5112 tablet_replica.cc:333] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.478053  5112 raft_consensus.cc:2243] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.478412  5112 raft_consensus.cc:2272] T 720ddf9396de4255ba8105124c624739 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.480497  5112 tablet_replica.cc:333] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.481204  5112 raft_consensus.cc:2243] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.481613  5112 raft_consensus.cc:2272] T 5505b452a14d41e1877484ca6696497a P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.483681  5112 tablet_replica.cc:333] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.484472  5112 raft_consensus.cc:2243] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.485498  5112 raft_consensus.cc:2272] T b872974f73d3469981669da74502740b P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.487793  5112 tablet_replica.cc:333] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.488579  5112 raft_consensus.cc:2243] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.489054  5112 raft_consensus.cc:2272] T fcf41f772abd4db09c73e0c6619642fe P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.489928 13108 consensus_peers.cc:597] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.491164  5112 tablet_replica.cc:333] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.491822  5112 raft_consensus.cc:2243] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.492372  5112 raft_consensus.cc:2272] T 8de0a1c110064cd8b8cecc8c4728e755 P 293c23c890764727a91d599e0d75604f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.494619  5112 tablet_replica.cc:333] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.495292  5112 raft_consensus.cc:2243] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.496197  5112 raft_consensus.cc:2272] T b5ad68b455024af5a1dfcc5dd42cc600 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.499078  5112 tablet_replica.cc:333] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.499912  5112 raft_consensus.cc:2243] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.500509  5112 raft_consensus.cc:2272] T 0384e7d3a9d74a11bb77367cbaea5476 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.502929 13034 consensus_peers.cc:597] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.503490  5112 tablet_replica.cc:333] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.504154  5112 raft_consensus.cc:2243] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.504606  5112 raft_consensus.cc:2272] T fcb4737defc94214adbcf8b7639f3087 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.506789  5112 tablet_replica.cc:333] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.507342  5112 raft_consensus.cc:2243] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.507766  5112 raft_consensus.cc:2272] T 64cb17552f904cb5b72197a75fa78b6f P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.509680  5112 tablet_replica.cc:333] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.510212  5112 raft_consensus.cc:2243] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.511085  5112 raft_consensus.cc:2272] T 6c270ee9d9bf4efaa6f866fe2f248663 P 293c23c890764727a91d599e0d75604f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.513612  5112 tablet_replica.cc:333] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.514550  5112 raft_consensus.cc:2243] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.515122  5112 raft_consensus.cc:2272] T f0d38bed483b4fa18d0cf4242e2eb808 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.517874  5112 tablet_replica.cc:333] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.518721  5112 raft_consensus.cc:2243] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:17:37.519403 13107 consensus_peers.cc:597] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.519771  5112 raft_consensus.cc:2272] T a154faa8adb64071b0226241e5c5fd24 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.522658  5112 tablet_replica.cc:333] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.523293  5112 raft_consensus.cc:2243] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.523788  5112 raft_consensus.cc:2272] T 4903a5109902424b919c33e97f22b096 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.526599  5112 tablet_replica.cc:333] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.527347  5112 raft_consensus.cc:2243] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.527904  5112 raft_consensus.cc:2272] T 66acbaec0edb4d7fbd364d37ccac32ab P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.530339 13107 consensus_peers.cc:597] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.532986  5112 tablet_replica.cc:333] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f: stopping tablet replica
W20260709 13:17:37.533169 13108 consensus_peers.cc:597] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 -> Peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Couldn't send request to peer 66218fb7f83e41ffa427b95015c3bf18. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.533806  5112 raft_consensus.cc:2243] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.534283  5112 raft_consensus.cc:2272] T 7f3b9e0089ed417d857d2dacb7cdc85f P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.536711  5112 tablet_replica.cc:333] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.537518  5112 raft_consensus.cc:2243] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.538070  5112 raft_consensus.cc:2272] T d833eb39cd9d47c28d825a09d0bb7d56 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.539341 13181 consensus_peers.cc:597] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.540351  5112 tablet_replica.cc:333] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.540894  5112 raft_consensus.cc:2243] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.541327  5112 raft_consensus.cc:2272] T 1f853a78f0704cbea0a4794c62412b27 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.543099  5112 tablet_replica.cc:333] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.543653  5112 raft_consensus.cc:2243] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.544039  5112 raft_consensus.cc:2272] T ad2b72f78e37437ca470520c1736e2f0 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.546298  5112 tablet_replica.cc:333] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.546792  5112 raft_consensus.cc:2243] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.547550  5112 raft_consensus.cc:2272] T 2a8bbf6cae584ed28932e79f625a4026 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.549587  5112 tablet_replica.cc:333] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.550215  5112 raft_consensus.cc:2243] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.550678  5112 raft_consensus.cc:2272] T a3fa4a311cc64cd197ab6bdae52c3f96 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.552789  5112 tablet_replica.cc:333] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.553344  5112 raft_consensus.cc:2243] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.554168  5112 raft_consensus.cc:2272] T 9713e0bcb2b64111a73eaa424eb16574 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.556607  5112 tablet_replica.cc:333] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
W20260709 13:17:37.556960 13181 consensus_peers.cc:597] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.557337  5112 raft_consensus.cc:2243] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.557816  5112 raft_consensus.cc:2272] T e72a3ace6e8c4edfb0b28ddf70ceb000 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.559725  5112 tablet_replica.cc:333] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.560181  5112 raft_consensus.cc:2243] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.560547  5112 raft_consensus.cc:2272] T 668942e4495f4e6ca677aa883843b165 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.562350  5112 tablet_replica.cc:333] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.562816  5112 raft_consensus.cc:2243] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.563512  5112 raft_consensus.cc:2272] T f418ed3813fa42608ed35304ac9d123b P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.565369  5112 tablet_replica.cc:333] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.565824  5112 raft_consensus.cc:2243] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.566186  5112 raft_consensus.cc:2272] T e9198523b1084931b95003027883ba99 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.567927  5112 tablet_replica.cc:333] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.568383  5112 raft_consensus.cc:2243] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.568836  5112 raft_consensus.cc:2272] T 4bf030a2e0b44f30ace670a840933368 P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.570760  5112 tablet_replica.cc:333] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.571318  5112 raft_consensus.cc:2243] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.571869  5112 raft_consensus.cc:2272] T 96e5c0d26b904f169897a58bdf500a3a P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.574472  5112 tablet_replica.cc:333] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.575207  5112 raft_consensus.cc:2243] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.576231  5112 raft_consensus.cc:2272] T c9bc9d818fc44989bdc08e740dfcd1b3 P 293c23c890764727a91d599e0d75604f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.578655  5112 tablet_replica.cc:333] T 84a9a68cea89454584f50702e5bd032d P 293c23c890764727a91d599e0d75604f: stopping tablet replica
I20260709 13:17:37.579150  5112 raft_consensus.cc:2243] T 84a9a68cea89454584f50702e5bd032d P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.579541  5112 raft_consensus.cc:2272] T 84a9a68cea89454584f50702e5bd032d P 293c23c890764727a91d599e0d75604f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.592453 13107 consensus_peers.cc:597] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.633533 13181 consensus_peers.cc:597] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.660880  5112 tablet_server.cc:196] TabletServer@127.4.254.2:0 shutdown complete.
W20260709 13:17:37.736670 13181 consensus_peers.cc:597] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39523: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.740556 13107 consensus_peers.cc:597] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39523: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.743024 13107 consensus_peers.cc:597] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39523: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.743495 13107 consensus_peers.cc:597] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39523: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.752677  5112 tablet_server.cc:179] TabletServer@127.4.254.3:0 shutting down...
W20260709 13:17:37.791132 13181 consensus_peers.cc:597] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39523: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.792332 13181 consensus_peers.cc:597] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed -> Peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Couldn't send request to peer c538e5be22524c9a970f7a59c5379288. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.793087 13107 consensus_peers.cc:597] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39523: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.795176 13181 consensus_peers.cc:597] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed -> Peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Couldn't send request to peer c538e5be22524c9a970f7a59c5379288. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:37.801285 13181 consensus_peers.cc:597] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed -> Peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Couldn't send request to peer c538e5be22524c9a970f7a59c5379288. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.808105  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:37.809285  5112 tablet_replica.cc:333] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.810259  5112 raft_consensus.cc:2243] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.810851  5112 raft_consensus.cc:2272] T bef8dfbfd00748febd426f6a0a5b591b P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.812274 13107 consensus_peers.cc:597] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39523: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.813413  5112 tablet_replica.cc:333] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.814069  5112 raft_consensus.cc:2243] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.814821  5112 raft_consensus.cc:2272] T 862cb9adf046414ea2ed1f18fd42ed07 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.816774  5112 tablet_replica.cc:333] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.817389  5112 raft_consensus.cc:2243] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.817808  5112 raft_consensus.cc:2272] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.819613  5112 tablet_replica.cc:333] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.820127  5112 raft_consensus.cc:2243] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.820514  5112 raft_consensus.cc:2272] T 1005312f5ba04344b9dd149ba865a121 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.822367  5112 tablet_replica.cc:333] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.822907  5112 raft_consensus.cc:2243] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.823323  5112 raft_consensus.cc:2272] T 4483482a9c42442eaea9bfe345f9c1f0 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.825182  5112 tablet_replica.cc:333] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.825721  5112 raft_consensus.cc:2243] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.826097  5112 raft_consensus.cc:2272] T c1b9b7d6e83f4063b1a0214df6346486 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.827922  5112 tablet_replica.cc:333] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.828490  5112 raft_consensus.cc:2243] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.828891  5112 raft_consensus.cc:2272] T 9463f9fea2974209a5a12e4f4d3e07ea P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.830856  5112 tablet_replica.cc:333] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.831364  5112 raft_consensus.cc:2243] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.831748  5112 raft_consensus.cc:2272] T 39b407734f414540b3dc28b0c16a3476 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.833550  5112 tablet_replica.cc:333] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.834072  5112 raft_consensus.cc:2243] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.834513  5112 raft_consensus.cc:2272] T 1b13e68f1bda46e6afb535f52545dc00 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.836447  5112 tablet_replica.cc:333] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.837239  5112 raft_consensus.cc:2243] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.837668  5112 raft_consensus.cc:2272] T 581bf3becdab4773845a749f01ae77cf P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.838214 13181 consensus_peers.cc:597] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed -> Peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Couldn't send request to peer c538e5be22524c9a970f7a59c5379288. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.839565  5112 tablet_replica.cc:333] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.840196  5112 raft_consensus.cc:2243] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.840621  5112 raft_consensus.cc:2272] T f045d0ee1dab4622a49c705aec5c2168 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.842491  5112 tablet_replica.cc:333] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.843011  5112 raft_consensus.cc:2243] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.843412  5112 raft_consensus.cc:2272] T 59c00d97a4f0421d95d71476563154ed P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.845111  5112 tablet_replica.cc:333] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.845712  5112 raft_consensus.cc:2243] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.846119  5112 raft_consensus.cc:2272] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.848037  5112 tablet_replica.cc:333] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.848696  5112 raft_consensus.cc:2243] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.849329  5112 raft_consensus.cc:2272] T f1e13a599e4c415d829e003cdcd8d4d8 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.851642  5112 tablet_replica.cc:333] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.852406  5112 raft_consensus.cc:2243] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.852855  5112 raft_consensus.cc:2272] T 0b9cc31f16c2467c84113f244fcea75f P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.855082  5112 tablet_replica.cc:333] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.855751  5112 raft_consensus.cc:2243] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.856725  5112 raft_consensus.cc:2272] T 668942e4495f4e6ca677aa883843b165 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.859609  5112 tablet_replica.cc:333] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.860389  5112 raft_consensus.cc:2243] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.861418  5112 raft_consensus.cc:2272] T df6e641d04594c2797442b2393549f6c P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.864078  5112 tablet_replica.cc:333] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.864743  5112 raft_consensus.cc:2243] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.865572  5112 raft_consensus.cc:2272] T 33a739979c3244169c69c7c9d1c223c0 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.867796  5112 tablet_replica.cc:333] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.868449  5112 raft_consensus.cc:2243] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.869318  5112 raft_consensus.cc:2272] T 4bf030a2e0b44f30ace670a840933368 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.871347  5112 tablet_replica.cc:333] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.872036  5112 raft_consensus.cc:2243] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.872891  5112 raft_consensus.cc:2272] T 4903a5109902424b919c33e97f22b096 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.873275 13181 consensus_peers.cc:597] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed -> Peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Couldn't send request to peer c538e5be22524c9a970f7a59c5379288. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.874949  5112 tablet_replica.cc:333] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.875816  5112 raft_consensus.cc:2243] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.876317  5112 raft_consensus.cc:2272] T 7f3b9e0089ed417d857d2dacb7cdc85f P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.880800  5112 tablet_replica.cc:333] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.881763  5112 raft_consensus.cc:2243] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:17:37.882572 13181 consensus_peers.cc:597] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed -> Peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Couldn't send request to peer c538e5be22524c9a970f7a59c5379288. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.882735  5112 raft_consensus.cc:2272] T d833eb39cd9d47c28d825a09d0bb7d56 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.885677  5112 tablet_replica.cc:333] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.886368  5112 raft_consensus.cc:2243] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.886757  5112 raft_consensus.cc:2272] T 66acbaec0edb4d7fbd364d37ccac32ab P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.888576  5112 tablet_replica.cc:333] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.889061  5112 raft_consensus.cc:2243] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.889551  5112 raft_consensus.cc:2272] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.891367  5112 tablet_replica.cc:333] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.891875  5112 raft_consensus.cc:2243] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.892282  5112 raft_consensus.cc:2272] T c405efda88e2475f9916d4e89499e058 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.894137  5112 tablet_replica.cc:333] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.894650  5112 raft_consensus.cc:2243] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.894990  5112 raft_consensus.cc:2272] T 668888eb645947b9a0eeb86f97889199 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.896760  5112 tablet_replica.cc:333] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.897315  5112 raft_consensus.cc:2243] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.897992  5112 raft_consensus.cc:2272] T 64cb17552f904cb5b72197a75fa78b6f P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.899698  5112 tablet_replica.cc:333] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.900141  5112 raft_consensus.cc:2243] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.900506  5112 raft_consensus.cc:2272] T 7205bc9d20124044a1f1e9be55845ed6 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.902130  5112 tablet_replica.cc:333] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.902616  5112 raft_consensus.cc:2243] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.903112  5112 raft_consensus.cc:2272] T 50831cc643d24f00880db6263d32d280 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.906037  5112 tablet_replica.cc:333] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.906608  5112 raft_consensus.cc:2243] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.907356  5112 raft_consensus.cc:2272] T fcb4737defc94214adbcf8b7639f3087 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.909521  5112 tablet_replica.cc:333] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.910097  5112 raft_consensus.cc:2243] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.910971  5112 raft_consensus.cc:2272] T 8526082d24944a48aab1c0d78d626587 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.912168 13181 consensus_peers.cc:597] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed -> Peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Couldn't send request to peer c538e5be22524c9a970f7a59c5379288. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.912827  5112 tablet_replica.cc:333] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.913450  5112 raft_consensus.cc:2243] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.914166  5112 raft_consensus.cc:2272] T 5483c64ceb1f41e9a6eec70e2f257f96 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.915994  5112 tablet_replica.cc:333] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.916504  5112 raft_consensus.cc:2243] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.917243  5112 raft_consensus.cc:2272] T fcf41f772abd4db09c73e0c6619642fe P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.919003  5112 tablet_replica.cc:333] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.919691  5112 raft_consensus.cc:2243] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.920668  5112 raft_consensus.cc:2272] T 0384e7d3a9d74a11bb77367cbaea5476 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.923080  5112 tablet_replica.cc:333] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
W20260709 13:17:37.923169 13181 consensus_peers.cc:597] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed -> Peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Couldn't send request to peer c538e5be22524c9a970f7a59c5379288. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.923842  5112 raft_consensus.cc:2243] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.924324  5112 raft_consensus.cc:2272] T 8de0a1c110064cd8b8cecc8c4728e755 P c538e5be22524c9a970f7a59c5379288 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.925043 13107 consensus_peers.cc:597] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39523: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.926364  5112 tablet_replica.cc:333] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.926959  5112 raft_consensus.cc:2243] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.927377  5112 raft_consensus.cc:2272] T c9bc9d818fc44989bdc08e740dfcd1b3 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.929299  5112 tablet_replica.cc:333] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.929811  5112 raft_consensus.cc:2243] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.930214  5112 raft_consensus.cc:2272] T f0d38bed483b4fa18d0cf4242e2eb808 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.932051  5112 tablet_replica.cc:333] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.932559  5112 raft_consensus.cc:2243] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.932964  5112 raft_consensus.cc:2272] T 2a8bbf6cae584ed28932e79f625a4026 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.934752  5112 tablet_replica.cc:333] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.935264  5112 raft_consensus.cc:2243] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.935679  5112 raft_consensus.cc:2272] T 9713e0bcb2b64111a73eaa424eb16574 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.937822  5112 tablet_replica.cc:333] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.938301  5112 raft_consensus.cc:2243] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.938721  5112 raft_consensus.cc:2272] T a3fa4a311cc64cd197ab6bdae52c3f96 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.940506  5112 tablet_replica.cc:333] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.940985  5112 raft_consensus.cc:2243] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.941756  5112 raft_consensus.cc:2272] T 1f853a78f0704cbea0a4794c62412b27 P c538e5be22524c9a970f7a59c5379288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.943542  5112 tablet_replica.cc:333] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.944036  5112 raft_consensus.cc:2243] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.944446  5112 raft_consensus.cc:2272] T ad2b72f78e37437ca470520c1736e2f0 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.946386  5112 tablet_replica.cc:333] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.946893  5112 raft_consensus.cc:2243] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.947302  5112 raft_consensus.cc:2272] T 3989a176cafa4e99bb287f8dbd9a9f1c P c538e5be22524c9a970f7a59c5379288 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.949285  5112 tablet_replica.cc:333] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288: stopping tablet replica
I20260709 13:17:37.949898  5112 raft_consensus.cc:2243] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.950827  5112 raft_consensus.cc:2272] T e72a3ace6e8c4edfb0b28ddf70ceb000 P c538e5be22524c9a970f7a59c5379288 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.977551 13181 consensus_peers.cc:597] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed -> Peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Couldn't send request to peer 293c23c890764727a91d599e0d75604f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:39523: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.020972  5112 tablet_server.cc:196] TabletServer@127.4.254.3:0 shutdown complete.
W20260709 13:17:38.064778 13181 consensus_peers.cc:597] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed -> Peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Couldn't send request to peer c538e5be22524c9a970f7a59c5379288. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.3:36831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.071390 14043 raft_consensus.cc:493] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:38.072045 14043 raft_consensus.cc:515] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "c538e5be22524c9a970f7a59c5379288" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36831 } } peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } }
I20260709 13:17:38.074538 14043 leader_election.cc:290] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831)
W20260709 13:17:38.079180 13182 leader_election.cc:336] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111)
W20260709 13:17:38.080590 13181 leader_election.cc:336] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Network error: Client connection negotiation failed: client connection to 127.4.254.3:36831: connect: Connection refused (error 111)
I20260709 13:17:38.081027 13181 leader_election.cc:304] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 66218fb7f83e41ffa427b95015c3bf18, c538e5be22524c9a970f7a59c5379288
I20260709 13:17:38.081872 14048 raft_consensus.cc:2749] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:38.081743 14043 raft_consensus.cc:493] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:38.082598 14043 raft_consensus.cc:515] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:38.084518 14043 leader_election.cc:290] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
W20260709 13:17:38.089079 13181 leader_election.cc:336] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Network error: Client connection negotiation failed: client connection to 127.4.254.2:39523: connect: Connection refused (error 111)
W20260709 13:17:38.089604 13182 leader_election.cc:336] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111)
I20260709 13:17:38.089965 13182 leader_election.cc:304] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:38.090585 14043 raft_consensus.cc:2749] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:38.094307  5112 tablet_server.cc:179] TabletServer@127.4.254.4:0 shutting down...
W20260709 13:17:38.124456 13181 consensus_peers.cc:597] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed -> Peer c538e5be22524c9a970f7a59c5379288 (127.4.254.3:36831): Couldn't send request to peer c538e5be22524c9a970f7a59c5379288. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.3:36831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.124353 14043 raft_consensus.cc:493] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66218fb7f83e41ffa427b95015c3bf18)
I20260709 13:17:38.125882 14043 raft_consensus.cc:515] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6c79a100f9043f590697441315084ed" member_type: VOTER last_known_addr { host: "127.4.254.4" port: 36179 } } peers { permanent_uuid: "66218fb7f83e41ffa427b95015c3bf18" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 42939 } } peers { permanent_uuid: "293c23c890764727a91d599e0d75604f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 39523 } }
I20260709 13:17:38.128636 14043 leader_election.cc:290] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939), 293c23c890764727a91d599e0d75604f (127.4.254.2:39523)
W20260709 13:17:38.137923 13182 leader_election.cc:336] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66218fb7f83e41ffa427b95015c3bf18 (127.4.254.1:42939): Network error: Client connection negotiation failed: client connection to 127.4.254.1:42939: connect: Connection refused (error 111)
W20260709 13:17:38.144620 13181 leader_election.cc:336] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 293c23c890764727a91d599e0d75604f (127.4.254.2:39523): Network error: Client connection negotiation failed: client connection to 127.4.254.2:39523: connect: Connection refused (error 111)
I20260709 13:17:38.146834 13181 leader_election.cc:304] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6c79a100f9043f590697441315084ed; no voters: 293c23c890764727a91d599e0d75604f, 66218fb7f83e41ffa427b95015c3bf18
I20260709 13:17:38.147688 14048 raft_consensus.cc:2749] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:38.163193  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:38.164249  5112 tablet_replica.cc:333] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.165267  5112 raft_consensus.cc:2243] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.165839  5112 raft_consensus.cc:2272] T 862cb9adf046414ea2ed1f18fd42ed07 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.168656  5112 tablet_replica.cc:333] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.169546  5112 raft_consensus.cc:2243] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.170106  5112 raft_consensus.cc:2272] T bef8dfbfd00748febd426f6a0a5b591b P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.171974  5112 tablet_replica.cc:333] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.172556  5112 raft_consensus.cc:2243] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.173355  5112 raft_consensus.cc:2272] T 4483482a9c42442eaea9bfe345f9c1f0 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.175194  5112 tablet_replica.cc:333] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.175726  5112 raft_consensus.cc:2243] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.176438  5112 raft_consensus.cc:2272] T beda4eef244d40e08532d288c6a7c865 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.178362  5112 tablet_replica.cc:333] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.178890  5112 raft_consensus.cc:2243] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.179368  5112 raft_consensus.cc:2272] T a2b7a30cf34b4474939be4fcce8ae930 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.181093  5112 tablet_replica.cc:333] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.181684  5112 raft_consensus.cc:2243] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.182544  5112 raft_consensus.cc:2272] T 581bf3becdab4773845a749f01ae77cf P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.184943  5112 tablet_replica.cc:333] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.185719  5112 raft_consensus.cc:2243] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.186261  5112 raft_consensus.cc:2272] T f045d0ee1dab4622a49c705aec5c2168 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.188288  5112 tablet_replica.cc:333] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.188843  5112 raft_consensus.cc:2243] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.189764  5112 raft_consensus.cc:2272] T 4d9d17ac0f6d4b9a9851a6aa26127256 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.192323  5112 tablet_replica.cc:333] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.192916  5112 raft_consensus.cc:2243] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.193344  5112 raft_consensus.cc:2272] T ffa1f32b4b894946ab9f4cdac887ca19 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.194988  5112 tablet_replica.cc:333] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.195479  5112 raft_consensus.cc:2243] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.196126  5112 raft_consensus.cc:2272] T 0d3e2b3b94fc464c8abc3f09cbb895d1 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.197901  5112 tablet_replica.cc:333] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.198367  5112 raft_consensus.cc:2243] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.199021  5112 raft_consensus.cc:2272] T 639492da5d6a4c6baaf3d0b8f30f76b9 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.200882  5112 tablet_replica.cc:333] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.201483  5112 raft_consensus.cc:2243] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.202160  5112 raft_consensus.cc:2272] T f1e13a599e4c415d829e003cdcd8d4d8 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.203889  5112 tablet_replica.cc:333] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.204473  5112 raft_consensus.cc:2243] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.205308  5112 raft_consensus.cc:2272] T 0b9cc31f16c2467c84113f244fcea75f P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.207154  5112 tablet_replica.cc:333] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.207686  5112 raft_consensus.cc:2243] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.208096  5112 raft_consensus.cc:2272] T 7205bc9d20124044a1f1e9be55845ed6 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.210453  5112 tablet_replica.cc:333] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.211102  5112 raft_consensus.cc:2243] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.211582  5112 raft_consensus.cc:2272] T 50831cc643d24f00880db6263d32d280 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.213482  5112 tablet_replica.cc:333] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.213930  5112 raft_consensus.cc:2243] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.214576  5112 raft_consensus.cc:2272] T 5505b452a14d41e1877484ca6696497a P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.216359  5112 tablet_replica.cc:333] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.217031  5112 raft_consensus.cc:2243] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.217549  5112 raft_consensus.cc:2272] T 720ddf9396de4255ba8105124c624739 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.219978  5112 tablet_replica.cc:333] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.220752  5112 raft_consensus.cc:2243] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.221261  5112 raft_consensus.cc:2272] T 64cb17552f904cb5b72197a75fa78b6f P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.223042  5112 tablet_replica.cc:333] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.223569  5112 raft_consensus.cc:2243] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.223959  5112 raft_consensus.cc:2272] T fcf41f772abd4db09c73e0c6619642fe P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.225854  5112 tablet_replica.cc:333] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.226375  5112 raft_consensus.cc:2243] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.226773  5112 raft_consensus.cc:2272] T b872974f73d3469981669da74502740b P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.228442  5112 tablet_replica.cc:333] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.228955  5112 raft_consensus.cc:2243] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.229413  5112 raft_consensus.cc:2272] T 0384e7d3a9d74a11bb77367cbaea5476 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.231160  5112 tablet_replica.cc:333] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.231663  5112 raft_consensus.cc:2243] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.232046  5112 raft_consensus.cc:2272] T b5ad68b455024af5a1dfcc5dd42cc600 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.233748  5112 tablet_replica.cc:333] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.234256  5112 raft_consensus.cc:2243] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.234640  5112 raft_consensus.cc:2272] T 11a2dad5f61d4971a5a7ae53bfe10ca3 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.236286  5112 tablet_replica.cc:333] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.236786  5112 raft_consensus.cc:2243] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.237548  5112 raft_consensus.cc:2272] T c405efda88e2475f9916d4e89499e058 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.239293  5112 tablet_replica.cc:333] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.239775  5112 raft_consensus.cc:2243] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.240520  5112 raft_consensus.cc:2272] T 668888eb645947b9a0eeb86f97889199 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.242432  5112 tablet_replica.cc:333] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.242981  5112 raft_consensus.cc:2243] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.243398  5112 raft_consensus.cc:2272] T 6c270ee9d9bf4efaa6f866fe2f248663 P c6c79a100f9043f590697441315084ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.245079  5112 tablet_replica.cc:333] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.245643  5112 raft_consensus.cc:2243] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.246328  5112 raft_consensus.cc:2272] T f0d38bed483b4fa18d0cf4242e2eb808 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.248085  5112 tablet_replica.cc:333] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.248624  5112 raft_consensus.cc:2243] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.248968  5112 raft_consensus.cc:2272] T a154faa8adb64071b0226241e5c5fd24 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.250777  5112 tablet_replica.cc:333] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.251322  5112 raft_consensus.cc:2243] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.252185  5112 raft_consensus.cc:2272] T 84a9a68cea89454584f50702e5bd032d P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.254014  5112 tablet_replica.cc:333] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.254462  5112 raft_consensus.cc:2243] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.254938  5112 raft_consensus.cc:2272] T df6e641d04594c2797442b2393549f6c P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.257321  5112 tablet_replica.cc:333] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.257776  5112 raft_consensus.cc:2243] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.258121  5112 raft_consensus.cc:2272] T 33a739979c3244169c69c7c9d1c223c0 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.259822  5112 tablet_replica.cc:333] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.260280  5112 raft_consensus.cc:2243] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.260610  5112 raft_consensus.cc:2272] T 668942e4495f4e6ca677aa883843b165 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.262252  5112 tablet_replica.cc:333] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.262682  5112 raft_consensus.cc:2243] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.263029  5112 raft_consensus.cc:2272] T e9198523b1084931b95003027883ba99 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.264595  5112 tablet_replica.cc:333] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.265044  5112 raft_consensus.cc:2243] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.265448  5112 raft_consensus.cc:2272] T f418ed3813fa42608ed35304ac9d123b P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.267091  5112 tablet_replica.cc:333] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.267517  5112 raft_consensus.cc:2243] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.267864  5112 raft_consensus.cc:2272] T 4903a5109902424b919c33e97f22b096 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.269728  5112 tablet_replica.cc:333] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.270252  5112 raft_consensus.cc:2243] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.270648  5112 raft_consensus.cc:2272] T 8526082d24944a48aab1c0d78d626587 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.272383  5112 tablet_replica.cc:333] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.272886  5112 raft_consensus.cc:2243] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.273314  5112 raft_consensus.cc:2272] T 104ab1e98709456eb4495544632b0eeb P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.275103  5112 tablet_replica.cc:333] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.275579  5112 raft_consensus.cc:2243] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.275956  5112 raft_consensus.cc:2272] T 5483c64ceb1f41e9a6eec70e2f257f96 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.277812  5112 tablet_replica.cc:333] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.278306  5112 raft_consensus.cc:2243] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.278743  5112 raft_consensus.cc:2272] T 3989a176cafa4e99bb287f8dbd9a9f1c P c6c79a100f9043f590697441315084ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.280405  5112 tablet_replica.cc:333] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.280887  5112 raft_consensus.cc:2243] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.281648  5112 raft_consensus.cc:2272] T 96e5c0d26b904f169897a58bdf500a3a P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.283479  5112 tablet_replica.cc:333] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.283957  5112 raft_consensus.cc:2243] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.284361  5112 raft_consensus.cc:2272] T 1f853a78f0704cbea0a4794c62412b27 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.286145  5112 tablet_replica.cc:333] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.286628  5112 raft_consensus.cc:2243] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.287334  5112 raft_consensus.cc:2272] T ad2b72f78e37437ca470520c1736e2f0 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.292475  5112 tablet_replica.cc:333] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.292944  5112 raft_consensus.cc:2243] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.293373  5112 raft_consensus.cc:2272] T 2a8bbf6cae584ed28932e79f625a4026 P c6c79a100f9043f590697441315084ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.295078  5112 tablet_replica.cc:333] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed: stopping tablet replica
I20260709 13:17:38.295508  5112 raft_consensus.cc:2243] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.295905  5112 raft_consensus.cc:2272] T 9713e0bcb2b64111a73eaa424eb16574 P c6c79a100f9043f590697441315084ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.377421  5112 tablet_server.cc:196] TabletServer@127.4.254.4:0 shutdown complete.
I20260709 13:17:38.438485  5112 master.cc:562] Master@127.4.254.62:45155 shutting down...
I20260709 13:17:38.463088  5112 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.463593  5112 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.463869  5112 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4111455ddcc04ce3bd95cf730a36307b: stopping tablet replica
I20260709 13:17:38.485302  5112 master.cc:584] Master@127.4.254.62:45155 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (28621 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:17:38.572912  5112 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.254.62:34103
I20260709 13:17:38.574386  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:38.580050 14082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:38.580171 14083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:38.581398 14085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:38.582511  5112 server_base.cc:1061] running on GCE node
I20260709 13:17:38.583693  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:38.583891  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:38.584069  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603058584034 us; error 0 us; skew 500 ppm
I20260709 13:17:38.584607  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:38.587162  5112 webserver.cc:533] Webserver started at http://127.4.254.62:38921/ using document root <none> and password file <none>
I20260709 13:17:38.587641  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:38.587838  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:38.588128  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:38.589346  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/master-0-root/instance:
uuid: "7a01688cc52f4ddf8e07619521110e32"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-k73n"
I20260709 13:17:38.593739  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:17:38.597080 14090 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.597867  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:17:38.598160  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/master-0-root
uuid: "7a01688cc52f4ddf8e07619521110e32"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-k73n"
I20260709 13:17:38.598445  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:38.620538  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:38.621801  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:38.658737  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.62:34103
I20260709 13:17:38.658834 14141 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.62:34103 every 8 connection(s)
I20260709 13:17:38.662568 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:38.672788 14142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32: Bootstrap starting.
I20260709 13:17:38.677534 14142 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:38.681805 14142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32: No bootstrap required, opened a new log
I20260709 13:17:38.684010 14142 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a01688cc52f4ddf8e07619521110e32" member_type: VOTER }
I20260709 13:17:38.684363 14142 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:38.684540 14142 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a01688cc52f4ddf8e07619521110e32, State: Initialized, Role: FOLLOWER
I20260709 13:17:38.685024 14142 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a01688cc52f4ddf8e07619521110e32" member_type: VOTER }
I20260709 13:17:38.685443 14142 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:38.685631 14142 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:38.685843 14142 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.690351 14142 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a01688cc52f4ddf8e07619521110e32" member_type: VOTER }
I20260709 13:17:38.690836 14142 leader_election.cc:304] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a01688cc52f4ddf8e07619521110e32; no voters: 
I20260709 13:17:38.691875 14142 leader_election.cc:290] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:38.692292 14145 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:38.693686 14145 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [term 1 LEADER]: Becoming Leader. State: Replica: 7a01688cc52f4ddf8e07619521110e32, State: Running, Role: LEADER
I20260709 13:17:38.694366 14145 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a01688cc52f4ddf8e07619521110e32" member_type: VOTER }
I20260709 13:17:38.694947 14142 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:38.699546 14147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a01688cc52f4ddf8e07619521110e32. Latest consensus state: current_term: 1 leader_uuid: "7a01688cc52f4ddf8e07619521110e32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a01688cc52f4ddf8e07619521110e32" member_type: VOTER } }
I20260709 13:17:38.700413 14147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:38.700915 14146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a01688cc52f4ddf8e07619521110e32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a01688cc52f4ddf8e07619521110e32" member_type: VOTER } }
I20260709 13:17:38.701422 14146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:38.702445 14152 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:38.707332 14152 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:38.711963  5112 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:38.716004 14152 catalog_manager.cc:1383] Generated new cluster ID: 44f5a4d96df849dd9aa955471fc60837
I20260709 13:17:38.716295 14152 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:38.733337 14152 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:38.734575 14152 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:38.750027 14152 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32: Generated new TSK 0
I20260709 13:17:38.750655 14152 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:38.779630  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:38.786206 14163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:38.788625 14164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:38.789109  5112 server_base.cc:1061] running on GCE node
W20260709 13:17:38.790337 14166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:38.791250  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:38.791488  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:38.791651  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603058791634 us; error 0 us; skew 500 ppm
I20260709 13:17:38.792254  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:38.794498  5112 webserver.cc:533] Webserver started at http://127.4.254.1:33339/ using document root <none> and password file <none>
I20260709 13:17:38.794965  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:38.795169  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:38.795434  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:38.796587  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-0-root/instance:
uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-k73n"
I20260709 13:17:38.800735  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:38.803820 14171 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.804556  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:38.804841  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-0-root
uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-k73n"
I20260709 13:17:38.805107  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:38.833772  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:38.835093  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:38.836495  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:38.838724  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:38.838894  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.839200  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:38.839376  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.878160  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.1:41549
I20260709 13:17:38.878273 14233 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.1:41549 every 8 connection(s)
I20260709 13:17:38.883298  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:38.890445 14238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:38.896720 14239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:38.901340 14241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:38.901388  5112 server_base.cc:1061] running on GCE node
I20260709 13:17:38.901734 14234 heartbeater.cc:344] Connected to a master server at 127.4.254.62:34103
I20260709 13:17:38.902302 14234 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:38.902977  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:38.903028 14234 heartbeater.cc:507] Master 127.4.254.62:34103 requested a full tablet report, sending...
W20260709 13:17:38.903313  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:38.903582  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603058903561 us; error 0 us; skew 500 ppm
I20260709 13:17:38.904321  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:38.905874 14107 ts_manager.cc:194] Registered new tserver with Master: 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549)
I20260709 13:17:38.907240  5112 webserver.cc:533] Webserver started at http://127.4.254.2:39353/ using document root <none> and password file <none>
I20260709 13:17:38.907764  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:38.907956  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:38.908241  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:38.908650 14107 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34758
I20260709 13:17:38.909690  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-1-root/instance:
uuid: "87ea5f0c9a4141eeab03de6631c5288f"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-k73n"
I20260709 13:17:38.914518  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:17:38.917851 14246 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.918574  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:38.918829  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-1-root
uuid: "87ea5f0c9a4141eeab03de6631c5288f"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-k73n"
I20260709 13:17:38.919073  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:38.959944  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:38.961102  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:38.963315  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:38.965970  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:38.966171  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.966439  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:38.966600  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.007364  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.2:44925
I20260709 13:17:39.007472 14308 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.2:44925 every 8 connection(s)
I20260709 13:17:39.012241  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:39.019032 14312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:39.020648 14313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:39.023442 14315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:39.023628  5112 server_base.cc:1061] running on GCE node
I20260709 13:17:39.024780  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:39.025048  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:39.025106 14309 heartbeater.cc:344] Connected to a master server at 127.4.254.62:34103
I20260709 13:17:39.025308  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603059025288 us; error 0 us; skew 500 ppm
I20260709 13:17:39.025712 14309 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:39.026095  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:39.026538 14309 heartbeater.cc:507] Master 127.4.254.62:34103 requested a full tablet report, sending...
I20260709 13:17:39.028800  5112 webserver.cc:533] Webserver started at http://127.4.254.3:44883/ using document root <none> and password file <none>
I20260709 13:17:39.028878 14107 ts_manager.cc:194] Registered new tserver with Master: 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
I20260709 13:17:39.029426  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:39.029661  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:39.029912  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:39.030548 14107 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34770
I20260709 13:17:39.031055  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-2-root/instance:
uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
format_stamp: "Formatted at 2026-07-09 13:17:39 on dist-test-slave-k73n"
I20260709 13:17:39.036813  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:17:39.039911 14320 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.040683  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:39.040980  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-2-root
uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
format_stamp: "Formatted at 2026-07-09 13:17:39 on dist-test-slave-k73n"
I20260709 13:17:39.041311  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:39.052915  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:39.054054  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:39.055428  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:39.057612  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:39.057828  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.058058  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:39.058223  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.097167  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.3:33999
I20260709 13:17:39.097277 14382 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.3:33999 every 8 connection(s)
I20260709 13:17:39.110598 14383 heartbeater.cc:344] Connected to a master server at 127.4.254.62:34103
I20260709 13:17:39.111095 14383 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:39.111768 14383 heartbeater.cc:507] Master 127.4.254.62:34103 requested a full tablet report, sending...
I20260709 13:17:39.113646 14107 ts_manager.cc:194] Registered new tserver with Master: cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:39.114485  5112 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01434843s
I20260709 13:17:39.115000 14107 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34784
I20260709 13:17:39.139319 14107 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34794:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:39.142184 14107 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:39.211455 14347 tablet_service.cc:1511] Processing CreateTablet for tablet 2a415ef9aa884b989791be2a4bfbd0f9 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:39.211612 14346 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1894411bd84c1fba284c731f0f6cc8 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:39.213210 14346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1894411bd84c1fba284c731f0f6cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.213551 14348 tablet_service.cc:1511] Processing CreateTablet for tablet 3e3c66753fd74fcfaa56039d944eee1e (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:39.214859 14348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e3c66753fd74fcfaa56039d944eee1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.217078 14347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a415ef9aa884b989791be2a4bfbd0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.224879 14274 tablet_service.cc:1511] Processing CreateTablet for tablet 3e3c66753fd74fcfaa56039d944eee1e (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:39.225786 14273 tablet_service.cc:1511] Processing CreateTablet for tablet 2a415ef9aa884b989791be2a4bfbd0f9 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:39.226438 14274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e3c66753fd74fcfaa56039d944eee1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.227174 14273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a415ef9aa884b989791be2a4bfbd0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.230497 14345 tablet_service.cc:1511] Processing CreateTablet for tablet 253053b859784b4784bfc2b60edd9703 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:39.231900 14345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253053b859784b4784bfc2b60edd9703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.241664 14344 tablet_service.cc:1511] Processing CreateTablet for tablet 08545673d7a343098386ef8d5ccc7689 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:39.243078 14272 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1894411bd84c1fba284c731f0f6cc8 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:39.245397 14272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1894411bd84c1fba284c731f0f6cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.246335 14397 tablet_bootstrap.cc:492] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0: Bootstrap starting.
I20260709 13:17:39.247164 14343 tablet_service.cc:1511] Processing CreateTablet for tablet 845227310e3b4584985b3bff1ca4e03d (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:39.248124 14344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08545673d7a343098386ef8d5ccc7689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.256969 14271 tablet_service.cc:1511] Processing CreateTablet for tablet 253053b859784b4784bfc2b60edd9703 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:39.252748 14342 tablet_service.cc:1511] Processing CreateTablet for tablet 34c606df0ec347b5bfd8e36621389eec (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:39.258863 14271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253053b859784b4784bfc2b60edd9703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.259004 14342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c606df0ec347b5bfd8e36621389eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.261164 14397 tablet_bootstrap.cc:654] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.261511 14343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845227310e3b4584985b3bff1ca4e03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.270666 14348 tablet_service.cc:1511] Processing CreateTablet for tablet b9d919fb569d45139e5281b21d834815 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:39.272056 14348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d919fb569d45139e5281b21d834815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.273052 14341 tablet_service.cc:1511] Processing CreateTablet for tablet ffaf0ca23c7848579f3293d216159c15 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:39.274416 14341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffaf0ca23c7848579f3293d216159c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.276697 14270 tablet_service.cc:1511] Processing CreateTablet for tablet 08545673d7a343098386ef8d5ccc7689 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:39.278626 14270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08545673d7a343098386ef8d5ccc7689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.292397 14269 tablet_service.cc:1511] Processing CreateTablet for tablet 845227310e3b4584985b3bff1ca4e03d (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:39.293880 14269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845227310e3b4584985b3bff1ca4e03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.299755 14268 tablet_service.cc:1511] Processing CreateTablet for tablet 34c606df0ec347b5bfd8e36621389eec (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:39.301456 14268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c606df0ec347b5bfd8e36621389eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.315574 14267 tablet_service.cc:1511] Processing CreateTablet for tablet b9d919fb569d45139e5281b21d834815 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:39.318169 14397 tablet_bootstrap.cc:492] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0: No bootstrap required, opened a new log
I20260709 13:17:39.318895 14397 ts_tablet_manager.cc:1403] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.000s
I20260709 13:17:39.320312 14266 tablet_service.cc:1511] Processing CreateTablet for tablet ffaf0ca23c7848579f3293d216159c15 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:39.322286 14397 raft_consensus.cc:359] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } }
I20260709 13:17:39.322614 14265 tablet_service.cc:1511] Processing CreateTablet for tablet c82ce00978c948f7b0c9ab6434c2228a (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:39.325865 14397 raft_consensus.cc:385] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.326514 14267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d919fb569d45139e5281b21d834815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.335513 14266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffaf0ca23c7848579f3293d216159c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.341554 14265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82ce00978c948f7b0c9ab6434c2228a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.347075 14398 tablet_bootstrap.cc:492] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f: Bootstrap starting.
I20260709 13:17:39.332875 14340 tablet_service.cc:1511] Processing CreateTablet for tablet c82ce00978c948f7b0c9ab6434c2228a (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:39.351533 14340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82ce00978c948f7b0c9ab6434c2228a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.353168 14199 tablet_service.cc:1511] Processing CreateTablet for tablet 3e3c66753fd74fcfaa56039d944eee1e (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:39.354573 14199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e3c66753fd74fcfaa56039d944eee1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.355583 14191 tablet_service.cc:1511] Processing CreateTablet for tablet ffaf0ca23c7848579f3293d216159c15 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:39.356959 14191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffaf0ca23c7848579f3293d216159c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.357223 14198 tablet_service.cc:1511] Processing CreateTablet for tablet 2a415ef9aa884b989791be2a4bfbd0f9 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:39.358570 14198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a415ef9aa884b989791be2a4bfbd0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.358309 14197 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1894411bd84c1fba284c731f0f6cc8 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:39.359658 14197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1894411bd84c1fba284c731f0f6cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.362396 14190 tablet_service.cc:1511] Processing CreateTablet for tablet c82ce00978c948f7b0c9ab6434c2228a (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:39.362623 14196 tablet_service.cc:1511] Processing CreateTablet for tablet 253053b859784b4784bfc2b60edd9703 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:39.363731 14190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82ce00978c948f7b0c9ab6434c2228a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.364440 14196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253053b859784b4784bfc2b60edd9703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.366693 14195 tablet_service.cc:1511] Processing CreateTablet for tablet 08545673d7a343098386ef8d5ccc7689 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:39.368531 14195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08545673d7a343098386ef8d5ccc7689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.370781 14194 tablet_service.cc:1511] Processing CreateTablet for tablet 845227310e3b4584985b3bff1ca4e03d (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:39.372552 14194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845227310e3b4584985b3bff1ca4e03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.374605 14193 tablet_service.cc:1511] Processing CreateTablet for tablet 34c606df0ec347b5bfd8e36621389eec (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:39.378968 14192 tablet_service.cc:1511] Processing CreateTablet for tablet b9d919fb569d45139e5281b21d834815 (DEFAULT_TABLE table=test-workload [id=3cb3553d0f05499693860fd5aa5f4d91]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:39.380722 14193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c606df0ec347b5bfd8e36621389eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.383339 14192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d919fb569d45139e5281b21d834815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.388427 14398 tablet_bootstrap.cc:654] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.399955 14398 tablet_bootstrap.cc:492] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f: No bootstrap required, opened a new log
I20260709 13:17:39.400581 14398 ts_tablet_manager.cc:1403] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.023s
I20260709 13:17:39.404516 14398 raft_consensus.cc:359] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } }
I20260709 13:17:39.404539 14401 tablet_bootstrap.cc:492] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:39.405292 14398 raft_consensus.cc:385] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.405752 14398 raft_consensus.cc:740] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.406721 14398 consensus_queue.cc:260] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } }
I20260709 13:17:39.411666 14401 tablet_bootstrap.cc:654] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.416035 14398 ts_tablet_manager.cc:1434] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:17:39.416812 14309 heartbeater.cc:499] Master 127.4.254.62:34103 was elected leader, sending a full tablet report...
I20260709 13:17:39.426483 14398 tablet_bootstrap.cc:492] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f: Bootstrap starting.
I20260709 13:17:39.433723 14398 tablet_bootstrap.cc:654] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.418422 14397 raft_consensus.cc:740] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.461938 14397 consensus_queue.cc:260] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } }
I20260709 13:17:39.472532 14398 tablet_bootstrap.cc:492] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f: No bootstrap required, opened a new log
I20260709 13:17:39.473198 14398 ts_tablet_manager.cc:1403] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.013s
I20260709 13:17:39.474733 14401 tablet_bootstrap.cc:492] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8: No bootstrap required, opened a new log
I20260709 13:17:39.475257 14401 ts_tablet_manager.cc:1403] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.007s
I20260709 13:17:39.476045 14398 raft_consensus.cc:359] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.476811 14398 raft_consensus.cc:385] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.477109 14398 raft_consensus.cc:740] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.478193 14401 raft_consensus.cc:359] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.481261 14401 raft_consensus.cc:385] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.481520 14401 raft_consensus.cc:740] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.482210 14401 consensus_queue.cc:260] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.483487 14398 consensus_queue.cc:260] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.489034 14234 heartbeater.cc:499] Master 127.4.254.62:34103 was elected leader, sending a full tablet report...
I20260709 13:17:39.489446 14401 ts_tablet_manager.cc:1434] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:17:39.492614 14398 ts_tablet_manager.cc:1434] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:17:39.495700 14383 heartbeater.cc:499] Master 127.4.254.62:34103 was elected leader, sending a full tablet report...
I20260709 13:17:39.497046 14401 tablet_bootstrap.cc:492] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:39.500028 14397 ts_tablet_manager.cc:1434] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0: Time spent starting tablet: real 0.181s	user 0.007s	sys 0.005s
I20260709 13:17:39.501209 14397 tablet_bootstrap.cc:492] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0: Bootstrap starting.
I20260709 13:17:39.521850 14401 tablet_bootstrap.cc:654] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.522740 14397 tablet_bootstrap.cc:654] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.527438 14398 tablet_bootstrap.cc:492] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f: Bootstrap starting.
I20260709 13:17:39.535424 14397 tablet_bootstrap.cc:492] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0: No bootstrap required, opened a new log
I20260709 13:17:39.536023 14397 ts_tablet_manager.cc:1403] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.008s
I20260709 13:17:39.539398 14397 raft_consensus.cc:359] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.540207 14397 raft_consensus.cc:385] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.540514 14397 raft_consensus.cc:740] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.541363 14397 consensus_queue.cc:260] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.542832 14401 tablet_bootstrap.cc:492] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8: No bootstrap required, opened a new log
I20260709 13:17:39.543457 14401 ts_tablet_manager.cc:1403] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.006s
I20260709 13:17:39.543623 14397 ts_tablet_manager.cc:1434] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:17:39.544646 14397 tablet_bootstrap.cc:492] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0: Bootstrap starting.
I20260709 13:17:39.547433 14398 tablet_bootstrap.cc:654] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.551174 14397 tablet_bootstrap.cc:654] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.550786 14401 raft_consensus.cc:359] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.551862 14401 raft_consensus.cc:385] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.552274 14401 raft_consensus.cc:740] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.553261 14401 consensus_queue.cc:260] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.555918 14401 ts_tablet_manager.cc:1434] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:17:39.557169 14401 tablet_bootstrap.cc:492] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:39.558604 14397 tablet_bootstrap.cc:492] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0: No bootstrap required, opened a new log
I20260709 13:17:39.559172 14397 ts_tablet_manager.cc:1403] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:17:39.562196 14397 raft_consensus.cc:359] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.563000 14397 raft_consensus.cc:385] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.563289 14397 raft_consensus.cc:740] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.564042 14397 consensus_queue.cc:260] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.564569 14401 tablet_bootstrap.cc:654] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.566287 14397 ts_tablet_manager.cc:1434] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:17:39.568599 14397 tablet_bootstrap.cc:492] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0: Bootstrap starting.
I20260709 13:17:39.578181 14397 tablet_bootstrap.cc:654] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.582113 14398 tablet_bootstrap.cc:492] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f: No bootstrap required, opened a new log
I20260709 13:17:39.582123 14401 tablet_bootstrap.cc:492] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8: No bootstrap required, opened a new log
I20260709 13:17:39.582748 14398 ts_tablet_manager.cc:1403] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f: Time spent bootstrapping tablet: real 0.069s	user 0.020s	sys 0.002s
I20260709 13:17:39.582854 14401 ts_tablet_manager.cc:1403] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.007s
I20260709 13:17:39.583057 14397 tablet_bootstrap.cc:492] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0: No bootstrap required, opened a new log
I20260709 13:17:39.583544 14397 ts_tablet_manager.cc:1403] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 13:17:39.585947 14397 raft_consensus.cc:359] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.585848 14398 raft_consensus.cc:359] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.586732 14397 raft_consensus.cc:385] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.586814 14398 raft_consensus.cc:385] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.586417 14401 raft_consensus.cc:359] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.587157 14397 raft_consensus.cc:740] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.587314 14398 raft_consensus.cc:740] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.587561 14401 raft_consensus.cc:385] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.587990 14401 raft_consensus.cc:740] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.588007 14397 consensus_queue.cc:260] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.588186 14398 consensus_queue.cc:260] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.589015 14401 consensus_queue.cc:260] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.590508 14397 ts_tablet_manager.cc:1434] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:17:39.593071 14398 ts_tablet_manager.cc:1434] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:17:39.594213 14398 tablet_bootstrap.cc:492] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f: Bootstrap starting.
I20260709 13:17:39.594597 14401 ts_tablet_manager.cc:1434] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:39.595537 14397 tablet_bootstrap.cc:492] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0: Bootstrap starting.
I20260709 13:17:39.595741 14401 tablet_bootstrap.cc:492] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:39.597949 14402 raft_consensus.cc:493] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.598464 14402 raft_consensus.cc:515] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } }
I20260709 13:17:39.607890 14398 tablet_bootstrap.cc:654] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.609098 14402 leader_election.cc:290] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999), 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549)
I20260709 13:17:39.612897 14401 tablet_bootstrap.cc:654] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.615687 14405 raft_consensus.cc:493] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.616359 14405 raft_consensus.cc:515] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } }
I20260709 13:17:39.619596 14405 leader_election.cc:290] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925), 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549)
I20260709 13:17:39.624511 14398 tablet_bootstrap.cc:492] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f: No bootstrap required, opened a new log
I20260709 13:17:39.625140 14398 ts_tablet_manager.cc:1403] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.008s
I20260709 13:17:39.625252 14397 tablet_bootstrap.cc:654] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.628144 14398 raft_consensus.cc:359] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.632882 14401 tablet_bootstrap.cc:492] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8: No bootstrap required, opened a new log
I20260709 13:17:39.633481 14401 ts_tablet_manager.cc:1403] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.008s
I20260709 13:17:39.636307 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3c66753fd74fcfaa56039d944eee1e" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" is_pre_election: true
I20260709 13:17:39.628871 14398 raft_consensus.cc:385] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.637265 14398 raft_consensus.cc:740] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.637313 14358 raft_consensus.cc:2468] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 0.
I20260709 13:17:39.639063 14398 consensus_queue.cc:260] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.639349 14248 leader_election.cc:304] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:39.641726 14401 raft_consensus.cc:359] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.642539 14401 raft_consensus.cc:385] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.642894 14401 raft_consensus.cc:740] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.644167 14402 raft_consensus.cc:2804] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:39.643836 14401 consensus_queue.cc:260] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.644572 14402 raft_consensus.cc:493] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.644953 14402 raft_consensus.cc:3060] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.648249 14401 ts_tablet_manager.cc:1434] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:17:39.648335 14209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3c66753fd74fcfaa56039d944eee1e" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" is_pre_election: true
I20260709 13:17:39.659453 14401 tablet_bootstrap.cc:492] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:39.661530 14402 raft_consensus.cc:515] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } }
I20260709 13:17:39.664096 14402 leader_election.cc:290] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Requested vote from peers cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999), 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549)
I20260709 13:17:39.664649 14402 raft_consensus.cc:493] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.665150 14402 raft_consensus.cc:515] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.666111 14401 tablet_bootstrap.cc:654] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.667172 14402 leader_election.cc:290] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
W20260709 13:17:39.668295 14250 leader_election.cc:343] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.669090 14398 ts_tablet_manager.cc:1434] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:17:39.670724 14208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3c66753fd74fcfaa56039d944eee1e" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:39.672668 14207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253053b859784b4784bfc2b60edd9703" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" is_pre_election: true
I20260709 13:17:39.673647 14207 raft_consensus.cc:2468] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 0.
W20260709 13:17:39.675382 14250 leader_election.cc:343] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.676291 14250 leader_election.cc:304] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: 
I20260709 13:17:39.677593 14402 raft_consensus.cc:2804] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:39.678095 14402 raft_consensus.cc:493] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.678526 14402 raft_consensus.cc:3060] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.686205 14398 tablet_bootstrap.cc:492] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f: Bootstrap starting.
W20260709 13:17:39.697656 14248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:33999, user_credentials={real_user=slave}} blocked reactor thread for 58561.8us
I20260709 13:17:39.699370 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3c66753fd74fcfaa56039d944eee1e" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:39.699872 14397 tablet_bootstrap.cc:492] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0: No bootstrap required, opened a new log
I20260709 13:17:39.699971 14358 raft_consensus.cc:3060] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.700531 14397 ts_tablet_manager.cc:1403] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0: Time spent bootstrapping tablet: real 0.109s	user 0.031s	sys 0.046s
I20260709 13:17:39.703735 14397 raft_consensus.cc:359] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.704473 14397 raft_consensus.cc:385] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.704767 14397 raft_consensus.cc:740] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Initialized, Role: FOLLOWER
W20260709 13:17:39.706696 14155 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:39.708745 14420 raft_consensus.cc:493] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.708338 14397 consensus_queue.cc:260] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.709281 14420 raft_consensus.cc:515] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.710162 14402 raft_consensus.cc:515] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.711804 14420 leader_election.cc:290] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:39.713052 14209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a415ef9aa884b989791be2a4bfbd0f9" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" is_pre_election: true
I20260709 13:17:39.721542 14398 tablet_bootstrap.cc:654] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.721963 14209 raft_consensus.cc:2468] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 0.
I20260709 13:17:39.722116 14357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253053b859784b4784bfc2b60edd9703" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" is_pre_election: true
I20260709 13:17:39.714131 14284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3c66753fd74fcfaa56039d944eee1e" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f" is_pre_election: true
I20260709 13:17:39.723183 14356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a415ef9aa884b989791be2a4bfbd0f9" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" is_pre_election: true
I20260709 13:17:39.723637 14284 raft_consensus.cc:2393] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cac1ac0d1d8e43cba83a11d285d041e0 in current term 1: Already voted for candidate 87ea5f0c9a4141eeab03de6631c5288f in this term.
I20260709 13:17:39.723888 14356 raft_consensus.cc:2468] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 0.
I20260709 13:17:39.714807 14406 raft_consensus.cc:493] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.725844 14250 leader_election.cc:304] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: 
I20260709 13:17:39.726434 14402 leader_election.cc:290] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:39.724516 14397 ts_tablet_manager.cc:1434] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:17:39.727584 14420 raft_consensus.cc:2804] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:39.727965 14420 raft_consensus.cc:493] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.728307 14420 raft_consensus.cc:3060] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.728722 14397 tablet_bootstrap.cc:492] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0: Bootstrap starting.
I20260709 13:17:39.729018 14209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253053b859784b4784bfc2b60edd9703" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:39.729700 14209 raft_consensus.cc:3060] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.735865 14397 tablet_bootstrap.cc:654] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.736037 14420 raft_consensus.cc:515] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.736574 14406 raft_consensus.cc:515] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.739046 14207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a415ef9aa884b989791be2a4bfbd0f9" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:39.739256 14356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253053b859784b4784bfc2b60edd9703" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:39.739657 14207 raft_consensus.cc:3060] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.742483 14405 raft_consensus.cc:493] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.739317 14406 leader_election.cc:290] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:39.743477 14405 raft_consensus.cc:515] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.722821 14357 raft_consensus.cc:2468] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 0.
I20260709 13:17:39.745585 14405 leader_election.cc:290] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
I20260709 13:17:39.747629 14284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f" is_pre_election: true
I20260709 13:17:39.717414 14401 tablet_bootstrap.cc:492] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8: No bootstrap required, opened a new log
W20260709 13:17:39.749146 14324 leader_election.cc:343] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.750094 14401 ts_tablet_manager.cc:1403] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.101s	user 0.024s	sys 0.026s
I20260709 13:17:39.715773 14358 raft_consensus.cc:2468] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 1.
I20260709 13:17:39.752137 14248 leader_election.cc:304] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 69a524bd5b1c4950ab14e0b5c70a08f8
I20260709 13:17:39.752952 14402 raft_consensus.cc:2804] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:39.753162 14401 raft_consensus.cc:359] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } }
I20260709 13:17:39.753803 14209 raft_consensus.cc:2468] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 1.
I20260709 13:17:39.753968 14401 raft_consensus.cc:385] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.754395 14401 raft_consensus.cc:740] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.755182 14401 consensus_queue.cc:260] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } }
I20260709 13:17:39.755306 14250 leader_election.cc:304] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: cac1ac0d1d8e43cba83a11d285d041e0
I20260709 13:17:39.756734 14398 tablet_bootstrap.cc:492] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f: No bootstrap required, opened a new log
I20260709 13:17:39.757278 14398 ts_tablet_manager.cc:1403] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.003s
I20260709 13:17:39.760109 14398 raft_consensus.cc:359] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.760825 14398 raft_consensus.cc:385] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.762809 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a415ef9aa884b989791be2a4bfbd0f9" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:39.763444 14358 raft_consensus.cc:3060] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.764230 14401 ts_tablet_manager.cc:1434] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:17:39.770399 14406 raft_consensus.cc:493] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.770980 14406 raft_consensus.cc:515] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.771878 14401 tablet_bootstrap.cc:492] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:39.772480 14358 raft_consensus.cc:2468] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 1.
I20260709 13:17:39.773200 14406 leader_election.cc:290] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:39.770931 14402 raft_consensus.cc:697] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Becoming Leader. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:39.773713 14248 leader_election.cc:304] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:39.775379 14402 consensus_queue.cc:237] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } }
I20260709 13:17:39.775822 14405 raft_consensus.cc:493] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.776372 14405 raft_consensus.cc:515] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.777248 14209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3c66753fd74fcfaa56039d944eee1e" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" is_pre_election: true
I20260709 13:17:39.777912 14209 raft_consensus.cc:2468] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 0.
I20260709 13:17:39.778455 14405 leader_election.cc:290] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
I20260709 13:17:39.778942 14401 tablet_bootstrap.cc:654] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.778877 14426 raft_consensus.cc:2804] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:39.780669 14420 leader_election.cc:290] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:39.780571 14284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08545673d7a343098386ef8d5ccc7689" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f" is_pre_election: true
I20260709 13:17:39.780537 14209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" is_pre_election: true
I20260709 13:17:39.781531 14284 raft_consensus.cc:2468] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 0.
I20260709 13:17:39.782904 14324 leader_election.cc:304] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:39.783511 14426 raft_consensus.cc:697] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Becoming Leader. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:39.783788 14429 raft_consensus.cc:2804] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:39.783960 14324 leader_election.cc:304] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 87ea5f0c9a4141eeab03de6631c5288f
I20260709 13:17:39.784734 14405 raft_consensus.cc:2804] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:39.785154 14405 raft_consensus.cc:493] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.785588 14405 raft_consensus.cc:3060] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.783758 14207 raft_consensus.cc:2468] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 1.
I20260709 13:17:39.787782 14209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08545673d7a343098386ef8d5ccc7689" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" is_pre_election: true
I20260709 13:17:39.786233 14426 consensus_queue.cc:237] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.792037 14284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf0ca23c7848579f3293d216159c15" candidate_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f" is_pre_election: true
I20260709 13:17:39.793793 14283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82ce00978c948f7b0c9ab6434c2228a" candidate_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f" is_pre_election: true
I20260709 13:17:39.795001 14429 raft_consensus.cc:697] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Becoming Leader. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:39.796458 14431 raft_consensus.cc:2764] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:17:39.796638 14324 leader_election.cc:343] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.799510 14401 tablet_bootstrap.cc:492] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8: No bootstrap required, opened a new log
I20260709 13:17:39.761121 14398 raft_consensus.cc:740] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.801431 14401 ts_tablet_manager.cc:1403] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.004s
I20260709 13:17:39.798089 14104 catalog_manager.cc:5697] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f reported cstate change: term changed from 0 to 1, leader changed from <none> to 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:39.804605 14401 raft_consensus.cc:359] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.805397 14401 raft_consensus.cc:385] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:17:39.800772 14175 leader_election.cc:343] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.802045 14398 consensus_queue.cc:260] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
W20260709 13:17:39.806738 14175 leader_election.cc:343] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.800796 14324 leader_election.cc:304] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cac1ac0d1d8e43cba83a11d285d041e0; no voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f
W20260709 13:17:39.808502 14324 leader_election.cc:343] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.809406 14431 raft_consensus.cc:2749] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:39.810487 14398 ts_tablet_manager.cc:1434] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 13:17:39.812850 14398 tablet_bootstrap.cc:492] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f: Bootstrap starting.
I20260709 13:17:39.810070 14405 raft_consensus.cc:515] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.800276 14429 consensus_queue.cc:237] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.815084 14397 tablet_bootstrap.cc:492] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0: No bootstrap required, opened a new log
I20260709 13:17:39.815605 14397 ts_tablet_manager.cc:1403] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0: Time spent bootstrapping tablet: real 0.087s	user 0.007s	sys 0.015s
I20260709 13:17:39.805701 14401 raft_consensus.cc:740] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.817713 14401 consensus_queue.cc:260] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.818953 14397 raft_consensus.cc:359] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.819722 14397 raft_consensus.cc:385] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.820003 14397 raft_consensus.cc:740] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.820294 14398 tablet_bootstrap.cc:654] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.820194 14401 ts_tablet_manager.cc:1434] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:17:39.820858 14397 consensus_queue.cc:260] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.822355 14401 tablet_bootstrap.cc:492] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:39.830483 14397 ts_tablet_manager.cc:1434] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:17:39.831907 14405 leader_election.cc:290] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
I20260709 13:17:39.834268 14207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08545673d7a343098386ef8d5ccc7689" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:39.834867 14283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08545673d7a343098386ef8d5ccc7689" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
I20260709 13:17:39.835258 14357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82ce00978c948f7b0c9ab6434c2228a" candidate_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" is_pre_election: true
I20260709 13:17:39.835474 14283 raft_consensus.cc:3060] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:39.835736 14324 leader_election.cc:343] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.836705 14397 tablet_bootstrap.cc:492] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0: Bootstrap starting.
W20260709 13:17:39.836766 14173 leader_election.cc:343] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.834888 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf0ca23c7848579f3293d216159c15" candidate_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" is_pre_election: true
I20260709 13:17:39.837430 14173 leader_election.cc:304] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8; no voters: 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0
W20260709 13:17:39.838611 14173 leader_election.cc:343] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.839046 14173 leader_election.cc:304] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8; no voters: 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0
I20260709 13:17:39.840167 14406 raft_consensus.cc:2749] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:39.840776 14406 raft_consensus.cc:2749] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:39.842904 14401 tablet_bootstrap.cc:654] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.847785 14283 raft_consensus.cc:2468] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 1.
I20260709 13:17:39.848784 14397 tablet_bootstrap.cc:654] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.849725 14324 leader_election.cc:304] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 69a524bd5b1c4950ab14e0b5c70a08f8
I20260709 13:17:39.851293 14405 raft_consensus.cc:2804] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:39.852792 14405 raft_consensus.cc:697] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 LEADER]: Becoming Leader. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Running, Role: LEADER
I20260709 13:17:39.853727 14405 consensus_queue.cc:237] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.861811 14397 tablet_bootstrap.cc:492] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0: No bootstrap required, opened a new log
I20260709 13:17:39.862540 14397 ts_tablet_manager.cc:1403] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.005s
I20260709 13:17:39.866624 14397 raft_consensus.cc:359] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.867421 14397 raft_consensus.cc:385] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.867775 14397 raft_consensus.cc:740] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.869253 14401 tablet_bootstrap.cc:492] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: No bootstrap required, opened a new log
I20260709 13:17:39.868957 14397 consensus_queue.cc:260] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.869875 14401 ts_tablet_manager.cc:1403] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.009s
I20260709 13:17:39.872567 14397 ts_tablet_manager.cc:1434] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:17:39.873102 14401 raft_consensus.cc:359] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.873960 14401 raft_consensus.cc:385] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.874007 14397 tablet_bootstrap.cc:492] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0: Bootstrap starting.
I20260709 13:17:39.874349 14401 raft_consensus.cc:740] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.875274 14398 tablet_bootstrap.cc:492] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f: No bootstrap required, opened a new log
I20260709 13:17:39.875870 14398 ts_tablet_manager.cc:1403] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.027s
I20260709 13:17:39.875403 14401 consensus_queue.cc:260] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.879006 14398 raft_consensus.cc:359] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.879729 14398 raft_consensus.cc:385] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.880014 14398 raft_consensus.cc:740] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.881989 14401 ts_tablet_manager.cc:1434] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:17:39.882704 14397 tablet_bootstrap.cc:654] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.883245 14401 tablet_bootstrap.cc:492] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:39.884033 14398 consensus_queue.cc:260] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.889436 14398 ts_tablet_manager.cc:1434] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 13:17:39.890359 14401 tablet_bootstrap.cc:654] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.890486 14398 tablet_bootstrap.cc:492] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f: Bootstrap starting.
I20260709 13:17:39.891116 14105 catalog_manager.cc:5697] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.898037 14397 tablet_bootstrap.cc:492] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0: No bootstrap required, opened a new log
I20260709 13:17:39.898139 14429 raft_consensus.cc:493] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.898599 14397 ts_tablet_manager.cc:1403] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 13:17:39.898633 14398 tablet_bootstrap.cc:654] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.901397 14397 raft_consensus.cc:359] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.902072 14397 raft_consensus.cc:385] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.902346 14397 raft_consensus.cc:740] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.898663 14429 raft_consensus.cc:515] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.904093 14397 consensus_queue.cc:260] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.906577 14397 ts_tablet_manager.cc:1434] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:17:39.907460 14397 tablet_bootstrap.cc:492] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0: Bootstrap starting.
I20260709 13:17:39.907382 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82ce00978c948f7b0c9ab6434c2228a" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" is_pre_election: true
I20260709 13:17:39.908561 14207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82ce00978c948f7b0c9ab6434c2228a" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" is_pre_election: true
I20260709 13:17:39.909264 14207 raft_consensus.cc:2468] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 0.
I20260709 13:17:39.910549 14250 leader_election.cc:304] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: 
I20260709 13:17:39.911468 14426 raft_consensus.cc:2804] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:39.911836 14426 raft_consensus.cc:493] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.912153 14426 raft_consensus.cc:3060] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.913537 14397 tablet_bootstrap.cc:654] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:39.918758 14248 leader_election.cc:343] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.919353 14398 tablet_bootstrap.cc:492] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f: No bootstrap required, opened a new log
I20260709 13:17:39.919823 14397 tablet_bootstrap.cc:492] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0: No bootstrap required, opened a new log
I20260709 13:17:39.920215 14398 ts_tablet_manager.cc:1403] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.008s
I20260709 13:17:39.920404 14397 ts_tablet_manager.cc:1403] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:17:39.923323 14397 raft_consensus.cc:359] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.923974 14397 raft_consensus.cc:385] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.924232 14397 raft_consensus.cc:740] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.925063 14429 leader_election.cc:290] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:39.924767 14398 raft_consensus.cc:359] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.925987 14398 raft_consensus.cc:385] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.925034 14397 consensus_queue.cc:260] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.926620 14398 raft_consensus.cc:740] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.928195 14397 ts_tablet_manager.cc:1434] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:39.927891 14398 consensus_queue.cc:260] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.929224 14397 tablet_bootstrap.cc:492] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0: Bootstrap starting.
I20260709 13:17:39.931660 14398 ts_tablet_manager.cc:1434] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:17:39.933223 14398 tablet_bootstrap.cc:492] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f: Bootstrap starting.
I20260709 13:17:39.935405 14397 tablet_bootstrap.cc:654] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.942159 14398 tablet_bootstrap.cc:654] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.942329 14405 raft_consensus.cc:493] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.942943 14405 raft_consensus.cc:515] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.946822 14426 raft_consensus.cc:515] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.947160 14207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c606df0ec347b5bfd8e36621389eec" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" is_pre_election: true
I20260709 13:17:39.947229 14283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c606df0ec347b5bfd8e36621389eec" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f" is_pre_election: true
W20260709 13:17:39.948606 14324 leader_election.cc:343] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.924392 14104 catalog_manager.cc:5697] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f reported cstate change: term changed from 0 to 1, leader changed from <none> to 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:39.945021 14405 leader_election.cc:290] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
W20260709 13:17:39.949925 14324 leader_election.cc:343] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.949982 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82ce00978c948f7b0c9ab6434c2228a" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:39.950655 14324 leader_election.cc:304] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cac1ac0d1d8e43cba83a11d285d041e0; no voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f
W20260709 13:17:39.951700 14248 leader_election.cc:343] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.952299 14405 raft_consensus.cc:2749] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:39.953115 14207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82ce00978c948f7b0c9ab6434c2228a" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:39.952769 14104 catalog_manager.cc:5697] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f reported cstate change: term changed from 0 to 1, leader changed from <none> to 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:39.954016 14207 raft_consensus.cc:3060] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.956985 14426 leader_election.cc:290] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:39.957726 14397 tablet_bootstrap.cc:492] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0: No bootstrap required, opened a new log
I20260709 13:17:39.958222 14397 ts_tablet_manager.cc:1403] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.003s
I20260709 13:17:39.960688 14397 raft_consensus.cc:359] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.961416 14397 raft_consensus.cc:385] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.961764 14397 raft_consensus.cc:740] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.962507 14397 consensus_queue.cc:260] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.965771 14207 raft_consensus.cc:2468] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 1.
I20260709 13:17:39.967742 14397 ts_tablet_manager.cc:1434] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:17:39.969918 14250 leader_election.cc:304] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: cac1ac0d1d8e43cba83a11d285d041e0
I20260709 13:17:39.971283 14426 raft_consensus.cc:2804] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:39.971763 14426 raft_consensus.cc:697] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Becoming Leader. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:39.974306 14426 consensus_queue.cc:237] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.986657 14405 raft_consensus.cc:493] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.987269 14405 raft_consensus.cc:515] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:39.990356 14207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d919fb569d45139e5281b21d834815" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" is_pre_election: true
I20260709 13:17:39.991703 14405 leader_election.cc:290] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
W20260709 13:17:39.991739 14324 leader_election.cc:343] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.993788 14283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d919fb569d45139e5281b21d834815" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f" is_pre_election: true
W20260709 13:17:39.995534 14324 leader_election.cc:343] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.995990 14324 leader_election.cc:304] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cac1ac0d1d8e43cba83a11d285d041e0; no voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f
I20260709 13:17:39.996850 14405 raft_consensus.cc:2749] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:39.998291 14401 tablet_bootstrap.cc:492] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: No bootstrap required, opened a new log
I20260709 13:17:39.998828 14401 ts_tablet_manager.cc:1403] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.116s	user 0.031s	sys 0.077s
I20260709 13:17:39.999949 14398 tablet_bootstrap.cc:492] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f: No bootstrap required, opened a new log
I20260709 13:17:40.000381 14398 ts_tablet_manager.cc:1403] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.011s
I20260709 13:17:40.001449 14401 raft_consensus.cc:359] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.002197 14401 raft_consensus.cc:385] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.002465 14401 raft_consensus.cc:740] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.002599 14398 raft_consensus.cc:359] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.003219 14398 raft_consensus.cc:385] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.003593 14398 raft_consensus.cc:740] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.003176 14401 consensus_queue.cc:260] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.004226 14398 consensus_queue.cc:260] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.005369 14401 ts_tablet_manager.cc:1434] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:17:40.004666 14104 catalog_manager.cc:5697] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f reported cstate change: term changed from 0 to 1, leader changed from <none> to 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.006301 14401 tablet_bootstrap.cc:492] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:40.006398 14398 ts_tablet_manager.cc:1434] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:40.007501 14398 tablet_bootstrap.cc:492] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f: Bootstrap starting.
I20260709 13:17:40.011742 14401 tablet_bootstrap.cc:654] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.012856 14398 tablet_bootstrap.cc:654] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.017526 14398 tablet_bootstrap.cc:492] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f: No bootstrap required, opened a new log
I20260709 13:17:40.017974 14398 ts_tablet_manager.cc:1403] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:17:40.019331 14426 raft_consensus.cc:493] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.019985 14401 tablet_bootstrap.cc:492] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8: No bootstrap required, opened a new log
I20260709 13:17:40.019830 14426 raft_consensus.cc:515] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.020553 14401 ts_tablet_manager.cc:1403] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:17:40.020740 14398 raft_consensus.cc:359] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.021487 14398 raft_consensus.cc:385] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.021752 14398 raft_consensus.cc:740] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.021931 14426 leader_election.cc:290] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:40.022413 14398 consensus_queue.cc:260] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.023523 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845227310e3b4584985b3bff1ca4e03d" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" is_pre_election: true
I20260709 13:17:40.023619 14401 raft_consensus.cc:359] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.024227 14358 raft_consensus.cc:2468] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 0.
I20260709 13:17:40.024535 14398 ts_tablet_manager.cc:1434] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:17:40.024474 14401 raft_consensus.cc:385] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.025194 14401 raft_consensus.cc:740] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.025652 14398 tablet_bootstrap.cc:492] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f: Bootstrap starting.
I20260709 13:17:40.025766 14207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845227310e3b4584985b3bff1ca4e03d" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" is_pre_election: true
I20260709 13:17:40.026415 14207 raft_consensus.cc:2468] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 0.
I20260709 13:17:40.026145 14401 consensus_queue.cc:260] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.027711 14250 leader_election.cc:304] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: 
I20260709 13:17:40.028674 14401 ts_tablet_manager.cc:1434] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:17:40.028822 14429 raft_consensus.cc:2804] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.029356 14429 raft_consensus.cc:493] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.029706 14429 raft_consensus.cc:3060] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.029857 14401 tablet_bootstrap.cc:492] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:40.031878 14398 tablet_bootstrap.cc:654] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.036577 14401 tablet_bootstrap.cc:654] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.046352 14429 raft_consensus.cc:515] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.048789 14401 tablet_bootstrap.cc:492] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8: No bootstrap required, opened a new log
I20260709 13:17:40.049430 14401 ts_tablet_manager.cc:1403] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:17:40.050606 14398 tablet_bootstrap.cc:492] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f: No bootstrap required, opened a new log
I20260709 13:17:40.050258 14207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845227310e3b4584985b3bff1ca4e03d" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:40.050258 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845227310e3b4584985b3bff1ca4e03d" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:40.050925 14429 leader_election.cc:290] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:40.051095 14398 ts_tablet_manager.cc:1403] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.016s
I20260709 13:17:40.051383 14358 raft_consensus.cc:3060] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.052323 14401 raft_consensus.cc:359] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.053119 14401 raft_consensus.cc:385] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.053440 14401 raft_consensus.cc:740] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.053898 14398 raft_consensus.cc:359] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.054607 14398 raft_consensus.cc:385] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.054881 14398 raft_consensus.cc:740] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.051133 14207 raft_consensus.cc:3060] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.054170 14401 consensus_queue.cc:260] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.055573 14398 consensus_queue.cc:260] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.057535 14398 ts_tablet_manager.cc:1434] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:17:40.059181 14401 ts_tablet_manager.cc:1434] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:17:40.063140 14207 raft_consensus.cc:2468] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 1.
I20260709 13:17:40.064361 14250 leader_election.cc:304] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: 
I20260709 13:17:40.065248 14429 raft_consensus.cc:2804] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.065745 14429 raft_consensus.cc:697] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Becoming Leader. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:40.066569 14429 consensus_queue.cc:237] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.067312 14358 raft_consensus.cc:2468] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 1.
I20260709 13:17:40.075476 14106 catalog_manager.cc:5697] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f reported cstate change: term changed from 0 to 1, leader changed from <none> to 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.113698 14437 raft_consensus.cc:493] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.114251 14437 raft_consensus.cc:515] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.116070 14437 leader_election.cc:290] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:40.116822 14283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d919fb569d45139e5281b21d834815" candidate_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f" is_pre_election: true
I20260709 13:17:40.117063 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d919fb569d45139e5281b21d834815" candidate_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" is_pre_election: true
I20260709 13:17:40.117491 14283 raft_consensus.cc:2468] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a524bd5b1c4950ab14e0b5c70a08f8 in term 0.
I20260709 13:17:40.117719 14358 raft_consensus.cc:2468] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a524bd5b1c4950ab14e0b5c70a08f8 in term 0.
I20260709 13:17:40.118499 14175 leader_election.cc:304] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: 
I20260709 13:17:40.119326 14437 raft_consensus.cc:2804] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.119627 14437 raft_consensus.cc:493] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.119907 14437 raft_consensus.cc:3060] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.125293 14437 raft_consensus.cc:515] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.126848 14437 leader_election.cc:290] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 election: Requested vote from peers 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:40.127684 14283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d919fb569d45139e5281b21d834815" candidate_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
I20260709 13:17:40.127815 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d919fb569d45139e5281b21d834815" candidate_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:40.128243 14283 raft_consensus.cc:3060] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.128391 14358 raft_consensus.cc:3060] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.133407 14358 raft_consensus.cc:2468] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a524bd5b1c4950ab14e0b5c70a08f8 in term 1.
I20260709 13:17:40.133409 14283 raft_consensus.cc:2468] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a524bd5b1c4950ab14e0b5c70a08f8 in term 1.
I20260709 13:17:40.134680 14175 leader_election.cc:304] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:40.135681 14437 raft_consensus.cc:2804] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.136164 14437 raft_consensus.cc:697] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 LEADER]: Becoming Leader. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Running, Role: LEADER
I20260709 13:17:40.136902 14437 consensus_queue.cc:237] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.145464 14106 catalog_manager.cc:5697] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.199999 14429 raft_consensus.cc:493] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.200625 14429 raft_consensus.cc:515] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.202303 14429 leader_election.cc:290] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:40.203226 14207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf0ca23c7848579f3293d216159c15" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" is_pre_election: true
I20260709 13:17:40.203348 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf0ca23c7848579f3293d216159c15" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" is_pre_election: true
I20260709 13:17:40.203855 14207 raft_consensus.cc:2468] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 0.
I20260709 13:17:40.203990 14358 raft_consensus.cc:2468] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 0.
I20260709 13:17:40.204847 14250 leader_election.cc:304] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: 
I20260709 13:17:40.205529 14429 raft_consensus.cc:2804] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.205892 14429 raft_consensus.cc:493] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.206220 14429 raft_consensus.cc:3060] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.211447 14429 raft_consensus.cc:515] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.213037 14429 leader_election.cc:290] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:40.213997 14207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf0ca23c7848579f3293d216159c15" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:40.214083 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf0ca23c7848579f3293d216159c15" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:40.214906 14207 raft_consensus.cc:3060] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.214982 14358 raft_consensus.cc:3060] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.222178 14429 consensus_queue.cc:1048] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:40.222213 14358 raft_consensus.cc:2468] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 1.
I20260709 13:17:40.223054 14207 raft_consensus.cc:2468] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 1.
I20260709 13:17:40.223560 14248 leader_election.cc:304] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:40.224532 14429 raft_consensus.cc:2804] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.225032 14429 raft_consensus.cc:697] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Becoming Leader. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:40.225788 14429 consensus_queue.cc:237] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.236769 14207 raft_consensus.cc:3060] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.236289 14103 catalog_manager.cc:5697] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f reported cstate change: term changed from 0 to 1, leader changed from <none> to 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.243420 14437 raft_consensus.cc:493] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.244001 14437 raft_consensus.cc:515] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.246017 14429 consensus_queue.cc:1048] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:40.246091 14437 leader_election.cc:290] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:40.248018 14283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8" candidate_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f" is_pre_election: true
I20260709 13:17:40.248116 14357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8" candidate_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" is_pre_election: true
I20260709 13:17:40.248834 14283 raft_consensus.cc:2468] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a524bd5b1c4950ab14e0b5c70a08f8 in term 0.
I20260709 13:17:40.248898 14357 raft_consensus.cc:2468] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a524bd5b1c4950ab14e0b5c70a08f8 in term 0.
I20260709 13:17:40.250195 14173 leader_election.cc:304] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:40.251283 14406 raft_consensus.cc:2804] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.251688 14406 raft_consensus.cc:493] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.252049 14406 raft_consensus.cc:3060] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.259099 14429 consensus_queue.cc:1048] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:40.262941 14406 raft_consensus.cc:515] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.265210 14357 raft_consensus.cc:3060] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.267270 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8" candidate_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:40.268165 14358 raft_consensus.cc:3060] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.269601 14406 leader_election.cc:290] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 election: Requested vote from peers 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:40.274395 14283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8" candidate_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
I20260709 13:17:40.275074 14283 raft_consensus.cc:3060] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.277032 14358 raft_consensus.cc:2468] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a524bd5b1c4950ab14e0b5c70a08f8 in term 1.
I20260709 13:17:40.278422 14173 leader_election.cc:304] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:40.279219 14406 raft_consensus.cc:2804] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.279932 14406 raft_consensus.cc:697] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 LEADER]: Becoming Leader. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Running, Role: LEADER
I20260709 13:17:40.280797 14406 consensus_queue.cc:237] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.283382 14283 raft_consensus.cc:2468] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a524bd5b1c4950ab14e0b5c70a08f8 in term 1.
I20260709 13:17:40.285074 14429 consensus_queue.cc:1048] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:40.287432 14429 raft_consensus.cc:493] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.287427 14402 consensus_queue.cc:1048] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:40.287928 14429 raft_consensus.cc:515] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.290395 14429 leader_election.cc:290] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:40.292965 14207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c606df0ec347b5bfd8e36621389eec" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" is_pre_election: true
I20260709 13:17:40.293726 14207 raft_consensus.cc:2468] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 0.
I20260709 13:17:40.294937 14250 leader_election.cc:304] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: 
I20260709 13:17:40.295830 14429 raft_consensus.cc:2804] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.294015 14106 catalog_manager.cc:5697] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.296232 14429 raft_consensus.cc:493] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.296749 14429 raft_consensus.cc:3060] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.296666 14356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c606df0ec347b5bfd8e36621389eec" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" is_pre_election: true
I20260709 13:17:40.297487 14356 raft_consensus.cc:2468] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 0.
I20260709 13:17:40.307442 14426 consensus_queue.cc:1048] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:40.308115 14429 raft_consensus.cc:515] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.310552 14429 leader_election.cc:290] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:40.311306 14209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c606df0ec347b5bfd8e36621389eec" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:40.312004 14209 raft_consensus.cc:3060] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.312889 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c606df0ec347b5bfd8e36621389eec" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:40.313642 14358 raft_consensus.cc:3060] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.317425 14405 raft_consensus.cc:493] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.318128 14405 raft_consensus.cc:515] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.319636 14209 raft_consensus.cc:2468] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 1.
I20260709 13:17:40.321059 14250 leader_election.cc:304] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: 
I20260709 13:17:40.321440 14208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82ce00978c948f7b0c9ab6434c2228a" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" is_pre_election: true
I20260709 13:17:40.321684 14358 raft_consensus.cc:2468] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 1.
I20260709 13:17:40.322077 14429 raft_consensus.cc:2804] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.322340 14208 raft_consensus.cc:2393] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cac1ac0d1d8e43cba83a11d285d041e0 in current term 1: Already voted for candidate 87ea5f0c9a4141eeab03de6631c5288f in this term.
I20260709 13:17:40.322650 14429 raft_consensus.cc:697] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Becoming Leader. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:40.323565 14429 consensus_queue.cc:237] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:40.324653 14405 leader_election.cc:290] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
I20260709 13:17:40.326362 14283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82ce00978c948f7b0c9ab6434c2228a" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f" is_pre_election: true
I20260709 13:17:40.328496 14324 leader_election.cc:304] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cac1ac0d1d8e43cba83a11d285d041e0; no voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f
I20260709 13:17:40.329604 14405 raft_consensus.cc:3060] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.341580 14405 raft_consensus.cc:2749] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:40.342698 14103 catalog_manager.cc:5697] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f reported cstate change: term changed from 0 to 1, leader changed from <none> to 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2). New cstate: current_term: 1 leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.392469 14405 consensus_queue.cc:1048] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:40.403384 14207 raft_consensus.cc:3060] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.413998 14468 consensus_queue.cc:1048] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:40.449489  5112 ts_manager.cc:295] Set tserver state for 69a524bd5b1c4950ab14e0b5c70a08f8 to MAINTENANCE_MODE
I20260709 13:17:40.450287  5112 tablet_server.cc:179] TabletServer@127.4.254.1:0 shutting down...
I20260709 13:17:40.467885  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:40.468683  5112 tablet_replica.cc:333] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8: stopping tablet replica
I20260709 13:17:40.469545  5112 raft_consensus.cc:2243] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:40.470132  5112 raft_consensus.cc:2272] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:40.472546  5112 tablet_replica.cc:333] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8: stopping tablet replica
I20260709 13:17:40.473063  5112 raft_consensus.cc:2243] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:40.473459  5112 raft_consensus.cc:2272] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:40.475173  5112 tablet_replica.cc:333] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: stopping tablet replica
I20260709 13:17:40.475665  5112 raft_consensus.cc:2243] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:40.476168  5112 pending_rounds.cc:70] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: Trying to abort 1 pending ops.
I20260709 13:17:40.476316  5112 pending_rounds.cc:77] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638134330281984 op_type: NO_OP noop_request { }
I20260709 13:17:40.476564  5112 raft_consensus.cc:2889] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:40.476771  5112 raft_consensus.cc:2272] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:40.478948  5112 tablet_replica.cc:333] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8: stopping tablet replica
I20260709 13:17:40.479462  5112 raft_consensus.cc:2243] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:40.479763  5112 raft_consensus.cc:2272] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:40.481312  5112 tablet_replica.cc:333] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8: stopping tablet replica
I20260709 13:17:40.481742  5112 raft_consensus.cc:2243] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:40.482067  5112 raft_consensus.cc:2272] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:40.483942  5112 tablet_replica.cc:333] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: stopping tablet replica
I20260709 13:17:40.484395  5112 raft_consensus.cc:2243] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:40.484876  5112 pending_rounds.cc:70] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: Trying to abort 1 pending ops.
I20260709 13:17:40.485016  5112 pending_rounds.cc:77] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638134922420224 op_type: NO_OP noop_request { }
I20260709 13:17:40.485316  5112 raft_consensus.cc:2889] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:40.485527  5112 raft_consensus.cc:2272] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:40.487257  5112 tablet_replica.cc:333] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8: stopping tablet replica
I20260709 13:17:40.487716  5112 raft_consensus.cc:2243] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:40.488008  5112 raft_consensus.cc:2272] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:40.489670  5112 tablet_replica.cc:333] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8: stopping tablet replica
I20260709 13:17:40.490083  5112 raft_consensus.cc:2243] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:40.490413  5112 raft_consensus.cc:2272] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:40.492511  5112 tablet_replica.cc:333] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8: stopping tablet replica
I20260709 13:17:40.492947  5112 raft_consensus.cc:2243] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:40.493357  5112 raft_consensus.cc:2272] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:40.495332  5112 tablet_replica.cc:333] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8: stopping tablet replica
I20260709 13:17:40.495743  5112 raft_consensus.cc:2243] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:40.496091  5112 raft_consensus.cc:2272] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:40.524824 14429 consensus_queue.cc:1048] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:40.526005  5112 tablet_server.cc:196] TabletServer@127.4.254.1:0 shutdown complete.
W20260709 13:17:40.526970 14250 consensus_peers.cc:597] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:40.559366 14429 consensus_queue.cc:1048] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:40.571334 14250 consensus_peers.cc:597] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:40.617719 14250 consensus_peers.cc:597] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:40.633426 14429 consensus_queue.cc:1048] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:40.707716 14155 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:40.717442 14429 consensus_queue.cc:1048] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:40.718240 14250 consensus_peers.cc:597] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:40.731024 14250 consensus_peers.cc:597] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:40.817685 14250 consensus_peers.cc:597] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:40.933661 14250 consensus_peers.cc:597] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:41.008069 14324 consensus_peers.cc:597] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:41.708730 14155 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:42.122360 14250 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111) [suppressed 121 similar messages]
I20260709 13:17:42.286407 14487 raft_consensus.cc:493] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.286863 14487 raft_consensus.cc:515] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:42.288637 14487 leader_election.cc:290] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:42.289749 14357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d919fb569d45139e5281b21d834815" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" is_pre_election: true
I20260709 13:17:42.290480 14357 raft_consensus.cc:2468] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 1.
I20260709 13:17:42.291563 14248 leader_election.cc:304] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
W20260709 13:17:42.292038 14250 leader_election.cc:336] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111)
I20260709 13:17:42.292213 14487 raft_consensus.cc:2804] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:42.292613 14487 raft_consensus.cc:493] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.292877 14487 raft_consensus.cc:3060] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.297799 14487 raft_consensus.cc:515] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:42.299324 14487 leader_election.cc:290] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 2 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:42.300338 14357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d919fb569d45139e5281b21d834815" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:42.300933 14357 raft_consensus.cc:3060] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:42.302804 14250 leader_election.cc:336] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111)
I20260709 13:17:42.306342 14357 raft_consensus.cc:2468] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 2.
I20260709 13:17:42.307328 14248 leader_election.cc:304] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 69a524bd5b1c4950ab14e0b5c70a08f8
I20260709 13:17:42.307999 14487 raft_consensus.cc:2804] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:42.308427 14487 raft_consensus.cc:697] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 LEADER]: Becoming Leader. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:42.309299 14487 consensus_queue.cc:237] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:42.316849 14103 catalog_manager.cc:5697] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f reported cstate change: term changed from 1 to 2, leader changed from 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1) to 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2). New cstate: current_term: 2 leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.518008 14487 raft_consensus.cc:493] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.518528 14487 raft_consensus.cc:515] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:42.520279 14487 leader_election.cc:290] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:42.521447 14357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" is_pre_election: true
I20260709 13:17:42.522199 14357 raft_consensus.cc:2468] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 1.
I20260709 13:17:42.523191 14248 leader_election.cc:304] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:42.523898 14487 raft_consensus.cc:2804] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:17:42.524066 14250 leader_election.cc:336] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111)
I20260709 13:17:42.524277 14487 raft_consensus.cc:493] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.524668 14487 raft_consensus.cc:3060] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.530395 14487 raft_consensus.cc:515] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:42.531929 14487 leader_election.cc:290] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 2 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:42.532959 14357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:42.533571 14357 raft_consensus.cc:3060] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:42.535771 14250 leader_election.cc:336] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111)
I20260709 13:17:42.538910 14357 raft_consensus.cc:2468] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 2.
I20260709 13:17:42.539999 14248 leader_election.cc:304] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 69a524bd5b1c4950ab14e0b5c70a08f8
I20260709 13:17:42.540750 14487 raft_consensus.cc:2804] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:42.541240 14487 raft_consensus.cc:697] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 LEADER]: Becoming Leader. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:42.542106 14487 consensus_queue.cc:237] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:42.549197 14103 catalog_manager.cc:5697] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f reported cstate change: term changed from 1 to 2, leader changed from 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1) to 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2). New cstate: current_term: 2 leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:42.709713 14155 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:42.749423 14357 raft_consensus.cc:1275] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Refusing update from remote peer 87ea5f0c9a4141eeab03de6631c5288f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:42.750686 14487 consensus_queue.cc:1048] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:42.764384 14250 consensus_peers.cc:597] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.820817 14250 consensus_peers.cc:597] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:42.895187 14250 consensus_peers.cc:597] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:43.134673 14357 raft_consensus.cc:1275] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Refusing update from remote peer 87ea5f0c9a4141eeab03de6631c5288f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:43.135843 14487 consensus_queue.cc:1048] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:43.155073 14250 consensus_peers.cc:597] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:43.181463 14250 consensus_peers.cc:597] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:43.276584 14250 consensus_peers.cc:597] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:43.387207 14250 consensus_peers.cc:597] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:43.446019 14250 consensus_peers.cc:597] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:43.559334 14250 consensus_peers.cc:597] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:43.710755 14155 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:43.915202 14324 consensus_peers.cc:597] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:44.711791 14155 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:45.020632 14250 consensus_peers.cc:597] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:45.031040 14250 consensus_peers.cc:597] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:45.463531 14250 consensus_peers.cc:597] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:45.547457  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:45.553833 14513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:45.554133 14514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:45.556463 14516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:45.557015  5112 server_base.cc:1061] running on GCE node
I20260709 13:17:45.558836  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:45.559082  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:45.559291  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603065559272 us; error 0 us; skew 500 ppm
I20260709 13:17:45.559907  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:45.562340  5112 webserver.cc:533] Webserver started at http://127.4.254.1:33339/ using document root <none> and password file <none>
I20260709 13:17:45.562834  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:45.563017  5112 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:17:45.566658  5112 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:17:45.570628 14521 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:45.571564  5112 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:17:45.571890  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-0-root
uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-k73n"
I20260709 13:17:45.572218  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602796139571-5112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:45.583487  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:45.584558  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:45.586110  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:45.631289 14529 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:17:45.647083 14250 consensus_peers.cc:597] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:45.656883 14250 consensus_peers.cc:597] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:45.702826  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:17:45.703236  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.113s	user 0.006s	sys 0.000s
I20260709 13:17:45.703583  5112 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:17:45.709883 14529 tablet_bootstrap.cc:492] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
W20260709 13:17:45.713524 14155 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:45.724620 14529 tablet_bootstrap.cc:492] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:45.725549 14529 tablet_bootstrap.cc:492] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap complete.
I20260709 13:17:45.726158 14529 ts_tablet_manager.cc:1403] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:17:45.728740 14529 raft_consensus.cc:359] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.729689 14529 raft_consensus.cc:740] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.730443 14529 consensus_queue.cc:260] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.732852 14529 ts_tablet_manager.cc:1434] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:17:45.733652 14529 tablet_bootstrap.cc:492] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:45.744297  5112 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:17:45.744604  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.041s	user 0.031s	sys 0.007s
I20260709 13:17:45.745040 14529 tablet_bootstrap.cc:492] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:45.745854 14529 tablet_bootstrap.cc:492] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap complete.
I20260709 13:17:45.746536 14529 ts_tablet_manager.cc:1403] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:17:45.748695 14529 raft_consensus.cc:359] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.749270 14529 raft_consensus.cc:740] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.749883 14529 consensus_queue.cc:260] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.751405 14529 ts_tablet_manager.cc:1434] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:17:45.752053 14529 tablet_bootstrap.cc:492] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:45.766225 14529 tablet_bootstrap.cc:492] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:17:45.767532 14529 tablet_bootstrap.cc:492] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap complete.
I20260709 13:17:45.768329 14529 ts_tablet_manager.cc:1403] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:17:45.771390 14529 raft_consensus.cc:359] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.772392 14529 raft_consensus.cc:740] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.773308 14529 consensus_queue.cc:260] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.775384 14529 ts_tablet_manager.cc:1434] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 13:17:45.776137 14529 tablet_bootstrap.cc:492] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:45.787597 14529 tablet_bootstrap.cc:492] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:45.788360 14529 tablet_bootstrap.cc:492] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap complete.
I20260709 13:17:45.788885 14529 ts_tablet_manager.cc:1403] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:17:45.791322 14529 raft_consensus.cc:359] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.791867 14529 raft_consensus.cc:740] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.792616 14529 consensus_queue.cc:260] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.794430 14529 ts_tablet_manager.cc:1434] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:17:45.795090 14529 tablet_bootstrap.cc:492] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:45.806488 14529 tablet_bootstrap.cc:492] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:45.807204 14529 tablet_bootstrap.cc:492] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap complete.
I20260709 13:17:45.807914 14529 ts_tablet_manager.cc:1403] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:17:45.809607  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.1:41549
I20260709 13:17:45.809877 14592 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.1:41549 every 8 connection(s)
I20260709 13:17:45.811492 14529 raft_consensus.cc:359] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.812357 14529 raft_consensus.cc:740] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.813272 14529 consensus_queue.cc:260] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.815304 14529 ts_tablet_manager.cc:1434] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 13:17:45.815845 14594 tablet.cc:2406] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:45.816010  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:45.816305 14529 tablet_bootstrap.cc:492] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:45.831509 14529 tablet_bootstrap.cc:492] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:45.832898 14529 tablet_bootstrap.cc:492] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap complete.
I20260709 13:17:45.833845 14529 ts_tablet_manager.cc:1403] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:17:45.838091 14529 raft_consensus.cc:359] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.838769 14529 raft_consensus.cc:740] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.839605 14529 consensus_queue.cc:260] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.846894 14529 ts_tablet_manager.cc:1434] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260709 13:17:45.847764 14593 heartbeater.cc:344] Connected to a master server at 127.4.254.62:34103
I20260709 13:17:45.848574 14593 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:45.847939 14529 tablet_bootstrap.cc:492] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:45.849764 14593 heartbeater.cc:507] Master 127.4.254.62:34103 requested a full tablet report, sending...
I20260709 13:17:45.857806 14103 ts_manager.cc:194] Re-registered known tserver with Master: 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549)
I20260709 13:17:45.862497 14283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a415ef9aa884b989791be2a4bfbd0f9"
dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
mode: GRACEFUL
new_leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:42236
I20260709 13:17:45.863384 14283 raft_consensus.cc:606] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Received request to transfer leadership to TS cac1ac0d1d8e43cba83a11d285d041e0
I20260709 13:17:45.869321 14283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34c606df0ec347b5bfd8e36621389eec"
dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
mode: GRACEFUL
new_leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:42236
I20260709 13:17:45.870285 14283 raft_consensus.cc:606] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Received request to transfer leadership to TS cac1ac0d1d8e43cba83a11d285d041e0
I20260709 13:17:45.874765 14283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8"
dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
mode: GRACEFUL
new_leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:42236
I20260709 13:17:45.875713 14283 raft_consensus.cc:606] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 LEADER]: Received request to transfer leadership to TS cac1ac0d1d8e43cba83a11d285d041e0
I20260709 13:17:45.877884 14103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40040
I20260709 13:17:45.880522 14284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "845227310e3b4584985b3bff1ca4e03d"
dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
mode: GRACEFUL
new_leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:42236
I20260709 13:17:45.881243 14284 raft_consensus.cc:606] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Received request to transfer leadership to TS cac1ac0d1d8e43cba83a11d285d041e0
I20260709 13:17:45.883431 14529 tablet_bootstrap.cc:492] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:45.883898 14593 heartbeater.cc:499] Master 127.4.254.62:34103 was elected leader, sending a full tablet report...
I20260709 13:17:45.884572 14529 tablet_bootstrap.cc:492] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap complete.
I20260709 13:17:45.884351 14284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c82ce00978c948f7b0c9ab6434c2228a"
dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
mode: GRACEFUL
new_leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:42236
I20260709 13:17:45.885051 14284 raft_consensus.cc:606] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Received request to transfer leadership to TS cac1ac0d1d8e43cba83a11d285d041e0
I20260709 13:17:45.885339 14529 ts_tablet_manager.cc:1403] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.014s
I20260709 13:17:45.886603  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:45.887259  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:45.888048  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:45.887823 14529 raft_consensus.cc:359] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.888551 14529 raft_consensus.cc:740] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.889314 14529 consensus_queue.cc:260] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.891557 14529 ts_tablet_manager.cc:1434] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:45.892338 14529 tablet_bootstrap.cc:492] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:45.896747 14530 raft_consensus.cc:993] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f: : Instructing follower cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:45.897462 14512 raft_consensus.cc:1081] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 LEADER]: Signalling peer cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:45.899420 14358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8"
dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:17:45.900041 14358 raft_consensus.cc:493] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.900453 14358 raft_consensus.cc:3060] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.909576 14529 tablet_bootstrap.cc:492] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:45.909687 14358 raft_consensus.cc:515] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.910463 14529 tablet_bootstrap.cc:492] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap complete.
I20260709 13:17:45.911047 14529 ts_tablet_manager.cc:1403] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:17:45.911952 14358 leader_election.cc:290] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 3 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
I20260709 13:17:45.914058 14529 raft_consensus.cc:359] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } }
I20260709 13:17:45.914764 14529 raft_consensus.cc:740] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.914783 14284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
I20260709 13:17:45.915675 14529 consensus_queue.cc:260] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } }
I20260709 13:17:45.915706 14284 raft_consensus.cc:3055] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:45.917845 14529 ts_tablet_manager.cc:1434] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:45.917870 14284 raft_consensus.cc:740] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:45.918790 14529 tablet_bootstrap.cc:492] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:45.919148 14284 consensus_queue.cc:260] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.920944 14284 raft_consensus.cc:3060] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.927790 14565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:45.928547 14565 raft_consensus.cc:3060] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.935081 14284 raft_consensus.cc:2468] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 3.
I20260709 13:17:45.936793 14324 leader_election.cc:304] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:45.937932 14482 raft_consensus.cc:2804] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:45.939392 14482 raft_consensus.cc:697] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 LEADER]: Becoming Leader. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Running, Role: LEADER
I20260709 13:17:45.940641 14482 consensus_queue.cc:237] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.951150 14565 raft_consensus.cc:2468] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 3.
I20260709 13:17:45.951555 14529 tablet_bootstrap.cc:492] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:45.952536 14529 tablet_bootstrap.cc:492] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap complete.
I20260709 13:17:45.953296 14529 ts_tablet_manager.cc:1403] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.012s
I20260709 13:17:45.955834 14529 raft_consensus.cc:359] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.956471 14529 raft_consensus.cc:740] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.957254 14529 consensus_queue.cc:260] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.959255 14529 ts_tablet_manager.cc:1434] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:45.960059 14529 tablet_bootstrap.cc:492] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap starting.
I20260709 13:17:45.959537 14104 catalog_manager.cc:5697] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 reported cstate change: term changed from 2 to 3, leader changed from 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2) to cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.977183 14529 tablet_bootstrap.cc:492] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:17:45.978147 14529 tablet_bootstrap.cc:492] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: Bootstrap complete.
I20260709 13:17:45.978830 14529 ts_tablet_manager.cc:1403] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:17:45.980790 14529 raft_consensus.cc:359] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.981442 14529 raft_consensus.cc:740] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a524bd5b1c4950ab14e0b5c70a08f8, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.982069 14529 consensus_queue.cc:260] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:45.983779 14529 ts_tablet_manager.cc:1434] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:46.015969 14530 raft_consensus.cc:993] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f: : Instructing follower cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:46.016497 14512 raft_consensus.cc:1081] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Signalling peer cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:46.018468 14358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a415ef9aa884b989791be2a4bfbd0f9"
dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:17:46.019033 14358 raft_consensus.cc:493] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.019395 14358 raft_consensus.cc:3060] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.027518 14358 raft_consensus.cc:515] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.030048 14358 leader_election.cc:290] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 2 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
I20260709 13:17:46.030295 14565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a415ef9aa884b989791be2a4bfbd0f9" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:46.031112 14284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a415ef9aa884b989791be2a4bfbd0f9" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
I20260709 13:17:46.031332 14565 raft_consensus.cc:3060] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.031730 14284 raft_consensus.cc:3055] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:46.032037 14284 raft_consensus.cc:740] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:46.032774 14284 consensus_queue.cc:260] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.033880 14284 raft_consensus.cc:3060] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.037057 14565 raft_consensus.cc:2468] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 2.
I20260709 13:17:46.038357 14324 leader_election.cc:304] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:46.039244 14482 raft_consensus.cc:2804] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:46.039706 14482 raft_consensus.cc:697] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Becoming Leader. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Running, Role: LEADER
I20260709 13:17:46.040541 14482 consensus_queue.cc:237] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.040972 14284 raft_consensus.cc:2468] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 2.
I20260709 13:17:46.048825 14104 catalog_manager.cc:5697] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 reported cstate change: term changed from 1 to 2, leader changed from 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2) to cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.088673 14530 raft_consensus.cc:993] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f: : Instructing follower cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:46.089264 14512 raft_consensus.cc:1081] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Signalling peer cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:46.090955 14358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34c606df0ec347b5bfd8e36621389eec"
dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:17:46.091531 14358 raft_consensus.cc:493] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.091846 14358 raft_consensus.cc:3060] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.092072 14567 raft_consensus.cc:3060] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.098591 14358 raft_consensus.cc:515] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.100329 14567 pending_rounds.cc:85] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: Aborting all ops after (but not including) 0
I20260709 13:17:46.100679 14358 leader_election.cc:290] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 2 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
I20260709 13:17:46.100714 14567 pending_rounds.cc:107] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:17:46.101559 14565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c606df0ec347b5bfd8e36621389eec" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:46.101888 14284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c606df0ec347b5bfd8e36621389eec" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
I20260709 13:17:46.102052 14567 raft_consensus.cc:2889] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:46.102638 14284 raft_consensus.cc:3055] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:46.103005 14284 raft_consensus.cc:740] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:46.104050 14284 consensus_queue.cc:260] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.105580 14284 raft_consensus.cc:3060] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.102351 14565 raft_consensus.cc:3060] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.113425 14284 raft_consensus.cc:2468] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 2.
I20260709 13:17:46.114553 14324 leader_election.cc:304] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87ea5f0c9a4141eeab03de6631c5288f, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:46.115046 14565 raft_consensus.cc:2468] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 2.
I20260709 13:17:46.115397 14482 raft_consensus.cc:2804] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:46.115940 14482 raft_consensus.cc:697] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Becoming Leader. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Running, Role: LEADER
I20260709 13:17:46.116933 14482 consensus_queue.cc:237] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.124142 14104 catalog_manager.cc:5697] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 reported cstate change: term changed from 1 to 2, leader changed from 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2) to cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.236105 14501 raft_consensus.cc:993] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f: : Instructing follower cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:46.236579 14530 raft_consensus.cc:1081] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Signalling peer cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:46.238099 14358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c82ce00978c948f7b0c9ab6434c2228a"
dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:17:46.238579 14358 raft_consensus.cc:493] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.238900 14358 raft_consensus.cc:3060] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.244706 14358 raft_consensus.cc:515] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.246284 14358 leader_election.cc:290] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 2 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
I20260709 13:17:46.247226 14565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82ce00978c948f7b0c9ab6434c2228a" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:46.247556 14284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82ce00978c948f7b0c9ab6434c2228a" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
I20260709 13:17:46.247901 14565 raft_consensus.cc:3060] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.248184 14284 raft_consensus.cc:3055] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:46.248535 14284 raft_consensus.cc:740] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:46.249478 14284 consensus_queue.cc:260] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.250828 14284 raft_consensus.cc:3060] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.255582 14565 raft_consensus.cc:2468] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 2.
I20260709 13:17:46.256824 14324 leader_election.cc:304] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:46.257691 14482 raft_consensus.cc:2804] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:46.258128 14482 raft_consensus.cc:697] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Becoming Leader. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Running, Role: LEADER
I20260709 13:17:46.258308 14284 raft_consensus.cc:2468] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 2.
I20260709 13:17:46.259076 14482 consensus_queue.cc:237] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.266306 14104 catalog_manager.cc:5697] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 reported cstate change: term changed from 1 to 2, leader changed from 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2) to cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.439210 14284 raft_consensus.cc:1275] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.440373 14482 consensus_queue.cc:1048] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.452330 14565 raft_consensus.cc:1275] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.455480 14622 consensus_queue.cc:1048] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:46.477540 14512 raft_consensus.cc:993] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f: : Instructing follower cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:46.478065 14625 raft_consensus.cc:1081] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Signalling peer cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:46.479470 14358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "845227310e3b4584985b3bff1ca4e03d"
dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:17:46.479955 14358 raft_consensus.cc:493] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.480263 14358 raft_consensus.cc:3060] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.485670 14358 raft_consensus.cc:515] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.487360 14358 leader_election.cc:290] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 2 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
I20260709 13:17:46.488131 14565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845227310e3b4584985b3bff1ca4e03d" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:46.488540 14284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845227310e3b4584985b3bff1ca4e03d" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
I20260709 13:17:46.488807 14565 raft_consensus.cc:3060] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.489245 14284 raft_consensus.cc:3055] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:46.489602 14284 raft_consensus.cc:740] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:46.490473 14284 consensus_queue.cc:260] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.491777 14284 raft_consensus.cc:3060] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.496464 14565 raft_consensus.cc:2468] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 2.
I20260709 13:17:46.497810 14324 leader_election.cc:304] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:46.498610 14565 raft_consensus.cc:1275] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.498690 14622 raft_consensus.cc:2804] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:46.499379 14622 raft_consensus.cc:697] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Becoming Leader. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Running, Role: LEADER
I20260709 13:17:46.500367 14482 consensus_queue.cc:1048] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.500674 14284 raft_consensus.cc:2468] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 2.
I20260709 13:17:46.500344 14622 consensus_queue.cc:237] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.508221 14284 raft_consensus.cc:1275] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 3 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:46.509842 14607 consensus_queue.cc:1048] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.511520 14103 catalog_manager.cc:5697] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 reported cstate change: term changed from 1 to 2, leader changed from 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2) to cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.514927 14283 raft_consensus.cc:1275] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.519716 14482 consensus_queue.cc:1048] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.523460 14565 raft_consensus.cc:1275] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:46.525741 14622 consensus_queue.cc:1048] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:46.526329 14622 consensus_queue.cc:1243] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Peer 69a524bd5b1c4950ab14e0b5c70a08f8 log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:17:46.528939 14565 pending_rounds.cc:85] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: Aborting all ops after (but not including) 0
I20260709 13:17:46.529273 14565 pending_rounds.cc:107] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:17:46.529515 14565 raft_consensus.cc:2889] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:46.714648 14155 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:46.780310 14284 raft_consensus.cc:1275] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.781690 14622 consensus_queue.cc:1048] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.791026 14565 raft_consensus.cc:1275] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.792472 14607 consensus_queue.cc:1048] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.884069 14565 raft_consensus.cc:1275] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.885295 14622 consensus_queue.cc:1048] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.895117 14284 raft_consensus.cc:1275] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.896924 14622 consensus_queue.cc:1048] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.903316  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:46.923851 14358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a415ef9aa884b989791be2a4bfbd0f9"
dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
mode: GRACEFUL
new_leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
 from {username='slave'} at 127.0.0.1:44226
I20260709 13:17:46.924464 14358 raft_consensus.cc:606] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Received request to transfer leadership to TS 87ea5f0c9a4141eeab03de6631c5288f
I20260709 13:17:46.927021 14358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8"
dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
mode: GRACEFUL
new_leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
 from {username='slave'} at 127.0.0.1:44226
I20260709 13:17:46.927441 14358 raft_consensus.cc:606] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 LEADER]: Received request to transfer leadership to TS 87ea5f0c9a4141eeab03de6631c5288f
I20260709 13:17:46.928401  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:46.929019  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:46.929768  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:46.937112 14632 raft_consensus.cc:993] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0: : Instructing follower 87ea5f0c9a4141eeab03de6631c5288f to start an election
I20260709 13:17:46.937593 14622 raft_consensus.cc:1081] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 LEADER]: Signalling peer 87ea5f0c9a4141eeab03de6631c5288f to start an election
I20260709 13:17:46.938992 14284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8"
dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
 from {username='slave'} at 127.0.0.1:34832
I20260709 13:17:46.939523 14284 raft_consensus.cc:493] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.939841 14284 raft_consensus.cc:3060] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:46.944942 14284 raft_consensus.cc:515] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.946736 14284 leader_election.cc:290] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 4 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:46.947440 14565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:46.947834 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:46.948100 14565 raft_consensus.cc:3060] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:46.948388 14358 raft_consensus.cc:3055] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:46.948689 14358 raft_consensus.cc:740] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Running, Role: LEADER
I20260709 13:17:46.949383 14358 consensus_queue.cc:260] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.950242 14358 raft_consensus.cc:3060] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:46.953222 14565 raft_consensus.cc:2468] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 4.
I20260709 13:17:46.954269 14250 leader_election.cc:304] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: 
I20260709 13:17:46.954828 14358 raft_consensus.cc:2468] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 4.
I20260709 13:17:46.955037 14512 raft_consensus.cc:2804] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:46.955621 14512 raft_consensus.cc:697] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 4 LEADER]: Becoming Leader. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:46.956336 14512 consensus_queue.cc:237] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:46.962507 14103 catalog_manager.cc:5697] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f reported cstate change: term changed from 3 to 4, leader changed from cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3) to 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2). New cstate: current_term: 4 leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.065732 14632 raft_consensus.cc:993] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0: : Instructing follower 87ea5f0c9a4141eeab03de6631c5288f to start an election
I20260709 13:17:47.066270 14622 raft_consensus.cc:1081] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Signalling peer 87ea5f0c9a4141eeab03de6631c5288f to start an election
I20260709 13:17:47.067847 14284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a415ef9aa884b989791be2a4bfbd0f9"
dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
 from {username='slave'} at 127.0.0.1:34832
I20260709 13:17:47.068377 14284 raft_consensus.cc:493] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:47.068744 14284 raft_consensus.cc:3060] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:47.074040 14284 raft_consensus.cc:515] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:47.075716 14284 leader_election.cc:290] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 3 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:47.076627 14565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a415ef9aa884b989791be2a4bfbd0f9" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:47.076713 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a415ef9aa884b989791be2a4bfbd0f9" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:47.077515 14565 raft_consensus.cc:3060] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:47.077577 14358 raft_consensus.cc:3055] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:47.078006 14358 raft_consensus.cc:740] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Running, Role: LEADER
I20260709 13:17:47.078847 14358 consensus_queue.cc:260] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:47.079721 14358 raft_consensus.cc:3060] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:47.083612 14565 raft_consensus.cc:2468] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 3.
I20260709 13:17:47.084785 14250 leader_election.cc:304] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: 
I20260709 13:17:47.085481 14512 raft_consensus.cc:2804] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:47.085899 14512 raft_consensus.cc:697] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 3 LEADER]: Becoming Leader. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:47.086149 14358 raft_consensus.cc:2468] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 3.
I20260709 13:17:47.086711 14512 consensus_queue.cc:237] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:47.092725 14103 catalog_manager.cc:5697] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f reported cstate change: term changed from 2 to 3, leader changed from cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3) to 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2). New cstate: current_term: 3 leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.345219 14565 raft_consensus.cc:1275] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 4 FOLLOWER]: Refusing update from remote peer 87ea5f0c9a4141eeab03de6631c5288f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:47.346451 14512 consensus_queue.cc:1048] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.354689 14358 raft_consensus.cc:1275] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 4 FOLLOWER]: Refusing update from remote peer 87ea5f0c9a4141eeab03de6631c5288f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:47.356189 14512 consensus_queue.cc:1048] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.636224 14358 raft_consensus.cc:1275] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 FOLLOWER]: Refusing update from remote peer 87ea5f0c9a4141eeab03de6631c5288f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.637387 14512 consensus_queue.cc:1048] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.645711 14565 raft_consensus.cc:1275] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: Refusing update from remote peer 87ea5f0c9a4141eeab03de6631c5288f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.647392 14637 consensus_queue.cc:1048] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:47.715751 14155 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:47.936491  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:47.945194 14283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "253053b859784b4784bfc2b60edd9703"
dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
mode: GRACEFUL
new_leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:42236
I20260709 13:17:47.945883 14283 raft_consensus.cc:606] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Received request to transfer leadership to TS cac1ac0d1d8e43cba83a11d285d041e0
I20260709 13:17:47.948441 14283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9d919fb569d45139e5281b21d834815"
dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
mode: GRACEFUL
new_leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:42236
I20260709 13:17:47.948850 14283 raft_consensus.cc:606] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 LEADER]: Received request to transfer leadership to TS cac1ac0d1d8e43cba83a11d285d041e0
I20260709 13:17:47.949788  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:47.950270  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:47.950812  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:48.015504 14637 raft_consensus.cc:993] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f: : Instructing follower cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:48.016077 14512 raft_consensus.cc:1081] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Signalling peer cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:48.017467 14358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "253053b859784b4784bfc2b60edd9703"
dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:17:48.017866 14358 raft_consensus.cc:493] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.018205 14358 raft_consensus.cc:3060] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.022897 14358 raft_consensus.cc:515] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:48.024371 14358 leader_election.cc:290] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 2 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
I20260709 13:17:48.025323 14565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253053b859784b4784bfc2b60edd9703" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:48.025575 14283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253053b859784b4784bfc2b60edd9703" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
I20260709 13:17:48.025933 14565 raft_consensus.cc:3060] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.026185 14283 raft_consensus.cc:3055] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.026538 14283 raft_consensus.cc:740] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:48.027272 14283 consensus_queue.cc:260] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:48.028231 14283 raft_consensus.cc:3060] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.031347 14565 raft_consensus.cc:2468] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 2.
I20260709 13:17:48.032516 14324 leader_election.cc:304] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:48.033286 14607 raft_consensus.cc:2804] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.033926 14283 raft_consensus.cc:2468] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 2.
I20260709 13:17:48.034251 14607 raft_consensus.cc:697] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Becoming Leader. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Running, Role: LEADER
I20260709 13:17:48.035279 14607 consensus_queue.cc:237] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:48.042148 14104 catalog_manager.cc:5697] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 reported cstate change: term changed from 1 to 2, leader changed from 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2) to cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:48.105851 14637 raft_consensus.cc:993] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f: : Instructing follower cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:48.106333 14512 raft_consensus.cc:1081] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 LEADER]: Signalling peer cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:48.107983 14358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9d919fb569d45139e5281b21d834815"
dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:17:48.108498 14358 raft_consensus.cc:493] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.108799 14358 raft_consensus.cc:3060] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.113313 14358 raft_consensus.cc:515] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:48.114878 14358 leader_election.cc:290] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 3 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
I20260709 13:17:48.115779 14565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d919fb569d45139e5281b21d834815" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:48.116106 14283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d919fb569d45139e5281b21d834815" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
I20260709 13:17:48.116413 14565 raft_consensus.cc:3060] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.116698 14283 raft_consensus.cc:3055] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:48.117049 14283 raft_consensus.cc:740] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:48.117748 14283 consensus_queue.cc:260] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:48.118789 14283 raft_consensus.cc:3060] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.122044 14565 raft_consensus.cc:2468] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 3.
I20260709 13:17:48.123250 14324 leader_election.cc:304] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:48.123809 14283 raft_consensus.cc:2468] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 3.
I20260709 13:17:48.123983 14607 raft_consensus.cc:2804] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:48.124641 14607 raft_consensus.cc:697] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 LEADER]: Becoming Leader. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Running, Role: LEADER
I20260709 13:17:48.125579 14607 consensus_queue.cc:237] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:48.133505 14104 catalog_manager.cc:5697] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 reported cstate change: term changed from 2 to 3, leader changed from 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2) to cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3). New cstate: current_term: 3 leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:48.474967 14565 raft_consensus.cc:1275] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.476166 14607 consensus_queue.cc:1048] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:48.487012 14283 raft_consensus.cc:1275] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.488981 14640 consensus_queue.cc:1048] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:48.658644 14565 raft_consensus.cc:1275] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:48.659915 14649 consensus_queue.cc:1048] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:48.670030 14283 raft_consensus.cc:1275] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 3 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:48.671413 14640 consensus_queue.cc:1048] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:48.716744 14155 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:48.956629  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:48.963779 14358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "845227310e3b4584985b3bff1ca4e03d"
dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
mode: GRACEFUL
new_leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
 from {username='slave'} at 127.0.0.1:44226
I20260709 13:17:48.964291 14358 raft_consensus.cc:606] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Received request to transfer leadership to TS 87ea5f0c9a4141eeab03de6631c5288f
I20260709 13:17:48.966881 14358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9d919fb569d45139e5281b21d834815"
dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
mode: GRACEFUL
new_leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
 from {username='slave'} at 127.0.0.1:44226
I20260709 13:17:48.967415 14358 raft_consensus.cc:606] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 LEADER]: Received request to transfer leadership to TS 87ea5f0c9a4141eeab03de6631c5288f
I20260709 13:17:48.968446  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:48.969204  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:48.969923  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:49.058998 14607 raft_consensus.cc:993] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0: : Instructing follower 87ea5f0c9a4141eeab03de6631c5288f to start an election
I20260709 13:17:49.059556 14640 raft_consensus.cc:1081] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 LEADER]: Signalling peer 87ea5f0c9a4141eeab03de6631c5288f to start an election
I20260709 13:17:49.061257 14283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9d919fb569d45139e5281b21d834815"
dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
 from {username='slave'} at 127.0.0.1:34832
I20260709 13:17:49.061771 14283 raft_consensus.cc:493] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.062125 14283 raft_consensus.cc:3060] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.067301 14283 raft_consensus.cc:515] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:49.068898 14283 leader_election.cc:290] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 4 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:49.069708 14565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d919fb569d45139e5281b21d834815" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:49.070075 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d919fb569d45139e5281b21d834815" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:49.070358 14565 raft_consensus.cc:3060] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.070730 14358 raft_consensus.cc:3055] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:49.071058 14358 raft_consensus.cc:740] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Running, Role: LEADER
I20260709 13:17:49.071822 14358 consensus_queue.cc:260] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:49.073040 14358 raft_consensus.cc:3060] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.075822 14565 raft_consensus.cc:2468] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 4.
I20260709 13:17:49.076777 14250 leader_election.cc:304] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: 
I20260709 13:17:49.077467 14512 raft_consensus.cc:2804] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:49.078392 14512 raft_consensus.cc:697] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 4 LEADER]: Becoming Leader. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:49.078406 14358 raft_consensus.cc:2468] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 4.
I20260709 13:17:49.079347 14512 consensus_queue.cc:237] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:49.084820 14104 catalog_manager.cc:5697] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f reported cstate change: term changed from 3 to 4, leader changed from cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3) to 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2). New cstate: current_term: 4 leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.351411 14607 raft_consensus.cc:993] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0: : Instructing follower 87ea5f0c9a4141eeab03de6631c5288f to start an election
I20260709 13:17:49.351900 14640 raft_consensus.cc:1081] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Signalling peer 87ea5f0c9a4141eeab03de6631c5288f to start an election
I20260709 13:17:49.353381 14283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "845227310e3b4584985b3bff1ca4e03d"
dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
 from {username='slave'} at 127.0.0.1:34832
I20260709 13:17:49.353889 14283 raft_consensus.cc:493] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.354197 14283 raft_consensus.cc:3060] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.359211 14283 raft_consensus.cc:515] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:49.361292 14283 leader_election.cc:290] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 3 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3:33999)
I20260709 13:17:49.361657 14567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845227310e3b4584985b3bff1ca4e03d" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:49.361920 14358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845227310e3b4584985b3bff1ca4e03d" candidate_uuid: "87ea5f0c9a4141eeab03de6631c5288f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
I20260709 13:17:49.362294 14567 raft_consensus.cc:3060] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.362521 14358 raft_consensus.cc:3055] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:49.362917 14358 raft_consensus.cc:740] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Running, Role: LEADER
I20260709 13:17:49.363570 14358 consensus_queue.cc:260] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:49.364395 14358 raft_consensus.cc:3060] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.367679 14567 raft_consensus.cc:2468] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 3.
I20260709 13:17:49.368836 14250 leader_election.cc:304] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, 87ea5f0c9a4141eeab03de6631c5288f; no voters: 
I20260709 13:17:49.368949 14358 raft_consensus.cc:2468] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87ea5f0c9a4141eeab03de6631c5288f in term 3.
I20260709 13:17:49.369580 14655 raft_consensus.cc:2804] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:49.370033 14655 raft_consensus.cc:697] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 3 LEADER]: Becoming Leader. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:49.370738 14655 consensus_queue.cc:237] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:49.380024 14104 catalog_manager.cc:5697] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f reported cstate change: term changed from 2 to 3, leader changed from cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3) to 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2). New cstate: current_term: 3 leader_uuid: "87ea5f0c9a4141eeab03de6631c5288f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.565963 14358 raft_consensus.cc:1275] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 4 FOLLOWER]: Refusing update from remote peer 87ea5f0c9a4141eeab03de6631c5288f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:49.567160 14655 consensus_queue.cc:1048] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:49.575321 14567 raft_consensus.cc:1275] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 4 FOLLOWER]: Refusing update from remote peer 87ea5f0c9a4141eeab03de6631c5288f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:49.578373 14655 consensus_queue.cc:1048] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:49.717738 14155 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:49.826975 14358 raft_consensus.cc:1275] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 FOLLOWER]: Refusing update from remote peer 87ea5f0c9a4141eeab03de6631c5288f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:49.828559 14655 consensus_queue.cc:1048] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:49.836971 14567 raft_consensus.cc:1275] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: Refusing update from remote peer 87ea5f0c9a4141eeab03de6631c5288f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:49.838982 14512 consensus_queue.cc:1048] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:49.976842  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:49.983871 14283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8"
dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
mode: GRACEFUL
new_leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:42236
I20260709 13:17:49.984483 14283 raft_consensus.cc:606] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 4 LEADER]: Received request to transfer leadership to TS cac1ac0d1d8e43cba83a11d285d041e0
I20260709 13:17:49.986832 14283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffaf0ca23c7848579f3293d216159c15"
dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
mode: GRACEFUL
new_leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:42236
I20260709 13:17:49.987280 14283 raft_consensus.cc:606] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Received request to transfer leadership to TS cac1ac0d1d8e43cba83a11d285d041e0
I20260709 13:17:49.988227  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:49.988701  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:49.989272  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:50.136111 14512 raft_consensus.cc:993] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f: : Instructing follower cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:50.136624 14655 raft_consensus.cc:1081] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 4 LEADER]: Signalling peer cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:50.137984 14358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8"
dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:17:50.138373 14358 raft_consensus.cc:493] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:50.138612 14358 raft_consensus.cc:3060] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:50.143229 14358 raft_consensus.cc:515] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:50.144893 14358 leader_election.cc:290] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 5 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
I20260709 13:17:50.145653 14565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:50.145897 14283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1894411bd84c1fba284c731f0f6cc8" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
I20260709 13:17:50.146286 14565 raft_consensus.cc:3060] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:50.146456 14283 raft_consensus.cc:3055] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:50.146867 14283 raft_consensus.cc:740] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:50.147686 14283 consensus_queue.cc:260] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:50.148937 14283 raft_consensus.cc:3060] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:50.152993 14565 raft_consensus.cc:2468] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 5.
I20260709 13:17:50.154237 14324 leader_election.cc:304] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:50.155030 14607 raft_consensus.cc:2804] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:50.155452 14607 raft_consensus.cc:697] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 5 LEADER]: Becoming Leader. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Running, Role: LEADER
I20260709 13:17:50.156052 14283 raft_consensus.cc:2468] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 5.
I20260709 13:17:50.156203 14607 consensus_queue.cc:237] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:50.163161 14104 catalog_manager.cc:5697] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 reported cstate change: term changed from 4 to 5, leader changed from 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2) to cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3). New cstate: current_term: 5 leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:50.232007 14512 raft_consensus.cc:993] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f: : Instructing follower cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:50.232491 14655 raft_consensus.cc:1081] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Signalling peer cac1ac0d1d8e43cba83a11d285d041e0 to start an election
I20260709 13:17:50.233881 14358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffaf0ca23c7848579f3293d216159c15"
dest_uuid: "cac1ac0d1d8e43cba83a11d285d041e0"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:17:50.234272 14358 raft_consensus.cc:493] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:50.234511 14358 raft_consensus.cc:3060] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.239264 14358 raft_consensus.cc:515] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:50.240542 14358 leader_election.cc:290] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 2 election: Requested vote from peers 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549), 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925)
I20260709 13:17:50.241403 14565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf0ca23c7848579f3293d216159c15" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8"
I20260709 13:17:50.241737 14283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffaf0ca23c7848579f3293d216159c15" candidate_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87ea5f0c9a4141eeab03de6631c5288f"
I20260709 13:17:50.242014 14565 raft_consensus.cc:3060] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.242332 14283 raft_consensus.cc:3055] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:50.242656 14283 raft_consensus.cc:740] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87ea5f0c9a4141eeab03de6631c5288f, State: Running, Role: LEADER
I20260709 13:17:50.243520 14283 consensus_queue.cc:260] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:50.244825 14283 raft_consensus.cc:3060] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.248739 14565 raft_consensus.cc:2468] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 2.
I20260709 13:17:50.249923 14324 leader_election.cc:304] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a524bd5b1c4950ab14e0b5c70a08f8, cac1ac0d1d8e43cba83a11d285d041e0; no voters: 
I20260709 13:17:50.250661 14607 raft_consensus.cc:2804] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:50.251077 14607 raft_consensus.cc:697] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Becoming Leader. State: Replica: cac1ac0d1d8e43cba83a11d285d041e0, State: Running, Role: LEADER
I20260709 13:17:50.251495 14283 raft_consensus.cc:2468] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac1ac0d1d8e43cba83a11d285d041e0 in term 2.
I20260709 13:17:50.251935 14607 consensus_queue.cc:237] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } }
I20260709 13:17:50.259269 14104 catalog_manager.cc:5697] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 reported cstate change: term changed from 1 to 2, leader changed from 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2) to cac1ac0d1d8e43cba83a11d285d041e0 (127.4.254.3). New cstate: current_term: 2 leader_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac1ac0d1d8e43cba83a11d285d041e0" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33999 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:50.562202 14565 raft_consensus.cc:1275] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 5 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:50.563350 14607 consensus_queue.cc:1048] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:50.572494 14283 raft_consensus.cc:1275] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 5 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:50.575024 14607 consensus_queue.cc:1048] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:50.676715 14565 raft_consensus.cc:1275] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:50.677892 14607 consensus_queue.cc:1048] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a524bd5b1c4950ab14e0b5c70a08f8" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 41549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:50.685477 14283 raft_consensus.cc:1275] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Refusing update from remote peer cac1ac0d1d8e43cba83a11d285d041e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:50.686946 14640 consensus_queue.cc:1048] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87ea5f0c9a4141eeab03de6631c5288f" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:50.718793 14155 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:50.995097  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:51.022118  5112 tablet_server.cc:179] TabletServer@127.4.254.1:41549 shutting down...
I20260709 13:17:51.042559  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:51.043452  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:51.044092  5112 raft_consensus.cc:2243] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.044515  5112 raft_consensus.cc:2272] T 3e3c66753fd74fcfaa56039d944eee1e P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.046409  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:51.046963  5112 raft_consensus.cc:2243] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.047397  5112 raft_consensus.cc:2272] T b9d919fb569d45139e5281b21d834815 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.049007  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:51.049584  5112 raft_consensus.cc:2243] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.049980  5112 raft_consensus.cc:2272] T 34c606df0ec347b5bfd8e36621389eec P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.051707  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:51.052205  5112 raft_consensus.cc:2243] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.052605  5112 raft_consensus.cc:2272] T 845227310e3b4584985b3bff1ca4e03d P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.054352  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:51.054862  5112 raft_consensus.cc:2243] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.055250  5112 raft_consensus.cc:2272] T 253053b859784b4784bfc2b60edd9703 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.056874  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:51.057436  5112 raft_consensus.cc:2243] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.057861  5112 raft_consensus.cc:2272] T 6e1894411bd84c1fba284c731f0f6cc8 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.059882  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:51.060421  5112 raft_consensus.cc:2243] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.060820  5112 raft_consensus.cc:2272] T ffaf0ca23c7848579f3293d216159c15 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.063288  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:51.063814  5112 raft_consensus.cc:2243] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.064193  5112 raft_consensus.cc:2272] T 08545673d7a343098386ef8d5ccc7689 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.065898  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:51.066367  5112 raft_consensus.cc:2243] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.066761  5112 raft_consensus.cc:2272] T c82ce00978c948f7b0c9ab6434c2228a P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.068401  5112 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:51.068847  5112 raft_consensus.cc:2243] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.069312  5112 raft_consensus.cc:2272] T 2a415ef9aa884b989791be2a4bfbd0f9 P 69a524bd5b1c4950ab14e0b5c70a08f8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:51.072996 14324 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 76 similar messages]
W20260709 13:17:51.076171 14324 consensus_peers.cc:597] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:51.100101  5112 tablet_server.cc:196] TabletServer@127.4.254.1:41549 shutdown complete.
I20260709 13:17:51.119823  5112 tablet_server.cc:179] TabletServer@127.4.254.2:0 shutting down...
W20260709 13:17:51.136209 14324 consensus_peers.cc:597] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 -> Peer 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925): Couldn't send request to peer 87ea5f0c9a4141eeab03de6631c5288f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:51.141759 14324 consensus_peers.cc:597] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 -> Peer 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925): Couldn't send request to peer 87ea5f0c9a4141eeab03de6631c5288f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:51.143913  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:51.144662  5112 tablet_replica.cc:333] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f: stopping tablet replica
I20260709 13:17:51.145371  5112 raft_consensus.cc:2243] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.145834  5112 raft_consensus.cc:2272] T 34c606df0ec347b5bfd8e36621389eec P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.147965  5112 tablet_replica.cc:333] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f: stopping tablet replica
I20260709 13:17:51.148587  5112 raft_consensus.cc:2243] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:51.149449  5112 raft_consensus.cc:2272] T b9d919fb569d45139e5281b21d834815 P 87ea5f0c9a4141eeab03de6631c5288f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.151467  5112 tablet_replica.cc:333] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f: stopping tablet replica
I20260709 13:17:51.152001  5112 raft_consensus.cc:2243] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:51.152760  5112 raft_consensus.cc:2272] T 845227310e3b4584985b3bff1ca4e03d P 87ea5f0c9a4141eeab03de6631c5288f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.154640  5112 tablet_replica.cc:333] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f: stopping tablet replica
I20260709 13:17:51.155146  5112 raft_consensus.cc:2243] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.155553  5112 raft_consensus.cc:2272] T c82ce00978c948f7b0c9ab6434c2228a P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.157467  5112 tablet_replica.cc:333] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f: stopping tablet replica
I20260709 13:17:51.157991  5112 raft_consensus.cc:2243] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.158393  5112 raft_consensus.cc:2272] T ffaf0ca23c7848579f3293d216159c15 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.160846  5112 tablet_replica.cc:333] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f: stopping tablet replica
I20260709 13:17:51.161530  5112 raft_consensus.cc:2243] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.161932  5112 raft_consensus.cc:2272] T 253053b859784b4784bfc2b60edd9703 P 87ea5f0c9a4141eeab03de6631c5288f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.163941  5112 tablet_replica.cc:333] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f: stopping tablet replica
I20260709 13:17:51.164433  5112 raft_consensus.cc:2243] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.164834  5112 raft_consensus.cc:2272] T 6e1894411bd84c1fba284c731f0f6cc8 P 87ea5f0c9a4141eeab03de6631c5288f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.167306  5112 tablet_replica.cc:333] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f: stopping tablet replica
I20260709 13:17:51.167825  5112 raft_consensus.cc:2243] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.168228  5112 raft_consensus.cc:2272] T 08545673d7a343098386ef8d5ccc7689 P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.170401  5112 tablet_replica.cc:333] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f: stopping tablet replica
I20260709 13:17:51.170914  5112 raft_consensus.cc:2243] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:51.171633  5112 raft_consensus.cc:2272] T 2a415ef9aa884b989791be2a4bfbd0f9 P 87ea5f0c9a4141eeab03de6631c5288f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.173589  5112 tablet_replica.cc:333] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f: stopping tablet replica
I20260709 13:17:51.174062  5112 raft_consensus.cc:2243] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:51.174824  5112 raft_consensus.cc:2272] T 3e3c66753fd74fcfaa56039d944eee1e P 87ea5f0c9a4141eeab03de6631c5288f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:51.196887 14324 consensus_peers.cc:597] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 -> Peer 87ea5f0c9a4141eeab03de6631c5288f (127.4.254.2:44925): Couldn't send request to peer 87ea5f0c9a4141eeab03de6631c5288f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:44925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:51.197685  5112 tablet_server.cc:196] TabletServer@127.4.254.2:0 shutdown complete.
I20260709 13:17:51.220750  5112 tablet_server.cc:179] TabletServer@127.4.254.3:0 shutting down...
W20260709 13:17:51.229175 14324 consensus_peers.cc:597] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:51.248445  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:17:51.249187 14324 consensus_peers.cc:597] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:51.249378  5112 tablet_replica.cc:333] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0: stopping tablet replica
I20260709 13:17:51.250223  5112 raft_consensus.cc:2243] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:51.250993  5112 raft_consensus.cc:2272] T c82ce00978c948f7b0c9ab6434c2228a P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.253649  5112 tablet_replica.cc:333] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0: stopping tablet replica
I20260709 13:17:51.254392  5112 raft_consensus.cc:2243] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:51.255127  5112 raft_consensus.cc:2272] T 34c606df0ec347b5bfd8e36621389eec P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:51.255293 14324 consensus_peers.cc:597] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 -> Peer 69a524bd5b1c4950ab14e0b5c70a08f8 (127.4.254.1:41549): Couldn't send request to peer 69a524bd5b1c4950ab14e0b5c70a08f8. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:41549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:51.257053  5112 tablet_replica.cc:333] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0: stopping tablet replica
I20260709 13:17:51.257779  5112 raft_consensus.cc:2243] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.258193  5112 raft_consensus.cc:2272] T b9d919fb569d45139e5281b21d834815 P cac1ac0d1d8e43cba83a11d285d041e0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.260126  5112 tablet_replica.cc:333] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0: stopping tablet replica
I20260709 13:17:51.260679  5112 raft_consensus.cc:2243] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.261094  5112 raft_consensus.cc:2272] T 845227310e3b4584985b3bff1ca4e03d P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.263029  5112 tablet_replica.cc:333] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0: stopping tablet replica
I20260709 13:17:51.263566  5112 raft_consensus.cc:2243] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.263962  5112 raft_consensus.cc:2272] T 2a415ef9aa884b989791be2a4bfbd0f9 P cac1ac0d1d8e43cba83a11d285d041e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.266023  5112 tablet_replica.cc:333] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0: stopping tablet replica
I20260709 13:17:51.266562  5112 raft_consensus.cc:2243] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:51.267463  5112 raft_consensus.cc:2272] T 08545673d7a343098386ef8d5ccc7689 P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.269573  5112 tablet_replica.cc:333] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0: stopping tablet replica
I20260709 13:17:51.270112  5112 raft_consensus.cc:2243] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:51.270906  5112 raft_consensus.cc:2272] T ffaf0ca23c7848579f3293d216159c15 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.274164  5112 tablet_replica.cc:333] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0: stopping tablet replica
I20260709 13:17:51.274688  5112 raft_consensus.cc:2243] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:17:51.275404  5112 raft_consensus.cc:2272] T 6e1894411bd84c1fba284c731f0f6cc8 P cac1ac0d1d8e43cba83a11d285d041e0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.277966  5112 tablet_replica.cc:333] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0: stopping tablet replica
I20260709 13:17:51.278456  5112 raft_consensus.cc:2243] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:51.279177  5112 raft_consensus.cc:2272] T 253053b859784b4784bfc2b60edd9703 P cac1ac0d1d8e43cba83a11d285d041e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.281029  5112 tablet_replica.cc:333] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0: stopping tablet replica
I20260709 13:17:51.281545  5112 raft_consensus.cc:2243] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.281975  5112 raft_consensus.cc:2272] T 3e3c66753fd74fcfaa56039d944eee1e P cac1ac0d1d8e43cba83a11d285d041e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.311875  5112 tablet_server.cc:196] TabletServer@127.4.254.3:0 shutdown complete.
I20260709 13:17:51.333791  5112 master.cc:562] Master@127.4.254.62:34103 shutting down...
I20260709 13:17:51.357504  5112 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:51.358067  5112 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.358412  5112 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7a01688cc52f4ddf8e07619521110e32: stopping tablet replica
I20260709 13:17:51.378746  5112 master.cc:584] Master@127.4.254.62:34103 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12852 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:17:51.425799  5112 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.254.62:46541
I20260709 13:17:51.427074  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:51.432865 14687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:51.433349 14688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:51.434504 14690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:51.435223  5112 server_base.cc:1061] running on GCE node
I20260709 13:17:51.436156  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:51.436411  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:51.436581  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603071436561 us; error 0 us; skew 500 ppm
I20260709 13:17:51.437256  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:51.439703  5112 webserver.cc:533] Webserver started at http://127.4.254.62:46681/ using document root <none> and password file <none>
I20260709 13:17:51.440232  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:51.440450  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:51.440752  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:51.442153  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/master-0-root/instance:
uuid: "4e418ed9e00e48c7a9748d9121c8e14f"
format_stamp: "Formatted at 2026-07-09 13:17:51 on dist-test-slave-k73n"
I20260709 13:17:51.446962  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:17:51.450521 14695 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:51.451411  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:17:51.451668  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/master-0-root
uuid: "4e418ed9e00e48c7a9748d9121c8e14f"
format_stamp: "Formatted at 2026-07-09 13:17:51 on dist-test-slave-k73n"
I20260709 13:17:51.451905  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:51.483780  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:51.484956  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:51.522522  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.62:46541
I20260709 13:17:51.522672 14746 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.62:46541 every 8 connection(s)
I20260709 13:17:51.528311 14747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.539348 14747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f: Bootstrap starting.
I20260709 13:17:51.544209 14747 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.548451 14747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f: No bootstrap required, opened a new log
I20260709 13:17:51.550701 14747 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e418ed9e00e48c7a9748d9121c8e14f" member_type: VOTER }
I20260709 13:17:51.551097 14747 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.551342 14747 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e418ed9e00e48c7a9748d9121c8e14f, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.551978 14747 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e418ed9e00e48c7a9748d9121c8e14f" member_type: VOTER }
I20260709 13:17:51.552495 14747 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:51.552734 14747 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:51.553030 14747 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.557914 14747 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e418ed9e00e48c7a9748d9121c8e14f" member_type: VOTER }
I20260709 13:17:51.558440 14747 leader_election.cc:304] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e418ed9e00e48c7a9748d9121c8e14f; no voters: 
I20260709 13:17:51.559558 14747 leader_election.cc:290] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:51.559998 14750 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:51.561367 14750 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [term 1 LEADER]: Becoming Leader. State: Replica: 4e418ed9e00e48c7a9748d9121c8e14f, State: Running, Role: LEADER
I20260709 13:17:51.562039 14750 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e418ed9e00e48c7a9748d9121c8e14f" member_type: VOTER }
I20260709 13:17:51.562419 14747 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:51.566327 14752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e418ed9e00e48c7a9748d9121c8e14f. Latest consensus state: current_term: 1 leader_uuid: "4e418ed9e00e48c7a9748d9121c8e14f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e418ed9e00e48c7a9748d9121c8e14f" member_type: VOTER } }
I20260709 13:17:51.566928 14752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:51.567912 14751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e418ed9e00e48c7a9748d9121c8e14f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e418ed9e00e48c7a9748d9121c8e14f" member_type: VOTER } }
I20260709 13:17:51.568624 14751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:51.570848 14758 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:51.575611 14758 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:51.577925  5112 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:51.584805 14758 catalog_manager.cc:1383] Generated new cluster ID: 48a55cce721e4bca84fbbaf3076ff18a
I20260709 13:17:51.585093 14758 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:51.601305 14758 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:51.602633 14758 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:51.619179 14758 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f: Generated new TSK 0
I20260709 13:17:51.619787 14758 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:51.647404  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:51.653841 14768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:51.654767 14769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:51.656929  5112 server_base.cc:1061] running on GCE node
W20260709 13:17:51.657423 14771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:51.658366  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:51.658563  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:51.658772  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603071658736 us; error 0 us; skew 500 ppm
I20260709 13:17:51.659328  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:51.661641  5112 webserver.cc:533] Webserver started at http://127.4.254.1:42509/ using document root <none> and password file <none>
I20260709 13:17:51.662108  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:51.662318  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:51.662585  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:51.663713  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-0-root/instance:
uuid: "3475b9e1dc2d483da54678e41e63fc0f"
format_stamp: "Formatted at 2026-07-09 13:17:51 on dist-test-slave-k73n"
I20260709 13:17:51.668100  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:51.671366 14776 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:51.672225  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:51.672520  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-0-root
uuid: "3475b9e1dc2d483da54678e41e63fc0f"
format_stamp: "Formatted at 2026-07-09 13:17:51 on dist-test-slave-k73n"
I20260709 13:17:51.672813  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:51.688047  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:51.689301  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:51.690816  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:51.693634  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:51.693856  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:51.694139  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:51.694317  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:51.734154  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.1:35477
I20260709 13:17:51.734248 14838 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.1:35477 every 8 connection(s)
I20260709 13:17:51.740630  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:51.748368 14843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:51.749310 14844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:51.752048 14839 heartbeater.cc:344] Connected to a master server at 127.4.254.62:46541
I20260709 13:17:51.752614 14839 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:51.753283  5112 server_base.cc:1061] running on GCE node
I20260709 13:17:51.753630 14839 heartbeater.cc:507] Master 127.4.254.62:46541 requested a full tablet report, sending...
W20260709 13:17:51.753983 14846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:51.754964  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:51.755195  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:51.755366  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603071755335 us; error 0 us; skew 500 ppm
I20260709 13:17:51.755934  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:51.756078 14712 ts_manager.cc:194] Registered new tserver with Master: 3475b9e1dc2d483da54678e41e63fc0f (127.4.254.1:35477)
I20260709 13:17:51.758020 14712 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48064
I20260709 13:17:51.758834  5112 webserver.cc:533] Webserver started at http://127.4.254.2:44829/ using document root <none> and password file <none>
I20260709 13:17:51.759402  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:51.759599  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:51.759877  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:51.760982  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-1-root/instance:
uuid: "df4c5e3893eb43e8851d91ccf542ea54"
format_stamp: "Formatted at 2026-07-09 13:17:51 on dist-test-slave-k73n"
I20260709 13:17:51.765478  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:17:51.768761 14851 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:51.769565  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:17:51.769860  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-1-root
uuid: "df4c5e3893eb43e8851d91ccf542ea54"
format_stamp: "Formatted at 2026-07-09 13:17:51 on dist-test-slave-k73n"
I20260709 13:17:51.770154  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:51.799238  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:51.800480  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:51.801970  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:51.804255  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:51.804483  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:51.804720  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:51.804893  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:51.845049  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.2:45961
I20260709 13:17:51.845198 14913 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.2:45961 every 8 connection(s)
I20260709 13:17:51.849970  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:51.858536 14918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:51.858541 14917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:51.862598 14920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:51.862933 14914 heartbeater.cc:344] Connected to a master server at 127.4.254.62:46541
I20260709 13:17:51.863436 14914 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:51.864033  5112 server_base.cc:1061] running on GCE node
I20260709 13:17:51.864487 14914 heartbeater.cc:507] Master 127.4.254.62:46541 requested a full tablet report, sending...
I20260709 13:17:51.864993  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:51.865306  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:51.865507  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603071865488 us; error 0 us; skew 500 ppm
I20260709 13:17:51.866080  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:51.866788 14712 ts_manager.cc:194] Registered new tserver with Master: df4c5e3893eb43e8851d91ccf542ea54 (127.4.254.2:45961)
I20260709 13:17:51.868489 14712 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48078
I20260709 13:17:51.868791  5112 webserver.cc:533] Webserver started at http://127.4.254.3:45615/ using document root <none> and password file <none>
I20260709 13:17:51.869413  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:51.869680  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:51.870019  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:51.871176  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-2-root/instance:
uuid: "3c8f954041a848d8984d51d14546da45"
format_stamp: "Formatted at 2026-07-09 13:17:51 on dist-test-slave-k73n"
I20260709 13:17:51.875829  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:51.879096 14925 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:51.879920  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:51.880227  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-2-root
uuid: "3c8f954041a848d8984d51d14546da45"
format_stamp: "Formatted at 2026-07-09 13:17:51 on dist-test-slave-k73n"
I20260709 13:17:51.880496  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602796139571-5112-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:51.904932  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:51.906208  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:51.907673  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:51.909844  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:51.910017  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:51.910328  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:51.910490  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:51.950301  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.3:36345
I20260709 13:17:51.950384 14987 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.3:36345 every 8 connection(s)
I20260709 13:17:51.963888 14988 heartbeater.cc:344] Connected to a master server at 127.4.254.62:46541
I20260709 13:17:51.964244 14988 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:51.964895 14988 heartbeater.cc:507] Master 127.4.254.62:46541 requested a full tablet report, sending...
I20260709 13:17:51.966760 14712 ts_manager.cc:194] Registered new tserver with Master: 3c8f954041a848d8984d51d14546da45 (127.4.254.3:36345)
I20260709 13:17:51.967880  5112 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014477265s
I20260709 13:17:51.968309 14712 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48084
I20260709 13:17:51.993181 14712 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48094:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:51.995232 14712 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:52.040607 14953 tablet_service.cc:1511] Processing CreateTablet for tablet a8f60765f46542dabf3fe7ba0c040216 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b6d426c941b64bbd9039a6f04ce38586]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:52.042145 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f60765f46542dabf3fe7ba0c040216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:52.044232 14952 tablet_service.cc:1511] Processing CreateTablet for tablet 09632745fa5943dd87f142819bea8aca (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b6d426c941b64bbd9039a6f04ce38586]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:52.045826 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09632745fa5943dd87f142819bea8aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:52.052953 14804 tablet_service.cc:1511] Processing CreateTablet for tablet a8f60765f46542dabf3fe7ba0c040216 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b6d426c941b64bbd9039a6f04ce38586]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:52.054392 14804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f60765f46542dabf3fe7ba0c040216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:52.057720 14879 tablet_service.cc:1511] Processing CreateTablet for tablet a8f60765f46542dabf3fe7ba0c040216 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b6d426c941b64bbd9039a6f04ce38586]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:52.059171 14879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f60765f46542dabf3fe7ba0c040216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:52.063237 14878 tablet_service.cc:1511] Processing CreateTablet for tablet 09632745fa5943dd87f142819bea8aca (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b6d426c941b64bbd9039a6f04ce38586]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:52.064644 14878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09632745fa5943dd87f142819bea8aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:52.066599 15002 tablet_bootstrap.cc:492] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45: Bootstrap starting.
I20260709 13:17:52.067086 14803 tablet_service.cc:1511] Processing CreateTablet for tablet 09632745fa5943dd87f142819bea8aca (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b6d426c941b64bbd9039a6f04ce38586]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:52.068430 14803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09632745fa5943dd87f142819bea8aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:52.076076 15002 tablet_bootstrap.cc:654] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:52.092335 15004 tablet_bootstrap.cc:492] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f: Bootstrap starting.
I20260709 13:17:52.094457 15002 tablet_bootstrap.cc:492] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45: No bootstrap required, opened a new log
I20260709 13:17:52.094980 15005 tablet_bootstrap.cc:492] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54: Bootstrap starting.
I20260709 13:17:52.095134 15002 ts_tablet_manager.cc:1403] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.008s
I20260709 13:17:52.098959 15004 tablet_bootstrap.cc:654] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:52.100376 15002 raft_consensus.cc:359] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } } peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } }
I20260709 13:17:52.101222 15002 raft_consensus.cc:385] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.101521 15002 raft_consensus.cc:740] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c8f954041a848d8984d51d14546da45, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.102552 15002 consensus_queue.cc:260] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } } peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } }
I20260709 13:17:52.104777 14988 heartbeater.cc:499] Master 127.4.254.62:46541 was elected leader, sending a full tablet report...
I20260709 13:17:52.104807 15004 tablet_bootstrap.cc:492] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f: No bootstrap required, opened a new log
I20260709 13:17:52.104382 15005 tablet_bootstrap.cc:654] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:52.105363 15002 ts_tablet_manager.cc:1434] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:52.105685 15004 ts_tablet_manager.cc:1403] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.007s
I20260709 13:17:52.106539 15002 tablet_bootstrap.cc:492] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45: Bootstrap starting.
I20260709 13:17:52.108822 15004 raft_consensus.cc:359] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.109663 15004 raft_consensus.cc:385] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.110036 15004 raft_consensus.cc:740] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3475b9e1dc2d483da54678e41e63fc0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.111014 15004 consensus_queue.cc:260] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.114301 15002 tablet_bootstrap.cc:654] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:52.116453 14839 heartbeater.cc:499] Master 127.4.254.62:46541 was elected leader, sending a full tablet report...
I20260709 13:17:52.118046 15004 ts_tablet_manager.cc:1434] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 13:17:52.119043 15004 tablet_bootstrap.cc:492] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f: Bootstrap starting.
I20260709 13:17:52.124678 15005 tablet_bootstrap.cc:492] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54: No bootstrap required, opened a new log
I20260709 13:17:52.125300 15005 ts_tablet_manager.cc:1403] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.011s
I20260709 13:17:52.127753 15004 tablet_bootstrap.cc:654] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:52.128295 15005 raft_consensus.cc:359] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.129170 15005 raft_consensus.cc:385] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.129482 15005 raft_consensus.cc:740] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4c5e3893eb43e8851d91ccf542ea54, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.130471 15005 consensus_queue.cc:260] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.143869 14914 heartbeater.cc:499] Master 127.4.254.62:46541 was elected leader, sending a full tablet report...
I20260709 13:17:52.144791 15005 ts_tablet_manager.cc:1434] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.009s
I20260709 13:17:52.145955 15005 tablet_bootstrap.cc:492] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54: Bootstrap starting.
I20260709 13:17:52.147040 15004 tablet_bootstrap.cc:492] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f: No bootstrap required, opened a new log
I20260709 13:17:52.147075 15002 tablet_bootstrap.cc:492] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45: No bootstrap required, opened a new log
I20260709 13:17:52.147734 15004 ts_tablet_manager.cc:1403] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.012s
I20260709 13:17:52.147830 15002 ts_tablet_manager.cc:1403] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.023s
I20260709 13:17:52.151014 15004 raft_consensus.cc:359] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } } peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } }
I20260709 13:17:52.151811 15004 raft_consensus.cc:385] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.151396 15002 raft_consensus.cc:359] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.152190 15004 raft_consensus.cc:740] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3475b9e1dc2d483da54678e41e63fc0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.152366 15002 raft_consensus.cc:385] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.152799 15002 raft_consensus.cc:740] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c8f954041a848d8984d51d14546da45, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.153028 15005 tablet_bootstrap.cc:654] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:52.153340 15004 consensus_queue.cc:260] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } } peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } }
I20260709 13:17:52.155743 15004 ts_tablet_manager.cc:1434] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:52.153764 15002 consensus_queue.cc:260] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.158756 15002 ts_tablet_manager.cc:1434] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:17:52.162539 15005 tablet_bootstrap.cc:492] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54: No bootstrap required, opened a new log
I20260709 13:17:52.163206 15005 ts_tablet_manager.cc:1403] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:17:52.165836 15005 raft_consensus.cc:359] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } } peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } }
I20260709 13:17:52.166378 15005 raft_consensus.cc:385] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.166626 15005 raft_consensus.cc:740] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4c5e3893eb43e8851d91ccf542ea54, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.167261 15005 consensus_queue.cc:260] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } } peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } }
I20260709 13:17:52.169087 15005 ts_tablet_manager.cc:1434] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:17:52.229176 15007 raft_consensus.cc:493] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.229789 15007 raft_consensus.cc:515] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.231820 15007 leader_election.cc:290] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3475b9e1dc2d483da54678e41e63fc0f (127.4.254.1:35477), df4c5e3893eb43e8851d91ccf542ea54 (127.4.254.2:45961)
I20260709 13:17:52.241837 14814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09632745fa5943dd87f142819bea8aca" candidate_uuid: "3c8f954041a848d8984d51d14546da45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3475b9e1dc2d483da54678e41e63fc0f" is_pre_election: true
I20260709 13:17:52.242695 14814 raft_consensus.cc:2468] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c8f954041a848d8984d51d14546da45 in term 0.
I20260709 13:17:52.243487 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09632745fa5943dd87f142819bea8aca" candidate_uuid: "3c8f954041a848d8984d51d14546da45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4c5e3893eb43e8851d91ccf542ea54" is_pre_election: true
I20260709 13:17:52.243902 14928 leader_election.cc:304] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3475b9e1dc2d483da54678e41e63fc0f, 3c8f954041a848d8984d51d14546da45; no voters: 
I20260709 13:17:52.244297 14889 raft_consensus.cc:2468] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c8f954041a848d8984d51d14546da45 in term 0.
I20260709 13:17:52.244866 15007 raft_consensus.cc:2804] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:52.245229 15007 raft_consensus.cc:493] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.245546 15007 raft_consensus.cc:3060] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.250516 15007 raft_consensus.cc:515] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.252066 15007 leader_election.cc:290] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [CANDIDATE]: Term 1 election: Requested vote from peers 3475b9e1dc2d483da54678e41e63fc0f (127.4.254.1:35477), df4c5e3893eb43e8851d91ccf542ea54 (127.4.254.2:45961)
I20260709 13:17:52.252830 14814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09632745fa5943dd87f142819bea8aca" candidate_uuid: "3c8f954041a848d8984d51d14546da45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3475b9e1dc2d483da54678e41e63fc0f"
I20260709 13:17:52.253191 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09632745fa5943dd87f142819bea8aca" candidate_uuid: "3c8f954041a848d8984d51d14546da45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4c5e3893eb43e8851d91ccf542ea54"
I20260709 13:17:52.253520 14814 raft_consensus.cc:3060] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.253778 14889 raft_consensus.cc:3060] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.258791 14889 raft_consensus.cc:2468] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c8f954041a848d8984d51d14546da45 in term 1.
I20260709 13:17:52.258785 14814 raft_consensus.cc:2468] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c8f954041a848d8984d51d14546da45 in term 1.
I20260709 13:17:52.259894 14928 leader_election.cc:304] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c8f954041a848d8984d51d14546da45, df4c5e3893eb43e8851d91ccf542ea54; no voters: 
I20260709 13:17:52.260587 15007 raft_consensus.cc:2804] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:52.261437 15007 raft_consensus.cc:697] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [term 1 LEADER]: Becoming Leader. State: Replica: 3c8f954041a848d8984d51d14546da45, State: Running, Role: LEADER
I20260709 13:17:52.262107 15007 consensus_queue.cc:237] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.269688 14712 catalog_manager.cc:5697] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c8f954041a848d8984d51d14546da45 (127.4.254.3). New cstate: current_term: 1 leader_uuid: "3c8f954041a848d8984d51d14546da45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:52.308102 15009 raft_consensus.cc:493] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.308692 15009 raft_consensus.cc:515] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } } peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } }
I20260709 13:17:52.310802 15009 leader_election.cc:290] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c8f954041a848d8984d51d14546da45 (127.4.254.3:36345), df4c5e3893eb43e8851d91ccf542ea54 (127.4.254.2:45961)
I20260709 13:17:52.321761 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f60765f46542dabf3fe7ba0c040216" candidate_uuid: "3475b9e1dc2d483da54678e41e63fc0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c8f954041a848d8984d51d14546da45" is_pre_election: true
I20260709 13:17:52.322594 14963 raft_consensus.cc:2468] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3475b9e1dc2d483da54678e41e63fc0f in term 0.
I20260709 13:17:52.322808 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f60765f46542dabf3fe7ba0c040216" candidate_uuid: "3475b9e1dc2d483da54678e41e63fc0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4c5e3893eb43e8851d91ccf542ea54" is_pre_election: true
I20260709 13:17:52.323455 14889 raft_consensus.cc:2468] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3475b9e1dc2d483da54678e41e63fc0f in term 0.
I20260709 13:17:52.323704 14780 leader_election.cc:304] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3475b9e1dc2d483da54678e41e63fc0f, 3c8f954041a848d8984d51d14546da45; no voters: 
I20260709 13:17:52.324575 15009 raft_consensus.cc:2804] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:52.324844 15009 raft_consensus.cc:493] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.325055 15009 raft_consensus.cc:3060] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.330025 15009 raft_consensus.cc:515] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } } peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } }
I20260709 13:17:52.331511 15009 leader_election.cc:290] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [CANDIDATE]: Term 1 election: Requested vote from peers 3c8f954041a848d8984d51d14546da45 (127.4.254.3:36345), df4c5e3893eb43e8851d91ccf542ea54 (127.4.254.2:45961)
I20260709 13:17:52.332242 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f60765f46542dabf3fe7ba0c040216" candidate_uuid: "3475b9e1dc2d483da54678e41e63fc0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c8f954041a848d8984d51d14546da45"
I20260709 13:17:52.332561 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f60765f46542dabf3fe7ba0c040216" candidate_uuid: "3475b9e1dc2d483da54678e41e63fc0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4c5e3893eb43e8851d91ccf542ea54"
I20260709 13:17:52.332890 14963 raft_consensus.cc:3060] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.333179 14889 raft_consensus.cc:3060] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.340056 14889 raft_consensus.cc:2468] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3475b9e1dc2d483da54678e41e63fc0f in term 1.
I20260709 13:17:52.340056 14963 raft_consensus.cc:2468] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3475b9e1dc2d483da54678e41e63fc0f in term 1.
I20260709 13:17:52.341488 14779 leader_election.cc:304] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3475b9e1dc2d483da54678e41e63fc0f, df4c5e3893eb43e8851d91ccf542ea54; no voters: 
I20260709 13:17:52.342187 15009 raft_consensus.cc:2804] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:52.343207 15009 raft_consensus.cc:697] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [term 1 LEADER]: Becoming Leader. State: Replica: 3475b9e1dc2d483da54678e41e63fc0f, State: Running, Role: LEADER
I20260709 13:17:52.343989 15009 consensus_queue.cc:237] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } } peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } }
I20260709 13:17:52.350544 14712 catalog_manager.cc:5697] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3475b9e1dc2d483da54678e41e63fc0f (127.4.254.1). New cstate: current_term: 1 leader_uuid: "3475b9e1dc2d483da54678e41e63fc0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.436331 14712 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48110:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:52.438265 14712 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:52.461298 14804 tablet_service.cc:1511] Processing CreateTablet for tablet 84f2cc1850fe4cc385d9ed6bcf42cced (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d5b58bcd2f52431486a00bddaca09ce8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:52.462647 14804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f2cc1850fe4cc385d9ed6bcf42cced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:52.462575 14879 tablet_service.cc:1511] Processing CreateTablet for tablet 84f2cc1850fe4cc385d9ed6bcf42cced (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d5b58bcd2f52431486a00bddaca09ce8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:52.463928 14879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f2cc1850fe4cc385d9ed6bcf42cced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:52.463786 14953 tablet_service.cc:1511] Processing CreateTablet for tablet 84f2cc1850fe4cc385d9ed6bcf42cced (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d5b58bcd2f52431486a00bddaca09ce8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:52.465116 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f2cc1850fe4cc385d9ed6bcf42cced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:52.467754 14803 tablet_service.cc:1511] Processing CreateTablet for tablet 5a822cdd811a4815b3c7f8fb002110a0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d5b58bcd2f52431486a00bddaca09ce8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:52.469022 14803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a822cdd811a4815b3c7f8fb002110a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:52.471879 14952 tablet_service.cc:1511] Processing CreateTablet for tablet 5a822cdd811a4815b3c7f8fb002110a0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d5b58bcd2f52431486a00bddaca09ce8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:52.473161 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a822cdd811a4815b3c7f8fb002110a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:52.478610 14878 tablet_service.cc:1511] Processing CreateTablet for tablet 5a822cdd811a4815b3c7f8fb002110a0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d5b58bcd2f52431486a00bddaca09ce8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:52.479882 14878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a822cdd811a4815b3c7f8fb002110a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:52.481276 15002 tablet_bootstrap.cc:492] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45: Bootstrap starting.
I20260709 13:17:52.482303 15004 tablet_bootstrap.cc:492] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f: Bootstrap starting.
I20260709 13:17:52.487623 15002 tablet_bootstrap.cc:654] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:52.488677 15004 tablet_bootstrap.cc:654] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:52.495918 15002 tablet_bootstrap.cc:492] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45: No bootstrap required, opened a new log
I20260709 13:17:52.496493 15002 ts_tablet_manager.cc:1403] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:17:52.498108 15005 tablet_bootstrap.cc:492] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54: Bootstrap starting.
I20260709 13:17:52.499667 15002 raft_consensus.cc:359] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.500221 15004 tablet_bootstrap.cc:492] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f: No bootstrap required, opened a new log
I20260709 13:17:52.500458 15002 raft_consensus.cc:385] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.500777 15004 ts_tablet_manager.cc:1403] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:17:52.500813 15002 raft_consensus.cc:740] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c8f954041a848d8984d51d14546da45, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.502154 15002 consensus_queue.cc:260] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.503885 15004 raft_consensus.cc:359] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.504819 15004 raft_consensus.cc:385] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.505236 15004 raft_consensus.cc:740] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3475b9e1dc2d483da54678e41e63fc0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.506038 15004 consensus_queue.cc:260] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.504411 15002 ts_tablet_manager.cc:1434] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:17:52.507009 15005 tablet_bootstrap.cc:654] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:52.511129 15004 ts_tablet_manager.cc:1434] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:17:52.512300 15004 tablet_bootstrap.cc:492] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f: Bootstrap starting.
I20260709 13:17:52.518838 15004 tablet_bootstrap.cc:654] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:52.519793 15002 tablet_bootstrap.cc:492] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45: Bootstrap starting.
I20260709 13:17:52.528687 15002 tablet_bootstrap.cc:654] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:52.530756 15004 tablet_bootstrap.cc:492] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f: No bootstrap required, opened a new log
I20260709 13:17:52.531414 15004 ts_tablet_manager.cc:1403] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:17:52.538019 15004 raft_consensus.cc:359] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.539085 15004 raft_consensus.cc:385] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.539525 15004 raft_consensus.cc:740] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3475b9e1dc2d483da54678e41e63fc0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.540668 15004 consensus_queue.cc:260] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.544415 15004 ts_tablet_manager.cc:1434] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:17:52.547791 15002 tablet_bootstrap.cc:492] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45: No bootstrap required, opened a new log
I20260709 13:17:52.548439 15002 ts_tablet_manager.cc:1403] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.015s
I20260709 13:17:52.549360 15005 tablet_bootstrap.cc:492] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54: No bootstrap required, opened a new log
I20260709 13:17:52.550027 15005 ts_tablet_manager.cc:1403] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54: Time spent bootstrapping tablet: real 0.052s	user 0.031s	sys 0.018s
I20260709 13:17:52.551803 15002 raft_consensus.cc:359] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.552639 15002 raft_consensus.cc:385] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.552942 15002 raft_consensus.cc:740] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c8f954041a848d8984d51d14546da45, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.553077 15005 raft_consensus.cc:359] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.553862 15002 consensus_queue.cc:260] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.554361 15005 raft_consensus.cc:385] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.554716 15005 raft_consensus.cc:740] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4c5e3893eb43e8851d91ccf542ea54, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.555536 15005 consensus_queue.cc:260] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.557807 15005 ts_tablet_manager.cc:1434] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:17:52.558933 15005 tablet_bootstrap.cc:492] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54: Bootstrap starting.
I20260709 13:17:52.556278 15002 ts_tablet_manager.cc:1434] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:52.565343 15005 tablet_bootstrap.cc:654] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:52.569943 15005 tablet_bootstrap.cc:492] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54: No bootstrap required, opened a new log
I20260709 13:17:52.570461 15005 ts_tablet_manager.cc:1403] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54: Time spent bootstrapping tablet: real 0.012s	user 0.004s	sys 0.006s
W20260709 13:17:52.572482 14760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:52.573056 15005 raft_consensus.cc:359] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.573726 15005 raft_consensus.cc:385] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.573964 15005 raft_consensus.cc:740] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4c5e3893eb43e8851d91ccf542ea54, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.574649 15005 consensus_queue.cc:260] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.576643 15005 ts_tablet_manager.cc:1434] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.002s
I20260709 13:17:52.709491 15007 consensus_queue.cc:1048] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.724116 15015 consensus_queue.cc:1048] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.789517 15012 raft_consensus.cc:493] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.790048 15012 raft_consensus.cc:515] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.791996 15012 leader_election.cc:290] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3475b9e1dc2d483da54678e41e63fc0f (127.4.254.1:35477), 3c8f954041a848d8984d51d14546da45 (127.4.254.3:36345)
I20260709 13:17:52.802278 15009 consensus_queue.cc:1048] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.804107 15012 raft_consensus.cc:493] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.804667 15012 raft_consensus.cc:515] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.805464 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f2cc1850fe4cc385d9ed6bcf42cced" candidate_uuid: "df4c5e3893eb43e8851d91ccf542ea54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c8f954041a848d8984d51d14546da45" is_pre_election: true
I20260709 13:17:52.806124 14963 raft_consensus.cc:2468] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df4c5e3893eb43e8851d91ccf542ea54 in term 0.
I20260709 13:17:52.806216 14814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f2cc1850fe4cc385d9ed6bcf42cced" candidate_uuid: "df4c5e3893eb43e8851d91ccf542ea54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3475b9e1dc2d483da54678e41e63fc0f" is_pre_election: true
I20260709 13:17:52.806797 15012 leader_election.cc:290] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3475b9e1dc2d483da54678e41e63fc0f (127.4.254.1:35477), 3c8f954041a848d8984d51d14546da45 (127.4.254.3:36345)
I20260709 13:17:52.807228 14814 raft_consensus.cc:2468] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df4c5e3893eb43e8851d91ccf542ea54 in term 0.
I20260709 13:17:52.808598 14855 leader_election.cc:304] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c8f954041a848d8984d51d14546da45, df4c5e3893eb43e8851d91ccf542ea54; no voters: 
I20260709 13:17:52.809180 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a822cdd811a4815b3c7f8fb002110a0" candidate_uuid: "df4c5e3893eb43e8851d91ccf542ea54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c8f954041a848d8984d51d14546da45" is_pre_election: true
I20260709 13:17:52.809962 14963 raft_consensus.cc:2468] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df4c5e3893eb43e8851d91ccf542ea54 in term 0.
I20260709 13:17:52.809998 15041 raft_consensus.cc:2804] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:52.810364 14814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a822cdd811a4815b3c7f8fb002110a0" candidate_uuid: "df4c5e3893eb43e8851d91ccf542ea54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3475b9e1dc2d483da54678e41e63fc0f" is_pre_election: true
I20260709 13:17:52.811101 14814 raft_consensus.cc:2468] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df4c5e3893eb43e8851d91ccf542ea54 in term 0.
I20260709 13:17:52.811300 14855 leader_election.cc:304] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c8f954041a848d8984d51d14546da45, df4c5e3893eb43e8851d91ccf542ea54; no voters: 
I20260709 13:17:52.812179 15012 raft_consensus.cc:2804] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:52.810566 15041 raft_consensus.cc:493] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.812516 15012 raft_consensus.cc:493] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.812841 15041 raft_consensus.cc:3060] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.812903 15012 raft_consensus.cc:3060] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.820093 15019 consensus_queue.cc:1048] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.821010 15012 raft_consensus.cc:515] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.823598 15041 raft_consensus.cc:515] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.825083 15012 leader_election.cc:290] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [CANDIDATE]: Term 1 election: Requested vote from peers 3475b9e1dc2d483da54678e41e63fc0f (127.4.254.1:35477), 3c8f954041a848d8984d51d14546da45 (127.4.254.3:36345)
I20260709 13:17:52.825268 14814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a822cdd811a4815b3c7f8fb002110a0" candidate_uuid: "df4c5e3893eb43e8851d91ccf542ea54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3475b9e1dc2d483da54678e41e63fc0f"
I20260709 13:17:52.825948 14814 raft_consensus.cc:3060] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.828105 15041 leader_election.cc:290] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [CANDIDATE]: Term 1 election: Requested vote from peers 3475b9e1dc2d483da54678e41e63fc0f (127.4.254.1:35477), 3c8f954041a848d8984d51d14546da45 (127.4.254.3:36345)
I20260709 13:17:52.831969 14813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f2cc1850fe4cc385d9ed6bcf42cced" candidate_uuid: "df4c5e3893eb43e8851d91ccf542ea54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3475b9e1dc2d483da54678e41e63fc0f"
I20260709 13:17:52.832435 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a822cdd811a4815b3c7f8fb002110a0" candidate_uuid: "df4c5e3893eb43e8851d91ccf542ea54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c8f954041a848d8984d51d14546da45"
I20260709 13:17:52.832903 14813 raft_consensus.cc:3060] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.833119 14962 raft_consensus.cc:3060] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.834017 14814 raft_consensus.cc:2468] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4c5e3893eb43e8851d91ccf542ea54 in term 1.
I20260709 13:17:52.835352 14854 leader_election.cc:304] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3475b9e1dc2d483da54678e41e63fc0f, df4c5e3893eb43e8851d91ccf542ea54; no voters: 
I20260709 13:17:52.836375 15041 raft_consensus.cc:2804] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:52.837595 15041 raft_consensus.cc:697] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 1 LEADER]: Becoming Leader. State: Replica: df4c5e3893eb43e8851d91ccf542ea54, State: Running, Role: LEADER
I20260709 13:17:52.838626 15041 consensus_queue.cc:237] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.840795 14962 raft_consensus.cc:2468] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4c5e3893eb43e8851d91ccf542ea54 in term 1.
I20260709 13:17:52.842226 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f2cc1850fe4cc385d9ed6bcf42cced" candidate_uuid: "df4c5e3893eb43e8851d91ccf542ea54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c8f954041a848d8984d51d14546da45"
I20260709 13:17:52.843132 14961 raft_consensus.cc:3060] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.852373 14813 raft_consensus.cc:2468] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4c5e3893eb43e8851d91ccf542ea54 in term 1.
I20260709 13:17:52.854034 14854 leader_election.cc:304] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3475b9e1dc2d483da54678e41e63fc0f, df4c5e3893eb43e8851d91ccf542ea54; no voters: 
I20260709 13:17:52.853371 14712 catalog_manager.cc:5697] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 reported cstate change: term changed from 0 to 1, leader changed from <none> to df4c5e3893eb43e8851d91ccf542ea54 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "df4c5e3893eb43e8851d91ccf542ea54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.854282 14961 raft_consensus.cc:2468] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4c5e3893eb43e8851d91ccf542ea54 in term 1.
I20260709 13:17:52.855013 15041 raft_consensus.cc:2804] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:52.855571 15041 raft_consensus.cc:697] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 1 LEADER]: Becoming Leader. State: Replica: df4c5e3893eb43e8851d91ccf542ea54, State: Running, Role: LEADER
I20260709 13:17:52.856426 15041 consensus_queue.cc:237] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:52.866793 14712 catalog_manager.cc:5697] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 reported cstate change: term changed from 0 to 1, leader changed from <none> to df4c5e3893eb43e8851d91ccf542ea54 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "df4c5e3893eb43e8851d91ccf542ea54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.923220 14889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84f2cc1850fe4cc385d9ed6bcf42cced"
dest_uuid: "df4c5e3893eb43e8851d91ccf542ea54"
mode: GRACEFUL
new_leader_uuid: "3475b9e1dc2d483da54678e41e63fc0f"
 from {username='slave'} at 127.0.0.1:36726
I20260709 13:17:52.923767 14889 raft_consensus.cc:606] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 1 LEADER]: Received request to transfer leadership to TS 3475b9e1dc2d483da54678e41e63fc0f
I20260709 13:17:52.928628 14889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a822cdd811a4815b3c7f8fb002110a0"
dest_uuid: "df4c5e3893eb43e8851d91ccf542ea54"
mode: GRACEFUL
new_leader_uuid: "3475b9e1dc2d483da54678e41e63fc0f"
 from {username='slave'} at 127.0.0.1:36726
I20260709 13:17:52.929317 14889 raft_consensus.cc:606] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 1 LEADER]: Received request to transfer leadership to TS 3475b9e1dc2d483da54678e41e63fc0f
I20260709 13:17:53.269912 15041 consensus_queue.cc:1048] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:53.276506 15012 raft_consensus.cc:993] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54: : Instructing follower 3475b9e1dc2d483da54678e41e63fc0f to start an election
I20260709 13:17:53.276979 15043 raft_consensus.cc:1081] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 1 LEADER]: Signalling peer 3475b9e1dc2d483da54678e41e63fc0f to start an election
I20260709 13:17:53.278723 14814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a822cdd811a4815b3c7f8fb002110a0"
dest_uuid: "3475b9e1dc2d483da54678e41e63fc0f"
 from {username='slave'} at 127.0.0.1:48980
I20260709 13:17:53.279345 14814 raft_consensus.cc:493] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:53.279857 14814 raft_consensus.cc:3060] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.282775 15012 consensus_queue.cc:1048] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:53.290578 14814 raft_consensus.cc:515] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:53.292819 14814 leader_election.cc:290] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [CANDIDATE]: Term 2 election: Requested vote from peers df4c5e3893eb43e8851d91ccf542ea54 (127.4.254.2:45961), 3c8f954041a848d8984d51d14546da45 (127.4.254.3:36345)
I20260709 13:17:53.293566 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a822cdd811a4815b3c7f8fb002110a0" candidate_uuid: "3475b9e1dc2d483da54678e41e63fc0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df4c5e3893eb43e8851d91ccf542ea54"
I20260709 13:17:53.294226 14889 raft_consensus.cc:3055] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:53.294678 14889 raft_consensus.cc:740] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df4c5e3893eb43e8851d91ccf542ea54, State: Running, Role: LEADER
I20260709 13:17:53.294798 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a822cdd811a4815b3c7f8fb002110a0" candidate_uuid: "3475b9e1dc2d483da54678e41e63fc0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c8f954041a848d8984d51d14546da45"
I20260709 13:17:53.295404 14961 raft_consensus.cc:3060] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.295384 14889 consensus_queue.cc:260] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:53.296240 14889 raft_consensus.cc:3060] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.301337 14889 raft_consensus.cc:2468] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3475b9e1dc2d483da54678e41e63fc0f in term 2.
I20260709 13:17:53.302438 15012 consensus_queue.cc:1048] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:53.302764 14779 leader_election.cc:304] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3475b9e1dc2d483da54678e41e63fc0f, df4c5e3893eb43e8851d91ccf542ea54; no voters: 
I20260709 13:17:53.302802 14961 raft_consensus.cc:2468] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3475b9e1dc2d483da54678e41e63fc0f in term 2.
I20260709 13:17:53.303790 15009 raft_consensus.cc:2804] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:53.304307 15009 raft_consensus.cc:697] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 2 LEADER]: Becoming Leader. State: Replica: 3475b9e1dc2d483da54678e41e63fc0f, State: Running, Role: LEADER
I20260709 13:17:53.305202 15009 consensus_queue.cc:237] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:53.315219 15012 consensus_queue.cc:1048] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:53.314651 14711 catalog_manager.cc:5697] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f reported cstate change: term changed from 1 to 2, leader changed from df4c5e3893eb43e8851d91ccf542ea54 (127.4.254.2) to 3475b9e1dc2d483da54678e41e63fc0f (127.4.254.1). New cstate: current_term: 2 leader_uuid: "3475b9e1dc2d483da54678e41e63fc0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.322721 15043 raft_consensus.cc:993] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54: : Instructing follower 3475b9e1dc2d483da54678e41e63fc0f to start an election
I20260709 13:17:53.323227 15012 raft_consensus.cc:1081] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 1 LEADER]: Signalling peer 3475b9e1dc2d483da54678e41e63fc0f to start an election
I20260709 13:17:53.324990 14814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84f2cc1850fe4cc385d9ed6bcf42cced"
dest_uuid: "3475b9e1dc2d483da54678e41e63fc0f"
 from {username='slave'} at 127.0.0.1:48980
I20260709 13:17:53.325559 14814 raft_consensus.cc:493] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:53.325968 14814 raft_consensus.cc:3060] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.334123 14814 raft_consensus.cc:515] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:53.338459 14814 leader_election.cc:290] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [CANDIDATE]: Term 2 election: Requested vote from peers df4c5e3893eb43e8851d91ccf542ea54 (127.4.254.2:45961), 3c8f954041a848d8984d51d14546da45 (127.4.254.3:36345)
I20260709 13:17:53.339114 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f2cc1850fe4cc385d9ed6bcf42cced" candidate_uuid: "3475b9e1dc2d483da54678e41e63fc0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c8f954041a848d8984d51d14546da45"
I20260709 13:17:53.339212 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f2cc1850fe4cc385d9ed6bcf42cced" candidate_uuid: "3475b9e1dc2d483da54678e41e63fc0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df4c5e3893eb43e8851d91ccf542ea54"
I20260709 13:17:53.339814 14963 raft_consensus.cc:3060] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.340359 14889 raft_consensus.cc:3055] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:53.340703 14889 raft_consensus.cc:740] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df4c5e3893eb43e8851d91ccf542ea54, State: Running, Role: LEADER
I20260709 13:17:53.341830 14889 consensus_queue.cc:260] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:53.343317 14889 raft_consensus.cc:3060] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.347221 14963 raft_consensus.cc:2468] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3475b9e1dc2d483da54678e41e63fc0f in term 2.
I20260709 13:17:53.348611 14780 leader_election.cc:304] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3475b9e1dc2d483da54678e41e63fc0f, 3c8f954041a848d8984d51d14546da45; no voters: 
I20260709 13:17:53.351341 15009 raft_consensus.cc:2804] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:53.351450 14889 raft_consensus.cc:2468] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3475b9e1dc2d483da54678e41e63fc0f in term 2.
I20260709 13:17:53.351867 15009 raft_consensus.cc:697] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [term 2 LEADER]: Becoming Leader. State: Replica: 3475b9e1dc2d483da54678e41e63fc0f, State: Running, Role: LEADER
I20260709 13:17:53.352778 15009 consensus_queue.cc:237] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:53.361481 14711 catalog_manager.cc:5697] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f reported cstate change: term changed from 1 to 2, leader changed from df4c5e3893eb43e8851d91ccf542ea54 (127.4.254.2) to 3475b9e1dc2d483da54678e41e63fc0f (127.4.254.1). New cstate: current_term: 2 leader_uuid: "3475b9e1dc2d483da54678e41e63fc0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.639101  5112 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:17:53.640590  5112 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:17:53.640918  5112 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:17:53.652341 14814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a822cdd811a4815b3c7f8fb002110a0"
dest_uuid: "3475b9e1dc2d483da54678e41e63fc0f"
mode: GRACEFUL
new_leader_uuid: "df4c5e3893eb43e8851d91ccf542ea54"
 from {username='slave'} at 127.0.0.1:48982
I20260709 13:17:53.652889 14814 raft_consensus.cc:606] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 2 LEADER]: Received request to transfer leadership to TS df4c5e3893eb43e8851d91ccf542ea54
I20260709 13:17:53.654016  5112 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:17:53.786334 14963 raft_consensus.cc:1275] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45 [term 2 FOLLOWER]: Refusing update from remote peer 3475b9e1dc2d483da54678e41e63fc0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.787197 14889 raft_consensus.cc:1275] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 2 FOLLOWER]: Refusing update from remote peer 3475b9e1dc2d483da54678e41e63fc0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.787721 15009 consensus_queue.cc:1048] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.788677 15050 consensus_queue.cc:1048] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.792001 14888 raft_consensus.cc:1275] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 2 FOLLOWER]: Refusing update from remote peer 3475b9e1dc2d483da54678e41e63fc0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.794176 15009 consensus_queue.cc:1048] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.797662 15057 raft_consensus.cc:993] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f: : Instructing follower df4c5e3893eb43e8851d91ccf542ea54 to start an election
I20260709 13:17:53.798151 15057 raft_consensus.cc:1081] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 2 LEADER]: Signalling peer df4c5e3893eb43e8851d91ccf542ea54 to start an election
I20260709 13:17:53.802165 14887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a822cdd811a4815b3c7f8fb002110a0"
dest_uuid: "df4c5e3893eb43e8851d91ccf542ea54"
 from {username='slave'} at 127.0.0.1:36710
I20260709 13:17:53.802767 14887 raft_consensus.cc:493] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:53.803134 14887 raft_consensus.cc:3060] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.810563 14887 raft_consensus.cc:515] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:53.815008 14963 raft_consensus.cc:1275] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45 [term 2 FOLLOWER]: Refusing update from remote peer 3475b9e1dc2d483da54678e41e63fc0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.815251 14814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a822cdd811a4815b3c7f8fb002110a0" candidate_uuid: "df4c5e3893eb43e8851d91ccf542ea54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3475b9e1dc2d483da54678e41e63fc0f"
I20260709 13:17:53.815968 14814 raft_consensus.cc:3055] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:53.816295 14814 raft_consensus.cc:740] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3475b9e1dc2d483da54678e41e63fc0f, State: Running, Role: LEADER
I20260709 13:17:53.817049 14814 consensus_queue.cc:260] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:53.818297 14814 raft_consensus.cc:3060] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.820938 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a822cdd811a4815b3c7f8fb002110a0" candidate_uuid: "df4c5e3893eb43e8851d91ccf542ea54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c8f954041a848d8984d51d14546da45"
I20260709 13:17:53.821640 14961 raft_consensus.cc:3060] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.826987 15050 consensus_queue.cc:1048] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.827517 14814 raft_consensus.cc:2468] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4c5e3893eb43e8851d91ccf542ea54 in term 3.
I20260709 13:17:53.828931 14854 leader_election.cc:304] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3475b9e1dc2d483da54678e41e63fc0f, df4c5e3893eb43e8851d91ccf542ea54; no voters: 
I20260709 13:17:53.829277 14887 leader_election.cc:290] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [CANDIDATE]: Term 3 election: Requested vote from peers 3475b9e1dc2d483da54678e41e63fc0f (127.4.254.1:35477), 3c8f954041a848d8984d51d14546da45 (127.4.254.3:36345)
I20260709 13:17:53.829577 14961 raft_consensus.cc:2468] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4c5e3893eb43e8851d91ccf542ea54 in term 3.
I20260709 13:17:53.829907 15012 raft_consensus.cc:2804] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:53.834151 15012 raft_consensus.cc:697] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 3 LEADER]: Becoming Leader. State: Replica: df4c5e3893eb43e8851d91ccf542ea54, State: Running, Role: LEADER
I20260709 13:17:53.834961 15012 consensus_queue.cc:237] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } }
I20260709 13:17:53.841531 14712 catalog_manager.cc:5697] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 reported cstate change: term changed from 2 to 3, leader changed from 3475b9e1dc2d483da54678e41e63fc0f (127.4.254.1) to df4c5e3893eb43e8851d91ccf542ea54 (127.4.254.2). New cstate: current_term: 3 leader_uuid: "df4c5e3893eb43e8851d91ccf542ea54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3475b9e1dc2d483da54678e41e63fc0f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 35477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4c5e3893eb43e8851d91ccf542ea54" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 45961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c8f954041a848d8984d51d14546da45" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 36345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.859591  5112 tablet_server.cc:179] TabletServer@127.4.254.1:0 shutting down...
I20260709 13:17:53.876164  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:53.876798  5112 tablet_replica.cc:333] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f: stopping tablet replica
I20260709 13:17:53.877415  5112 raft_consensus.cc:2243] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.877832  5112 raft_consensus.cc:2272] T 5a822cdd811a4815b3c7f8fb002110a0 P 3475b9e1dc2d483da54678e41e63fc0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.880291  5112 tablet_replica.cc:333] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f: stopping tablet replica
I20260709 13:17:53.880911  5112 raft_consensus.cc:2243] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.881829  5112 raft_consensus.cc:2272] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3475b9e1dc2d483da54678e41e63fc0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.884506  5112 tablet_replica.cc:333] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f: stopping tablet replica
I20260709 13:17:53.884959  5112 raft_consensus.cc:2243] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.885704  5112 raft_consensus.cc:2272] T a8f60765f46542dabf3fe7ba0c040216 P 3475b9e1dc2d483da54678e41e63fc0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.887328  5112 tablet_replica.cc:333] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f: stopping tablet replica
I20260709 13:17:53.887715  5112 raft_consensus.cc:2243] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.888037  5112 raft_consensus.cc:2272] T 09632745fa5943dd87f142819bea8aca P 3475b9e1dc2d483da54678e41e63fc0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.900367  5112 tablet_server.cc:196] TabletServer@127.4.254.1:0 shutdown complete.
I20260709 13:17:53.911691  5112 tablet_server.cc:179] TabletServer@127.4.254.2:0 shutting down...
I20260709 13:17:53.929961  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:53.930601  5112 tablet_replica.cc:333] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54: stopping tablet replica
I20260709 13:17:53.931190  5112 raft_consensus.cc:2243] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.931679  5112 raft_consensus.cc:2272] T 84f2cc1850fe4cc385d9ed6bcf42cced P df4c5e3893eb43e8851d91ccf542ea54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.933874  5112 tablet_replica.cc:333] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54: stopping tablet replica
I20260709 13:17:53.934418  5112 raft_consensus.cc:2243] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.935034  5112 pending_rounds.cc:70] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54: Trying to abort 1 pending ops.
I20260709 13:17:53.935235  5112 pending_rounds.cc:77] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638190436642816 op_type: NO_OP noop_request { }
I20260709 13:17:53.935539  5112 raft_consensus.cc:2889] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:53.935817  5112 raft_consensus.cc:2272] T 5a822cdd811a4815b3c7f8fb002110a0 P df4c5e3893eb43e8851d91ccf542ea54 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.937984  5112 tablet_replica.cc:333] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54: stopping tablet replica
I20260709 13:17:53.938504  5112 raft_consensus.cc:2243] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.938943  5112 raft_consensus.cc:2272] T a8f60765f46542dabf3fe7ba0c040216 P df4c5e3893eb43e8851d91ccf542ea54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.940728  5112 tablet_replica.cc:333] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54: stopping tablet replica
I20260709 13:17:53.941339  5112 raft_consensus.cc:2243] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.941752  5112 raft_consensus.cc:2272] T 09632745fa5943dd87f142819bea8aca P df4c5e3893eb43e8851d91ccf542ea54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.964020  5112 tablet_server.cc:196] TabletServer@127.4.254.2:0 shutdown complete.
I20260709 13:17:53.976509  5112 tablet_server.cc:179] TabletServer@127.4.254.3:0 shutting down...
I20260709 13:17:53.995304  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:53.996037  5112 tablet_replica.cc:333] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45: stopping tablet replica
I20260709 13:17:53.996716  5112 raft_consensus.cc:2243] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.997207  5112 raft_consensus.cc:2272] T 5a822cdd811a4815b3c7f8fb002110a0 P 3c8f954041a848d8984d51d14546da45 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.999331  5112 tablet_replica.cc:333] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45: stopping tablet replica
I20260709 13:17:53.999821  5112 raft_consensus.cc:2243] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.000195  5112 raft_consensus.cc:2272] T 84f2cc1850fe4cc385d9ed6bcf42cced P 3c8f954041a848d8984d51d14546da45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.002626  5112 tablet_replica.cc:333] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45: stopping tablet replica
I20260709 13:17:54.003093  5112 raft_consensus.cc:2243] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.003791  5112 raft_consensus.cc:2272] T 09632745fa5943dd87f142819bea8aca P 3c8f954041a848d8984d51d14546da45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.005923  5112 tablet_replica.cc:333] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45: stopping tablet replica
I20260709 13:17:54.006637  5112 raft_consensus.cc:2243] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.007058  5112 raft_consensus.cc:2272] T a8f60765f46542dabf3fe7ba0c040216 P 3c8f954041a848d8984d51d14546da45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.017860  5112 tablet_server.cc:196] TabletServer@127.4.254.3:0 shutdown complete.
I20260709 13:17:54.029840  5112 master.cc:562] Master@127.4.254.62:46541 shutting down...
I20260709 13:17:54.045739  5112 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.046312  5112 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.046648  5112 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4e418ed9e00e48c7a9748d9121c8e14f: stopping tablet replica
I20260709 13:17:54.064761  5112 master.cc:584] Master@127.4.254.62:46541 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2668 ms)
[----------] 6 tests from LeaderRebalancerTest (277793 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:17:54.094146  5112 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.254.62:38921
I20260709 13:17:54.095293  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:54.100368 15059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:54.100469 15060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:54.103236 15062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:54.104094  5112 server_base.cc:1061] running on GCE node
I20260709 13:17:54.104969  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:54.105211  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:54.105378  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603074105346 us; error 0 us; skew 500 ppm
I20260709 13:17:54.105922  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:54.108186  5112 webserver.cc:533] Webserver started at http://127.4.254.62:38589/ using document root <none> and password file <none>
I20260709 13:17:54.108655  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:54.108834  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:54.109370  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:54.110440  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/master-0-root/instance:
uuid: "affeb0047f594f6e9450ad508a104d0d"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-k73n"
I20260709 13:17:54.114766  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:17:54.118052 15067 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.118819  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:54.119115  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/master-0-root
uuid: "affeb0047f594f6e9450ad508a104d0d"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-k73n"
I20260709 13:17:54.119400  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:54.131680  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:54.132691  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:54.168287  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.62:38921
I20260709 13:17:54.168383 15118 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.62:38921 every 8 connection(s)
I20260709 13:17:54.171958 15119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.182242 15119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d: Bootstrap starting.
I20260709 13:17:54.186596 15119 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.190531 15119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d: No bootstrap required, opened a new log
I20260709 13:17:54.192508 15119 raft_consensus.cc:359] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "affeb0047f594f6e9450ad508a104d0d" member_type: VOTER }
I20260709 13:17:54.192862 15119 raft_consensus.cc:385] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.193037 15119 raft_consensus.cc:740] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: affeb0047f594f6e9450ad508a104d0d, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.193636 15119 consensus_queue.cc:260] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "affeb0047f594f6e9450ad508a104d0d" member_type: VOTER }
I20260709 13:17:54.194054 15119 raft_consensus.cc:399] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:54.194244 15119 raft_consensus.cc:493] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:54.194448 15119 raft_consensus.cc:3060] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:54.199054 15119 raft_consensus.cc:515] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "affeb0047f594f6e9450ad508a104d0d" member_type: VOTER }
I20260709 13:17:54.199527 15119 leader_election.cc:304] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: affeb0047f594f6e9450ad508a104d0d; no voters: 
I20260709 13:17:54.200559 15119 leader_election.cc:290] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:54.200892 15122 raft_consensus.cc:2804] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:54.202373 15122 raft_consensus.cc:697] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [term 1 LEADER]: Becoming Leader. State: Replica: affeb0047f594f6e9450ad508a104d0d, State: Running, Role: LEADER
I20260709 13:17:54.202970 15122 consensus_queue.cc:237] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "affeb0047f594f6e9450ad508a104d0d" member_type: VOTER }
I20260709 13:17:54.203444 15119 sys_catalog.cc:565] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:54.205709 15123 sys_catalog.cc:455] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "affeb0047f594f6e9450ad508a104d0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "affeb0047f594f6e9450ad508a104d0d" member_type: VOTER } }
I20260709 13:17:54.205709 15124 sys_catalog.cc:455] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader affeb0047f594f6e9450ad508a104d0d. Latest consensus state: current_term: 1 leader_uuid: "affeb0047f594f6e9450ad508a104d0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "affeb0047f594f6e9450ad508a104d0d" member_type: VOTER } }
I20260709 13:17:54.206497 15123 sys_catalog.cc:458] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:54.206626 15124 sys_catalog.cc:458] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:54.209451 15127 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:54.217375 15127 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:54.218689  5112 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:54.228076 15127 catalog_manager.cc:1383] Generated new cluster ID: a878be5f64eb4040af976f5654a9ac14
I20260709 13:17:54.228392 15127 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:54.246438 15127 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:54.247835 15127 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:54.262543 15127 catalog_manager.cc:6070] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d: Generated new TSK 0
I20260709 13:17:54.263186 15127 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:54.285074  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:54.291038 15140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:54.292065 15141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:54.295537 15143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:54.295735  5112 server_base.cc:1061] running on GCE node
I20260709 13:17:54.298619  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:54.298861  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:54.299033  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603074299009 us; error 0 us; skew 500 ppm
I20260709 13:17:54.299559  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:54.301852  5112 webserver.cc:533] Webserver started at http://127.4.254.1:41435/ using document root <none> and password file <none>
I20260709 13:17:54.302320  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:54.302536  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:54.302807  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:54.303861  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-0-root/instance:
uuid: "1fd4c74e74374908aa2edc5c8018f10f"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-k73n"
I20260709 13:17:54.308317  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:17:54.311671 15148 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.312398  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:54.312722  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-0-root
uuid: "1fd4c74e74374908aa2edc5c8018f10f"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-k73n"
I20260709 13:17:54.313019  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:54.327448  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:54.328579  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:54.330041  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:54.332194  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:54.332403  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.332669  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:54.332845  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.370427  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.1:40867
I20260709 13:17:54.370570 15210 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.1:40867 every 8 connection(s)
I20260709 13:17:54.375824  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:54.382580 15215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:54.382969 15216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:54.385257  5112 server_base.cc:1061] running on GCE node
W20260709 13:17:54.386559 15218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:54.387590 15211 heartbeater.cc:344] Connected to a master server at 127.4.254.62:38921
I20260709 13:17:54.387652  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:54.388101  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:54.388142 15211 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:54.388273  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603074388239 us; error 0 us; skew 500 ppm
I20260709 13:17:54.389003  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:54.389034 15211 heartbeater.cc:507] Master 127.4.254.62:38921 requested a full tablet report, sending...
I20260709 13:17:54.391362 15084 ts_manager.cc:194] Registered new tserver with Master: 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867)
I20260709 13:17:54.391577  5112 webserver.cc:533] Webserver started at http://127.4.254.2:39891/ using document root <none> and password file <none>
I20260709 13:17:54.392175  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:54.392383  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:54.392669  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:54.393410 15084 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52442
I20260709 13:17:54.393821  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-1-root/instance:
uuid: "062e441744914d958b96d5997834918c"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-k73n"
I20260709 13:17:54.398173  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:17:54.401307 15223 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.402181  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:17:54.402423  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-1-root
uuid: "062e441744914d958b96d5997834918c"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-k73n"
I20260709 13:17:54.402663  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:54.427006  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:54.427997  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:54.429409  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:54.431584  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:54.431821  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.432054  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:54.432229  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.469404  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.2:40299
I20260709 13:17:54.469492 15285 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.2:40299 every 8 connection(s)
I20260709 13:17:54.474043  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:54.483441 15289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:54.485648 15286 heartbeater.cc:344] Connected to a master server at 127.4.254.62:38921
W20260709 13:17:54.486114 15290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:54.486330 15286 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:54.487599 15286 heartbeater.cc:507] Master 127.4.254.62:38921 requested a full tablet report, sending...
I20260709 13:17:54.489367  5112 server_base.cc:1061] running on GCE node
W20260709 13:17:54.489830 15292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:54.490200 15084 ts_manager.cc:194] Registered new tserver with Master: 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:54.490890  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:54.491206  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:54.491412  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603074491393 us; error 0 us; skew 500 ppm
I20260709 13:17:54.492187  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:54.492097 15084 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52444
I20260709 13:17:54.494938  5112 webserver.cc:533] Webserver started at http://127.4.254.3:37957/ using document root <none> and password file <none>
I20260709 13:17:54.495393  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:54.495548  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:54.495747  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:54.496713  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-2-root/instance:
uuid: "baeb6abc07f7498385dccf2decd1928b"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-k73n"
I20260709 13:17:54.500860  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:17:54.504043 15297 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.504880  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:54.505225  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-2-root
uuid: "baeb6abc07f7498385dccf2decd1928b"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-k73n"
I20260709 13:17:54.505573  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602796139571-5112-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:54.530850  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:54.531924  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:54.533407  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:54.535614  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:54.535791  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.536080  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:54.536248  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.574607  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.3:33353
I20260709 13:17:54.574725 15359 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.3:33353 every 8 connection(s)
I20260709 13:17:54.588382 15360 heartbeater.cc:344] Connected to a master server at 127.4.254.62:38921
I20260709 13:17:54.588857 15360 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:54.589614 15360 heartbeater.cc:507] Master 127.4.254.62:38921 requested a full tablet report, sending...
I20260709 13:17:54.591540 15084 ts_manager.cc:194] Registered new tserver with Master: baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:54.592568  5112 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014673327s
I20260709 13:17:54.593164 15084 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52452
I20260709 13:17:54.617331 15084 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52468:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:54.620177 15084 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:54.679793 15323 tablet_service.cc:1511] Processing CreateTablet for tablet f309a73c989c4680818138b4123f20b8 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:54.681319 15323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f309a73c989c4680818138b4123f20b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.679819 15325 tablet_service.cc:1511] Processing CreateTablet for tablet 022154fd79414d4191640078fb352c39 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:54.680881 15324 tablet_service.cc:1511] Processing CreateTablet for tablet f70b51915b674bfab25f870c86763d99 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:54.685316 15322 tablet_service.cc:1511] Processing CreateTablet for tablet 7c15310a14214103b34cdcc820970801 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:54.691269 15176 tablet_service.cc:1511] Processing CreateTablet for tablet 022154fd79414d4191640078fb352c39 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:54.692678 15176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022154fd79414d4191640078fb352c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.692317 15175 tablet_service.cc:1511] Processing CreateTablet for tablet f70b51915b674bfab25f870c86763d99 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:54.694154 15174 tablet_service.cc:1511] Processing CreateTablet for tablet f309a73c989c4680818138b4123f20b8 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:54.696046 15173 tablet_service.cc:1511] Processing CreateTablet for tablet 7c15310a14214103b34cdcc820970801 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:54.697929 15321 tablet_service.cc:1511] Processing CreateTablet for tablet 677f11d6789c4eebb979c2317020c2f9 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:54.699538 15175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f70b51915b674bfab25f870c86763d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.702157 15320 tablet_service.cc:1511] Processing CreateTablet for tablet 1eca34ea3cb74f17ab5c5b1507b4a85e (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:54.704684 15172 tablet_service.cc:1511] Processing CreateTablet for tablet 677f11d6789c4eebb979c2317020c2f9 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:54.706113 15172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677f11d6789c4eebb979c2317020c2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.713080 15325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022154fd79414d4191640078fb352c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.713040 15171 tablet_service.cc:1511] Processing CreateTablet for tablet 1eca34ea3cb74f17ab5c5b1507b4a85e (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:54.714298 15324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f70b51915b674bfab25f870c86763d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.714720 15171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eca34ea3cb74f17ab5c5b1507b4a85e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.714960 15320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eca34ea3cb74f17ab5c5b1507b4a85e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.715903 15170 tablet_service.cc:1511] Processing CreateTablet for tablet e2362bd32bd649f7b6041b5117ff5b5b (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:54.717018 15174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f309a73c989c4680818138b4123f20b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.717718 15321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677f11d6789c4eebb979c2317020c2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.733546 15322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c15310a14214103b34cdcc820970801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.737865 15170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2362bd32bd649f7b6041b5117ff5b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.742383 15319 tablet_service.cc:1511] Processing CreateTablet for tablet e2362bd32bd649f7b6041b5117ff5b5b (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:54.743860 15319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2362bd32bd649f7b6041b5117ff5b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.756421 15249 tablet_service.cc:1511] Processing CreateTablet for tablet f309a73c989c4680818138b4123f20b8 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:54.757983 15249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f309a73c989c4680818138b4123f20b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.759106 15375 tablet_bootstrap.cc:492] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:54.757845 15251 tablet_service.cc:1511] Processing CreateTablet for tablet 022154fd79414d4191640078fb352c39 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:54.762147 15248 tablet_service.cc:1511] Processing CreateTablet for tablet 7c15310a14214103b34cdcc820970801 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:54.759191 15250 tablet_service.cc:1511] Processing CreateTablet for tablet f70b51915b674bfab25f870c86763d99 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:54.765547 15245 tablet_service.cc:1511] Processing CreateTablet for tablet e2362bd32bd649f7b6041b5117ff5b5b (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:54.763439 15173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c15310a14214103b34cdcc820970801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.763820 15247 tablet_service.cc:1511] Processing CreateTablet for tablet 677f11d6789c4eebb979c2317020c2f9 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:54.764658 15251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022154fd79414d4191640078fb352c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.768193 15246 tablet_service.cc:1511] Processing CreateTablet for tablet 1eca34ea3cb74f17ab5c5b1507b4a85e (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:54.769482 15246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eca34ea3cb74f17ab5c5b1507b4a85e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.773471 15248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c15310a14214103b34cdcc820970801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.774080 15247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677f11d6789c4eebb979c2317020c2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.777473 15250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f70b51915b674bfab25f870c86763d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.781997 15245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2362bd32bd649f7b6041b5117ff5b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.793834 15171 tablet_service.cc:1511] Processing CreateTablet for tablet 48c202ad14c14018ac507f94aa274b24 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:54.794953 15376 tablet_bootstrap.cc:492] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:54.795305 15171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c202ad14c14018ac507f94aa274b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.795773 15244 tablet_service.cc:1511] Processing CreateTablet for tablet 48c202ad14c14018ac507f94aa274b24 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:54.797160 15244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c202ad14c14018ac507f94aa274b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.828004 15243 tablet_service.cc:1511] Processing CreateTablet for tablet ad5613f84b76474595b674381322b7ec (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:54.822357 15170 tablet_service.cc:1511] Processing CreateTablet for tablet ad5613f84b76474595b674381322b7ec (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:54.838860 15170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5613f84b76474595b674381322b7ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.806746 15376 tablet_bootstrap.cc:654] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.841789 15324 tablet_service.cc:1511] Processing CreateTablet for tablet ad5613f84b76474595b674381322b7ec (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:54.842026 15322 tablet_service.cc:1511] Processing CreateTablet for tablet 48c202ad14c14018ac507f94aa274b24 (DEFAULT_TABLE table=test-workload [id=05df9bb29e5a47da8a8a3241cd790147]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:54.843133 15324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5613f84b76474595b674381322b7ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.853775 15322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c202ad14c14018ac507f94aa274b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.854461 15243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5613f84b76474595b674381322b7ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.820860 15375 tablet_bootstrap.cc:654] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.885708 15376 tablet_bootstrap.cc:492] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:54.886270 15376 ts_tablet_manager.cc:1403] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.016s
I20260709 13:17:54.888751 15378 tablet_bootstrap.cc:492] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:54.889350 15376 raft_consensus.cc:359] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:54.890177 15376 raft_consensus.cc:385] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.890461 15376 raft_consensus.cc:740] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.893003 15376 consensus_queue.cc:260] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:54.899515 15378 tablet_bootstrap.cc:654] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.908721 15375 tablet_bootstrap.cc:492] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:54.909250 15375 ts_tablet_manager.cc:1403] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.150s	user 0.016s	sys 0.003s
I20260709 13:17:54.915169 15376 ts_tablet_manager.cc:1434] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.029s	user 0.014s	sys 0.011s
I20260709 13:17:54.915046 15375 raft_consensus.cc:359] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } }
I20260709 13:17:54.915957 15375 raft_consensus.cc:385] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.915990 15360 heartbeater.cc:499] Master 127.4.254.62:38921 was elected leader, sending a full tablet report...
I20260709 13:17:54.916471 15375 raft_consensus.cc:740] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.916309 15376 tablet_bootstrap.cc:492] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:54.917438 15375 consensus_queue.cc:260] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } }
I20260709 13:17:54.921826 15378 tablet_bootstrap.cc:492] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:54.921916 15376 tablet_bootstrap.cc:654] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.922776 15378 ts_tablet_manager.cc:1403] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.011s
I20260709 13:17:54.926517 15378 raft_consensus.cc:359] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:54.927472 15378 raft_consensus.cc:385] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.927888 15378 raft_consensus.cc:740] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.929250 15378 consensus_queue.cc:260] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:54.932185 15211 heartbeater.cc:499] Master 127.4.254.62:38921 was elected leader, sending a full tablet report...
I20260709 13:17:54.932859 15375 ts_tablet_manager.cc:1434] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.017s
I20260709 13:17:54.935492 15375 tablet_bootstrap.cc:492] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:54.940423 15380 raft_consensus.cc:493] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.941015 15380 raft_consensus.cc:515] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:54.941576 15378 ts_tablet_manager.cc:1434] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.004s
I20260709 13:17:54.942072 15375 tablet_bootstrap.cc:654] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.942401 15286 heartbeater.cc:499] Master 127.4.254.62:38921 was elected leader, sending a full tablet report...
I20260709 13:17:54.943691 15380 leader_election.cc:290] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:54.954653 15375 tablet_bootstrap.cc:492] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:54.955279 15375 ts_tablet_manager.cc:1403] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.001s
I20260709 13:17:54.959249 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677f11d6789c4eebb979c2317020c2f9" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
W20260709 13:17:54.961103 15300 leader_election.cc:343] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.961582 15375 raft_consensus.cc:359] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:54.962414 15375 raft_consensus.cc:385] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.962713 15375 raft_consensus.cc:740] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.962735 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677f11d6789c4eebb979c2317020c2f9" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
I20260709 13:17:54.962917 15378 tablet_bootstrap.cc:492] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:54.963488 15382 raft_consensus.cc:493] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.963548 15375 consensus_queue.cc:260] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:54.964129 15382 raft_consensus.cc:515] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } }
W20260709 13:17:54.966382 15300 leader_election.cc:343] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 062e441744914d958b96d5997834918c (127.4.254.2:40299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.967265 15300 leader_election.cc:304] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baeb6abc07f7498385dccf2decd1928b; no voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f
I20260709 13:17:54.968156 15380 raft_consensus.cc:2749] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:54.969822 15378 tablet_bootstrap.cc:654] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.979327 15382 leader_election.cc:290] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:54.984494 15376 tablet_bootstrap.cc:492] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:54.985150 15376 ts_tablet_manager.cc:1403] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.012s
I20260709 13:17:54.986727 15378 tablet_bootstrap.cc:492] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:54.987314 15378 ts_tablet_manager.cc:1403] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.009s
I20260709 13:17:54.988152 15376 raft_consensus.cc:359] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:54.989282 15376 raft_consensus.cc:385] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.989692 15376 raft_consensus.cc:740] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.990391 15378 raft_consensus.cc:359] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:54.991026 15378 raft_consensus.cc:385] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.991322 15378 raft_consensus.cc:740] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.990720 15376 consensus_queue.cc:260] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:54.992008 15378 consensus_queue.cc:260] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:54.997359 15376 ts_tablet_manager.cc:1434] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:17:54.998482 15376 tablet_bootstrap.cc:492] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:55.001334 15378 ts_tablet_manager.cc:1434] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.005s
I20260709 13:17:55.009620 15378 tablet_bootstrap.cc:492] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:55.013729 15376 tablet_bootstrap.cc:654] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.015343 15378 tablet_bootstrap.cc:654] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.019922 15375 ts_tablet_manager.cc:1434] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.064s	user 0.024s	sys 0.020s
I20260709 13:17:55.021153 15375 tablet_bootstrap.cc:492] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:55.027061 15375 tablet_bootstrap.cc:654] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.027369 15380 raft_consensus.cc:493] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.027936 15380 raft_consensus.cc:515] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.032132 15335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022154fd79414d4191640078fb352c39" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
W20260709 13:17:55.033774 15150 leader_election.cc:343] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.034476 15376 tablet_bootstrap.cc:492] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:55.035007 15376 ts_tablet_manager.cc:1403] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.005s
I20260709 13:17:55.035041 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f309a73c989c4680818138b4123f20b8" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:17:55.035732 15380 leader_election.cc:290] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:55.036455 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f309a73c989c4680818138b4123f20b8" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
W20260709 13:17:55.036546 15300 leader_election.cc:343] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.035888 15378 tablet_bootstrap.cc:492] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:55.037523 15378 ts_tablet_manager.cc:1403] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.003s
I20260709 13:17:55.037456 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022154fd79414d4191640078fb352c39" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
W20260709 13:17:55.037900 15300 leader_election.cc:343] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 062e441744914d958b96d5997834918c (127.4.254.2:40299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.038048 15376 raft_consensus.cc:359] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.038443 15300 leader_election.cc:304] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baeb6abc07f7498385dccf2decd1928b; no voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f
I20260709 13:17:55.038854 15376 raft_consensus.cc:385] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:17:55.039049 15151 leader_election.cc:343] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 062e441744914d958b96d5997834918c (127.4.254.2:40299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.039218 15376 raft_consensus.cc:740] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.039536 15380 raft_consensus.cc:2749] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:55.039516 15151 leader_election.cc:304] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f; no voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b
I20260709 13:17:55.040105 15376 consensus_queue.cc:260] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.040506 15378 raft_consensus.cc:359] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.040904 15387 raft_consensus.cc:2749] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:55.041095 15378 raft_consensus.cc:385] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.041531 15378 raft_consensus.cc:740] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.042308 15376 ts_tablet_manager.cc:1434] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:17:55.042259 15378 consensus_queue.cc:260] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.043231 15376 tablet_bootstrap.cc:492] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:55.044550 15378 ts_tablet_manager.cc:1434] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:55.047044 15375 tablet_bootstrap.cc:492] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:55.048342 15375 ts_tablet_manager.cc:1403] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.008s
I20260709 13:17:55.047791 15378 tablet_bootstrap.cc:492] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:55.049419 15376 tablet_bootstrap.cc:654] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.055658 15378 tablet_bootstrap.cc:654] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.058245 15375 raft_consensus.cc:359] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.059122 15375 raft_consensus.cc:385] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.059468 15375 raft_consensus.cc:740] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.060289 15376 tablet_bootstrap.cc:492] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:55.060848 15376 ts_tablet_manager.cc:1403] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:17:55.060468 15375 consensus_queue.cc:260] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.062331 15378 tablet_bootstrap.cc:492] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:55.062816 15375 ts_tablet_manager.cc:1434] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:17:55.062834 15378 ts_tablet_manager.cc:1403] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 13:17:55.063959 15375 tablet_bootstrap.cc:492] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:55.063865 15376 raft_consensus.cc:359] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.064723 15376 raft_consensus.cc:385] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.065008 15376 raft_consensus.cc:740] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.065981 15376 consensus_queue.cc:260] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.066017 15378 raft_consensus.cc:359] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.066967 15378 raft_consensus.cc:385] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.067274 15378 raft_consensus.cc:740] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.068183 15378 consensus_queue.cc:260] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.071164 15375 tablet_bootstrap.cc:654] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.071573 15376 ts_tablet_manager.cc:1434] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:55.072674 15376 tablet_bootstrap.cc:492] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:55.075995 15378 ts_tablet_manager.cc:1434] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260709 13:17:55.077458 15378 tablet_bootstrap.cc:492] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:55.079222 15376 tablet_bootstrap.cc:654] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.084326 15376 tablet_bootstrap.cc:492] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:55.084755 15376 ts_tablet_manager.cc:1403] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:17:55.089412 15376 raft_consensus.cc:359] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.090142 15376 raft_consensus.cc:385] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.090426 15376 raft_consensus.cc:740] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.091310 15376 consensus_queue.cc:260] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.095381 15376 ts_tablet_manager.cc:1434] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:17:55.096347 15376 tablet_bootstrap.cc:492] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:55.097963 15378 tablet_bootstrap.cc:654] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.099283 15375 tablet_bootstrap.cc:492] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:55.099836 15375 ts_tablet_manager.cc:1403] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.011s
I20260709 13:17:55.103031 15376 tablet_bootstrap.cc:654] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.103690 15375 raft_consensus.cc:359] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.104815 15375 raft_consensus.cc:385] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.105413 15375 raft_consensus.cc:740] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.106482 15375 consensus_queue.cc:260] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.108937 15375 ts_tablet_manager.cc:1434] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:17:55.110144 15378 tablet_bootstrap.cc:492] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:55.110671 15375 tablet_bootstrap.cc:492] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:55.110671 15378 ts_tablet_manager.cc:1403] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.005s
I20260709 13:17:55.113973 15378 raft_consensus.cc:359] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.114818 15384 raft_consensus.cc:493] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.115599 15376 tablet_bootstrap.cc:492] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:55.115396 15384 raft_consensus.cc:515] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.116122 15376 ts_tablet_manager.cc:1403] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:17:55.118131 15375 tablet_bootstrap.cc:654] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.119323 15376 raft_consensus.cc:359] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.120078 15376 raft_consensus.cc:385] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.120391 15376 raft_consensus.cc:740] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.121162 15376 consensus_queue.cc:260] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.123621 15384 leader_election.cc:290] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:55.127254 15376 ts_tablet_manager.cc:1434] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.008s
I20260709 13:17:55.128346 15376 tablet_bootstrap.cc:492] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:55.129253 15378 raft_consensus.cc:385] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.129594 15378 raft_consensus.cc:740] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.131446 15378 consensus_queue.cc:260] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.134554 15376 tablet_bootstrap.cc:654] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.137851 15378 ts_tablet_manager.cc:1434] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:17:55.139325 15375 tablet_bootstrap.cc:492] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:55.139921 15375 ts_tablet_manager.cc:1403] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.005s
I20260709 13:17:55.142061 15378 tablet_bootstrap.cc:492] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:55.142897 15375 raft_consensus.cc:359] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.143644 15375 raft_consensus.cc:385] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.143923 15375 raft_consensus.cc:740] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.146528 15335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f309a73c989c4680818138b4123f20b8" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:17:55.146423 15375 consensus_queue.cc:260] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.147464 15335 raft_consensus.cc:2468] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 0.
I20260709 13:17:55.149431 15225 leader_election.cc:304] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:55.150591 15380 raft_consensus.cc:493] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.151036 15375 ts_tablet_manager.cc:1434] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:17:55.151258 15380 raft_consensus.cc:515] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.152136 15375 tablet_bootstrap.cc:492] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:55.150563 15384 raft_consensus.cc:2804] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.153520 15384 raft_consensus.cc:493] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.153853 15384 raft_consensus.cc:3060] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.154017 15380 leader_election.cc:290] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:55.155092 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eca34ea3cb74f17ab5c5b1507b4a85e" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:17:55.155761 15186 raft_consensus.cc:2468] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 0.
I20260709 13:17:55.156934 15300 leader_election.cc:304] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:55.157255 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eca34ea3cb74f17ab5c5b1507b4a85e" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
I20260709 13:17:55.157963 15380 raft_consensus.cc:2804] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.157893 15261 raft_consensus.cc:2468] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 0.
I20260709 13:17:55.158845 15375 tablet_bootstrap.cc:654] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.159006 15380 raft_consensus.cc:493] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.159559 15380 raft_consensus.cc:3060] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.163568 15376 tablet_bootstrap.cc:492] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:55.164122 15376 ts_tablet_manager.cc:1403] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.022s
I20260709 13:17:55.167173 15376 raft_consensus.cc:359] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } }
I20260709 13:17:55.167870 15376 raft_consensus.cc:385] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.168283 15376 raft_consensus.cc:740] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.167902 15380 raft_consensus.cc:515] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.169236 15376 consensus_queue.cc:260] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } }
I20260709 13:17:55.171346 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eca34ea3cb74f17ab5c5b1507b4a85e" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:55.172175 15186 raft_consensus.cc:3060] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.180006 15376 ts_tablet_manager.cc:1434] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:17:55.183403 15186 raft_consensus.cc:2468] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 1.
I20260709 13:17:55.185483 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eca34ea3cb74f17ab5c5b1507b4a85e" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:17:55.186628 15261 raft_consensus.cc:3060] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.186012 15380 leader_election.cc:290] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:55.184275 15384 raft_consensus.cc:515] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.193025 15378 tablet_bootstrap.cc:654] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.193842 15261 raft_consensus.cc:2468] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 1.
I20260709 13:17:55.195729 15300 leader_election.cc:304] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:55.203155 15406 raft_consensus.cc:2804] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.194322 15376 tablet_bootstrap.cc:492] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:55.203580 15380 raft_consensus.cc:493] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.203950 15375 tablet_bootstrap.cc:492] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:55.204778 15375 ts_tablet_manager.cc:1403] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.053s	user 0.031s	sys 0.020s
I20260709 13:17:55.205495 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f309a73c989c4680818138b4123f20b8" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
W20260709 13:17:55.206851 15226 leader_election.cc:343] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.204563 15380 raft_consensus.cc:515] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.207851 15375 raft_consensus.cc:359] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.204558 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f309a73c989c4680818138b4123f20b8" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:55.208547 15375 raft_consensus.cc:385] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.210239 15375 raft_consensus.cc:740] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.210769 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70b51915b674bfab25f870c86763d99" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:17:55.198313 15405 raft_consensus.cc:493] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:55.212055 15226 leader_election.cc:343] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:55.213071 15132 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:55.211093 15375 consensus_queue.cc:260] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.214335 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70b51915b674bfab25f870c86763d99" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
I20260709 13:17:55.214994 15261 raft_consensus.cc:2468] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 0.
I20260709 13:17:55.216181 15185 raft_consensus.cc:2468] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 0.
I20260709 13:17:55.216910 15335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f309a73c989c4680818138b4123f20b8" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:55.217423 15300 leader_election.cc:304] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:55.217619 15335 raft_consensus.cc:3060] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.218766 15375 ts_tablet_manager.cc:1434] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:17:55.220202 15375 tablet_bootstrap.cc:492] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:55.212505 15405 raft_consensus.cc:515] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.221767 15380 leader_election.cc:290] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:55.223642 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15310a14214103b34cdcc820970801" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:17:55.224223 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15310a14214103b34cdcc820970801" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:17:55.225176 15334 raft_consensus.cc:2468] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 0.
I20260709 13:17:55.225786 15335 raft_consensus.cc:2468] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 1.
I20260709 13:17:55.225972 15380 raft_consensus.cc:2804] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.226430 15380 raft_consensus.cc:493] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.226502 15225 leader_election.cc:304] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:55.226816 15384 leader_election.cc:290] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:55.227458 15384 raft_consensus.cc:2804] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.227805 15384 raft_consensus.cc:493] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.228199 15384 raft_consensus.cc:3060] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.224351 15186 raft_consensus.cc:2468] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 0.
I20260709 13:17:55.226845 15380 raft_consensus.cc:3060] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.232884 15225 leader_election.cc:304] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 1fd4c74e74374908aa2edc5c8018f10f
I20260709 13:17:55.233876 15378 tablet_bootstrap.cc:492] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:55.234427 15378 ts_tablet_manager.cc:1403] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.003s
I20260709 13:17:55.237507 15378 raft_consensus.cc:359] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.238231 15378 raft_consensus.cc:385] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.238535 15378 raft_consensus.cc:740] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.239308 15378 consensus_queue.cc:260] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.231487 15405 leader_election.cc:290] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:55.243021 15406 raft_consensus.cc:697] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Becoming Leader. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:17:55.242046 15384 raft_consensus.cc:515] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.244354 15405 raft_consensus.cc:2804] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.244200 15406 consensus_queue.cc:237] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.245646 15405 raft_consensus.cc:697] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Becoming Leader. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:17:55.246531 15405 consensus_queue.cc:237] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.249410 15384 leader_election.cc:290] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:55.249432 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15310a14214103b34cdcc820970801" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:55.250998 15335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15310a14214103b34cdcc820970801" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:55.251493 15186 raft_consensus.cc:3060] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.251605 15335 raft_consensus.cc:3060] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.252023 15380 raft_consensus.cc:515] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.250330 15376 tablet_bootstrap.cc:654] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.250877 15387 raft_consensus.cc:493] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.254166 15380 leader_election.cc:290] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:55.254278 15387 raft_consensus.cc:515] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.255259 15375 tablet_bootstrap.cc:654] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.256654 15387 leader_election.cc:290] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:55.257472 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2362bd32bd649f7b6041b5117ff5b5b" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
I20260709 13:17:55.259130 15335 raft_consensus.cc:2468] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 1.
W20260709 13:17:55.259303 15151 leader_election.cc:343] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 062e441744914d958b96d5997834918c (127.4.254.2:40299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.260387 15225 leader_election.cc:304] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:55.261240 15384 raft_consensus.cc:2804] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.262140 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70b51915b674bfab25f870c86763d99" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:55.262166 15384 raft_consensus.cc:697] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Becoming Leader. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:17:55.262826 15185 raft_consensus.cc:3060] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.263677 15384 consensus_queue.cc:237] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.265027 15186 raft_consensus.cc:2468] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 1.
I20260709 13:17:55.270495 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70b51915b674bfab25f870c86763d99" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:17:55.271169 15261 raft_consensus.cc:3060] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.277923 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2362bd32bd649f7b6041b5117ff5b5b" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:17:55.278659 15334 raft_consensus.cc:2468] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 0.
I20260709 13:17:55.279754 15150 leader_election.cc:304] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 062e441744914d958b96d5997834918c
I20260709 13:17:55.279287 15084 catalog_manager.cc:5697] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b reported cstate change: term changed from 0 to 1, leader changed from <none> to baeb6abc07f7498385dccf2decd1928b (127.4.254.3). New cstate: current_term: 1 leader_uuid: "baeb6abc07f7498385dccf2decd1928b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.280972 15387 raft_consensus.cc:2804] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.281368 15387 raft_consensus.cc:493] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.281704 15387 raft_consensus.cc:3060] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.284456 15410 raft_consensus.cc:493] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.285171 15410 raft_consensus.cc:515] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.290611 15410 leader_election.cc:290] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:55.291715 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677f11d6789c4eebb979c2317020c2f9" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:17:55.292738 15186 raft_consensus.cc:2468] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 0.
I20260709 13:17:55.293610 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677f11d6789c4eebb979c2317020c2f9" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:17:55.294445 15334 raft_consensus.cc:2468] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 0.
I20260709 13:17:55.295221 15226 leader_election.cc:304] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:17:55.297115 15410 raft_consensus.cc:2804] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.297258 15261 raft_consensus.cc:2468] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 1.
I20260709 13:17:55.297735 15410 raft_consensus.cc:493] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.298359 15410 raft_consensus.cc:3060] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.301436 15300 leader_election.cc:304] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:55.302328 15406 raft_consensus.cc:2804] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.302843 15406 raft_consensus.cc:697] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Becoming Leader. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:17:55.303912 15406 consensus_queue.cc:237] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.312937 15378 ts_tablet_manager.cc:1434] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.001s
I20260709 13:17:55.314510 15378 tablet_bootstrap.cc:492] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:55.312572 15410 raft_consensus.cc:515] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.323609 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677f11d6789c4eebb979c2317020c2f9" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:55.324354 15186 raft_consensus.cc:3060] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.327564 15378 tablet_bootstrap.cc:654] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.315407 15185 raft_consensus.cc:2468] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 1.
I20260709 13:17:55.316299 15387 raft_consensus.cc:515] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.332160 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2362bd32bd649f7b6041b5117ff5b5b" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:17:55.332405 15387 leader_election.cc:290] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 election: Requested vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
W20260709 13:17:55.333737 15151 leader_election.cc:343] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 062e441744914d958b96d5997834918c (127.4.254.2:40299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.333921 15084 catalog_manager.cc:5697] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b reported cstate change: term changed from 0 to 1, leader changed from <none> to baeb6abc07f7498385dccf2decd1928b (127.4.254.3). New cstate: current_term: 1 leader_uuid: "baeb6abc07f7498385dccf2decd1928b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.336306 15375 tablet_bootstrap.cc:492] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:55.337085 15375 ts_tablet_manager.cc:1403] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.117s	user 0.035s	sys 0.026s
I20260709 13:17:55.338474 15186 raft_consensus.cc:2468] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 1.
I20260709 13:17:55.340018 15226 leader_election.cc:304] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:17:55.340178 15375 raft_consensus.cc:359] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.339808 15082 catalog_manager.cc:5697] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c reported cstate change: term changed from 0 to 1, leader changed from <none> to 062e441744914d958b96d5997834918c (127.4.254.2). New cstate: current_term: 1 leader_uuid: "062e441744914d958b96d5997834918c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.334926 15335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2362bd32bd649f7b6041b5117ff5b5b" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:55.340950 15375 raft_consensus.cc:385] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.341176 15384 raft_consensus.cc:2804] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.341362 15375 raft_consensus.cc:740] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.341375 15335 raft_consensus.cc:3060] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.341886 15384 raft_consensus.cc:697] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Becoming Leader. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:17:55.342321 15375 consensus_queue.cc:260] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.344673 15375 ts_tablet_manager.cc:1434] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:55.336277 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677f11d6789c4eebb979c2317020c2f9" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:55.345458 15334 raft_consensus.cc:3060] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.345623 15375 tablet_bootstrap.cc:492] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:55.319960 15376 tablet_bootstrap.cc:492] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:55.347239 15376 ts_tablet_manager.cc:1403] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.153s	user 0.013s	sys 0.014s
I20260709 13:17:55.342736 15384 consensus_queue.cc:237] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.349938 15376 raft_consensus.cc:359] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.350653 15376 raft_consensus.cc:385] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.335723 15410 leader_election.cc:290] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:55.350960 15376 raft_consensus.cc:740] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.358026 15376 consensus_queue.cc:260] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.360126 15376 ts_tablet_manager.cc:1434] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:17:55.360190 15334 raft_consensus.cc:2468] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 1.
I20260709 13:17:55.361152 15376 tablet_bootstrap.cc:492] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:55.352658 15375 tablet_bootstrap.cc:654] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.369688 15376 tablet_bootstrap.cc:654] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.371115 15375 tablet_bootstrap.cc:492] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:55.371627 15375 ts_tablet_manager.cc:1403] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.026s	user 0.003s	sys 0.006s
I20260709 13:17:55.355082 15335 raft_consensus.cc:2468] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 1.
I20260709 13:17:55.374297 15375 raft_consensus.cc:359] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.375128 15375 raft_consensus.cc:385] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.374110 15081 catalog_manager.cc:5697] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c reported cstate change: term changed from 0 to 1, leader changed from <none> to 062e441744914d958b96d5997834918c (127.4.254.2). New cstate: current_term: 1 leader_uuid: "062e441744914d958b96d5997834918c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.375432 15375 raft_consensus.cc:740] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.375433 15150 leader_election.cc:304] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 062e441744914d958b96d5997834918c
I20260709 13:17:55.376508 15375 consensus_queue.cc:260] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.376860 15387 raft_consensus.cc:2804] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.376240 15081 catalog_manager.cc:5697] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c reported cstate change: term changed from 0 to 1, leader changed from <none> to 062e441744914d958b96d5997834918c (127.4.254.2). New cstate: current_term: 1 leader_uuid: "062e441744914d958b96d5997834918c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.378258 15375 ts_tablet_manager.cc:1434] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:55.379259 15375 tablet_bootstrap.cc:492] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:55.376865 15376 tablet_bootstrap.cc:492] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:55.375522 15378 tablet_bootstrap.cc:492] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:55.380997 15376 ts_tablet_manager.cc:1403] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.002s
I20260709 13:17:55.381072 15378 ts_tablet_manager.cc:1403] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.002s
I20260709 13:17:55.383795 15376 raft_consensus.cc:359] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.384289 15375 tablet_bootstrap.cc:654] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.384027 15378 raft_consensus.cc:359] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.384554 15376 raft_consensus.cc:385] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.385380 15378 raft_consensus.cc:385] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.385644 15376 raft_consensus.cc:740] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.385747 15378 raft_consensus.cc:740] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.386387 15387 raft_consensus.cc:697] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Becoming Leader. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:17:55.386634 15376 consensus_queue.cc:260] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.386624 15378 consensus_queue.cc:260] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.387614 15387 consensus_queue.cc:237] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.393275 15376 ts_tablet_manager.cc:1434] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:17:55.395942 15378 ts_tablet_manager.cc:1434] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 13:17:55.397244 15378 tablet_bootstrap.cc:492] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:55.402372 15375 tablet_bootstrap.cc:492] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:55.402972 15375 ts_tablet_manager.cc:1403] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.006s
I20260709 13:17:55.403525 15378 tablet_bootstrap.cc:654] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.405776 15375 raft_consensus.cc:359] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.406631 15375 raft_consensus.cc:385] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.407126 15375 raft_consensus.cc:740] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.408077 15375 consensus_queue.cc:260] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.408825 15082 catalog_manager.cc:5697] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1). New cstate: current_term: 1 leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.411211 15375 ts_tablet_manager.cc:1434] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:17:55.413552 15378 tablet_bootstrap.cc:492] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:55.413998 15378 ts_tablet_manager.cc:1403] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 13:17:55.416304 15378 raft_consensus.cc:359] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } }
I20260709 13:17:55.416975 15378 raft_consensus.cc:385] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.417279 15378 raft_consensus.cc:740] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.417927 15378 consensus_queue.cc:260] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } }
I20260709 13:17:55.419838 15378 ts_tablet_manager.cc:1434] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:55.420764 15378 tablet_bootstrap.cc:492] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:55.426267 15378 tablet_bootstrap.cc:654] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.430897 15378 tablet_bootstrap.cc:492] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:55.431383 15378 ts_tablet_manager.cc:1403] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:17:55.433281 15378 raft_consensus.cc:359] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.433766 15378 raft_consensus.cc:385] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.433985 15378 raft_consensus.cc:740] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.434588 15378 consensus_queue.cc:260] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.436102 15378 ts_tablet_manager.cc:1434] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:17:55.480908 15384 raft_consensus.cc:493] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.481551 15384 raft_consensus.cc:515] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.483345 15384 leader_election.cc:290] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:55.484047 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c202ad14c14018ac507f94aa274b24" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:17:55.484354 15335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c202ad14c14018ac507f94aa274b24" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:17:55.484632 15186 raft_consensus.cc:2468] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 0.
I20260709 13:17:55.484982 15335 raft_consensus.cc:2468] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 0.
I20260709 13:17:55.485774 15226 leader_election.cc:304] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:17:55.486635 15384 raft_consensus.cc:2804] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.486969 15384 raft_consensus.cc:493] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.487249 15384 raft_consensus.cc:3060] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.492213 15384 raft_consensus.cc:515] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.493880 15410 raft_consensus.cc:493] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.494433 15384 leader_election.cc:290] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:55.494426 15410 raft_consensus.cc:515] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } }
I20260709 13:17:55.494771 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c202ad14c14018ac507f94aa274b24" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:55.495039 15335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c202ad14c14018ac507f94aa274b24" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:55.495330 15186 raft_consensus.cc:3060] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.495610 15335 raft_consensus.cc:3060] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.496598 15410 leader_election.cc:290] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353), 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867)
I20260709 13:17:55.497390 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022154fd79414d4191640078fb352c39" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:17:55.498041 15334 raft_consensus.cc:2468] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 0.
I20260709 13:17:55.498236 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022154fd79414d4191640078fb352c39" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:17:55.498883 15185 raft_consensus.cc:2468] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 0.
I20260709 13:17:55.499325 15225 leader_election.cc:304] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:55.500226 15410 raft_consensus.cc:2804] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.500572 15410 raft_consensus.cc:493] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.500891 15410 raft_consensus.cc:3060] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.502657 15335 raft_consensus.cc:2468] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 1.
I20260709 13:17:55.502725 15186 raft_consensus.cc:2468] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 1.
I20260709 13:17:55.503786 15225 leader_election.cc:304] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:55.504702 15384 raft_consensus.cc:2804] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.505187 15384 raft_consensus.cc:697] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Becoming Leader. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:17:55.505924 15384 consensus_queue.cc:237] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.507545 15410 raft_consensus.cc:515] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } }
I20260709 13:17:55.509938 15410 leader_election.cc:290] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Requested vote from peers baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353), 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867)
I20260709 13:17:55.510236 15335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022154fd79414d4191640078fb352c39" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:55.510888 15335 raft_consensus.cc:3060] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.511879 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022154fd79414d4191640078fb352c39" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:55.512490 15186 raft_consensus.cc:3060] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.514359 15082 catalog_manager.cc:5697] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c reported cstate change: term changed from 0 to 1, leader changed from <none> to 062e441744914d958b96d5997834918c (127.4.254.2). New cstate: current_term: 1 leader_uuid: "062e441744914d958b96d5997834918c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.516266 15335 raft_consensus.cc:2468] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 1.
I20260709 13:17:55.517285 15225 leader_election.cc:304] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:55.518050 15410 raft_consensus.cc:2804] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.518513 15410 raft_consensus.cc:697] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Becoming Leader. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:17:55.519328 15410 consensus_queue.cc:237] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } }
I20260709 13:17:55.519349 15186 raft_consensus.cc:2468] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 1.
I20260709 13:17:55.532966 15082 catalog_manager.cc:5697] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c reported cstate change: term changed from 0 to 1, leader changed from <none> to 062e441744914d958b96d5997834918c (127.4.254.2). New cstate: current_term: 1 leader_uuid: "062e441744914d958b96d5997834918c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.562369 15410 raft_consensus.cc:493] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.562896 15410 raft_consensus.cc:515] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.564563 15410 leader_election.cc:290] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:55.565300 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2362bd32bd649f7b6041b5117ff5b5b" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:17:55.565577 15335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2362bd32bd649f7b6041b5117ff5b5b" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:17:55.566390 15335 raft_consensus.cc:2393] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 062e441744914d958b96d5997834918c in current term 1: Already voted for candidate 1fd4c74e74374908aa2edc5c8018f10f in this term.
I20260709 13:17:55.567322 15225 leader_election.cc:304] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 062e441744914d958b96d5997834918c; no voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b
I20260709 13:17:55.567960 15410 raft_consensus.cc:3060] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.572928 15410 raft_consensus.cc:2749] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:55.680226 15410 raft_consensus.cc:493] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.682160 15410 raft_consensus.cc:515] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.685055 15185 raft_consensus.cc:3060] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.685810 15410 leader_election.cc:290] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:55.687126 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5613f84b76474595b674381322b7ec" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:17:55.687398 15406 consensus_queue.cc:1048] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:55.688488 15184 raft_consensus.cc:2468] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 0.
I20260709 13:17:55.688953 15335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5613f84b76474595b674381322b7ec" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:17:55.690604 15226 leader_election.cc:304] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:17:55.692330 15335 raft_consensus.cc:2468] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 0.
I20260709 13:17:55.693682 15410 raft_consensus.cc:2804] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.694154 15410 raft_consensus.cc:493] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.694478 15410 raft_consensus.cc:3060] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.702690 15384 consensus_queue.cc:1048] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:55.719722 15410 raft_consensus.cc:515] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.722035 15408 consensus_queue.cc:1048] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:55.723066 15410 leader_election.cc:290] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:55.724414 15335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5613f84b76474595b674381322b7ec" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:55.725149 15335 raft_consensus.cc:3060] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.734735 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5613f84b76474595b674381322b7ec" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:55.735677 15185 raft_consensus.cc:3060] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.745762 15410 consensus_queue.cc:1048] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.754791 15410 consensus_queue.cc:1048] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.755584 15185 raft_consensus.cc:2468] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 1.
I20260709 13:17:55.758574 15226 leader_election.cc:304] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:17:55.759846 15411 raft_consensus.cc:2804] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.770550 15406 consensus_queue.cc:1048] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:55.747355 15335 raft_consensus.cc:2468] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 1.
I20260709 13:17:55.793747 15411 raft_consensus.cc:697] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 1 LEADER]: Becoming Leader. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:17:55.797843 15411 consensus_queue.cc:237] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:55.820632 15406 consensus_queue.cc:1048] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:55.829922 15410 consensus_queue.cc:1048] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.831059 15082 catalog_manager.cc:5697] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c reported cstate change: term changed from 0 to 1, leader changed from <none> to 062e441744914d958b96d5997834918c (127.4.254.2). New cstate: current_term: 1 leader_uuid: "062e441744914d958b96d5997834918c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.887931 15411 consensus_queue.cc:1048] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:55.896956 15442 consensus_queue.cc:1048] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:55.913079 15442 consensus_queue.cc:1048] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.927666 15410 consensus_queue.cc:1048] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.945083 15387 consensus_queue.cc:1048] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.956722 15410 consensus_queue.cc:1048] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.968520 15456 consensus_queue.cc:1048] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:55.981431 15384 consensus_queue.cc:1048] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.113106 15261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "022154fd79414d4191640078fb352c39"
dest_uuid: "062e441744914d958b96d5997834918c"
mode: GRACEFUL
new_leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
 from {username='slave'} at 127.0.0.1:48102
I20260709 13:17:56.113768 15261 raft_consensus.cc:606] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Received request to transfer leadership to TS 1fd4c74e74374908aa2edc5c8018f10f
I20260709 13:17:56.127691 15334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f70b51915b674bfab25f870c86763d99"
dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
mode: GRACEFUL
new_leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
 from {username='slave'} at 127.0.0.1:46468
I20260709 13:17:56.128243 15334 raft_consensus.cc:606] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Received request to transfer leadership to TS 1fd4c74e74374908aa2edc5c8018f10f
I20260709 13:17:56.133671 15261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f309a73c989c4680818138b4123f20b8"
dest_uuid: "062e441744914d958b96d5997834918c"
mode: GRACEFUL
new_leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
 from {username='slave'} at 127.0.0.1:48102
I20260709 13:17:56.134235 15261 raft_consensus.cc:606] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Received request to transfer leadership to TS 1fd4c74e74374908aa2edc5c8018f10f
I20260709 13:17:56.138827 15261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c15310a14214103b34cdcc820970801"
dest_uuid: "062e441744914d958b96d5997834918c"
mode: GRACEFUL
new_leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
 from {username='slave'} at 127.0.0.1:48102
I20260709 13:17:56.139314 15261 raft_consensus.cc:606] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Received request to transfer leadership to TS 1fd4c74e74374908aa2edc5c8018f10f
I20260709 13:17:56.147217 15334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eca34ea3cb74f17ab5c5b1507b4a85e"
dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
mode: GRACEFUL
new_leader_uuid: "062e441744914d958b96d5997834918c"
 from {username='slave'} at 127.0.0.1:46468
I20260709 13:17:56.147795 15334 raft_consensus.cc:606] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Received request to transfer leadership to TS 062e441744914d958b96d5997834918c
I20260709 13:17:56.156453 15410 raft_consensus.cc:993] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c: : Instructing follower 1fd4c74e74374908aa2edc5c8018f10f to start an election
I20260709 13:17:56.157027 15442 raft_consensus.cc:1081] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Signalling peer 1fd4c74e74374908aa2edc5c8018f10f to start an election
I20260709 13:17:56.158685 15184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f309a73c989c4680818138b4123f20b8"
dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
 from {username='slave'} at 127.0.0.1:50744
I20260709 13:17:56.159232 15184 raft_consensus.cc:493] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.159592 15184 raft_consensus.cc:3060] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.162786 15185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2362bd32bd649f7b6041b5117ff5b5b"
dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
mode: GRACEFUL
new_leader_uuid: "062e441744914d958b96d5997834918c"
 from {username='slave'} at 127.0.0.1:52816
I20260709 13:17:56.163537 15185 raft_consensus.cc:606] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Received request to transfer leadership to TS 062e441744914d958b96d5997834918c
I20260709 13:17:56.168182 15184 raft_consensus.cc:515] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.170833 15184 leader_election.cc:290] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 2 election: Requested vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:56.171213 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f309a73c989c4680818138b4123f20b8" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:17:56.171484 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f309a73c989c4680818138b4123f20b8" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:56.171912 15261 raft_consensus.cc:3055] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.172180 15334 raft_consensus.cc:3060] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.172286 15261 raft_consensus.cc:740] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:17:56.172289 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad5613f84b76474595b674381322b7ec"
dest_uuid: "062e441744914d958b96d5997834918c"
mode: GRACEFUL
new_leader_uuid: "baeb6abc07f7498385dccf2decd1928b"
 from {username='slave'} at 127.0.0.1:48102
I20260709 13:17:56.173214 15260 raft_consensus.cc:606] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 1 LEADER]: Received request to transfer leadership to TS baeb6abc07f7498385dccf2decd1928b
I20260709 13:17:56.173549 15261 consensus_queue.cc:260] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.174821 15261 raft_consensus.cc:3060] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.179397 15334 raft_consensus.cc:2468] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 2.
I20260709 13:17:56.180812 15150 leader_election.cc:304] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:56.181715 15457 raft_consensus.cc:2804] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:56.181814 15261 raft_consensus.cc:2468] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 2.
I20260709 13:17:56.182168 15457 raft_consensus.cc:697] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Becoming Leader. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:17:56.183235 15457 consensus_queue.cc:237] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.189509 15084 catalog_manager.cc:5697] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f reported cstate change: term changed from 1 to 2, leader changed from 062e441744914d958b96d5997834918c (127.4.254.2) to 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1). New cstate: current_term: 2 leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.216176 15411 raft_consensus.cc:993] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c: : Instructing follower 1fd4c74e74374908aa2edc5c8018f10f to start an election
I20260709 13:17:56.216701 15442 raft_consensus.cc:1081] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Signalling peer 1fd4c74e74374908aa2edc5c8018f10f to start an election
I20260709 13:17:56.218405 15184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c15310a14214103b34cdcc820970801"
dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
 from {username='slave'} at 127.0.0.1:50744
I20260709 13:17:56.218909 15184 raft_consensus.cc:493] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.219218 15184 raft_consensus.cc:3060] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.224287 15184 raft_consensus.cc:515] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.226033 15184 leader_election.cc:290] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 2 election: Requested vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:56.227193 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15310a14214103b34cdcc820970801" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:56.227253 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c15310a14214103b34cdcc820970801" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:17:56.227995 15334 raft_consensus.cc:3060] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.228116 15261 raft_consensus.cc:3055] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.228528 15261 raft_consensus.cc:740] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:17:56.229377 15261 consensus_queue.cc:260] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.230329 15261 raft_consensus.cc:3060] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.233321 15334 raft_consensus.cc:2468] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 2.
I20260709 13:17:56.234320 15150 leader_election.cc:304] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:56.234994 15457 raft_consensus.cc:2804] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:56.235459 15457 raft_consensus.cc:697] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Becoming Leader. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:17:56.235736 15261 raft_consensus.cc:2468] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 2.
I20260709 13:17:56.236472 15457 consensus_queue.cc:237] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.243269 15084 catalog_manager.cc:5697] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f reported cstate change: term changed from 1 to 2, leader changed from 062e441744914d958b96d5997834918c (127.4.254.2) to 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1). New cstate: current_term: 2 leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.243786 15442 consensus_queue.cc:1048] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.255249 15442 consensus_queue.cc:1048] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.263602 15384 raft_consensus.cc:993] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c: : Instructing follower baeb6abc07f7498385dccf2decd1928b to start an election
I20260709 13:17:56.264128 15442 raft_consensus.cc:1081] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 1 LEADER]: Signalling peer baeb6abc07f7498385dccf2decd1928b to start an election
I20260709 13:17:56.266083 15334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad5613f84b76474595b674381322b7ec"
dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
 from {username='slave'} at 127.0.0.1:53414
I20260709 13:17:56.266624 15334 raft_consensus.cc:493] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.267010 15334 raft_consensus.cc:3060] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.272703 15334 raft_consensus.cc:515] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.274571 15334 leader_election.cc:290] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 2 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:56.275305 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5613f84b76474595b674381322b7ec" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:56.275701 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5613f84b76474595b674381322b7ec" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:17:56.276010 15184 raft_consensus.cc:3060] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.276414 15261 raft_consensus.cc:3055] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.276728 15261 raft_consensus.cc:740] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:17:56.277503 15261 consensus_queue.cc:260] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.278352 15261 raft_consensus.cc:3060] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.283404 15184 raft_consensus.cc:2468] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 2.
I20260709 13:17:56.285048 15300 leader_election.cc:304] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:56.285969 15406 raft_consensus.cc:2804] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:56.286446 15406 raft_consensus.cc:697] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [term 2 LEADER]: Becoming Leader. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:17:56.287284 15261 raft_consensus.cc:2468] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 2.
I20260709 13:17:56.287431 15408 raft_consensus.cc:993] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b: : Instructing follower 1fd4c74e74374908aa2edc5c8018f10f to start an election
I20260709 13:17:56.287422 15406 consensus_queue.cc:237] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.288308 15380 raft_consensus.cc:1081] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Signalling peer 1fd4c74e74374908aa2edc5c8018f10f to start an election
I20260709 13:17:56.290122 15184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f70b51915b674bfab25f870c86763d99"
dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
 from {username='slave'} at 127.0.0.1:50736
I20260709 13:17:56.290634 15184 raft_consensus.cc:493] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.290999 15184 raft_consensus.cc:3060] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.295266 15082 catalog_manager.cc:5697] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b reported cstate change: term changed from 1 to 2, leader changed from 062e441744914d958b96d5997834918c (127.4.254.2) to baeb6abc07f7498385dccf2decd1928b (127.4.254.3). New cstate: current_term: 2 leader_uuid: "baeb6abc07f7498385dccf2decd1928b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:56.297312 15408 raft_consensus.cc:993] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b: : Instructing follower 062e441744914d958b96d5997834918c to start an election
I20260709 13:17:56.297818 15408 raft_consensus.cc:1081] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Signalling peer 062e441744914d958b96d5997834918c to start an election
I20260709 13:17:56.298290 15184 raft_consensus.cc:515] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.299573 15261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1eca34ea3cb74f17ab5c5b1507b4a85e"
dest_uuid: "062e441744914d958b96d5997834918c"
 from {username='slave'} at 127.0.0.1:43718
I20260709 13:17:56.300225 15261 raft_consensus.cc:493] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.300366 15184 leader_election.cc:290] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 2 election: Requested vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:56.300694 15261 raft_consensus.cc:3060] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.300999 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70b51915b674bfab25f870c86763d99" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:17:56.301844 15260 raft_consensus.cc:3060] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.303198 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70b51915b674bfab25f870c86763d99" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:56.303980 15334 raft_consensus.cc:3055] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.304525 15334 raft_consensus.cc:740] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:17:56.305505 15334 consensus_queue.cc:260] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.306998 15334 raft_consensus.cc:3060] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.309649 15261 raft_consensus.cc:515] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.311007 15260 raft_consensus.cc:2468] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 2.
I20260709 13:17:56.312079 15261 leader_election.cc:290] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 2 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:56.312507 15151 leader_election.cc:304] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:17:56.313822 15457 raft_consensus.cc:2804] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:56.314328 15457 raft_consensus.cc:697] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Becoming Leader. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:17:56.312558 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eca34ea3cb74f17ab5c5b1507b4a85e" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:56.315244 15184 raft_consensus.cc:3060] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.315872 15334 raft_consensus.cc:2468] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 2.
I20260709 13:17:56.315399 15457 consensus_queue.cc:237] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.314175 15333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eca34ea3cb74f17ab5c5b1507b4a85e" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:56.317210 15333 raft_consensus.cc:3055] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.317523 15333 raft_consensus.cc:740] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:17:56.318239 15333 consensus_queue.cc:260] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.319300 15333 raft_consensus.cc:3060] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.321916 15184 raft_consensus.cc:2468] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 2.
I20260709 13:17:56.323348 15226 leader_election.cc:304] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:17:56.324146 15411 raft_consensus.cc:2804] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:56.324667 15411 raft_consensus.cc:697] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [term 2 LEADER]: Becoming Leader. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:17:56.326009 15333 raft_consensus.cc:2468] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 2.
I20260709 13:17:56.325706 15411 consensus_queue.cc:237] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.326141 15082 catalog_manager.cc:5697] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f reported cstate change: term changed from 1 to 2, leader changed from baeb6abc07f7498385dccf2decd1928b (127.4.254.3) to 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1). New cstate: current_term: 2 leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.332661 15084 catalog_manager.cc:5697] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c reported cstate change: term changed from 1 to 2, leader changed from baeb6abc07f7498385dccf2decd1928b (127.4.254.3) to 062e441744914d958b96d5997834918c (127.4.254.2). New cstate: current_term: 2 leader_uuid: "062e441744914d958b96d5997834918c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.384649 15442 raft_consensus.cc:993] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c: : Instructing follower 1fd4c74e74374908aa2edc5c8018f10f to start an election
I20260709 13:17:56.385213 15411 raft_consensus.cc:1081] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Signalling peer 1fd4c74e74374908aa2edc5c8018f10f to start an election
I20260709 13:17:56.386641 15184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "022154fd79414d4191640078fb352c39"
dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
 from {username='slave'} at 127.0.0.1:50744
I20260709 13:17:56.387157 15184 raft_consensus.cc:493] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.387553 15184 raft_consensus.cc:3060] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.393313 15184 raft_consensus.cc:515] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } }
I20260709 13:17:56.395117 15184 leader_election.cc:290] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 2 election: Requested vote from peers baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:56.395803 15333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022154fd79414d4191640078fb352c39" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:56.396127 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022154fd79414d4191640078fb352c39" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:17:56.396425 15333 raft_consensus.cc:3060] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.396766 15261 raft_consensus.cc:3055] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.397163 15261 raft_consensus.cc:740] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:17:56.397995 15261 consensus_queue.cc:260] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } }
I20260709 13:17:56.398970 15261 raft_consensus.cc:3060] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.401589 15333 raft_consensus.cc:2468] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 2.
I20260709 13:17:56.402659 15150 leader_election.cc:304] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:56.403461 15457 raft_consensus.cc:2804] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:56.403939 15457 raft_consensus.cc:697] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Becoming Leader. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:17:56.404261 15261 raft_consensus.cc:2468] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 2.
I20260709 13:17:56.405156 15457 consensus_queue.cc:237] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } }
I20260709 13:17:56.411271 15084 catalog_manager.cc:5697] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f reported cstate change: term changed from 1 to 2, leader changed from 062e441744914d958b96d5997834918c (127.4.254.2) to 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1). New cstate: current_term: 2 leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.482417 15456 raft_consensus.cc:993] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f: : Instructing follower 062e441744914d958b96d5997834918c to start an election
I20260709 13:17:56.482921 15457 raft_consensus.cc:1081] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Signalling peer 062e441744914d958b96d5997834918c to start an election
I20260709 13:17:56.484421 15261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2362bd32bd649f7b6041b5117ff5b5b"
dest_uuid: "062e441744914d958b96d5997834918c"
 from {username='slave'} at 127.0.0.1:43734
I20260709 13:17:56.484925 15261 raft_consensus.cc:493] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.485266 15261 raft_consensus.cc:3060] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.490363 15261 raft_consensus.cc:515] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.491962 15261 leader_election.cc:290] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 2 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:56.492879 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2362bd32bd649f7b6041b5117ff5b5b" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:56.493059 15333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2362bd32bd649f7b6041b5117ff5b5b" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:56.493554 15184 raft_consensus.cc:3055] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.493700 15333 raft_consensus.cc:3060] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.493858 15184 raft_consensus.cc:740] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:17:56.494710 15184 consensus_queue.cc:260] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.495682 15184 raft_consensus.cc:3060] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.499846 15333 raft_consensus.cc:2468] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 2.
I20260709 13:17:56.500906 15184 raft_consensus.cc:2468] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 2.
I20260709 13:17:56.501176 15225 leader_election.cc:304] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:56.502085 15411 raft_consensus.cc:2804] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:56.502576 15411 raft_consensus.cc:697] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [term 2 LEADER]: Becoming Leader. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:17:56.503485 15411 consensus_queue.cc:237] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:56.509688 15084 catalog_manager.cc:5697] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c reported cstate change: term changed from 1 to 2, leader changed from 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1) to 062e441744914d958b96d5997834918c (127.4.254.2). New cstate: current_term: 2 leader_uuid: "062e441744914d958b96d5997834918c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.564683 15333 raft_consensus.cc:1275] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Refusing update from remote peer 1fd4c74e74374908aa2edc5c8018f10f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.565976 15457 consensus_queue.cc:1048] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.574329 15261 raft_consensus.cc:1275] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Refusing update from remote peer 1fd4c74e74374908aa2edc5c8018f10f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.576015 15457 consensus_queue.cc:1048] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.638388 15261 raft_consensus.cc:1275] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Refusing update from remote peer 1fd4c74e74374908aa2edc5c8018f10f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.639523 15457 consensus_queue.cc:1048] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.646724 15333 raft_consensus.cc:1275] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Refusing update from remote peer 1fd4c74e74374908aa2edc5c8018f10f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.648278 15456 consensus_queue.cc:1048] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.682452 15261 raft_consensus.cc:1275] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Refusing update from remote peer baeb6abc07f7498385dccf2decd1928b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.683641 15408 consensus_queue.cc:1048] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.691550 15184 raft_consensus.cc:1275] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Refusing update from remote peer baeb6abc07f7498385dccf2decd1928b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.693044 15380 consensus_queue.cc:1048] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.742970 15333 raft_consensus.cc:1275] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Refusing update from remote peer 062e441744914d958b96d5997834918c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.744192 15442 consensus_queue.cc:1048] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.752732 15184 raft_consensus.cc:1275] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Refusing update from remote peer 062e441744914d958b96d5997834918c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.755527 15411 consensus_queue.cc:1048] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.884560 15334 raft_consensus.cc:1275] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Refusing update from remote peer 1fd4c74e74374908aa2edc5c8018f10f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.885906 15456 consensus_queue.cc:1048] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.893103 15184 raft_consensus.cc:1275] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Refusing update from remote peer 062e441744914d958b96d5997834918c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.893708 15261 raft_consensus.cc:1275] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Refusing update from remote peer 1fd4c74e74374908aa2edc5c8018f10f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.895699 15457 consensus_queue.cc:1048] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.896596 15411 consensus_queue.cc:1048] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:56.904076 15260 raft_consensus.cc:1275] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Refusing update from remote peer 1fd4c74e74374908aa2edc5c8018f10f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.904199 15334 raft_consensus.cc:1275] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Refusing update from remote peer 1fd4c74e74374908aa2edc5c8018f10f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.907418 15457 consensus_queue.cc:1048] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:56.908929 15468 consensus_queue.cc:1048] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.910262 15334 raft_consensus.cc:1275] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Refusing update from remote peer 062e441744914d958b96d5997834918c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.917542 15410 consensus_queue.cc:1048] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:59.205632 15082 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44240:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:59.208043 15082 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 13:17:59.252720 15132 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:59.258805 15170 tablet_service.cc:1511] Processing CreateTablet for tablet cc034139d9f84e45b10044668ae1e166 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:59.260128 15245 tablet_service.cc:1511] Processing CreateTablet for tablet cc034139d9f84e45b10044668ae1e166 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:59.260682 15170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc034139d9f84e45b10044668ae1e166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.261785 15245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc034139d9f84e45b10044668ae1e166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.261729 15322 tablet_service.cc:1511] Processing CreateTablet for tablet cc034139d9f84e45b10044668ae1e166 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:59.263206 15322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc034139d9f84e45b10044668ae1e166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.266053 15251 tablet_service.cc:1511] Processing CreateTablet for tablet add5829a1d3f49989ea39fc5a9351fb5 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:59.267457 15251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add5829a1d3f49989ea39fc5a9351fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.271101 15324 tablet_service.cc:1511] Processing CreateTablet for tablet add5829a1d3f49989ea39fc5a9351fb5 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:59.272550 15324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add5829a1d3f49989ea39fc5a9351fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.275193 15250 tablet_service.cc:1511] Processing CreateTablet for tablet b060fe440c6d40d6af397b5ee5d80a9b (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:59.276623 15250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b060fe440c6d40d6af397b5ee5d80a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.278317 15174 tablet_service.cc:1511] Processing CreateTablet for tablet add5829a1d3f49989ea39fc5a9351fb5 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:59.279728 15174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add5829a1d3f49989ea39fc5a9351fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.280637 15325 tablet_service.cc:1511] Processing CreateTablet for tablet b060fe440c6d40d6af397b5ee5d80a9b (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:59.282454 15325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b060fe440c6d40d6af397b5ee5d80a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.282294 15171 tablet_service.cc:1511] Processing CreateTablet for tablet b060fe440c6d40d6af397b5ee5d80a9b (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:59.283658 15171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b060fe440c6d40d6af397b5ee5d80a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.284462 15243 tablet_service.cc:1511] Processing CreateTablet for tablet b90294f6ecb443e68c687960383c05a9 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:59.285836 15243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90294f6ecb443e68c687960383c05a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.286597 15321 tablet_service.cc:1511] Processing CreateTablet for tablet b90294f6ecb443e68c687960383c05a9 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:59.287850 15321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90294f6ecb443e68c687960383c05a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.290436 15175 tablet_service.cc:1511] Processing CreateTablet for tablet b90294f6ecb443e68c687960383c05a9 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:59.291747 15175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90294f6ecb443e68c687960383c05a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.293372 15244 tablet_service.cc:1511] Processing CreateTablet for tablet 0e822f21107447809798687a0809d453 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:59.294296 15173 tablet_service.cc:1511] Processing CreateTablet for tablet 0e822f21107447809798687a0809d453 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:59.294740 15244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e822f21107447809798687a0809d453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.295590 15173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e822f21107447809798687a0809d453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.315336 15319 tablet_service.cc:1511] Processing CreateTablet for tablet 0e822f21107447809798687a0809d453 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:59.316808 15319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e822f21107447809798687a0809d453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.319171 15172 tablet_service.cc:1511] Processing CreateTablet for tablet 5c33cabd9f6f42f79bee253550b16a3b (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:59.320003 15487 tablet_bootstrap.cc:492] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:59.320647 15172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c33cabd9f6f42f79bee253550b16a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.328450 15320 tablet_service.cc:1511] Processing CreateTablet for tablet 5c33cabd9f6f42f79bee253550b16a3b (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:59.329715 15487 tablet_bootstrap.cc:654] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.329993 15320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c33cabd9f6f42f79bee253550b16a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.334659 15243 tablet_service.cc:1511] Processing CreateTablet for tablet 5c33cabd9f6f42f79bee253550b16a3b (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:59.339449 15176 tablet_service.cc:1511] Processing CreateTablet for tablet 81aba0603d3548acb69df47319ee1e77 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:59.340809 15176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81aba0603d3548acb69df47319ee1e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.342060 15248 tablet_service.cc:1511] Processing CreateTablet for tablet 81aba0603d3548acb69df47319ee1e77 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:59.349421 15323 tablet_service.cc:1511] Processing CreateTablet for tablet 81aba0603d3548acb69df47319ee1e77 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:59.351200 15323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81aba0603d3548acb69df47319ee1e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.372016 15243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c33cabd9f6f42f79bee253550b16a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.373188 15169 tablet_service.cc:1511] Processing CreateTablet for tablet 644f4c907c6f474599fd53f58455fed8 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:59.374578 15169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644f4c907c6f474599fd53f58455fed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.377471 15248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81aba0603d3548acb69df47319ee1e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.378340 15249 tablet_service.cc:1511] Processing CreateTablet for tablet 644f4c907c6f474599fd53f58455fed8 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:59.379683 15249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644f4c907c6f474599fd53f58455fed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.397091 15486 tablet_bootstrap.cc:492] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:59.397831 15318 tablet_service.cc:1511] Processing CreateTablet for tablet 644f4c907c6f474599fd53f58455fed8 (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:59.399247 15318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644f4c907c6f474599fd53f58455fed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.404309 15486 tablet_bootstrap.cc:654] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.413110 15170 tablet_service.cc:1511] Processing CreateTablet for tablet 41f2b7210bf4463e9a09bf204b605f3d (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:59.414582 15170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f2b7210bf4463e9a09bf204b605f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.425876 15250 tablet_service.cc:1511] Processing CreateTablet for tablet 41f2b7210bf4463e9a09bf204b605f3d (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:59.425966 15320 tablet_service.cc:1511] Processing CreateTablet for tablet 41f2b7210bf4463e9a09bf204b605f3d (DEFAULT_TABLE table=soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:59.429407 15320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f2b7210bf4463e9a09bf204b605f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.427597 15250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f2b7210bf4463e9a09bf204b605f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:59.467250 15487 tablet_bootstrap.cc:492] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:59.467964 15487 ts_tablet_manager.cc:1403] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.148s	user 0.011s	sys 0.017s
I20260709 13:17:59.471524 15487 raft_consensus.cc:359] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.472312 15487 raft_consensus.cc:385] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.472709 15487 raft_consensus.cc:740] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.474393 15489 tablet_bootstrap.cc:492] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:59.490957 15486 tablet_bootstrap.cc:492] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:59.491655 15486 ts_tablet_manager.cc:1403] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.004s
I20260709 13:17:59.493745 15487 consensus_queue.cc:260] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.494810 15486 raft_consensus.cc:359] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.495755 15486 raft_consensus.cc:385] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.496150 15486 raft_consensus.cc:740] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.496966 15486 consensus_queue.cc:260] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.499913 15486 ts_tablet_manager.cc:1434] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:59.500730 15487 ts_tablet_manager.cc:1434] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:17:59.500977 15486 tablet_bootstrap.cc:492] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:59.501801 15487 tablet_bootstrap.cc:492] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:59.508433 15486 tablet_bootstrap.cc:654] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.502063 15489 tablet_bootstrap.cc:654] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.522599 15487 tablet_bootstrap.cc:654] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.527109 15486 tablet_bootstrap.cc:492] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:59.527276 15489 tablet_bootstrap.cc:492] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:59.527693 15486 ts_tablet_manager.cc:1403] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.008s
I20260709 13:17:59.527823 15489 ts_tablet_manager.cc:1403] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.003s
I20260709 13:17:59.530889 15489 raft_consensus.cc:359] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.531244 15486 raft_consensus.cc:359] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.531699 15489 raft_consensus.cc:385] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.532040 15487 tablet_bootstrap.cc:492] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:59.532076 15486 raft_consensus.cc:385] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.532171 15489 raft_consensus.cc:740] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.532868 15487 ts_tablet_manager.cc:1403] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.000s
I20260709 13:17:59.532788 15486 raft_consensus.cc:740] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.533365 15489 consensus_queue.cc:260] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.533954 15486 consensus_queue.cc:260] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.536230 15489 ts_tablet_manager.cc:1434] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:59.536645 15486 ts_tablet_manager.cc:1434] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:17:59.537511 15489 tablet_bootstrap.cc:492] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:59.537832 15486 tablet_bootstrap.cc:492] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:59.544926 15489 tablet_bootstrap.cc:654] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.548874 15486 tablet_bootstrap.cc:654] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.551081 15489 tablet_bootstrap.cc:492] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:59.551544 15489 ts_tablet_manager.cc:1403] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 13:17:59.551571 15487 raft_consensus.cc:359] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.552568 15487 raft_consensus.cc:385] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.552838 15487 raft_consensus.cc:740] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.553622 15487 consensus_queue.cc:260] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.554598 15486 tablet_bootstrap.cc:492] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:59.554397 15489 raft_consensus.cc:359] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.555197 15486 ts_tablet_manager.cc:1403] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.007s
I20260709 13:17:59.555238 15489 raft_consensus.cc:385] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.555805 15489 raft_consensus.cc:740] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.556049 15487 ts_tablet_manager.cc:1434] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.003s
I20260709 13:17:59.556622 15489 consensus_queue.cc:260] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.557503 15487 tablet_bootstrap.cc:492] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:59.558626 15486 raft_consensus.cc:359] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.559407 15486 raft_consensus.cc:385] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.559417 15489 ts_tablet_manager.cc:1434] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:59.559912 15486 raft_consensus.cc:740] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.560832 15489 tablet_bootstrap.cc:492] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:59.560915 15486 consensus_queue.cc:260] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.563560 15486 ts_tablet_manager.cc:1434] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:17:59.564522 15486 tablet_bootstrap.cc:492] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:59.567422 15489 tablet_bootstrap.cc:654] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.571226 15486 tablet_bootstrap.cc:654] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.577719 15487 tablet_bootstrap.cc:654] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.579320 15489 tablet_bootstrap.cc:492] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:59.579852 15489 ts_tablet_manager.cc:1403] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:17:59.582675 15486 tablet_bootstrap.cc:492] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:59.582738 15489 raft_consensus.cc:359] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.583371 15486 ts_tablet_manager.cc:1403] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.003s
I20260709 13:17:59.583614 15487 tablet_bootstrap.cc:492] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:59.583585 15489 raft_consensus.cc:385] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.584167 15489 raft_consensus.cc:740] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.584293 15487 ts_tablet_manager.cc:1403] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.005s
I20260709 13:17:59.585079 15489 consensus_queue.cc:260] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.586519 15486 raft_consensus.cc:359] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.587298 15486 raft_consensus.cc:385] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.587350 15489 ts_tablet_manager.cc:1434] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:59.587713 15486 raft_consensus.cc:740] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.587560 15487 raft_consensus.cc:359] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.588408 15487 raft_consensus.cc:385] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.588532 15489 tablet_bootstrap.cc:492] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:59.588768 15487 raft_consensus.cc:740] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.588601 15486 consensus_queue.cc:260] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.589926 15487 consensus_queue.cc:260] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.594005 15486 ts_tablet_manager.cc:1434] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:17:59.595202 15486 tablet_bootstrap.cc:492] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:59.595585 15489 tablet_bootstrap.cc:654] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.597024 15487 ts_tablet_manager.cc:1434] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:17:59.601784 15487 tablet_bootstrap.cc:492] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:59.609418 15486 tablet_bootstrap.cc:654] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.610289 15487 tablet_bootstrap.cc:654] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.615350 15489 tablet_bootstrap.cc:492] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:59.615870 15489 ts_tablet_manager.cc:1403] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.013s
I20260709 13:17:59.618533 15489 raft_consensus.cc:359] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.619309 15489 raft_consensus.cc:385] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.619561 15489 raft_consensus.cc:740] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.619804 15486 tablet_bootstrap.cc:492] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:59.620373 15486 ts_tablet_manager.cc:1403] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.008s
I20260709 13:17:59.620654 15487 tablet_bootstrap.cc:492] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:59.620251 15489 consensus_queue.cc:260] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.621236 15487 ts_tablet_manager.cc:1403] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 13:17:59.622814 15489 ts_tablet_manager.cc:1434] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:59.623792 15489 tablet_bootstrap.cc:492] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:59.623631 15486 raft_consensus.cc:359] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.624477 15486 raft_consensus.cc:385] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.624217 15487 raft_consensus.cc:359] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.624820 15486 raft_consensus.cc:740] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.625000 15487 raft_consensus.cc:385] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.625363 15487 raft_consensus.cc:740] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.625689 15486 consensus_queue.cc:260] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.626269 15487 consensus_queue.cc:260] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.626936 15474 raft_consensus.cc:493] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.627507 15474 raft_consensus.cc:515] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.631116 15489 tablet_bootstrap.cc:654] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.631338 15487 ts_tablet_manager.cc:1434] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:59.632372 15474 leader_election.cc:290] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:59.633909 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b060fe440c6d40d6af397b5ee5d80a9b" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:17:59.645625 15410 raft_consensus.cc:493] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.635887 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b060fe440c6d40d6af397b5ee5d80a9b" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
I20260709 13:17:59.637804 15486 ts_tablet_manager.cc:1434] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:17:59.646149 15410 raft_consensus.cc:515] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.646636 15260 raft_consensus.cc:2468] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 0.
I20260709 13:17:59.647028 15489 tablet_bootstrap.cc:492] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:59.647507 15486 tablet_bootstrap.cc:492] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:59.647528 15489 ts_tablet_manager.cc:1403] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 13:17:59.648269 15410 leader_election.cc:290] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
W20260709 13:17:59.648540 15300 leader_election.cc:343] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.650390 15300 leader_election.cc:304] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 1fd4c74e74374908aa2edc5c8018f10f
I20260709 13:17:59.650777 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90294f6ecb443e68c687960383c05a9" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:17:59.651552 15474 raft_consensus.cc:2804] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.651275 15489 raft_consensus.cc:359] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.651947 15474 raft_consensus.cc:493] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.652010 15489 raft_consensus.cc:385] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.652416 15474 raft_consensus.cc:3060] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.652424 15489 raft_consensus.cc:740] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.651494 15334 raft_consensus.cc:2468] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 0.
I20260709 13:17:59.654085 15489 consensus_queue.cc:260] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.632481 15487 tablet_bootstrap.cc:492] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:59.655651 15225 leader_election.cc:304] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:59.656056 15489 ts_tablet_manager.cc:1434] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:59.657145 15489 tablet_bootstrap.cc:492] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:59.663693 15487 tablet_bootstrap.cc:654] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.665606 15489 tablet_bootstrap.cc:654] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.667794 15474 raft_consensus.cc:515] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.668668 15486 tablet_bootstrap.cc:654] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.671449 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b060fe440c6d40d6af397b5ee5d80a9b" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:59.673331 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90294f6ecb443e68c687960383c05a9" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:17:59.674259 15184 raft_consensus.cc:2468] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 0.
W20260709 13:17:59.673470 15300 leader_election.cc:343] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.677345 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b060fe440c6d40d6af397b5ee5d80a9b" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:17:59.678129 15260 raft_consensus.cc:3060] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.686071 15410 raft_consensus.cc:2804] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.686743 15410 raft_consensus.cc:493] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.687464 15410 raft_consensus.cc:3060] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.698625 15474 leader_election.cc:290] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:59.709080 15260 raft_consensus.cc:2468] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 1.
I20260709 13:17:59.710577 15300 leader_election.cc:304] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 1fd4c74e74374908aa2edc5c8018f10f
I20260709 13:17:59.711697 15489 tablet_bootstrap.cc:492] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:59.712414 15489 ts_tablet_manager.cc:1403] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.056s	user 0.023s	sys 0.029s
I20260709 13:17:59.713312 15487 tablet_bootstrap.cc:492] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:59.713943 15487 ts_tablet_manager.cc:1403] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.017s
I20260709 13:17:59.713194 15474 raft_consensus.cc:2804] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.716852 15474 raft_consensus.cc:697] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Becoming Leader. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:17:59.717247 15487 raft_consensus.cc:359] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.718034 15487 raft_consensus.cc:385] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.718405 15486 tablet_bootstrap.cc:492] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:59.719187 15486 ts_tablet_manager.cc:1403] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.014s
I20260709 13:17:59.719484 15489 raft_consensus.cc:359] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.720342 15489 raft_consensus.cc:385] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.720666 15489 raft_consensus.cc:740] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.717875 15474 consensus_queue.cc:237] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.718477 15487 raft_consensus.cc:740] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.721971 15489 consensus_queue.cc:260] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.724526 15410 raft_consensus.cc:515] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.727068 15410 leader_election.cc:290] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:59.727244 15489 ts_tablet_manager.cc:1434] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:17:59.727900 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90294f6ecb443e68c687960383c05a9" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:59.728448 15489 tablet_bootstrap.cc:492] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:59.728540 15184 raft_consensus.cc:3060] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.729173 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90294f6ecb443e68c687960383c05a9" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:59.729782 15334 raft_consensus.cc:3060] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.733680 15487 consensus_queue.cc:260] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.734824 15080 catalog_manager.cc:5697] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b reported cstate change: term changed from 0 to 1, leader changed from <none> to baeb6abc07f7498385dccf2decd1928b (127.4.254.3). New cstate: current_term: 1 leader_uuid: "baeb6abc07f7498385dccf2decd1928b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.736073 15487 ts_tablet_manager.cc:1434] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:17:59.737540 15334 raft_consensus.cc:2468] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 1.
I20260709 13:17:59.738929 15489 tablet_bootstrap.cc:654] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.739919 15184 raft_consensus.cc:2468] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 1.
I20260709 13:17:59.739156 15225 leader_election.cc:304] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:59.723944 15486 raft_consensus.cc:359] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.742089 15508 raft_consensus.cc:2804] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.742588 15508 raft_consensus.cc:697] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Becoming Leader. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:17:59.742769 15487 tablet_bootstrap.cc:492] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:59.743546 15508 consensus_queue.cc:237] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.742110 15486 raft_consensus.cc:385] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.745702 15486 raft_consensus.cc:740] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.746518 15486 consensus_queue.cc:260] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.748818 15486 ts_tablet_manager.cc:1434] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:17:59.749840 15486 tablet_bootstrap.cc:492] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:59.756421 15487 tablet_bootstrap.cc:654] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.756421 15486 tablet_bootstrap.cc:654] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.760807 15489 tablet_bootstrap.cc:492] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:59.761297 15489 ts_tablet_manager.cc:1403] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.002s
I20260709 13:17:59.762769 15474 raft_consensus.cc:493] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.763337 15474 raft_consensus.cc:515] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.764199 15489 raft_consensus.cc:359] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.764962 15489 raft_consensus.cc:385] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.765259 15489 raft_consensus.cc:740] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.766249 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644f4c907c6f474599fd53f58455fed8" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:17:59.765991 15489 consensus_queue.cc:260] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.766893 15184 raft_consensus.cc:2468] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 0.
I20260709 13:17:59.768436 15489 ts_tablet_manager.cc:1434] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:17:59.768457 15300 leader_election.cc:304] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:59.769718 15502 raft_consensus.cc:2804] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.769944 15489 tablet_bootstrap.cc:492] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:59.770104 15502 raft_consensus.cc:493] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.770459 15502 raft_consensus.cc:3060] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.782202 15489 tablet_bootstrap.cc:654] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.786877 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644f4c907c6f474599fd53f58455fed8" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
W20260709 13:17:59.788980 15300 leader_election.cc:343] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 062e441744914d958b96d5997834918c (127.4.254.2:40299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.789878 15474 leader_election.cc:290] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:59.792878 15502 raft_consensus.cc:515] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.800601 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644f4c907c6f474599fd53f58455fed8" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:59.801342 15184 raft_consensus.cc:3060] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.823073 15184 raft_consensus.cc:2468] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 1.
I20260709 13:17:59.824705 15300 leader_election.cc:304] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:59.825294 15516 raft_consensus.cc:493] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.826261 15474 raft_consensus.cc:2804] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.826083 15516 raft_consensus.cc:515] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.829936 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add5829a1d3f49989ea39fc5a9351fb5" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
I20260709 13:17:59.830067 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644f4c907c6f474599fd53f58455fed8" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c"
W20260709 13:17:59.831805 15151 leader_election.cc:343] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 062e441744914d958b96d5997834918c (127.4.254.2:40299): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:59.832166 15300 leader_election.cc:343] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 062e441744914d958b96d5997834918c (127.4.254.2:40299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.833240 15502 leader_election.cc:290] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:59.834663 15474 raft_consensus.cc:697] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Becoming Leader. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:17:59.837196 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add5829a1d3f49989ea39fc5a9351fb5" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:17:59.838019 15516 leader_election.cc:290] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
W20260709 13:17:59.844065 15150 leader_election.cc:343] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.844691 15150 leader_election.cc:304] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f; no voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b
I20260709 13:17:59.846594 15457 raft_consensus.cc:2749] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:59.836052 15474 consensus_queue.cc:237] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.861372 15489 tablet_bootstrap.cc:492] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:59.861799 15489 ts_tablet_manager.cc:1403] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.092s	user 0.032s	sys 0.047s
I20260709 13:17:59.861594 15080 catalog_manager.cc:5697] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c reported cstate change: term changed from 0 to 1, leader changed from <none> to 062e441744914d958b96d5997834918c (127.4.254.2). New cstate: current_term: 1 leader_uuid: "062e441744914d958b96d5997834918c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.863736 15486 tablet_bootstrap.cc:492] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:59.864251 15486 ts_tablet_manager.cc:1403] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.115s	user 0.043s	sys 0.041s
I20260709 13:17:59.864301 15489 raft_consensus.cc:359] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.865062 15489 raft_consensus.cc:385] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.865337 15489 raft_consensus.cc:740] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.866124 15489 consensus_queue.cc:260] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.868196 15489 ts_tablet_manager.cc:1434] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:59.868865 15457 raft_consensus.cc:493] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.869179 15489 tablet_bootstrap.cc:492] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b: Bootstrap starting.
I20260709 13:17:59.869436 15457 raft_consensus.cc:515] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.870328 15486 raft_consensus.cc:359] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.871068 15486 raft_consensus.cc:385] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.871343 15486 raft_consensus.cc:740] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.872206 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc034139d9f84e45b10044668ae1e166" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
I20260709 13:17:59.872184 15486 consensus_queue.cc:260] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.873078 15260 raft_consensus.cc:2468] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 0.
I20260709 13:17:59.874719 15151 leader_election.cc:304] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:17:59.875473 15516 raft_consensus.cc:2804] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.875770 15489 tablet_bootstrap.cc:654] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.875826 15516 raft_consensus.cc:493] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.876394 15516 raft_consensus.cc:3060] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.867944 15083 catalog_manager.cc:5697] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b reported cstate change: term changed from 0 to 1, leader changed from <none> to baeb6abc07f7498385dccf2decd1928b (127.4.254.3). New cstate: current_term: 1 leader_uuid: "baeb6abc07f7498385dccf2decd1928b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.877957 15486 ts_tablet_manager.cc:1434] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:17:59.882830 15486 tablet_bootstrap.cc:492] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:59.882517 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc034139d9f84e45b10044668ae1e166" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:17:59.883461 15334 raft_consensus.cc:2468] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 0.
I20260709 13:17:59.885210 15457 leader_election.cc:290] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:59.886029 15457 raft_consensus.cc:493] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.886790 15457 raft_consensus.cc:515] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.887283 15489 tablet_bootstrap.cc:492] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b: No bootstrap required, opened a new log
I20260709 13:17:59.888485 15489 ts_tablet_manager.cc:1403] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:17:59.889835 15486 tablet_bootstrap.cc:654] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.891601 15489 raft_consensus.cc:359] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.892032 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e822f21107447809798687a0809d453" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:17:59.892298 15489 raft_consensus.cc:385] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.892570 15489 raft_consensus.cc:740] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.892678 15334 raft_consensus.cc:2468] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 0.
I20260709 13:17:59.893384 15489 consensus_queue.cc:260] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.894009 15150 leader_election.cc:304] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:59.895629 15489 ts_tablet_manager.cc:1434] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:59.895685 15457 leader_election.cc:290] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:59.896797 15457 raft_consensus.cc:2804] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.897176 15457 raft_consensus.cc:493] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.897521 15457 raft_consensus.cc:3060] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.903673 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e822f21107447809798687a0809d453" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
I20260709 13:17:59.904433 15260 raft_consensus.cc:2468] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 0.
I20260709 13:17:59.905689 15457 raft_consensus.cc:515] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.906286 15487 tablet_bootstrap.cc:492] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:59.906889 15487 ts_tablet_manager.cc:1403] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.164s	user 0.021s	sys 0.033s
I20260709 13:17:59.908463 15457 leader_election.cc:290] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 election: Requested vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:59.908736 15486 tablet_bootstrap.cc:492] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:59.909307 15486 ts_tablet_manager.cc:1403] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.002s
I20260709 13:17:59.909590 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e822f21107447809798687a0809d453" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:59.910198 15334 raft_consensus.cc:3060] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.910108 15487 raft_consensus.cc:359] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.910917 15487 raft_consensus.cc:385] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.911237 15487 raft_consensus.cc:740] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.911726 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e822f21107447809798687a0809d453" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:17:59.904078 15516 raft_consensus.cc:515] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.912367 15260 raft_consensus.cc:3060] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.914861 15333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc034139d9f84e45b10044668ae1e166" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:17:59.915473 15333 raft_consensus.cc:3060] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.917761 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc034139d9f84e45b10044668ae1e166" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:17:59.918352 15261 raft_consensus.cc:3060] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.918982 15334 raft_consensus.cc:2468] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 1.
I20260709 13:17:59.919998 15260 raft_consensus.cc:2468] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 1.
I20260709 13:17:59.921232 15151 leader_election.cc:304] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:17:59.915174 15516 leader_election.cc:290] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 election: Requested vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:17:59.923080 15457 raft_consensus.cc:2804] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.923568 15457 raft_consensus.cc:697] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Becoming Leader. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:17:59.924418 15457 consensus_queue.cc:237] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.912381 15487 consensus_queue.cc:260] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.927368 15487 ts_tablet_manager.cc:1434] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:17:59.928737 15487 tablet_bootstrap.cc:492] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:59.930027 15333 raft_consensus.cc:2468] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 1.
I20260709 13:17:59.931272 15150 leader_election.cc:304] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:59.933000 15261 raft_consensus.cc:2468] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 1.
I20260709 13:17:59.934571 15516 raft_consensus.cc:2804] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.913880 15486 raft_consensus.cc:359] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.936903 15486 raft_consensus.cc:385] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.937389 15486 raft_consensus.cc:740] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.938172 15486 consensus_queue.cc:260] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.939617 15487 tablet_bootstrap.cc:654] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.940194 15486 ts_tablet_manager.cc:1434] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:17:59.941179 15486 tablet_bootstrap.cc:492] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f: Bootstrap starting.
I20260709 13:17:59.943107 15516 raft_consensus.cc:697] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Becoming Leader. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:17:59.944038 15516 consensus_queue.cc:237] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.947417 15486 tablet_bootstrap.cc:654] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.952710 15487 tablet_bootstrap.cc:492] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:59.953333 15487 ts_tablet_manager.cc:1403] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.002s
I20260709 13:17:59.955976 15080 catalog_manager.cc:5697] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1). New cstate: current_term: 1 leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.956539 15487 raft_consensus.cc:359] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.957465 15486 tablet_bootstrap.cc:492] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f: No bootstrap required, opened a new log
I20260709 13:17:59.957486 15487 raft_consensus.cc:385] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.958039 15486 ts_tablet_manager.cc:1403] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.002s
I20260709 13:17:59.958168 15487 raft_consensus.cc:740] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.959136 15487 consensus_queue.cc:260] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.961040 15486 raft_consensus.cc:359] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.961757 15486 raft_consensus.cc:385] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.961879 15487 ts_tablet_manager.cc:1434] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:17:59.962059 15486 raft_consensus.cc:740] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.962929 15486 consensus_queue.cc:260] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.963691 15487 tablet_bootstrap.cc:492] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:59.964896 15486 ts_tablet_manager.cc:1434] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:59.970690 15487 tablet_bootstrap.cc:654] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.974720 15474 raft_consensus.cc:493] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.975286 15474 raft_consensus.cc:515] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.975848 15083 catalog_manager.cc:5697] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1). New cstate: current_term: 1 leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.977387 15474 leader_election.cc:290] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:59.978989 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81aba0603d3548acb69df47319ee1e77" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:17:59.979187 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81aba0603d3548acb69df47319ee1e77" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
I20260709 13:17:59.979756 15487 tablet_bootstrap.cc:492] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:17:59.979642 15184 raft_consensus.cc:2468] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 0.
I20260709 13:17:59.980247 15487 ts_tablet_manager.cc:1403] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:17:59.980786 15300 leader_election.cc:304] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:17:59.981616 15474 raft_consensus.cc:2804] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.981971 15474 raft_consensus.cc:493] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.982272 15474 raft_consensus.cc:3060] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:59.982901 15300 leader_election.cc:343] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 062e441744914d958b96d5997834918c (127.4.254.2:40299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.982934 15487 raft_consensus.cc:359] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.983774 15487 raft_consensus.cc:385] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.984037 15487 raft_consensus.cc:740] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.984797 15487 consensus_queue.cc:260] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.987162 15487 ts_tablet_manager.cc:1434] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:59.988067 15487 tablet_bootstrap.cc:492] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c: Bootstrap starting.
I20260709 13:17:59.989547 15474 raft_consensus.cc:515] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:17:59.991664 15474 leader_election.cc:290] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:17:59.994318 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81aba0603d3548acb69df47319ee1e77" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:17:59.994910 15487 tablet_bootstrap.cc:654] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.994920 15184 raft_consensus.cc:3060] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.996270 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81aba0603d3548acb69df47319ee1e77" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:17:59.996886 15261 raft_consensus.cc:3060] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.002537 15261 raft_consensus.cc:2468] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 1.
I20260709 13:18:00.002810 15184 raft_consensus.cc:2468] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 1.
I20260709 13:18:00.003578 15487 tablet_bootstrap.cc:492] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c: No bootstrap required, opened a new log
I20260709 13:18:00.003796 15508 raft_consensus.cc:493] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.004078 15487 ts_tablet_manager.cc:1403] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:18:00.004328 15508 raft_consensus.cc:515] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.006438 15508 leader_election.cc:290] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:18:00.007047 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644f4c907c6f474599fd53f58455fed8" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:18:00.007854 15300 leader_election.cc:304] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:18:00.007936 15333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644f4c907c6f474599fd53f58455fed8" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:18:00.007949 15487 raft_consensus.cc:359] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.008852 15487 raft_consensus.cc:385] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.009094 15487 raft_consensus.cc:740] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.009357 15502 raft_consensus.cc:2804] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.009860 15502 raft_consensus.cc:697] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Becoming Leader. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:18:00.009802 15487 consensus_queue.cc:260] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.007830 15184 raft_consensus.cc:2393] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 062e441744914d958b96d5997834918c in current term 1: Already voted for candidate baeb6abc07f7498385dccf2decd1928b in this term.
I20260709 13:18:00.010851 15502 consensus_queue.cc:237] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.011322 15226 leader_election.cc:304] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 062e441744914d958b96d5997834918c; no voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b
I20260709 13:18:00.012018 15487 ts_tablet_manager.cc:1434] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:00.012163 15508 raft_consensus.cc:3060] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.013329 15516 raft_consensus.cc:493] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.013792 15516 raft_consensus.cc:515] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.015805 15516 leader_election.cc:290] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:18:00.016455 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f2b7210bf4463e9a09bf204b605f3d" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
I20260709 13:18:00.017351 15261 raft_consensus.cc:2468] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 0.
I20260709 13:18:00.018597 15151 leader_election.cc:304] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:18:00.019388 15516 raft_consensus.cc:2804] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.019731 15516 raft_consensus.cc:493] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.020036 15516 raft_consensus.cc:3060] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.020119 15333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f2b7210bf4463e9a09bf204b605f3d" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:18:00.020603 15508 raft_consensus.cc:2749] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:00.020856 15333 raft_consensus.cc:2468] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 0.
I20260709 13:18:00.026925 15516 raft_consensus.cc:515] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.029546 15516 leader_election.cc:290] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 election: Requested vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:18:00.030098 15333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f2b7210bf4463e9a09bf204b605f3d" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:18:00.030169 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f2b7210bf4463e9a09bf204b605f3d" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:18:00.030894 15333 raft_consensus.cc:3060] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.030956 15261 raft_consensus.cc:3060] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.031792 15083 catalog_manager.cc:5697] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b reported cstate change: term changed from 0 to 1, leader changed from <none> to baeb6abc07f7498385dccf2decd1928b (127.4.254.3). New cstate: current_term: 1 leader_uuid: "baeb6abc07f7498385dccf2decd1928b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.033318 15502 raft_consensus.cc:493] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.033862 15502 raft_consensus.cc:515] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.036100 15502 leader_election.cc:290] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:18:00.036736 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c33cabd9f6f42f79bee253550b16a3b" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:18:00.037395 15184 raft_consensus.cc:2468] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 0.
I20260709 13:18:00.038058 15333 raft_consensus.cc:2468] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 1.
I20260709 13:18:00.039005 15300 leader_election.cc:304] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:18:00.039516 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c33cabd9f6f42f79bee253550b16a3b" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
I20260709 13:18:00.040093 15150 leader_election.cc:304] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:18:00.040180 15260 raft_consensus.cc:2468] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 0.
I20260709 13:18:00.041047 15516 raft_consensus.cc:2804] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.041529 15516 raft_consensus.cc:697] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Becoming Leader. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:18:00.042348 15516 consensus_queue.cc:237] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.044795 15261 raft_consensus.cc:2468] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 1.
I20260709 13:18:00.045898 15502 raft_consensus.cc:2804] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.046319 15502 raft_consensus.cc:493] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.046607 15502 raft_consensus.cc:3060] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.053630 15502 raft_consensus.cc:515] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.055800 15502 leader_election.cc:290] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:18:00.055178 15083 catalog_manager.cc:5697] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1). New cstate: current_term: 1 leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.056855 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c33cabd9f6f42f79bee253550b16a3b" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:18:00.057432 15184 raft_consensus.cc:3060] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.057497 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c33cabd9f6f42f79bee253550b16a3b" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:18:00.058175 15261 raft_consensus.cc:3060] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.063221 15261 raft_consensus.cc:2468] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 1.
I20260709 13:18:00.063753 15184 raft_consensus.cc:2468] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 1.
I20260709 13:18:00.064317 15300 leader_election.cc:304] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:18:00.065220 15502 raft_consensus.cc:2804] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.065938 15502 raft_consensus.cc:697] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Becoming Leader. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:18:00.066638 15502 consensus_queue.cc:237] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.081928 15083 catalog_manager.cc:5697] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b reported cstate change: term changed from 0 to 1, leader changed from <none> to baeb6abc07f7498385dccf2decd1928b (127.4.254.3). New cstate: current_term: 1 leader_uuid: "baeb6abc07f7498385dccf2decd1928b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.115761 15516 raft_consensus.cc:493] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.116303 15516 raft_consensus.cc:515] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.118503 15516 leader_election.cc:290] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:18:00.118824 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b060fe440c6d40d6af397b5ee5d80a9b" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
I20260709 13:18:00.119355 15333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b060fe440c6d40d6af397b5ee5d80a9b" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb6abc07f7498385dccf2decd1928b" is_pre_election: true
I20260709 13:18:00.119709 15261 raft_consensus.cc:2393] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1fd4c74e74374908aa2edc5c8018f10f in current term 1: Already voted for candidate baeb6abc07f7498385dccf2decd1928b in this term.
I20260709 13:18:00.120883 15150 leader_election.cc:304] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f; no voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b
I20260709 13:18:00.121670 15516 raft_consensus.cc:3060] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.124270 15502 raft_consensus.cc:493] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.124714 15502 raft_consensus.cc:515] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.126427 15502 leader_election.cc:290] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:18:00.126926 15516 raft_consensus.cc:2749] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:00.127099 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add5829a1d3f49989ea39fc5a9351fb5" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f" is_pre_election: true
I20260709 13:18:00.127357 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add5829a1d3f49989ea39fc5a9351fb5" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c" is_pre_election: true
I20260709 13:18:00.127739 15184 raft_consensus.cc:2468] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 0.
I20260709 13:18:00.128013 15261 raft_consensus.cc:2468] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 0.
I20260709 13:18:00.128712 15300 leader_election.cc:304] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:18:00.129402 15502 raft_consensus.cc:2804] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.129757 15502 raft_consensus.cc:493] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.130038 15502 raft_consensus.cc:3060] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.134676 15502 raft_consensus.cc:515] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.136379 15502 leader_election.cc:290] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:18:00.137018 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add5829a1d3f49989ea39fc5a9351fb5" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:18:00.137365 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add5829a1d3f49989ea39fc5a9351fb5" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:18:00.137663 15184 raft_consensus.cc:3060] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.137974 15261 raft_consensus.cc:3060] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.142004 15184 raft_consensus.cc:2468] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 1.
I20260709 13:18:00.142104 15261 raft_consensus.cc:2468] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 1.
I20260709 13:18:00.143078 15300 leader_election.cc:304] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:18:00.143726 15502 raft_consensus.cc:2804] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.144119 15502 raft_consensus.cc:697] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Becoming Leader. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:18:00.144865 15502 consensus_queue.cc:237] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.151647 15083 catalog_manager.cc:5697] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b reported cstate change: term changed from 0 to 1, leader changed from <none> to baeb6abc07f7498385dccf2decd1928b (127.4.254.3). New cstate: current_term: 1 leader_uuid: "baeb6abc07f7498385dccf2decd1928b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.156991 15508 consensus_queue.cc:1048] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.161393 15502 consensus_queue.cc:1048] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.183892 15517 consensus_queue.cc:1048] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:00.194566 15508 consensus_queue.cc:1048] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.197844 15334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "add5829a1d3f49989ea39fc5a9351fb5"
dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
mode: GRACEFUL
new_leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
 from {username='slave'} at 127.0.0.1:46468
I20260709 13:18:00.198454 15334 raft_consensus.cc:606] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Received request to transfer leadership to TS 1fd4c74e74374908aa2edc5c8018f10f
I20260709 13:18:00.206585 15334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b060fe440c6d40d6af397b5ee5d80a9b"
dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
mode: GRACEFUL
new_leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
 from {username='slave'} at 127.0.0.1:46468
I20260709 13:18:00.207152 15334 raft_consensus.cc:606] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Received request to transfer leadership to TS 1fd4c74e74374908aa2edc5c8018f10f
I20260709 13:18:00.212817 15261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b90294f6ecb443e68c687960383c05a9"
dest_uuid: "062e441744914d958b96d5997834918c"
mode: GRACEFUL
new_leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
 from {username='slave'} at 127.0.0.1:48102
I20260709 13:18:00.213315 15261 raft_consensus.cc:606] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Received request to transfer leadership to TS 1fd4c74e74374908aa2edc5c8018f10f
I20260709 13:18:00.219697 15185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e822f21107447809798687a0809d453"
dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
mode: GRACEFUL
new_leader_uuid: "062e441744914d958b96d5997834918c"
 from {username='slave'} at 127.0.0.1:52816
I20260709 13:18:00.220297 15185 raft_consensus.cc:606] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Received request to transfer leadership to TS 062e441744914d958b96d5997834918c
I20260709 13:18:00.225230 15334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c33cabd9f6f42f79bee253550b16a3b"
dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
mode: GRACEFUL
new_leader_uuid: "062e441744914d958b96d5997834918c"
 from {username='slave'} at 127.0.0.1:46468
I20260709 13:18:00.225809 15334 raft_consensus.cc:606] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Received request to transfer leadership to TS 062e441744914d958b96d5997834918c
I20260709 13:18:00.230456 15334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81aba0603d3548acb69df47319ee1e77"
dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
mode: GRACEFUL
new_leader_uuid: "062e441744914d958b96d5997834918c"
 from {username='slave'} at 127.0.0.1:46468
I20260709 13:18:00.230923 15334 raft_consensus.cc:606] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Received request to transfer leadership to TS 062e441744914d958b96d5997834918c
I20260709 13:18:00.234486 15517 consensus_queue.cc:1048] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.236212 15334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "644f4c907c6f474599fd53f58455fed8"
dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
mode: GRACEFUL
new_leader_uuid: "062e441744914d958b96d5997834918c"
 from {username='slave'} at 127.0.0.1:46468
I20260709 13:18:00.236785 15334 raft_consensus.cc:606] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Received request to transfer leadership to TS 062e441744914d958b96d5997834918c
I20260709 13:18:00.242715 15184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41f2b7210bf4463e9a09bf204b605f3d"
dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
mode: GRACEFUL
new_leader_uuid: "baeb6abc07f7498385dccf2decd1928b"
 from {username='slave'} at 127.0.0.1:52816
I20260709 13:18:00.243176 15184 raft_consensus.cc:606] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Received request to transfer leadership to TS baeb6abc07f7498385dccf2decd1928b
I20260709 13:18:00.249627 15474 consensus_queue.cc:1048] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.256887 15474 raft_consensus.cc:993] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b: : Instructing follower 062e441744914d958b96d5997834918c to start an election
I20260709 13:18:00.257356 15517 raft_consensus.cc:1081] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Signalling peer 062e441744914d958b96d5997834918c to start an election
I20260709 13:18:00.259040 15261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "644f4c907c6f474599fd53f58455fed8"
dest_uuid: "062e441744914d958b96d5997834918c"
 from {username='slave'} at 127.0.0.1:43718
I20260709 13:18:00.259567 15261 raft_consensus.cc:493] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.259876 15261 raft_consensus.cc:3060] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.264611 15261 raft_consensus.cc:515] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.266466 15261 leader_election.cc:290] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 2 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:18:00.267650 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644f4c907c6f474599fd53f58455fed8" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:18:00.268317 15185 raft_consensus.cc:3060] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.268348 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644f4c907c6f474599fd53f58455fed8" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:18:00.269078 15334 raft_consensus.cc:3055] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:00.269464 15334 raft_consensus.cc:740] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:18:00.270284 15334 consensus_queue.cc:260] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.271593 15334 raft_consensus.cc:3060] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.274636 15185 raft_consensus.cc:2468] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 2.
I20260709 13:18:00.275853 15226 leader_election.cc:304] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:18:00.276654 15508 raft_consensus.cc:2804] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:00.277000 15334 raft_consensus.cc:2468] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 2.
I20260709 13:18:00.277182 15508 raft_consensus.cc:697] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [term 2 LEADER]: Becoming Leader. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:18:00.278210 15508 consensus_queue.cc:237] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.285408 15083 catalog_manager.cc:5697] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c reported cstate change: term changed from 1 to 2, leader changed from baeb6abc07f7498385dccf2decd1928b (127.4.254.3) to 062e441744914d958b96d5997834918c (127.4.254.2). New cstate: current_term: 2 leader_uuid: "062e441744914d958b96d5997834918c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.386196 15457 consensus_queue.cc:1048] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.396176 15516 consensus_queue.cc:1048] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:00.406945 15457 raft_consensus.cc:993] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f: : Instructing follower 062e441744914d958b96d5997834918c to start an election
I20260709 13:18:00.407439 15457 raft_consensus.cc:1081] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Signalling peer 062e441744914d958b96d5997834918c to start an election
I20260709 13:18:00.408959 15261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e822f21107447809798687a0809d453"
dest_uuid: "062e441744914d958b96d5997834918c"
 from {username='slave'} at 127.0.0.1:43734
I20260709 13:18:00.409516 15261 raft_consensus.cc:493] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.409873 15261 raft_consensus.cc:3060] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.415009 15261 raft_consensus.cc:515] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.417101 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e822f21107447809798687a0809d453" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:18:00.417420 15261 leader_election.cc:290] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 2 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:18:00.417647 15185 raft_consensus.cc:3055] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:00.417414 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e822f21107447809798687a0809d453" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:18:00.418905 15185 raft_consensus.cc:740] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:18:00.419130 15334 raft_consensus.cc:3060] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.419795 15185 consensus_queue.cc:260] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.421195 15185 raft_consensus.cc:3060] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.424319 15334 raft_consensus.cc:2468] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 2.
I20260709 13:18:00.425351 15225 leader_election.cc:304] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:18:00.426038 15508 raft_consensus.cc:2804] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:00.426528 15508 raft_consensus.cc:697] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [term 2 LEADER]: Becoming Leader. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:18:00.427506 15185 raft_consensus.cc:2468] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 2.
I20260709 13:18:00.427359 15508 consensus_queue.cc:237] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.434616 15083 catalog_manager.cc:5697] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c reported cstate change: term changed from 1 to 2, leader changed from 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1) to 062e441744914d958b96d5997834918c (127.4.254.2). New cstate: current_term: 2 leader_uuid: "062e441744914d958b96d5997834918c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.486541 15457 consensus_queue.cc:1048] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.496483 15516 consensus_queue.cc:1048] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.522230 15516 consensus_queue.cc:1048] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.527756 15545 raft_consensus.cc:993] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f: : Instructing follower baeb6abc07f7498385dccf2decd1928b to start an election
I20260709 13:18:00.528264 15457 raft_consensus.cc:1081] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Signalling peer baeb6abc07f7498385dccf2decd1928b to start an election
I20260709 13:18:00.530005 15333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41f2b7210bf4463e9a09bf204b605f3d"
dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
 from {username='slave'} at 127.0.0.1:53408
I20260709 13:18:00.530570 15333 raft_consensus.cc:493] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.530967 15333 raft_consensus.cc:3060] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.534636 15523 consensus_queue.cc:1048] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.539230 15333 raft_consensus.cc:515] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.541287 15333 leader_election.cc:290] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 2 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:18:00.542411 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f2b7210bf4463e9a09bf204b605f3d" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:18:00.543076 15185 raft_consensus.cc:3055] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:00.543377 15185 raft_consensus.cc:740] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:18:00.543466 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f2b7210bf4463e9a09bf204b605f3d" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:18:00.544186 15185 consensus_queue.cc:260] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.546974 15517 consensus_queue.cc:1048] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.548259 15185 raft_consensus.cc:3060] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.549160 15517 consensus_queue.cc:1048] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.555753 15185 raft_consensus.cc:2468] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 2.
I20260709 13:18:00.557322 15300 leader_election.cc:304] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 062e441744914d958b96d5997834918c
I20260709 13:18:00.558526 15517 raft_consensus.cc:2804] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:00.559288 15517 raft_consensus.cc:697] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [term 2 LEADER]: Becoming Leader. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:18:00.561312 15502 raft_consensus.cc:993] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b: : Instructing follower 062e441744914d958b96d5997834918c to start an election
I20260709 13:18:00.562083 15502 raft_consensus.cc:1081] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Signalling peer 062e441744914d958b96d5997834918c to start an election
I20260709 13:18:00.567612 15260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c33cabd9f6f42f79bee253550b16a3b"
dest_uuid: "062e441744914d958b96d5997834918c"
 from {username='slave'} at 127.0.0.1:43718
I20260709 13:18:00.568181 15260 raft_consensus.cc:493] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.568544 15260 raft_consensus.cc:3060] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.560181 15517 consensus_queue.cc:237] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.576201 15260 raft_consensus.cc:515] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.579005 15260 leader_election.cc:290] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 2 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:18:00.581210 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c33cabd9f6f42f79bee253550b16a3b" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:18:00.579909 15080 catalog_manager.cc:5697] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b reported cstate change: term changed from 1 to 2, leader changed from 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1) to baeb6abc07f7498385dccf2decd1928b (127.4.254.3). New cstate: current_term: 2 leader_uuid: "baeb6abc07f7498385dccf2decd1928b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.582617 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c33cabd9f6f42f79bee253550b16a3b" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:18:00.583261 15185 raft_consensus.cc:3060] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.593289 15504 raft_consensus.cc:993] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c: : Instructing follower 1fd4c74e74374908aa2edc5c8018f10f to start an election
I20260709 13:18:00.593999 15504 raft_consensus.cc:1081] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Signalling peer 1fd4c74e74374908aa2edc5c8018f10f to start an election
I20260709 13:18:00.594281 15185 raft_consensus.cc:2468] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 2.
I20260709 13:18:00.595861 15334 raft_consensus.cc:3055] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:00.596238 15334 raft_consensus.cc:740] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:18:00.596716 15184 raft_consensus.cc:1240] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Rejecting Update request from peer baeb6abc07f7498385dccf2decd1928b for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:00.596552 15226 leader_election.cc:304] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:18:00.596971 15334 consensus_queue.cc:260] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.597741 15511 raft_consensus.cc:2804] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:00.598153 15334 raft_consensus.cc:3060] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.598271 15511 raft_consensus.cc:697] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 2 LEADER]: Becoming Leader. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:18:00.599939 15511 consensus_queue.cc:237] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.602300 15517 consensus_queue.cc:1048] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.606756 15185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b90294f6ecb443e68c687960383c05a9"
dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
 from {username='slave'} at 127.0.0.1:50744
I20260709 13:18:00.607427 15185 raft_consensus.cc:493] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.607890 15185 raft_consensus.cc:3060] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.612149 15552 consensus_queue.cc:1048] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:00.611773 15081 catalog_manager.cc:5697] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c reported cstate change: term changed from 1 to 2, leader changed from baeb6abc07f7498385dccf2decd1928b (127.4.254.3) to 062e441744914d958b96d5997834918c (127.4.254.2). New cstate: current_term: 2 leader_uuid: "062e441744914d958b96d5997834918c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.614871 15334 raft_consensus.cc:2468] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 2.
I20260709 13:18:00.622843 15185 raft_consensus.cc:515] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.624975 15185 leader_election.cc:290] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 2 election: Requested vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:18:00.626396 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90294f6ecb443e68c687960383c05a9" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:18:00.626721 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90294f6ecb443e68c687960383c05a9" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:18:00.627135 15259 raft_consensus.cc:3055] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:00.627310 15334 raft_consensus.cc:3060] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.627499 15259 raft_consensus.cc:740] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:18:00.628523 15553 raft_consensus.cc:993] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b: : Instructing follower 1fd4c74e74374908aa2edc5c8018f10f to start an election
I20260709 13:18:00.628422 15259 consensus_queue.cc:260] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.628990 15553 raft_consensus.cc:1081] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Signalling peer 1fd4c74e74374908aa2edc5c8018f10f to start an election
I20260709 13:18:00.629839 15259 raft_consensus.cc:3060] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.633837 15517 raft_consensus.cc:993] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b: : Instructing follower 062e441744914d958b96d5997834918c to start an election
I20260709 13:18:00.636255 15553 raft_consensus.cc:1081] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Signalling peer 062e441744914d958b96d5997834918c to start an election
I20260709 13:18:00.637434 15259 raft_consensus.cc:2468] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 2.
I20260709 13:18:00.635476 15334 raft_consensus.cc:2468] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 2.
I20260709 13:18:00.638676 15151 leader_election.cc:304] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:18:00.639701 15523 raft_consensus.cc:2804] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:00.639753 15185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "add5829a1d3f49989ea39fc5a9351fb5"
dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
 from {username='slave'} at 127.0.0.1:50736
I20260709 13:18:00.640266 15523 raft_consensus.cc:697] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Becoming Leader. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:18:00.640434 15185 raft_consensus.cc:493] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.640877 15185 raft_consensus.cc:3060] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.640689 15517 consensus_queue.cc:1048] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.641168 15523 consensus_queue.cc:237] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.639797 15260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81aba0603d3548acb69df47319ee1e77"
dest_uuid: "062e441744914d958b96d5997834918c"
 from {username='slave'} at 127.0.0.1:43718
I20260709 13:18:00.643925 15260 raft_consensus.cc:493] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.644330 15260 raft_consensus.cc:3060] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.648273 15185 raft_consensus.cc:515] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.651713 15260 raft_consensus.cc:515] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.653973 15260 leader_election.cc:290] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 2 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:18:00.655643 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add5829a1d3f49989ea39fc5a9351fb5" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:18:00.656004 15334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add5829a1d3f49989ea39fc5a9351fb5" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:18:00.656518 15260 raft_consensus.cc:3060] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.656621 15334 raft_consensus.cc:3055] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:00.656991 15334 raft_consensus.cc:740] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:18:00.657732 15334 consensus_queue.cc:260] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.658068 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81aba0603d3548acb69df47319ee1e77" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:18:00.658658 15184 raft_consensus.cc:3060] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.658736 15334 raft_consensus.cc:3060] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.661501 15333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81aba0603d3548acb69df47319ee1e77" candidate_uuid: "062e441744914d958b96d5997834918c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:18:00.662266 15333 raft_consensus.cc:3055] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:00.662611 15333 raft_consensus.cc:740] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:18:00.663403 15333 consensus_queue.cc:260] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.662276 15080 catalog_manager.cc:5697] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f reported cstate change: term changed from 1 to 2, leader changed from 062e441744914d958b96d5997834918c (127.4.254.2) to 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1). New cstate: current_term: 2 leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.663808 15260 raft_consensus.cc:2468] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 2.
I20260709 13:18:00.664849 15333 raft_consensus.cc:3060] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.665261 15151 leader_election.cc:304] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:18:00.666178 15523 raft_consensus.cc:2804] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:00.664012 15184 raft_consensus.cc:2468] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 2.
I20260709 13:18:00.666808 15523 raft_consensus.cc:697] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Becoming Leader. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:18:00.667659 15523 consensus_queue.cc:237] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.668154 15334 raft_consensus.cc:2468] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 2.
I20260709 13:18:00.669476 15226 leader_election.cc:304] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:18:00.666225 15185 leader_election.cc:290] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 2 election: Requested vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:18:00.670401 15511 raft_consensus.cc:2804] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:00.670907 15511 raft_consensus.cc:697] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [term 2 LEADER]: Becoming Leader. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:18:00.671715 15511 consensus_queue.cc:237] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.673629 15333 raft_consensus.cc:2468] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 062e441744914d958b96d5997834918c in term 2.
I20260709 13:18:00.679744 15080 catalog_manager.cc:5697] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c reported cstate change: term changed from 1 to 2, leader changed from baeb6abc07f7498385dccf2decd1928b (127.4.254.3) to 062e441744914d958b96d5997834918c (127.4.254.2). New cstate: current_term: 2 leader_uuid: "062e441744914d958b96d5997834918c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.687038 15083 catalog_manager.cc:5697] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f reported cstate change: term changed from 1 to 2, leader changed from baeb6abc07f7498385dccf2decd1928b (127.4.254.3) to 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1). New cstate: current_term: 2 leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.770870 15554 raft_consensus.cc:993] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b: : Instructing follower 1fd4c74e74374908aa2edc5c8018f10f to start an election
I20260709 13:18:00.771420 15552 raft_consensus.cc:1081] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Signalling peer 1fd4c74e74374908aa2edc5c8018f10f to start an election
I20260709 13:18:00.773101 15185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b060fe440c6d40d6af397b5ee5d80a9b"
dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
 from {username='slave'} at 127.0.0.1:50736
I20260709 13:18:00.773748 15185 raft_consensus.cc:493] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.774129 15185 raft_consensus.cc:3060] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.778981 15185 raft_consensus.cc:515] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.780527 15185 leader_election.cc:290] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 2 election: Requested vote from peers 062e441744914d958b96d5997834918c (127.4.254.2:40299), baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353)
I20260709 13:18:00.781294 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b060fe440c6d40d6af397b5ee5d80a9b" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:18:00.781539 15333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b060fe440c6d40d6af397b5ee5d80a9b" candidate_uuid: "1fd4c74e74374908aa2edc5c8018f10f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
I20260709 13:18:00.781944 15260 raft_consensus.cc:3060] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.782136 15333 raft_consensus.cc:3055] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:00.782516 15333 raft_consensus.cc:740] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:18:00.783216 15333 consensus_queue.cc:260] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.784124 15333 raft_consensus.cc:3060] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.786907 15260 raft_consensus.cc:2468] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 2.
I20260709 13:18:00.788008 15151 leader_election.cc:304] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, 1fd4c74e74374908aa2edc5c8018f10f; no voters: 
I20260709 13:18:00.788697 15523 raft_consensus.cc:2804] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:00.789219 15523 raft_consensus.cc:697] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Becoming Leader. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:18:00.789325 15333 raft_consensus.cc:2468] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd4c74e74374908aa2edc5c8018f10f in term 2.
I20260709 13:18:00.790143 15523 consensus_queue.cc:237] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:00.796531 15083 catalog_manager.cc:5697] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f reported cstate change: term changed from 1 to 2, leader changed from baeb6abc07f7498385dccf2decd1928b (127.4.254.3) to 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1). New cstate: current_term: 2 leader_uuid: "1fd4c74e74374908aa2edc5c8018f10f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.817725 15333 raft_consensus.cc:1275] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Refusing update from remote peer 062e441744914d958b96d5997834918c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:00.818869 15511 consensus_queue.cc:1048] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:00.826524 15185 raft_consensus.cc:1275] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Refusing update from remote peer 062e441744914d958b96d5997834918c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:00.828024 15504 consensus_queue.cc:1048] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:00.846845 15333 raft_consensus.cc:1275] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Refusing update from remote peer 062e441744914d958b96d5997834918c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:00.848019 15504 consensus_queue.cc:1048] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:00.855176 15185 raft_consensus.cc:1275] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Refusing update from remote peer 062e441744914d958b96d5997834918c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:00.857343 15511 consensus_queue.cc:1048] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:00.954089 15185 raft_consensus.cc:1275] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Refusing update from remote peer baeb6abc07f7498385dccf2decd1928b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:00.955284 15554 consensus_queue.cc:1048] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:00.962415 15260 raft_consensus.cc:3060] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.969551 15260 raft_consensus.cc:1275] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Refusing update from remote peer baeb6abc07f7498385dccf2decd1928b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:00.970715 15552 consensus_queue.cc:1048] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:01.071913 15333 raft_consensus.cc:1275] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Refusing update from remote peer 062e441744914d958b96d5997834918c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:01.073186 15511 consensus_queue.cc:1048] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:01.080370 15185 raft_consensus.cc:1275] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Refusing update from remote peer 062e441744914d958b96d5997834918c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:01.081810 15508 consensus_queue.cc:1048] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:01.090610 15185 raft_consensus.cc:1275] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Refusing update from remote peer 062e441744914d958b96d5997834918c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:01.091892 15504 consensus_queue.cc:1048] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:01.100927 15333 raft_consensus.cc:1275] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Refusing update from remote peer 062e441744914d958b96d5997834918c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:01.102346 15504 consensus_queue.cc:1048] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:01.190712 15334 raft_consensus.cc:1275] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Refusing update from remote peer 1fd4c74e74374908aa2edc5c8018f10f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:01.192092 15523 consensus_queue.cc:1048] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:01.194160 15334 raft_consensus.cc:1275] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Refusing update from remote peer 1fd4c74e74374908aa2edc5c8018f10f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:01.195350 15523 consensus_queue.cc:1048] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:01.200790 15260 raft_consensus.cc:1275] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Refusing update from remote peer 1fd4c74e74374908aa2edc5c8018f10f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:01.201113 15259 raft_consensus.cc:1275] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Refusing update from remote peer 1fd4c74e74374908aa2edc5c8018f10f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:01.202986 15560 consensus_queue.cc:1048] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:01.203261 15523 consensus_queue.cc:1048] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:01.227233 15259 raft_consensus.cc:1275] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Refusing update from remote peer 1fd4c74e74374908aa2edc5c8018f10f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:01.229894 15335 raft_consensus.cc:1275] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Refusing update from remote peer 1fd4c74e74374908aa2edc5c8018f10f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:01.229967 15560 consensus_queue.cc:1048] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:01.231794 15545 consensus_queue.cc:1048] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:03.246587 15083 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44240:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:18:03.265400 15083 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44240:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:18:03.300781  5112 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:18:03.566407 15619 tablet.cc:1724] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:03.530328 15151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:40299, user_credentials={real_user=slave}} blocked reactor thread for 103802us
W20260709 13:18:03.582031 15588 log.cc:927] Time spent T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:18:03.583514 15599 log.cc:927] Time spent T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:18:03.585049 15600 log.cc:927] Time spent T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:18:03.586390 15604 log.cc:927] Time spent T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:18:03.685501 15627 tablet.cc:1724] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.628656 15620 tablet.cc:1724] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.696761 15628 tablet.cc:1724] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:03.697891 15625 log.cc:927] Time spent T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:18:03.709925 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c33cabd9f6f42f79bee253550b16a3b"
dest_uuid: "062e441744914d958b96d5997834918c"
mode: GRACEFUL
new_leader_uuid: "baeb6abc07f7498385dccf2decd1928b"
 from {username='slave'} at 127.0.0.1:48116
I20260709 13:18:03.710515 15260 raft_consensus.cc:606] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 2 LEADER]: Received request to transfer leadership to TS baeb6abc07f7498385dccf2decd1928b
I20260709 13:18:03.637722 15626 tablet.cc:1724] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.737025 15629 tablet.cc:1724] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.700815 15634 tablet.cc:1724] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.748044 15636 tablet.cc:1724] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:03.759658 15361 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:41f2b7210bf4463e9a09bf204b605f3d)
I20260709 13:18:03.765511 15640 tablet.cc:1724] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:03.770318 15361 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:41f2b7210bf4463e9a09bf204b605f3d)
W20260709 13:18:03.771672 15361 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:41f2b7210bf4463e9a09bf204b605f3d)
I20260709 13:18:03.760659 15639 tablet.cc:1724] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.795077 15610 raft_consensus.cc:993] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c: : Instructing follower baeb6abc07f7498385dccf2decd1928b to start an election
I20260709 13:18:03.795738 15569 raft_consensus.cc:1081] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 2 LEADER]: Signalling peer baeb6abc07f7498385dccf2decd1928b to start an election
I20260709 13:18:03.797528 15330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c33cabd9f6f42f79bee253550b16a3b"
dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
 from {username='slave'} at 127.0.0.1:53414
I20260709 13:18:03.798026 15330 raft_consensus.cc:493] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:03.798343 15330 raft_consensus.cc:3060] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.807156 15330 raft_consensus.cc:515] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:03.805529 15639 tablet.cc:1724] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.810299 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c33cabd9f6f42f79bee253550b16a3b" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:18:03.810873 15185 raft_consensus.cc:3060] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.812418 15330 leader_election.cc:290] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 3 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:18:03.791641 15619 tablet.cc:1724] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.815505 15627 tablet.cc:1724] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.816790 15258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c33cabd9f6f42f79bee253550b16a3b" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:18:03.817471 15258 raft_consensus.cc:3055] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:03.817792 15258 raft_consensus.cc:740] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:18:03.789209 15620 tablet.cc:1724] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.818630 15258 consensus_queue.cc:260] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:03.819530 15185 raft_consensus.cc:2468] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 3.
I20260709 13:18:03.819825 15258 raft_consensus.cc:3060] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.820917 15300 leader_election.cc:304] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:18:03.821179 15636 tablet.cc:1724] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.821844 15553 raft_consensus.cc:2804] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:03.822980 15553 raft_consensus.cc:697] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 3 LEADER]: Becoming Leader. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:18:03.823401 15641 tablet.cc:1724] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.823832 15553 consensus_queue.cc:237] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:03.836086 15258 raft_consensus.cc:2468] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 3.
I20260709 13:18:03.838967 15628 tablet.cc:1724] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.822625 15629 tablet.cc:1724] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.850287 15640 tablet.cc:1724] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:03.853528 15226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:40867, user_credentials={real_user=slave}} blocked reactor thread for 218972us
I20260709 13:18:03.862531 15186 raft_consensus.cc:1240] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 3 FOLLOWER]: Rejecting Update request from peer 062e441744914d958b96d5997834918c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:03.869417 15639 tablet.cc:1724] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.870288 15620 tablet.cc:1724] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.870771 15082 catalog_manager.cc:5697] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b reported cstate change: term changed from 2 to 3, leader changed from 062e441744914d958b96d5997834918c (127.4.254.2) to baeb6abc07f7498385dccf2decd1928b (127.4.254.3). New cstate: current_term: 3 leader_uuid: "baeb6abc07f7498385dccf2decd1928b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.872256 15082 catalog_manager.cc:5789] TS baeb6abc07f7498385dccf2decd1928b (127.4.254.3:33353) does not have the latest schema for tablet 5c33cabd9f6f42f79bee253550b16a3b (table soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]). Expected version 1 got 0
I20260709 13:18:03.886128 15626 tablet.cc:1724] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.887408 15636 tablet.cc:1724] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.890123 15642 tablet.cc:1724] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.876628 15641 tablet.cc:1724] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.894462 15640 tablet.cc:1724] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:03.917223 15185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "add5829a1d3f49989ea39fc5a9351fb5"
dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
mode: GRACEFUL
new_leader_uuid: "baeb6abc07f7498385dccf2decd1928b"
 from {username='slave'} at 127.0.0.1:52826
I20260709 13:18:03.918043 15185 raft_consensus.cc:606] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Received request to transfer leadership to TS baeb6abc07f7498385dccf2decd1928b
I20260709 13:18:03.919404  5112 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:18:03.920085  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:03.938040 15259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "677f11d6789c4eebb979c2317020c2f9"
dest_uuid: "062e441744914d958b96d5997834918c"
mode: GRACEFUL
new_leader_uuid: "baeb6abc07f7498385dccf2decd1928b"
 from {username='slave'} at 127.0.0.1:48116
I20260709 13:18:03.938594 15259 raft_consensus.cc:606] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Received request to transfer leadership to TS baeb6abc07f7498385dccf2decd1928b
I20260709 13:18:03.941067 15185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f309a73c989c4680818138b4123f20b8"
dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
mode: GRACEFUL
new_leader_uuid: "baeb6abc07f7498385dccf2decd1928b"
 from {username='slave'} at 127.0.0.1:52826
I20260709 13:18:03.941648 15185 raft_consensus.cc:606] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Received request to transfer leadership to TS baeb6abc07f7498385dccf2decd1928b
I20260709 13:18:03.942895  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:03.943544  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:03.960474 15080 catalog_manager.cc:6242] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d: soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5] alter complete (version 1)
I20260709 13:18:03.993692 15607 raft_consensus.cc:993] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f: : Instructing follower baeb6abc07f7498385dccf2decd1928b to start an election
I20260709 13:18:03.994444 15611 raft_consensus.cc:1081] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Signalling peer baeb6abc07f7498385dccf2decd1928b to start an election
I20260709 13:18:03.996140 15330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f309a73c989c4680818138b4123f20b8"
dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
 from {username='slave'} at 127.0.0.1:53408
I20260709 13:18:03.996729 15330 raft_consensus.cc:493] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:03.997157 15330 raft_consensus.cc:3060] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.003638 15330 raft_consensus.cc:515] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:04.005694 15330 leader_election.cc:290] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 3 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:18:04.006220 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f309a73c989c4680818138b4123f20b8" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:18:04.006678 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f309a73c989c4680818138b4123f20b8" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:18:04.006899 15185 raft_consensus.cc:3055] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:04.007261 15185 raft_consensus.cc:740] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:18:04.007296 15259 raft_consensus.cc:3060] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.008100 15185 consensus_queue.cc:260] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:04.009339 15185 raft_consensus.cc:3060] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.014696 15259 raft_consensus.cc:2468] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 3.
I20260709 13:18:04.016132 15300 leader_election.cc:304] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:18:04.016136 15185 raft_consensus.cc:2468] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 3.
I20260709 13:18:04.017046 15623 raft_consensus.cc:2804] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:04.017870 15623 raft_consensus.cc:697] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 3 LEADER]: Becoming Leader. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:18:04.018808 15623 consensus_queue.cc:237] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:04.028280 15082 catalog_manager.cc:5697] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b reported cstate change: term changed from 2 to 3, leader changed from 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1) to baeb6abc07f7498385dccf2decd1928b (127.4.254.3). New cstate: current_term: 3 leader_uuid: "baeb6abc07f7498385dccf2decd1928b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:04.176726 15611 raft_consensus.cc:993] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f: : Instructing follower baeb6abc07f7498385dccf2decd1928b to start an election
I20260709 13:18:04.177294 15607 raft_consensus.cc:1081] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Signalling peer baeb6abc07f7498385dccf2decd1928b to start an election
I20260709 13:18:04.178754 15330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "add5829a1d3f49989ea39fc5a9351fb5"
dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
 from {username='slave'} at 127.0.0.1:53408
I20260709 13:18:04.179356 15330 raft_consensus.cc:493] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:04.179661 15330 raft_consensus.cc:3060] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.185042 15330 raft_consensus.cc:515] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:04.186980 15330 leader_election.cc:290] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 3 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:18:04.188485 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add5829a1d3f49989ea39fc5a9351fb5" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:18:04.188995 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add5829a1d3f49989ea39fc5a9351fb5" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:18:04.189270 15259 raft_consensus.cc:3060] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.189663 15185 raft_consensus.cc:3055] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:04.189996 15185 raft_consensus.cc:740] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1fd4c74e74374908aa2edc5c8018f10f, State: Running, Role: LEADER
I20260709 13:18:04.190706 15185 consensus_queue.cc:260] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:04.191732 15185 raft_consensus.cc:3060] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.195555 15259 raft_consensus.cc:2468] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 3.
I20260709 13:18:04.196564 15300 leader_election.cc:304] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 062e441744914d958b96d5997834918c, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:18:04.196712 15185 raft_consensus.cc:2468] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 3.
I20260709 13:18:04.198112 15623 raft_consensus.cc:2804] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:04.198609 15623 raft_consensus.cc:697] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 3 LEADER]: Becoming Leader. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:18:04.199522 15623 consensus_queue.cc:237] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:04.204035 15185 raft_consensus.cc:1275] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 3 FOLLOWER]: Refusing update from remote peer baeb6abc07f7498385dccf2decd1928b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:04.205463 15623 consensus_queue.cc:1048] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:04.206815 15082 catalog_manager.cc:5697] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b reported cstate change: term changed from 2 to 3, leader changed from 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1) to baeb6abc07f7498385dccf2decd1928b (127.4.254.3). New cstate: current_term: 3 leader_uuid: "baeb6abc07f7498385dccf2decd1928b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:04.208761 15642 tablet.cc:1724] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:04.216169 15080 catalog_manager.cc:5789] TS 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867) does not have the latest schema for tablet 5c33cabd9f6f42f79bee253550b16a3b (table soft_deleted_table [id=f4e57853ff874bda8eb57739b31143c5]). Expected version 1 got 0
I20260709 13:18:04.221591 15259 raft_consensus.cc:1275] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 3 FOLLOWER]: Refusing update from remote peer baeb6abc07f7498385dccf2decd1928b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:04.223295 15650 consensus_queue.cc:1048] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:04.251153 15630 raft_consensus.cc:993] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c: : Instructing follower baeb6abc07f7498385dccf2decd1928b to start an election
I20260709 13:18:04.251675 15630 raft_consensus.cc:1081] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Signalling peer baeb6abc07f7498385dccf2decd1928b to start an election
I20260709 13:18:04.253096 15330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "677f11d6789c4eebb979c2317020c2f9"
dest_uuid: "baeb6abc07f7498385dccf2decd1928b"
 from {username='slave'} at 127.0.0.1:53414
I20260709 13:18:04.253630 15330 raft_consensus.cc:493] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:04.253938 15330 raft_consensus.cc:3060] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.259420 15330 raft_consensus.cc:515] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:04.261236 15330 leader_election.cc:290] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 2 election: Requested vote from peers 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867), 062e441744914d958b96d5997834918c (127.4.254.2:40299)
I20260709 13:18:04.261893 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677f11d6789c4eebb979c2317020c2f9" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fd4c74e74374908aa2edc5c8018f10f"
I20260709 13:18:04.262164 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677f11d6789c4eebb979c2317020c2f9" candidate_uuid: "baeb6abc07f7498385dccf2decd1928b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "062e441744914d958b96d5997834918c"
I20260709 13:18:04.262526 15185 raft_consensus.cc:3060] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.262809 15259 raft_consensus.cc:3055] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:04.263159 15259 raft_consensus.cc:740] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 062e441744914d958b96d5997834918c, State: Running, Role: LEADER
I20260709 13:18:04.263834 15259 consensus_queue.cc:260] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:04.264762 15259 raft_consensus.cc:3060] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.267269 15185 raft_consensus.cc:2468] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 2.
I20260709 13:18:04.268383 15300 leader_election.cc:304] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd4c74e74374908aa2edc5c8018f10f, baeb6abc07f7498385dccf2decd1928b; no voters: 
I20260709 13:18:04.269016 15623 raft_consensus.cc:2804] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:04.269519 15623 raft_consensus.cc:697] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 2 LEADER]: Becoming Leader. State: Replica: baeb6abc07f7498385dccf2decd1928b, State: Running, Role: LEADER
I20260709 13:18:04.269795 15259 raft_consensus.cc:2468] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baeb6abc07f7498385dccf2decd1928b in term 2.
I20260709 13:18:04.270366 15623 consensus_queue.cc:237] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } }
I20260709 13:18:04.277868 15083 catalog_manager.cc:5697] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b reported cstate change: term changed from 1 to 2, leader changed from 062e441744914d958b96d5997834918c (127.4.254.2) to baeb6abc07f7498385dccf2decd1928b (127.4.254.3). New cstate: current_term: 2 leader_uuid: "baeb6abc07f7498385dccf2decd1928b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baeb6abc07f7498385dccf2decd1928b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 33353 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:04.487290 15185 raft_consensus.cc:1275] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 3 FOLLOWER]: Refusing update from remote peer baeb6abc07f7498385dccf2decd1928b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:04.488476 15623 consensus_queue.cc:1048] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:04.496757 15259 raft_consensus.cc:1275] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 3 FOLLOWER]: Refusing update from remote peer baeb6abc07f7498385dccf2decd1928b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:04.499368 15623 consensus_queue.cc:1048] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:04.599462 15185 raft_consensus.cc:1275] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 3 FOLLOWER]: Refusing update from remote peer baeb6abc07f7498385dccf2decd1928b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:04.600736 15623 consensus_queue.cc:1048] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:04.609675 15259 raft_consensus.cc:1275] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [term 3 FOLLOWER]: Refusing update from remote peer baeb6abc07f7498385dccf2decd1928b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:04.611158 15553 consensus_queue.cc:1048] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:04.766288 15184 raft_consensus.cc:1275] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Refusing update from remote peer baeb6abc07f7498385dccf2decd1928b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:04.767611 15553 consensus_queue.cc:1048] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fd4c74e74374908aa2edc5c8018f10f" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 40867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:04.772156 15259 raft_consensus.cc:1275] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Refusing update from remote peer baeb6abc07f7498385dccf2decd1928b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:04.773711 15623 consensus_queue.cc:1048] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [LEADER]: Connected to new peer: Peer: permanent_uuid: "062e441744914d958b96d5997834918c" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 40299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:04.998414  5112 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:18:05.003738  5112 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:18:05.004297  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:05.009972  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:18:05.010452  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:06.045718  5112 tablet_server.cc:179] TabletServer@127.4.254.1:0 shutting down...
I20260709 13:18:06.081743  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:06.082530  5112 tablet_replica.cc:333] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.083890  5112 raft_consensus.cc:2243] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.085052  5112 raft_consensus.cc:2272] T 81aba0603d3548acb69df47319ee1e77 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:06.086515 15226 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 13:18:06.088855  5112 tablet_replica.cc:333] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.089838  5112 raft_consensus.cc:2243] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:18:06.090138 15226 consensus_peers.cc:597] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c -> Peer 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867): Couldn't send request to peer 1fd4c74e74374908aa2edc5c8018f10f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.090940  5112 raft_consensus.cc:2272] T b060fe440c6d40d6af397b5ee5d80a9b P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.093717  5112 tablet_replica.cc:333] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.094504  5112 raft_consensus.cc:2243] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.095147  5112 raft_consensus.cc:2272] T 644f4c907c6f474599fd53f58455fed8 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.097641  5112 tablet_replica.cc:333] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.098277  5112 raft_consensus.cc:2243] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.099021  5112 raft_consensus.cc:2272] T 5c33cabd9f6f42f79bee253550b16a3b P 1fd4c74e74374908aa2edc5c8018f10f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.101681  5112 tablet_replica.cc:333] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.102276  5112 raft_consensus.cc:2243] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.103243  5112 raft_consensus.cc:2272] T b90294f6ecb443e68c687960383c05a9 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.105997  5112 tablet_replica.cc:333] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.106603  5112 raft_consensus.cc:2243] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.107373  5112 raft_consensus.cc:2272] T 41f2b7210bf4463e9a09bf204b605f3d P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.109872  5112 tablet_replica.cc:333] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.110579  5112 raft_consensus.cc:2243] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.111241  5112 raft_consensus.cc:2272] T 0e822f21107447809798687a0809d453 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.113866  5112 tablet_replica.cc:333] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.114599  5112 raft_consensus.cc:2243] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.115162  5112 raft_consensus.cc:2272] T ad5613f84b76474595b674381322b7ec P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.117650  5112 tablet_replica.cc:333] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.118321  5112 raft_consensus.cc:2243] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.118831  5112 raft_consensus.cc:2272] T f309a73c989c4680818138b4123f20b8 P 1fd4c74e74374908aa2edc5c8018f10f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.121448  5112 tablet_replica.cc:333] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.122023  5112 raft_consensus.cc:2243] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.123152  5112 raft_consensus.cc:2272] T f70b51915b674bfab25f870c86763d99 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.125651  5112 tablet_replica.cc:333] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.126204  5112 raft_consensus.cc:2243] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.127189  5112 raft_consensus.cc:2272] T cc034139d9f84e45b10044668ae1e166 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.129824  5112 tablet_replica.cc:333] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.130592  5112 raft_consensus.cc:2243] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.131381  5112 raft_consensus.cc:2272] T add5829a1d3f49989ea39fc5a9351fb5 P 1fd4c74e74374908aa2edc5c8018f10f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.135390  5112 tablet_replica.cc:333] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.136175  5112 raft_consensus.cc:2243] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.136631  5112 raft_consensus.cc:2272] T 48c202ad14c14018ac507f94aa274b24 P 1fd4c74e74374908aa2edc5c8018f10f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.139578  5112 tablet_replica.cc:333] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.140312  5112 raft_consensus.cc:2243] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.141677  5112 raft_consensus.cc:2272] T 7c15310a14214103b34cdcc820970801 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:06.142138 15226 consensus_peers.cc:597] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c -> Peer 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867): Couldn't send request to peer 1fd4c74e74374908aa2edc5c8018f10f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.144793  5112 tablet_replica.cc:333] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.145762  5112 raft_consensus.cc:2243] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.146562  5112 raft_consensus.cc:2272] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.149726  5112 tablet_replica.cc:333] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.150326  5112 raft_consensus.cc:2243] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.151005  5112 raft_consensus.cc:2272] T e2362bd32bd649f7b6041b5117ff5b5b P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.153328  5112 tablet_replica.cc:333] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.153761  5112 raft_consensus.cc:2243] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.154237  5112 raft_consensus.cc:2272] T 677f11d6789c4eebb979c2317020c2f9 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.156376  5112 tablet_replica.cc:333] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f: stopping tablet replica
I20260709 13:18:06.156841  5112 raft_consensus.cc:2243] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.157790  5112 raft_consensus.cc:2272] T 022154fd79414d4191640078fb352c39 P 1fd4c74e74374908aa2edc5c8018f10f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:06.180099 15226 consensus_peers.cc:597] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c -> Peer 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867): Couldn't send request to peer 1fd4c74e74374908aa2edc5c8018f10f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.206286  5112 tablet_server.cc:196] TabletServer@127.4.254.1:0 shutdown complete.
W20260709 13:18:06.212020 15300 consensus_peers.cc:597] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b -> Peer 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867): Couldn't send request to peer 1fd4c74e74374908aa2edc5c8018f10f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:40867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:06.226794 15300 consensus_peers.cc:597] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b -> Peer 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867): Couldn't send request to peer 1fd4c74e74374908aa2edc5c8018f10f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:40867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.258914  5112 tablet_server.cc:179] TabletServer@127.4.254.2:0 shutting down...
W20260709 13:18:06.288275 15300 consensus_peers.cc:597] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b -> Peer 062e441744914d958b96d5997834918c (127.4.254.2:40299): Couldn't send request to peer 062e441744914d958b96d5997834918c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.289760  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:06.290669  5112 tablet_replica.cc:333] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.291985  5112 raft_consensus.cc:2243] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.292963  5112 raft_consensus.cc:2272] T 81aba0603d3548acb69df47319ee1e77 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.295410  5112 tablet_replica.cc:333] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.296074  5112 raft_consensus.cc:2243] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.296919  5112 raft_consensus.cc:2272] T 644f4c907c6f474599fd53f58455fed8 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.299199  5112 tablet_replica.cc:333] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.299925  5112 raft_consensus.cc:2243] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.300683  5112 raft_consensus.cc:2272] T cc034139d9f84e45b10044668ae1e166 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.303088  5112 tablet_replica.cc:333] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.303566  5112 raft_consensus.cc:2243] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.304018  5112 raft_consensus.cc:2272] T b060fe440c6d40d6af397b5ee5d80a9b P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.306588  5112 tablet_replica.cc:333] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.307179  5112 raft_consensus.cc:2243] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.307780  5112 raft_consensus.cc:2272] T 5c33cabd9f6f42f79bee253550b16a3b P 062e441744914d958b96d5997834918c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.310454  5112 tablet_replica.cc:333] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.311200  5112 raft_consensus.cc:2243] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.311929  5112 raft_consensus.cc:2272] T 022154fd79414d4191640078fb352c39 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.315008  5112 tablet_replica.cc:333] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c: stopping tablet replica
W20260709 13:18:06.315023 15226 consensus_peers.cc:597] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c -> Peer 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867): Couldn't send request to peer 1fd4c74e74374908aa2edc5c8018f10f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:40867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.315778  5112 raft_consensus.cc:2243] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.316383  5112 raft_consensus.cc:2272] T 41f2b7210bf4463e9a09bf204b605f3d P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.318957  5112 tablet_replica.cc:333] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.319537  5112 raft_consensus.cc:2243] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.320415  5112 raft_consensus.cc:2272] T 0e822f21107447809798687a0809d453 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.322846  5112 tablet_replica.cc:333] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.323361  5112 raft_consensus.cc:2243] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.323845  5112 raft_consensus.cc:2272] T ad5613f84b76474595b674381322b7ec P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.326073  5112 tablet_replica.cc:333] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.326557  5112 raft_consensus.cc:2243] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.327103  5112 raft_consensus.cc:2272] T f70b51915b674bfab25f870c86763d99 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.329684  5112 tablet_replica.cc:333] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.330214  5112 raft_consensus.cc:2243] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.330686  5112 raft_consensus.cc:2272] T 677f11d6789c4eebb979c2317020c2f9 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.332854  5112 tablet_replica.cc:333] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.333428  5112 raft_consensus.cc:2243] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.333992  5112 raft_consensus.cc:2272] T b90294f6ecb443e68c687960383c05a9 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.336197  5112 tablet_replica.cc:333] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.336728  5112 raft_consensus.cc:2243] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.337287  5112 raft_consensus.cc:2272] T f309a73c989c4680818138b4123f20b8 P 062e441744914d958b96d5997834918c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.339471  5112 tablet_replica.cc:333] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.340011  5112 raft_consensus.cc:2243] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.340932  5112 raft_consensus.cc:2272] T e2362bd32bd649f7b6041b5117ff5b5b P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.343133  5112 tablet_replica.cc:333] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.343681  5112 raft_consensus.cc:2243] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.344152  5112 raft_consensus.cc:2272] T add5829a1d3f49989ea39fc5a9351fb5 P 062e441744914d958b96d5997834918c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.346347  5112 tablet_replica.cc:333] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.346879  5112 raft_consensus.cc:2243] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.347765  5112 raft_consensus.cc:2272] T 48c202ad14c14018ac507f94aa274b24 P 062e441744914d958b96d5997834918c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.350276  5112 tablet_replica.cc:333] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.351135  5112 raft_consensus.cc:2243] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.352360  5112 raft_consensus.cc:2272] T 1eca34ea3cb74f17ab5c5b1507b4a85e P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:06.354151 15300 consensus_peers.cc:597] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b -> Peer 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867): Couldn't send request to peer 1fd4c74e74374908aa2edc5c8018f10f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:40867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.355604  5112 tablet_replica.cc:333] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c: stopping tablet replica
I20260709 13:18:06.356350  5112 raft_consensus.cc:2243] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.356947  5112 raft_consensus.cc:2272] T 7c15310a14214103b34cdcc820970801 P 062e441744914d958b96d5997834918c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:06.358937 15300 consensus_peers.cc:597] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b -> Peer 062e441744914d958b96d5997834918c (127.4.254.2:40299): Couldn't send request to peer 062e441744914d958b96d5997834918c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:06.366443 15300 consensus_peers.cc:597] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b -> Peer 062e441744914d958b96d5997834918c (127.4.254.2:40299): Couldn't send request to peer 062e441744914d958b96d5997834918c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.402716  5112 tablet_server.cc:196] TabletServer@127.4.254.2:0 shutdown complete.
I20260709 13:18:06.442337  5112 tablet_server.cc:179] TabletServer@127.4.254.3:0 shutting down...
I20260709 13:18:06.478456  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:06.479332  5112 tablet_replica.cc:333] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.480482  5112 raft_consensus.cc:2243] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.481319  5112 raft_consensus.cc:2272] T 81aba0603d3548acb69df47319ee1e77 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.484216  5112 tablet_replica.cc:333] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
W20260709 13:18:06.484288 15300 consensus_peers.cc:597] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b -> Peer 1fd4c74e74374908aa2edc5c8018f10f (127.4.254.1:40867): Couldn't send request to peer 1fd4c74e74374908aa2edc5c8018f10f. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:40867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.484975  5112 raft_consensus.cc:2243] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.485991  5112 raft_consensus.cc:2272] T 41f2b7210bf4463e9a09bf204b605f3d P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.488183  5112 tablet_replica.cc:333] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.488775  5112 raft_consensus.cc:2243] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.489343  5112 raft_consensus.cc:2272] T 0e822f21107447809798687a0809d453 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.491482  5112 tablet_replica.cc:333] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.492077  5112 raft_consensus.cc:2243] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.492579  5112 raft_consensus.cc:2272] T cc034139d9f84e45b10044668ae1e166 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.494768  5112 tablet_replica.cc:333] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.495333  5112 raft_consensus.cc:2243] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.495784  5112 raft_consensus.cc:2272] T b90294f6ecb443e68c687960383c05a9 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.498001  5112 tablet_replica.cc:333] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.498598  5112 raft_consensus.cc:2243] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.499141  5112 raft_consensus.cc:2272] T 644f4c907c6f474599fd53f58455fed8 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.502019  5112 tablet_replica.cc:333] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.502575  5112 raft_consensus.cc:2243] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.503070  5112 raft_consensus.cc:2272] T b060fe440c6d40d6af397b5ee5d80a9b P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.505331  5112 tablet_replica.cc:333] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.505858  5112 raft_consensus.cc:2243] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.506703  5112 raft_consensus.cc:2272] T ad5613f84b76474595b674381322b7ec P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.508780  5112 tablet_replica.cc:333] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.509339  5112 raft_consensus.cc:2243] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.509800  5112 raft_consensus.cc:2272] T 022154fd79414d4191640078fb352c39 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.512063  5112 tablet_replica.cc:333] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.512867  5112 raft_consensus.cc:2243] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.513407  5112 raft_consensus.cc:2272] T 1eca34ea3cb74f17ab5c5b1507b4a85e P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.515545  5112 tablet_replica.cc:333] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.516101  5112 raft_consensus.cc:2243] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.516601  5112 raft_consensus.cc:2272] T 7c15310a14214103b34cdcc820970801 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.518733  5112 tablet_replica.cc:333] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.519256  5112 raft_consensus.cc:2243] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.519731  5112 raft_consensus.cc:2272] T f70b51915b674bfab25f870c86763d99 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.522085  5112 tablet_replica.cc:333] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.522620  5112 raft_consensus.cc:2243] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.523442  5112 raft_consensus.cc:2272] T 5c33cabd9f6f42f79bee253550b16a3b P baeb6abc07f7498385dccf2decd1928b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.525393  5112 tablet_replica.cc:333] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.525877  5112 raft_consensus.cc:2243] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.526727  5112 raft_consensus.cc:2272] T add5829a1d3f49989ea39fc5a9351fb5 P baeb6abc07f7498385dccf2decd1928b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.528784  5112 tablet_replica.cc:333] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.529364  5112 raft_consensus.cc:2243] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.529814  5112 raft_consensus.cc:2272] T 48c202ad14c14018ac507f94aa274b24 P baeb6abc07f7498385dccf2decd1928b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.531818  5112 tablet_replica.cc:333] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.532289  5112 raft_consensus.cc:2243] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.532750  5112 raft_consensus.cc:2272] T e2362bd32bd649f7b6041b5117ff5b5b P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.534842  5112 tablet_replica.cc:333] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.535313  5112 raft_consensus.cc:2243] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.536223  5112 raft_consensus.cc:2272] T 677f11d6789c4eebb979c2317020c2f9 P baeb6abc07f7498385dccf2decd1928b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.538611  5112 tablet_replica.cc:333] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b: stopping tablet replica
I20260709 13:18:06.539117  5112 raft_consensus.cc:2243] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.539918  5112 raft_consensus.cc:2272] T f309a73c989c4680818138b4123f20b8 P baeb6abc07f7498385dccf2decd1928b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.582037  5112 tablet_server.cc:196] TabletServer@127.4.254.3:0 shutdown complete.
I20260709 13:18:06.620304  5112 master.cc:562] Master@127.4.254.62:38921 shutting down...
I20260709 13:18:06.641387  5112 raft_consensus.cc:2243] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.641974  5112 raft_consensus.cc:2272] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.642249  5112 tablet_replica.cc:333] T 00000000000000000000000000000000 P affeb0047f594f6e9450ad508a104d0d: stopping tablet replica
I20260709 13:18:06.663044  5112 master.cc:584] Master@127.4.254.62:38921 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12623 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:18:06.717445  5112 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.254.62:35311
I20260709 13:18:06.718499  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:06.724256 15668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:06.724262 15669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:06.724831 15671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:06.725729  5112 server_base.cc:1061] running on GCE node
I20260709 13:18:06.726624  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:06.726820  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:06.726977  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603086726944 us; error 0 us; skew 500 ppm
I20260709 13:18:06.727490  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:06.729844  5112 webserver.cc:533] Webserver started at http://127.4.254.62:46119/ using document root <none> and password file <none>
I20260709 13:18:06.730298  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:06.730486  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:06.730755  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:06.731877  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/master-0-root/instance:
uuid: "8fa5044281d3475fa1d17f5bd8ff93d5"
format_stamp: "Formatted at 2026-07-09 13:18:06 on dist-test-slave-k73n"
I20260709 13:18:06.736239  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:18:06.739439 15676 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:06.740147  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:18:06.740427  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/master-0-root
uuid: "8fa5044281d3475fa1d17f5bd8ff93d5"
format_stamp: "Formatted at 2026-07-09 13:18:06 on dist-test-slave-k73n"
I20260709 13:18:06.740710  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:06.754604  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:06.755789  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:06.793280  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.62:35311
I20260709 13:18:06.793344 15727 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.62:35311 every 8 connection(s)
I20260709 13:18:06.797040 15728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.808525 15728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5: Bootstrap starting.
I20260709 13:18:06.813503 15728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.817772 15728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5: No bootstrap required, opened a new log
I20260709 13:18:06.819976 15728 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa5044281d3475fa1d17f5bd8ff93d5" member_type: VOTER }
I20260709 13:18:06.820389 15728 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.820585 15728 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa5044281d3475fa1d17f5bd8ff93d5, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.821055 15728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa5044281d3475fa1d17f5bd8ff93d5" member_type: VOTER }
I20260709 13:18:06.821498 15728 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:06.821694 15728 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:06.821909 15728 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.826496 15728 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa5044281d3475fa1d17f5bd8ff93d5" member_type: VOTER }
I20260709 13:18:06.826980 15728 leader_election.cc:304] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fa5044281d3475fa1d17f5bd8ff93d5; no voters: 
I20260709 13:18:06.828116 15728 leader_election.cc:290] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:06.828514 15731 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:06.829922 15731 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa5044281d3475fa1d17f5bd8ff93d5, State: Running, Role: LEADER
I20260709 13:18:06.830664 15731 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa5044281d3475fa1d17f5bd8ff93d5" member_type: VOTER }
I20260709 13:18:06.831131 15728 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:06.835798 15733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fa5044281d3475fa1d17f5bd8ff93d5. Latest consensus state: current_term: 1 leader_uuid: "8fa5044281d3475fa1d17f5bd8ff93d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa5044281d3475fa1d17f5bd8ff93d5" member_type: VOTER } }
I20260709 13:18:06.836642 15732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8fa5044281d3475fa1d17f5bd8ff93d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa5044281d3475fa1d17f5bd8ff93d5" member_type: VOTER } }
I20260709 13:18:06.836722 15733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:06.837288 15732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:06.839102 15738 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:06.847023 15738 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:06.848007  5112 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:06.856184 15738 catalog_manager.cc:1383] Generated new cluster ID: 0c56bd95203541339815e44a6f04db40
I20260709 13:18:06.856448 15738 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:06.879642 15738 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:06.881070 15738 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:06.895066 15738 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5: Generated new TSK 0
I20260709 13:18:06.895650 15738 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:06.914492  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:06.920656 15749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:06.921995 15750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:06.924026 15752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:06.924054  5112 server_base.cc:1061] running on GCE node
I20260709 13:18:06.925307  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:06.925489  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:06.925614  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603086925603 us; error 0 us; skew 500 ppm
I20260709 13:18:06.926048  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:06.928174  5112 webserver.cc:533] Webserver started at http://127.4.254.1:36221/ using document root <none> and password file <none>
I20260709 13:18:06.928583  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:06.928731  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:06.928929  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:06.930048  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-0-root/instance:
uuid: "d2125841728845849d019dcf41500f09"
format_stamp: "Formatted at 2026-07-09 13:18:06 on dist-test-slave-k73n"
I20260709 13:18:06.934403  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:18:06.937469 15757 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:06.938218  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:18:06.938462  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-0-root
uuid: "d2125841728845849d019dcf41500f09"
format_stamp: "Formatted at 2026-07-09 13:18:06 on dist-test-slave-k73n"
I20260709 13:18:06.938685  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:06.953691  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:06.954849  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:06.956176  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:06.958359  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:06.958566  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:06.958833  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:06.959022  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:06.997884  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.1:38511
I20260709 13:18:06.997984 15819 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.1:38511 every 8 connection(s)
I20260709 13:18:07.003010  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:07.010932 15825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:07.012169 15824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:07.015892 15827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:07.016095  5112 server_base.cc:1061] running on GCE node
I20260709 13:18:07.016701 15820 heartbeater.cc:344] Connected to a master server at 127.4.254.62:35311
I20260709 13:18:07.017086 15820 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:07.017709  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:07.017932  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:07.017853 15820 heartbeater.cc:507] Master 127.4.254.62:35311 requested a full tablet report, sending...
I20260709 13:18:07.018386  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603087018360 us; error 0 us; skew 500 ppm
I20260709 13:18:07.019085  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:07.020486 15693 ts_manager.cc:194] Registered new tserver with Master: d2125841728845849d019dcf41500f09 (127.4.254.1:38511)
I20260709 13:18:07.021721  5112 webserver.cc:533] Webserver started at http://127.4.254.2:41361/ using document root <none> and password file <none>
I20260709 13:18:07.022248  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:07.022437  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:07.022714  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:07.022701 15693 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57992
I20260709 13:18:07.024329  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-1-root/instance:
uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
format_stamp: "Formatted at 2026-07-09 13:18:07 on dist-test-slave-k73n"
I20260709 13:18:07.028720  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:18:07.031972 15832 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:07.032727  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:18:07.033043  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-1-root
uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
format_stamp: "Formatted at 2026-07-09 13:18:07 on dist-test-slave-k73n"
I20260709 13:18:07.033380  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:07.065660  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:07.066929  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:07.068421  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:07.070762  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:07.070988  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:07.071233  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:07.071406  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:07.110227  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.2:33099
I20260709 13:18:07.110330 15894 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.2:33099 every 8 connection(s)
I20260709 13:18:07.114995  5112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:07.122354 15898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:07.124353 15899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:07.125876 15901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:07.126801  5112 server_base.cc:1061] running on GCE node
I20260709 13:18:07.127758  5112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:07.128046  5112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:07.128258  5112 hybrid_clock.cc:648] HybridClock initialized: now 1783603087128241 us; error 0 us; skew 500 ppm
I20260709 13:18:07.128583 15895 heartbeater.cc:344] Connected to a master server at 127.4.254.62:35311
I20260709 13:18:07.129007  5112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:07.129032 15895 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:07.130260 15895 heartbeater.cc:507] Master 127.4.254.62:35311 requested a full tablet report, sending...
I20260709 13:18:07.132207  5112 webserver.cc:533] Webserver started at http://127.4.254.3:44431/ using document root <none> and password file <none>
I20260709 13:18:07.132608 15693 ts_manager.cc:194] Registered new tserver with Master: 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:07.132893  5112 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:07.133205  5112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:07.133508  5112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:07.134567 15693 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58006
I20260709 13:18:07.135241  5112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-2-root/instance:
uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
format_stamp: "Formatted at 2026-07-09 13:18:07 on dist-test-slave-k73n"
I20260709 13:18:07.140232  5112 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:18:07.143771 15906 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:07.144487  5112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:18:07.144793  5112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-2-root
uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
format_stamp: "Formatted at 2026-07-09 13:18:07 on dist-test-slave-k73n"
I20260709 13:18:07.145080  5112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqTyovK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602796139571-5112-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:07.158751  5112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:07.159917  5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:07.161365  5112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:07.163463  5112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:07.163697  5112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:07.163935  5112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:07.164109  5112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:07.203730  5112 rpc_server.cc:307] RPC server started. Bound to: 127.4.254.3:43907
I20260709 13:18:07.203830 15968 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.254.3:43907 every 8 connection(s)
I20260709 13:18:07.217955 15969 heartbeater.cc:344] Connected to a master server at 127.4.254.62:35311
I20260709 13:18:07.218423 15969 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:07.219198 15969 heartbeater.cc:507] Master 127.4.254.62:35311 requested a full tablet report, sending...
I20260709 13:18:07.221218 15693 ts_manager.cc:194] Registered new tserver with Master: b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:07.221571  5112 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014591178s
I20260709 13:18:07.222643 15693 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58010
I20260709 13:18:07.247895 15693 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58024:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:07.250658 15693 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:07.320945 15785 tablet_service.cc:1511] Processing CreateTablet for tablet 7621f8dc45a74b1692dea1d9ab45abfa (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:07.322966 15785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7621f8dc45a74b1692dea1d9ab45abfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.325465 15784 tablet_service.cc:1511] Processing CreateTablet for tablet 726f9d99397d4d7ca425ce99b0de38e5 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:07.327316 15784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 726f9d99397d4d7ca425ce99b0de38e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.347838 15860 tablet_service.cc:1511] Processing CreateTablet for tablet 7621f8dc45a74b1692dea1d9ab45abfa (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:07.349570 15860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7621f8dc45a74b1692dea1d9ab45abfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.350894 15859 tablet_service.cc:1511] Processing CreateTablet for tablet 726f9d99397d4d7ca425ce99b0de38e5 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:07.351402 15984 tablet_bootstrap.cc:492] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:07.352386 15859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 726f9d99397d4d7ca425ce99b0de38e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.354907 15783 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba8da1cbcf840f5a523e4482cda8ae8 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:07.356386 15783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba8da1cbcf840f5a523e4482cda8ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.360896 15934 tablet_service.cc:1511] Processing CreateTablet for tablet 7621f8dc45a74b1692dea1d9ab45abfa (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:07.362551 15934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7621f8dc45a74b1692dea1d9ab45abfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.365650 15858 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba8da1cbcf840f5a523e4482cda8ae8 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:07.367043 15858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba8da1cbcf840f5a523e4482cda8ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.367964 15933 tablet_service.cc:1511] Processing CreateTablet for tablet 726f9d99397d4d7ca425ce99b0de38e5 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:07.369180 15984 tablet_bootstrap.cc:654] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.369719 15933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 726f9d99397d4d7ca425ce99b0de38e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.370393 15857 tablet_service.cc:1511] Processing CreateTablet for tablet 61bd2943bcf541a5b79d0456bbea0683 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:07.371727 15857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61bd2943bcf541a5b79d0456bbea0683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.373538 15932 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba8da1cbcf840f5a523e4482cda8ae8 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:07.375775 15932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba8da1cbcf840f5a523e4482cda8ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.394588 15784 tablet_service.cc:1511] Processing CreateTablet for tablet 61bd2943bcf541a5b79d0456bbea0683 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:07.396435 15931 tablet_service.cc:1511] Processing CreateTablet for tablet 61bd2943bcf541a5b79d0456bbea0683 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:07.406353 15931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61bd2943bcf541a5b79d0456bbea0683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.407101 15984 tablet_bootstrap.cc:492] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:07.407680 15984 ts_tablet_manager.cc:1403] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.006s
I20260709 13:18:07.398262 15785 tablet_service.cc:1511] Processing CreateTablet for tablet 8bdfdebfb9124e8191cf7c8f952ef4ea (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:07.410310 15785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bdfdebfb9124e8191cf7c8f952ef4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.410845 15984 raft_consensus.cc:359] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:07.411602 15984 raft_consensus.cc:385] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.411863 15984 raft_consensus.cc:740] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.415053 15856 tablet_service.cc:1511] Processing CreateTablet for tablet 8bdfdebfb9124e8191cf7c8f952ef4ea (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:07.416698 15930 tablet_service.cc:1511] Processing CreateTablet for tablet 8bdfdebfb9124e8191cf7c8f952ef4ea (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:07.418187 15930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bdfdebfb9124e8191cf7c8f952ef4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.420385 15782 tablet_service.cc:1511] Processing CreateTablet for tablet b76dbdecebd545e89831e7ffff29e8b3 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:07.420718 15855 tablet_service.cc:1511] Processing CreateTablet for tablet b76dbdecebd545e89831e7ffff29e8b3 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:07.421825 15782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76dbdecebd545e89831e7ffff29e8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.422673 15984 consensus_queue.cc:260] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:07.416944 15856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bdfdebfb9124e8191cf7c8f952ef4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.429595 15855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76dbdecebd545e89831e7ffff29e8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.432811 15929 tablet_service.cc:1511] Processing CreateTablet for tablet b76dbdecebd545e89831e7ffff29e8b3 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:07.434329 15929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76dbdecebd545e89831e7ffff29e8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.436529 15857 tablet_service.cc:1511] Processing CreateTablet for tablet 6f076fbe245547a68263c6793250c813 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:07.438320 15857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f076fbe245547a68263c6793250c813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.436426 15781 tablet_service.cc:1511] Processing CreateTablet for tablet 6f076fbe245547a68263c6793250c813 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:07.441757 15781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f076fbe245547a68263c6793250c813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.443863 15928 tablet_service.cc:1511] Processing CreateTablet for tablet 6f076fbe245547a68263c6793250c813 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:07.446369 15780 tablet_service.cc:1511] Processing CreateTablet for tablet d77018beecd941398c8e0bcc7c8a92fa (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:07.450263 15858 tablet_service.cc:1511] Processing CreateTablet for tablet d77018beecd941398c8e0bcc7c8a92fa (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:07.451417 15780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77018beecd941398c8e0bcc7c8a92fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.451678 15858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77018beecd941398c8e0bcc7c8a92fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.453614 15784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61bd2943bcf541a5b79d0456bbea0683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.457262 15928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f076fbe245547a68263c6793250c813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.462527 15927 tablet_service.cc:1511] Processing CreateTablet for tablet d77018beecd941398c8e0bcc7c8a92fa (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:07.464330 15927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77018beecd941398c8e0bcc7c8a92fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.476758 15779 tablet_service.cc:1511] Processing CreateTablet for tablet 968f5a4c174c4e0baf9c60b1f7e69880 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:07.478564 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968f5a4c174c4e0baf9c60b1f7e69880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.494303 15820 heartbeater.cc:499] Master 127.4.254.62:35311 was elected leader, sending a full tablet report...
I20260709 13:18:07.503465 15854 tablet_service.cc:1511] Processing CreateTablet for tablet 968f5a4c174c4e0baf9c60b1f7e69880 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:07.504887 15854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968f5a4c174c4e0baf9c60b1f7e69880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.504801 15926 tablet_service.cc:1511] Processing CreateTablet for tablet 968f5a4c174c4e0baf9c60b1f7e69880 (DEFAULT_TABLE table=test-workload [id=ddb40bcc375142b8962ae98d3430796e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:07.506254 15926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968f5a4c174c4e0baf9c60b1f7e69880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.560065 15985 tablet_bootstrap.cc:492] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:07.562292 15984 ts_tablet_manager.cc:1434] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.154s	user 0.008s	sys 0.004s
I20260709 13:18:07.566666 15984 tablet_bootstrap.cc:492] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:07.614814 15984 tablet_bootstrap.cc:654] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.616616 15987 raft_consensus.cc:493] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.617336 15987 raft_consensus.cc:515] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:07.631013 15987 leader_election.cc:290] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:07.616662 15985 tablet_bootstrap.cc:654] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.658054 15988 tablet_bootstrap.cc:492] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:07.660105 15984 tablet_bootstrap.cc:492] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:07.660735 15984 ts_tablet_manager.cc:1403] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.094s	user 0.024s	sys 0.026s
I20260709 13:18:07.663887 15984 raft_consensus.cc:359] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.664626 15984 raft_consensus.cc:385] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.664928 15984 raft_consensus.cc:740] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.665756 15984 consensus_queue.cc:260] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.667941 15984 ts_tablet_manager.cc:1434] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:18:07.670297 15984 tablet_bootstrap.cc:492] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:07.671432 15985 tablet_bootstrap.cc:492] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:07.672277 15985 ts_tablet_manager.cc:1403] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.113s	user 0.005s	sys 0.013s
I20260709 13:18:07.675696 15985 raft_consensus.cc:359] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.676498 15985 raft_consensus.cc:385] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.676863 15985 raft_consensus.cc:740] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.676975 15984 tablet_bootstrap.cc:654] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.678355 15985 consensus_queue.cc:260] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.681558 15895 heartbeater.cc:499] Master 127.4.254.62:35311 was elected leader, sending a full tablet report...
I20260709 13:18:07.677464 15988 tablet_bootstrap.cc:654] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.690210 15984 tablet_bootstrap.cc:492] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:07.690819 15984 ts_tablet_manager.cc:1403] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 13:18:07.692386 15985 ts_tablet_manager.cc:1434] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:18:07.693603 15985 tablet_bootstrap.cc:492] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:07.693653 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:07.693897 15984 raft_consensus.cc:359] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.694731 15984 raft_consensus.cc:385] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.692441 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
W20260709 13:18:07.696110 15759 leader_election.cc:343] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:07.696734 15761 leader_election.cc:343] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.697224 15761 leader_election.cc:304] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2125841728845849d019dcf41500f09; no voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:07.695111 15984 raft_consensus.cc:740] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.698527 15984 consensus_queue.cc:260] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.699476 15987 raft_consensus.cc:2749] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.702344 15985 tablet_bootstrap.cc:654] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.702471 15984 ts_tablet_manager.cc:1434] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:18:07.704087 15984 tablet_bootstrap.cc:492] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:07.705262 15988 tablet_bootstrap.cc:492] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:07.705807 15988 ts_tablet_manager.cc:1403] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.005s
I20260709 13:18:07.708910 15988 raft_consensus.cc:359] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.709724 15988 raft_consensus.cc:385] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.710022 15988 raft_consensus.cc:740] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.710744 15988 consensus_queue.cc:260] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.713972 15984 tablet_bootstrap.cc:654] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.714767 15985 tablet_bootstrap.cc:492] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:07.715418 15985 ts_tablet_manager.cc:1403] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.005s
I20260709 13:18:07.717962 15969 heartbeater.cc:499] Master 127.4.254.62:35311 was elected leader, sending a full tablet report...
I20260709 13:18:07.719075 15985 raft_consensus.cc:359] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.720172 15985 raft_consensus.cc:385] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.720611 15985 raft_consensus.cc:740] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.721732 15985 consensus_queue.cc:260] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.722648 15988 ts_tablet_manager.cc:1434] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.002s
I20260709 13:18:07.723785 15988 tablet_bootstrap.cc:492] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:07.725790 15987 raft_consensus.cc:493] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.726589 15984 tablet_bootstrap.cc:492] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:07.726330 15987 raft_consensus.cc:515] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.727150 15984 ts_tablet_manager.cc:1403] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.002s
I20260709 13:18:07.728616 15987 leader_election.cc:290] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:07.730250 15988 tablet_bootstrap.cc:654] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.730332 15984 raft_consensus.cc:359] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.731180 15984 raft_consensus.cc:385] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.731531 15984 raft_consensus.cc:740] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.732393 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726f9d99397d4d7ca425ce99b0de38e5" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
I20260709 13:18:07.732306 15984 consensus_queue.cc:260] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.733144 15944 raft_consensus.cc:2468] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 0.
I20260709 13:18:07.734598 15761 leader_election.cc:304] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:07.736841 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726f9d99397d4d7ca425ce99b0de38e5" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:07.737526 15870 raft_consensus.cc:2468] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 0.
I20260709 13:18:07.739202 15987 raft_consensus.cc:2804] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:07.740520 15987 raft_consensus.cc:493] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.740954 15987 raft_consensus.cc:3060] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.748562 15984 ts_tablet_manager.cc:1434] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.021s	user 0.015s	sys 0.007s
I20260709 13:18:07.749102 15988 tablet_bootstrap.cc:492] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:07.749753 15988 ts_tablet_manager.cc:1403] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 13:18:07.750064 15987 raft_consensus.cc:515] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.752192 15987 leader_election.cc:290] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 election: Requested vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:07.752902 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726f9d99397d4d7ca425ce99b0de38e5" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:07.752751 15988 raft_consensus.cc:359] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:07.753513 15870 raft_consensus.cc:3060] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.754006 15984 tablet_bootstrap.cc:492] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:07.754077 15985 ts_tablet_manager.cc:1434] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:18:07.755496 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726f9d99397d4d7ca425ce99b0de38e5" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:07.756106 15944 raft_consensus.cc:3060] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.756280 15985 tablet_bootstrap.cc:492] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:07.760692 15984 tablet_bootstrap.cc:654] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.762176 15870 raft_consensus.cc:2468] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 1.
I20260709 13:18:07.753548 15988 raft_consensus.cc:385] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.768018 15988 raft_consensus.cc:740] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.769227 15988 consensus_queue.cc:260] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:07.769315 15759 leader_election.cc:304] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:07.771404 15987 raft_consensus.cc:2804] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.772125 15988 ts_tablet_manager.cc:1434] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:18:07.773264 15988 tablet_bootstrap.cc:492] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:07.763535 15944 raft_consensus.cc:2468] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 1.
I20260709 13:18:07.772039 15987 raft_consensus.cc:697] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Becoming Leader. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:07.763473 15985 tablet_bootstrap.cc:654] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.774770 15987 consensus_queue.cc:237] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.780531 15984 tablet_bootstrap.cc:492] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:07.780584 15988 tablet_bootstrap.cc:654] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.781550 15984 ts_tablet_manager.cc:1403] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.017s
I20260709 13:18:07.785550 15984 raft_consensus.cc:359] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.786424 15984 raft_consensus.cc:385] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.786769 15984 raft_consensus.cc:740] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.787099 15985 tablet_bootstrap.cc:492] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:07.787643 15985 ts_tablet_manager.cc:1403] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.011s
I20260709 13:18:07.787632 15984 consensus_queue.cc:260] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.788483 15988 tablet_bootstrap.cc:492] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:07.789077 15988 ts_tablet_manager.cc:1403] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.001s
I20260709 13:18:07.790110 15984 ts_tablet_manager.cc:1434] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:18:07.790343 15693 catalog_manager.cc:5697] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2125841728845849d019dcf41500f09 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "d2125841728845849d019dcf41500f09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.791468 15984 tablet_bootstrap.cc:492] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:07.791076 15985 raft_consensus.cc:359] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.792096 15985 raft_consensus.cc:385] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.792696 15985 raft_consensus.cc:740] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.793651 15985 consensus_queue.cc:260] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.795773 15985 ts_tablet_manager.cc:1434] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:18:07.792084 15988 raft_consensus.cc:359] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.796980 15985 tablet_bootstrap.cc:492] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:07.797288 15988 raft_consensus.cc:385] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.797665 15988 raft_consensus.cc:740] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.798785 15987 raft_consensus.cc:493] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.798477 15988 consensus_queue.cc:260] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.799304 15987 raft_consensus.cc:515] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.801054 15988 ts_tablet_manager.cc:1434] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:18:07.801501 15987 leader_election.cc:290] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:07.802166 15988 tablet_bootstrap.cc:492] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:07.803030 15984 tablet_bootstrap.cc:654] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.803494 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968f5a4c174c4e0baf9c60b1f7e69880" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
W20260709 13:18:07.805063 15761 leader_election.cc:343] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.805691 15987 raft_consensus.cc:493] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.806197 15987 raft_consensus.cc:515] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.806367 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968f5a4c174c4e0baf9c60b1f7e69880" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
W20260709 13:18:07.807842 15759 leader_election.cc:343] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.808279 15759 leader_election.cc:304] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2125841728845849d019dcf41500f09; no voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:07.809372 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bdfdebfb9124e8191cf7c8f952ef4ea" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
I20260709 13:18:07.809778 16000 raft_consensus.cc:2749] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.810297 15988 tablet_bootstrap.cc:654] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:07.810775 15761 leader_election.cc:343] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.811221 15993 raft_consensus.cc:493] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.811393 15987 leader_election.cc:290] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:07.811753 15993 raft_consensus.cc:515] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.813589 15985 tablet_bootstrap.cc:654] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.815770 15993 leader_election.cc:290] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:07.816607 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bdfdebfb9124e8191cf7c8f952ef4ea" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:07.824853 15988 tablet_bootstrap.cc:492] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:07.825714 15988 ts_tablet_manager.cc:1403] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.006s
I20260709 13:18:07.829844 15988 raft_consensus.cc:359] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.830940 15988 raft_consensus.cc:385] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.831401 15988 raft_consensus.cc:740] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.832726 15988 consensus_queue.cc:260] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.838975 15988 ts_tablet_manager.cc:1434] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
W20260709 13:18:07.842338 15741 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:07.843250 15988 tablet_bootstrap.cc:492] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:07.853333 15988 tablet_bootstrap.cc:654] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.866444 15988 tablet_bootstrap.cc:492] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:07.867146 15988 ts_tablet_manager.cc:1403] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.012s
I20260709 13:18:07.871238 15988 raft_consensus.cc:359] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.872249 15988 raft_consensus.cc:385] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.872637 15988 raft_consensus.cc:740] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.873893 15988 consensus_queue.cc:260] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.886256 15988 ts_tablet_manager.cc:1434] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.010s
I20260709 13:18:07.896983 15988 tablet_bootstrap.cc:492] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:07.900243 15997 raft_consensus.cc:493] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.901031 15997 raft_consensus.cc:515] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
W20260709 13:18:07.904021 15759 leader_election.cc:343] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.904780 15759 leader_election.cc:304] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2125841728845849d019dcf41500f09; no voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:07.905853 15987 raft_consensus.cc:2749] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.919432 15997 leader_election.cc:290] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:07.933424 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8da1cbcf840f5a523e4482cda8ae8" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:07.934551 15795 raft_consensus.cc:2468] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 0.
I20260709 13:18:07.936635 15833 leader_election.cc:304] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:07.937808 15993 raft_consensus.cc:2804] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:07.938292 15993 raft_consensus.cc:493] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.938763 15993 raft_consensus.cc:3060] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.950798 15993 raft_consensus.cc:515] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.945744 15988 tablet_bootstrap.cc:654] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.969573 15985 tablet_bootstrap.cc:492] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:07.970163 15985 ts_tablet_manager.cc:1403] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.173s	user 0.072s	sys 0.085s
I20260709 13:18:07.970484 15984 tablet_bootstrap.cc:492] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:07.970363 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:07.971148 15984 ts_tablet_manager.cc:1403] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.180s	user 0.057s	sys 0.102s
I20260709 13:18:07.972005 15988 tablet_bootstrap.cc:492] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
W20260709 13:18:07.972131 15908 leader_election.cc:343] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.972744 15988 ts_tablet_manager.cc:1403] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.000s
I20260709 13:18:07.973348 15985 raft_consensus.cc:359] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.974164 15985 raft_consensus.cc:385] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.974481 15985 raft_consensus.cc:740] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.975268 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:07.975404 15985 consensus_queue.cc:260] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.975957 15795 raft_consensus.cc:2468] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 0.
I20260709 13:18:07.976272 15988 raft_consensus.cc:359] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.977080 15988 raft_consensus.cc:385] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.977200 15993 leader_election.cc:290] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:07.977483 15988 raft_consensus.cc:740] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.978083 15943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8da1cbcf840f5a523e4482cda8ae8" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:07.978718 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8da1cbcf840f5a523e4482cda8ae8" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
W20260709 13:18:07.979667 15836 leader_election.cc:343] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.980335 15984 raft_consensus.cc:359] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
W20260709 13:18:07.980733 15836 leader_election.cc:343] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.980562 15907 leader_election.cc:304] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 07fd5c48d9bc4793a2260eb5bcbd93d7
I20260709 13:18:07.981241 15984 raft_consensus.cc:385] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.981595 15984 raft_consensus.cc:740] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.981833 15997 raft_consensus.cc:2804] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:07.982255 15997 raft_consensus.cc:493] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.982653 15997 raft_consensus.cc:3060] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.982384 15984 consensus_queue.cc:260] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.977893 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8da1cbcf840f5a523e4482cda8ae8" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:07.984776 15984 ts_tablet_manager.cc:1434] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.006s
I20260709 13:18:07.984891 15795 raft_consensus.cc:3060] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.986018 15984 tablet_bootstrap.cc:492] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:07.990600 15997 raft_consensus.cc:515] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:07.978543 15988 consensus_queue.cc:260] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:07.993579 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:07.994246 15794 raft_consensus.cc:3060] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.995440 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
W20260709 13:18:07.996960 15908 leader_election.cc:343] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.997539 15997 leader_election.cc:290] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:08.000839 15984 tablet_bootstrap.cc:654] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.002296 15794 raft_consensus.cc:2468] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 1.
I20260709 13:18:08.003690 15907 leader_election.cc:304] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 07fd5c48d9bc4793a2260eb5bcbd93d7
I20260709 13:18:08.004591 15988 ts_tablet_manager.cc:1434] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 13:18:08.005683 15988 tablet_bootstrap.cc:492] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:08.005936 15795 raft_consensus.cc:2468] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 1.
I20260709 13:18:08.006989 15833 leader_election.cc:304] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:08.008285 15993 raft_consensus.cc:2804] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.008767 15993 raft_consensus.cc:697] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Becoming Leader. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:08.009697 15993 consensus_queue.cc:237] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.010097 16020 raft_consensus.cc:2804] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.010922 15985 ts_tablet_manager.cc:1434] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.011s
I20260709 13:18:08.011514 16020 raft_consensus.cc:697] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Becoming Leader. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:08.012030 15985 tablet_bootstrap.cc:492] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:08.012359 16020 consensus_queue.cc:237] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:08.018287 15985 tablet_bootstrap.cc:654] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.019582 15984 tablet_bootstrap.cc:492] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:08.020200 15984 ts_tablet_manager.cc:1403] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.005s
I20260709 13:18:08.020653 15988 tablet_bootstrap.cc:654] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.027706 15984 raft_consensus.cc:359] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.028908 15984 raft_consensus.cc:385] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.029409 15984 raft_consensus.cc:740] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.030478 15984 consensus_queue.cc:260] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.031730 15693 catalog_manager.cc:5697] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b reported cstate change: term changed from 0 to 1, leader changed from <none> to b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.041203 15985 tablet_bootstrap.cc:492] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:08.041806 15985 ts_tablet_manager.cc:1403] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.007s
I20260709 13:18:08.041785 15984 ts_tablet_manager.cc:1434] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 13:18:08.043228 15984 tablet_bootstrap.cc:492] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:08.045104 15985 raft_consensus.cc:359] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.045877 15985 raft_consensus.cc:385] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.046197 15985 raft_consensus.cc:740] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.047061 15985 consensus_queue.cc:260] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.049649 15985 ts_tablet_manager.cc:1434] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:18:08.050365 15984 tablet_bootstrap.cc:654] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.050704 15985 tablet_bootstrap.cc:492] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:08.040740 15690 catalog_manager.cc:5697] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.059124 15985 tablet_bootstrap.cc:654] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.059599 16020 raft_consensus.cc:493] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.060303 16020 raft_consensus.cc:515] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.064186 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f076fbe245547a68263c6793250c813" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
W20260709 13:18:08.066202 15907 leader_election.cc:343] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2125841728845849d019dcf41500f09 (127.4.254.1:38511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.072919 15987 raft_consensus.cc:493] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.073733 15987 raft_consensus.cc:515] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.074716 15984 tablet_bootstrap.cc:492] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:08.075397 15984 ts_tablet_manager.cc:1403] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.003s
I20260709 13:18:08.077637 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76dbdecebd545e89831e7ffff29e8b3" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:08.078531 15870 raft_consensus.cc:2468] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 0.
I20260709 13:18:08.079125 15984 raft_consensus.cc:359] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.080293 15984 raft_consensus.cc:385] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.080719 15984 raft_consensus.cc:740] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.081735 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76dbdecebd545e89831e7ffff29e8b3" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
I20260709 13:18:08.081828 15984 consensus_queue.cc:260] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.082819 15944 raft_consensus.cc:2468] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 0.
I20260709 13:18:08.084368 15759 leader_election.cc:304] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:08.084817 15987 leader_election.cc:290] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:08.085373 16000 raft_consensus.cc:2804] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.086053 16000 raft_consensus.cc:493] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.086515 16000 raft_consensus.cc:3060] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.087270 15985 tablet_bootstrap.cc:492] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:08.087788 15985 ts_tablet_manager.cc:1403] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.037s	user 0.030s	sys 0.003s
I20260709 13:18:08.088083 15984 ts_tablet_manager.cc:1434] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:18:08.089092 15984 tablet_bootstrap.cc:492] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:08.089564 15993 raft_consensus.cc:493] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.090267 15993 raft_consensus.cc:515] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.090755 15985 raft_consensus.cc:359] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.091522 15985 raft_consensus.cc:385] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.091830 15985 raft_consensus.cc:740] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.093691 15993 leader_election.cc:290] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:08.093743 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bd2943bcf541a5b79d0456bbea0683" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:08.094657 15984 tablet_bootstrap.cc:654] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:08.095602 15833 leader_election.cc:343] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2125841728845849d019dcf41500f09 (127.4.254.1:38511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.092715 15985 consensus_queue.cc:260] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.098318 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bd2943bcf541a5b79d0456bbea0683" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
I20260709 13:18:08.099023 15985 ts_tablet_manager.cc:1434] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:18:08.099308 15944 raft_consensus.cc:2468] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 0.
I20260709 13:18:08.100162 15985 tablet_bootstrap.cc:492] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:08.101264 15836 leader_election.cc:304] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b; no voters: d2125841728845849d019dcf41500f09
I20260709 13:18:08.102996 15993 raft_consensus.cc:2804] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.103482 15993 raft_consensus.cc:493] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.103896 15993 raft_consensus.cc:3060] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.109261 15985 tablet_bootstrap.cc:654] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.126212 15985 tablet_bootstrap.cc:492] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:08.126988 15985 ts_tablet_manager.cc:1403] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 13:18:08.131392 15985 raft_consensus.cc:359] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:08.132629 15985 raft_consensus.cc:385] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.133090 15985 raft_consensus.cc:740] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.134392 15985 consensus_queue.cc:260] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:08.142808 15985 ts_tablet_manager.cc:1434] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:18:08.144323 15985 tablet_bootstrap.cc:492] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:08.151034 15985 tablet_bootstrap.cc:654] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.172003 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f076fbe245547a68263c6793250c813" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:08.173034 15870 raft_consensus.cc:2468] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 0.
I20260709 13:18:08.174772 15908 leader_election.cc:304] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b; no voters: d2125841728845849d019dcf41500f09
I20260709 13:18:08.176067 15997 raft_consensus.cc:2804] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.176609 15997 raft_consensus.cc:493] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.177024 15997 raft_consensus.cc:3060] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.185274 16020 leader_election.cc:290] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:08.188781 15997 raft_consensus.cc:515] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.189455 15988 tablet_bootstrap.cc:492] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:08.190073 15988 ts_tablet_manager.cc:1403] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.185s	user 0.062s	sys 0.100s
I20260709 13:18:08.192883 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f076fbe245547a68263c6793250c813" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:08.193599 15795 raft_consensus.cc:3060] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.193303 15988 raft_consensus.cc:359] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.194061 15988 raft_consensus.cc:385] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.194348 15988 raft_consensus.cc:740] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.195190 15988 consensus_queue.cc:260] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.200929 15795 raft_consensus.cc:2468] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 1.
I20260709 13:18:08.201833 15988 ts_tablet_manager.cc:1434] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:18:08.202353 15907 leader_election.cc:304] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:08.202991 15988 tablet_bootstrap.cc:492] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:08.203286 16020 raft_consensus.cc:2804] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.211582 15988 tablet_bootstrap.cc:654] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.212330 15987 consensus_queue.cc:1048] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.227650 15993 raft_consensus.cc:515] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.230901 16020 raft_consensus.cc:697] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Becoming Leader. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:08.232340 16020 consensus_queue.cc:237] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.168843 16000 raft_consensus.cc:515] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.241250 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76dbdecebd545e89831e7ffff29e8b3" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:08.242074 15869 raft_consensus.cc:3060] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.264375 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f076fbe245547a68263c6793250c813" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:08.265429 15868 raft_consensus.cc:3060] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.278987 15997 leader_election.cc:290] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:08.282613 15987 raft_consensus.cc:493] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.282987 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bd2943bcf541a5b79d0456bbea0683" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:08.283751 15944 raft_consensus.cc:3060] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.283515 15987 raft_consensus.cc:515] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.286127 15987 leader_election.cc:290] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:08.287372 15943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77018beecd941398c8e0bcc7c8a92fa" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
I20260709 13:18:08.301301 15943 raft_consensus.cc:2468] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 0.
I20260709 13:18:08.289260 15867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77018beecd941398c8e0bcc7c8a92fa" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:08.302500 15761 leader_election.cc:304] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:08.293100 15944 raft_consensus.cc:2468] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 1.
I20260709 13:18:08.304497 15836 leader_election.cc:304] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b; no voters: 
I20260709 13:18:08.293773 15997 raft_consensus.cc:493] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.305703 16019 raft_consensus.cc:2804] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.305922 15997 raft_consensus.cc:515] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.253033 15869 raft_consensus.cc:2468] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 1.
I20260709 13:18:08.282766 15993 leader_election.cc:290] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:08.296917 15942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76dbdecebd545e89831e7ffff29e8b3" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:08.309628 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bdfdebfb9124e8191cf7c8f952ef4ea" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:08.310070 15942 raft_consensus.cc:3060] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.310343 15794 raft_consensus.cc:2468] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 0.
I20260709 13:18:08.311846 15907 leader_election.cc:304] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:08.312809 16020 raft_consensus.cc:2804] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.313292 16020 raft_consensus.cc:493] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.313768 16020 raft_consensus.cc:3060] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.278034 15868 raft_consensus.cc:2468] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 1.
I20260709 13:18:08.298554 15985 tablet_bootstrap.cc:492] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:08.319165 15985 ts_tablet_manager.cc:1403] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.175s	user 0.009s	sys 0.058s
I20260709 13:18:08.300765 15984 tablet_bootstrap.cc:492] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:08.321573 15984 ts_tablet_manager.cc:1403] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.233s	user 0.045s	sys 0.089s
I20260709 13:18:08.324136 15942 raft_consensus.cc:2468] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 1.
I20260709 13:18:08.326535 15985 raft_consensus.cc:359] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.327322 15985 raft_consensus.cc:385] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.327632 15985 raft_consensus.cc:740] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.327917 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bdfdebfb9124e8191cf7c8f952ef4ea" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:08.295120 16000 leader_election.cc:290] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 election: Requested vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:08.324813 15984 raft_consensus.cc:359] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.329018 16000 raft_consensus.cc:2804] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.329295 15984 raft_consensus.cc:385] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.329600 16000 raft_consensus.cc:493] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.302002 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bd2943bcf541a5b79d0456bbea0683" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:08.330183 16000 raft_consensus.cc:3060] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.330502 15985 consensus_queue.cc:260] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.336699 15988 tablet_bootstrap.cc:492] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:08.341440 15988 ts_tablet_manager.cc:1403] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.139s	user 0.038s	sys 0.045s
I20260709 13:18:08.333246 15997 leader_election.cc:290] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:08.334177 15868 raft_consensus.cc:2468] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 0.
W20260709 13:18:08.331616 15759 leader_election.cc:343] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.343909 15759 leader_election.cc:304] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:08.347708 15993 raft_consensus.cc:493] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.348387 15993 raft_consensus.cc:515] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:08.349313 15988 raft_consensus.cc:359] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.329885 15984 raft_consensus.cc:740] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.352324 15942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
I20260709 13:18:08.352012 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:08.353900 15794 raft_consensus.cc:2393] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in current term 1: Already voted for candidate b45ae26ee8b34e5189409e5c34ccd82b in this term.
I20260709 13:18:08.349318 15987 raft_consensus.cc:2804] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.354984 15833 leader_election.cc:304] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7; no voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09
I20260709 13:18:08.355122 15984 consensus_queue.cc:260] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.355280 15987 raft_consensus.cc:697] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Becoming Leader. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:08.358011 15984 ts_tablet_manager.cc:1434] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:18:08.357687 15987 consensus_queue.cc:237] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.358831 15795 raft_consensus.cc:3060] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.364950 15988 raft_consensus.cc:385] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.365378 15993 leader_election.cc:290] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:08.366601 15993 raft_consensus.cc:3060] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.365410 15988 raft_consensus.cc:740] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.351927 16000 raft_consensus.cc:515] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.339956 15985 ts_tablet_manager.cc:1434] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:18:08.375222 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77018beecd941398c8e0bcc7c8a92fa" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:08.371402 15988 consensus_queue.cc:260] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.375886 15869 raft_consensus.cc:3060] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.376173 16020 raft_consensus.cc:515] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.378383 15985 tablet_bootstrap.cc:492] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:08.378755 15988 ts_tablet_manager.cc:1434] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:18:08.304932 15690 catalog_manager.cc:5697] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b reported cstate change: term changed from 0 to 1, leader changed from <none> to b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.380364 15988 tablet_bootstrap.cc:492] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:08.374557 16000 leader_election.cc:290] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 election: Requested vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
W20260709 13:18:08.387356 15761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.254.3:43907, user_credentials={real_user=slave}} blocked reactor thread for 84947.8us
I20260709 13:18:08.391928 15795 raft_consensus.cc:2468] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 1.
I20260709 13:18:08.393383 15942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77018beecd941398c8e0bcc7c8a92fa" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:08.394124 15942 raft_consensus.cc:3060] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.394837 15869 raft_consensus.cc:2468] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 1.
I20260709 13:18:08.396557 15759 leader_election.cc:304] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:08.398038 15987 raft_consensus.cc:2804] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.398748 15987 raft_consensus.cc:697] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Becoming Leader. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:08.411999 15987 consensus_queue.cc:237] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.413285 16019 raft_consensus.cc:697] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Becoming Leader. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:08.402634 15942 raft_consensus.cc:2468] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 1.
I20260709 13:18:08.406973 16020 leader_election.cc:290] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:08.407693 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bdfdebfb9124e8191cf7c8f952ef4ea" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:08.414484 15795 raft_consensus.cc:3060] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.414203 16019 consensus_queue.cc:237] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.409046 15993 raft_consensus.cc:2749] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.422698 15985 tablet_bootstrap.cc:654] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.409444 15988 tablet_bootstrap.cc:654] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.410560 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bdfdebfb9124e8191cf7c8f952ef4ea" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:08.404495 16037 consensus_queue.cc:1048] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:18:08.429618 15869 raft_consensus.cc:3060] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.436120 15988 tablet_bootstrap.cc:492] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:08.438258 15988 ts_tablet_manager.cc:1403] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.005s
I20260709 13:18:08.428988 15795 raft_consensus.cc:2468] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 1.
I20260709 13:18:08.444144 15869 raft_consensus.cc:2468] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 1.
I20260709 13:18:08.443914 15907 leader_election.cc:304] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:08.445400 16020 raft_consensus.cc:2804] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.445885 16020 raft_consensus.cc:697] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Becoming Leader. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:08.446271 15985 tablet_bootstrap.cc:492] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:08.446821 15985 ts_tablet_manager.cc:1403] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.003s
I20260709 13:18:08.446727 16020 consensus_queue.cc:237] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.449651 15985 raft_consensus.cc:359] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.450309 15985 raft_consensus.cc:385] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.450583 15985 raft_consensus.cc:740] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.443998 15988 raft_consensus.cc:359] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.453866 15988 raft_consensus.cc:385] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.454149 15988 raft_consensus.cc:740] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.455283 15988 consensus_queue.cc:260] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.446323 15691 catalog_manager.cc:5697] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2125841728845849d019dcf41500f09 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "d2125841728845849d019dcf41500f09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.457531 15988 ts_tablet_manager.cc:1434] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:18:08.458115 15691 catalog_manager.cc:5697] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2125841728845849d019dcf41500f09 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "d2125841728845849d019dcf41500f09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.454399 15985 consensus_queue.cc:260] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.462071 15985 ts_tablet_manager.cc:1434] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:18:08.468504 15690 catalog_manager.cc:5697] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.478690 15691 catalog_manager.cc:5697] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b reported cstate change: term changed from 0 to 1, leader changed from <none> to b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.502579 16020 raft_consensus.cc:493] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.503166 16020 raft_consensus.cc:515] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.504949 16020 leader_election.cc:290] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:08.505888 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968f5a4c174c4e0baf9c60b1f7e69880" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:08.506196 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968f5a4c174c4e0baf9c60b1f7e69880" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:08.506623 15795 raft_consensus.cc:2468] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 0.
I20260709 13:18:08.506812 15869 raft_consensus.cc:2468] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 0.
I20260709 13:18:08.507706 15907 leader_election.cc:304] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:08.508464 16020 raft_consensus.cc:2804] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.508880 16020 raft_consensus.cc:493] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.508823 15997 consensus_queue.cc:1048] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:08.509521 16020 raft_consensus.cc:3060] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.516963 16020 raft_consensus.cc:515] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.520547 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968f5a4c174c4e0baf9c60b1f7e69880" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:08.521145 15795 raft_consensus.cc:3060] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.521616 16031 consensus_queue.cc:1048] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:08.528882 15795 raft_consensus.cc:2468] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 1.
I20260709 13:18:08.529953 16020 leader_election.cc:290] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:08.531420 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968f5a4c174c4e0baf9c60b1f7e69880" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:08.532994 15868 raft_consensus.cc:3060] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.533429 15907 leader_election.cc:304] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:08.534305 16020 raft_consensus.cc:2804] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.534777 16020 raft_consensus.cc:697] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Becoming Leader. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:08.535589 16020 consensus_queue.cc:237] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.542346 15942 raft_consensus.cc:3060] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.546247 15868 raft_consensus.cc:2468] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 1.
I20260709 13:18:08.549407 16019 consensus_queue.cc:1048] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.556133 15690 catalog_manager.cc:5697] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b reported cstate change: term changed from 0 to 1, leader changed from <none> to b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.562171 16038 consensus_queue.cc:1048] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.743824 15987 consensus_queue.cc:1048] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.753943 16036 consensus_queue.cc:1048] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:08.801502 15942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa"
dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
mode: GRACEFUL
new_leader_uuid: "d2125841728845849d019dcf41500f09"
 from {username='slave'} at 127.0.0.1:50528
I20260709 13:18:08.802047 15942 raft_consensus.cc:606] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Received request to transfer leadership to TS d2125841728845849d019dcf41500f09
I20260709 13:18:08.817167 15868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ba8da1cbcf840f5a523e4482cda8ae8"
dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
mode: GRACEFUL
new_leader_uuid: "d2125841728845849d019dcf41500f09"
 from {username='slave'} at 127.0.0.1:53550
I20260709 13:18:08.817657 15868 raft_consensus.cc:606] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Received request to transfer leadership to TS d2125841728845849d019dcf41500f09
I20260709 13:18:08.822446 15868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61bd2943bcf541a5b79d0456bbea0683"
dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
mode: GRACEFUL
new_leader_uuid: "d2125841728845849d019dcf41500f09"
 from {username='slave'} at 127.0.0.1:53550
I20260709 13:18:08.822907 15868 raft_consensus.cc:606] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Received request to transfer leadership to TS d2125841728845849d019dcf41500f09
I20260709 13:18:08.827739 15942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bdfdebfb9124e8191cf7c8f952ef4ea"
dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
mode: GRACEFUL
new_leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
 from {username='slave'} at 127.0.0.1:50528
I20260709 13:18:08.828195 15942 raft_consensus.cc:606] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Received request to transfer leadership to TS 07fd5c48d9bc4793a2260eb5bcbd93d7
I20260709 13:18:08.840471 15795 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b76dbdecebd545e89831e7ffff29e8b3"
dest_uuid: "d2125841728845849d019dcf41500f09"
mode: GRACEFUL
new_leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
 from {username='slave'} at 127.0.0.1:55510
I20260709 13:18:08.841056 15795 raft_consensus.cc:606] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Received request to transfer leadership to TS 07fd5c48d9bc4793a2260eb5bcbd93d7
I20260709 13:18:08.846241 15942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f076fbe245547a68263c6793250c813"
dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
mode: GRACEFUL
new_leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
 from {username='slave'} at 127.0.0.1:50528
I20260709 13:18:08.846735 15942 raft_consensus.cc:606] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Received request to transfer leadership to TS 07fd5c48d9bc4793a2260eb5bcbd93d7
I20260709 13:18:08.852197 15794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d77018beecd941398c8e0bcc7c8a92fa"
dest_uuid: "d2125841728845849d019dcf41500f09"
mode: GRACEFUL
new_leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
 from {username='slave'} at 127.0.0.1:55510
I20260709 13:18:08.852813 15794 raft_consensus.cc:606] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Received request to transfer leadership to TS 07fd5c48d9bc4793a2260eb5bcbd93d7
I20260709 13:18:08.852862 16020 consensus_queue.cc:1048] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.860600 15997 consensus_queue.cc:1048] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.872582 16031 raft_consensus.cc:993] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b: : Instructing follower 07fd5c48d9bc4793a2260eb5bcbd93d7 to start an election
I20260709 13:18:08.873077 15997 raft_consensus.cc:1081] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Signalling peer 07fd5c48d9bc4793a2260eb5bcbd93d7 to start an election
I20260709 13:18:08.874573 15868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f076fbe245547a68263c6793250c813"
dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
 from {username='slave'} at 127.0.0.1:53540
I20260709 13:18:08.875079 15868 raft_consensus.cc:493] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:08.875451 15868 raft_consensus.cc:3060] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.880615 15868 raft_consensus.cc:515] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.882400 15868 leader_election.cc:290] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 2 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:08.883139 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f076fbe245547a68263c6793250c813" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:08.883675 15942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f076fbe245547a68263c6793250c813" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:08.883976 15794 raft_consensus.cc:3060] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.884589 15942 raft_consensus.cc:3055] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:08.885106 15942 raft_consensus.cc:740] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:08.886159 15942 consensus_queue.cc:260] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.887990 15942 raft_consensus.cc:3060] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.892064 15794 raft_consensus.cc:2468] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 2.
I20260709 13:18:08.893112 15833 leader_election.cc:304] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:08.893959 16038 raft_consensus.cc:2804] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:08.894004 15942 raft_consensus.cc:2468] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 2.
I20260709 13:18:08.894521 16038 raft_consensus.cc:697] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 LEADER]: Becoming Leader. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:08.895260 16038 consensus_queue.cc:237] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.901981 15691 catalog_manager.cc:5697] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 reported cstate change: term changed from 1 to 2, leader changed from b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3) to 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2). New cstate: current_term: 2 leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.915956 16036 consensus_queue.cc:1048] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.916406 16038 consensus_queue.cc:1048] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.920207 15997 consensus_queue.cc:1048] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.925339 16037 raft_consensus.cc:993] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09: : Instructing follower 07fd5c48d9bc4793a2260eb5bcbd93d7 to start an election
I20260709 13:18:08.925872 16037 raft_consensus.cc:1081] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Signalling peer 07fd5c48d9bc4793a2260eb5bcbd93d7 to start an election
I20260709 13:18:08.933106 15868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d77018beecd941398c8e0bcc7c8a92fa"
dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
 from {username='slave'} at 127.0.0.1:53524
I20260709 13:18:08.933826 15868 raft_consensus.cc:493] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:08.934333 15868 raft_consensus.cc:3060] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.936219 16036 consensus_queue.cc:1048] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:08.937783 15993 raft_consensus.cc:993] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7: : Instructing follower d2125841728845849d019dcf41500f09 to start an election
I20260709 13:18:08.938262 15993 raft_consensus.cc:1081] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Signalling peer d2125841728845849d019dcf41500f09 to start an election
I20260709 13:18:08.940138 15795 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61bd2943bcf541a5b79d0456bbea0683"
dest_uuid: "d2125841728845849d019dcf41500f09"
 from {username='slave'} at 127.0.0.1:55498
I20260709 13:18:08.940730 15795 raft_consensus.cc:493] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:08.941084 15795 raft_consensus.cc:3060] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.942827 15868 raft_consensus.cc:515] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.946287 15868 leader_election.cc:290] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 2 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:08.947183 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77018beecd941398c8e0bcc7c8a92fa" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:08.948254 15793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77018beecd941398c8e0bcc7c8a92fa" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:08.948904 15793 raft_consensus.cc:3055] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:08.951228 15993 raft_consensus.cc:993] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7: : Instructing follower d2125841728845849d019dcf41500f09 to start an election
I20260709 13:18:08.951380 15793 raft_consensus.cc:740] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:08.951834 15993 raft_consensus.cc:1081] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Signalling peer d2125841728845849d019dcf41500f09 to start an election
I20260709 13:18:08.952370 15793 consensus_queue.cc:260] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.953670 15793 raft_consensus.cc:3060] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.955649 15794 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ba8da1cbcf840f5a523e4482cda8ae8"
dest_uuid: "d2125841728845849d019dcf41500f09"
 from {username='slave'} at 127.0.0.1:55498
I20260709 13:18:08.956306 15794 raft_consensus.cc:493] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:08.956720 15794 raft_consensus.cc:3060] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.959724 16019 consensus_queue.cc:1048] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.961351 15795 raft_consensus.cc:515] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.962476 15792 raft_consensus.cc:1240] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Rejecting Update request from peer 07fd5c48d9bc4793a2260eb5bcbd93d7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:08.965690 15942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bd2943bcf541a5b79d0456bbea0683" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:08.965586 16020 consensus_queue.cc:1048] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:08.967593 15795 leader_election.cc:290] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 2 election: Requested vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:08.969833 16031 raft_consensus.cc:993] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b: : Instructing follower d2125841728845849d019dcf41500f09 to start an election
I20260709 13:18:08.970232 16031 raft_consensus.cc:1081] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Signalling peer d2125841728845849d019dcf41500f09 to start an election
I20260709 13:18:08.971928 15795 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa"
dest_uuid: "d2125841728845849d019dcf41500f09"
 from {username='slave'} at 127.0.0.1:55500
I20260709 13:18:08.971927 15997 consensus_queue.cc:1048] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.972640 15795 raft_consensus.cc:493] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:08.973016 15795 raft_consensus.cc:3060] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.973940 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bd2943bcf541a5b79d0456bbea0683" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:08.974572 15869 raft_consensus.cc:3055] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:08.974884 15869 raft_consensus.cc:740] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:08.975677 15869 consensus_queue.cc:260] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.976593 15869 raft_consensus.cc:3060] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.971320 15793 raft_consensus.cc:2468] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 2.
I20260709 13:18:08.983595 15997 consensus_queue.cc:1048] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.983939 15833 leader_election.cc:304] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:08.985237 16019 raft_consensus.cc:2804] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:08.985703 16019 raft_consensus.cc:697] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 LEADER]: Becoming Leader. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:08.986495 16019 consensus_queue.cc:237] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.986621 15794 raft_consensus.cc:515] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:08.991576 15942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8da1cbcf840f5a523e4482cda8ae8" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:08.992164 15942 raft_consensus.cc:3060] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.996048 15794 leader_election.cc:290] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 2 election: Requested vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:09.005987 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8da1cbcf840f5a523e4482cda8ae8" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:09.006716 15870 raft_consensus.cc:3055] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:09.007061 15870 raft_consensus.cc:740] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:09.007884 15870 consensus_queue.cc:260] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:09.004971 15869 raft_consensus.cc:2468] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 2.
I20260709 13:18:09.009974 15759 leader_election.cc:304] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:09.010911 16037 raft_consensus.cc:2804] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:09.011358 16037 raft_consensus.cc:697] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Becoming Leader. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:09.011565 15870 raft_consensus.cc:3060] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.012204 16037 consensus_queue.cc:237] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:09.018365 15942 raft_consensus.cc:2468] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 2.
I20260709 13:18:09.019742 15761 leader_election.cc:304] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:09.020726 16037 raft_consensus.cc:2804] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:09.021520 16037 raft_consensus.cc:697] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Becoming Leader. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:09.022506 16037 consensus_queue.cc:237] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:09.032568 15795 raft_consensus.cc:515] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:09.036792 15942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:09.037721 15942 raft_consensus.cc:3055] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:09.038393 15942 raft_consensus.cc:740] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:09.039562 15942 consensus_queue.cc:260] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:09.039932 15870 raft_consensus.cc:2468] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 2.
I20260709 13:18:09.042613 15795 leader_election.cc:290] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 2 election: Requested vote from peers b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:09.045360 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:09.045979 15869 raft_consensus.cc:3060] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.047976 15942 raft_consensus.cc:3060] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.046635 16020 raft_consensus.cc:993] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b: : Instructing follower 07fd5c48d9bc4793a2260eb5bcbd93d7 to start an election
I20260709 13:18:09.051702 16020 raft_consensus.cc:1081] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Signalling peer 07fd5c48d9bc4793a2260eb5bcbd93d7 to start an election
I20260709 13:18:09.054579 15867 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bdfdebfb9124e8191cf7c8f952ef4ea"
dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
 from {username='slave'} at 127.0.0.1:53540
I20260709 13:18:09.055179 15867 raft_consensus.cc:493] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:09.055580 15867 raft_consensus.cc:3060] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.055986 15869 raft_consensus.cc:2468] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 2.
I20260709 13:18:09.057528 15759 leader_election.cc:304] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:09.058456 16037 raft_consensus.cc:2804] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:09.058928 16037 raft_consensus.cc:697] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Becoming Leader. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:09.059733 16037 consensus_queue.cc:237] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:09.064575 15690 catalog_manager.cc:5697] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 reported cstate change: term changed from 1 to 2, leader changed from 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2) to d2125841728845849d019dcf41500f09 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "d2125841728845849d019dcf41500f09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.065702 15867 raft_consensus.cc:515] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:09.067257 15690 catalog_manager.cc:5697] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 reported cstate change: term changed from 1 to 2, leader changed from 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2) to d2125841728845849d019dcf41500f09 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "d2125841728845849d019dcf41500f09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.068116 15942 raft_consensus.cc:2468] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 2.
I20260709 13:18:09.070305 15867 leader_election.cc:290] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 2 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:09.072018 15942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bdfdebfb9124e8191cf7c8f952ef4ea" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:09.072562 15942 raft_consensus.cc:3055] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:09.072840 15942 raft_consensus.cc:740] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:09.073541 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bdfdebfb9124e8191cf7c8f952ef4ea" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:09.074111 15795 raft_consensus.cc:3060] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.073699 15942 consensus_queue.cc:260] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:09.075098 15942 raft_consensus.cc:3060] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.079991 15795 raft_consensus.cc:2468] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 2.
I20260709 13:18:09.081377 15833 leader_election.cc:304] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:09.080533 15691 catalog_manager.cc:5697] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 reported cstate change: term changed from 1 to 2, leader changed from d2125841728845849d019dcf41500f09 (127.4.254.1) to 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2). New cstate: current_term: 2 leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.082033 15942 raft_consensus.cc:2468] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 2.
I20260709 13:18:09.082273 16019 raft_consensus.cc:2804] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:09.082837 16019 raft_consensus.cc:697] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 LEADER]: Becoming Leader. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:09.083643 16019 consensus_queue.cc:237] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:09.091254 15690 catalog_manager.cc:5697] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 reported cstate change: term changed from 1 to 2, leader changed from b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3) to d2125841728845849d019dcf41500f09 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "d2125841728845849d019dcf41500f09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.099323 15691 catalog_manager.cc:5697] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 reported cstate change: term changed from 1 to 2, leader changed from b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3) to 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2). New cstate: current_term: 2 leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.343475 16037 raft_consensus.cc:993] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09: : Instructing follower 07fd5c48d9bc4793a2260eb5bcbd93d7 to start an election
I20260709 13:18:09.343981 16036 raft_consensus.cc:1081] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Signalling peer 07fd5c48d9bc4793a2260eb5bcbd93d7 to start an election
I20260709 13:18:09.345579 15867 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b76dbdecebd545e89831e7ffff29e8b3"
dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
 from {username='slave'} at 127.0.0.1:53524
I20260709 13:18:09.346201 15867 raft_consensus.cc:493] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:09.346608 15867 raft_consensus.cc:3060] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.351598 15867 raft_consensus.cc:515] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:09.353082 15867 leader_election.cc:290] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 2 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:09.353965 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76dbdecebd545e89831e7ffff29e8b3" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:09.354265 15942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76dbdecebd545e89831e7ffff29e8b3" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:09.354679 15795 raft_consensus.cc:3055] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:09.354846 15942 raft_consensus.cc:3060] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.355048 15795 raft_consensus.cc:740] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:09.355952 15795 consensus_queue.cc:260] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:09.357299 15795 raft_consensus.cc:3060] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.362191 15942 raft_consensus.cc:2468] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 2.
I20260709 13:18:09.363379 15836 leader_election.cc:304] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b; no voters: 
I20260709 13:18:09.363989 15795 raft_consensus.cc:2468] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 2.
I20260709 13:18:09.364085 16019 raft_consensus.cc:2804] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:09.364677 16019 raft_consensus.cc:697] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 LEADER]: Becoming Leader. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:09.365593 16019 consensus_queue.cc:237] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:09.371589 15691 catalog_manager.cc:5697] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 reported cstate change: term changed from 1 to 2, leader changed from d2125841728845849d019dcf41500f09 (127.4.254.1) to 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2). New cstate: current_term: 2 leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.416808 15795 raft_consensus.cc:1275] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Refusing update from remote peer 07fd5c48d9bc4793a2260eb5bcbd93d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:09.418008 15942 raft_consensus.cc:3060] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.418231 16019 consensus_queue.cc:1048] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:09.425235 15942 raft_consensus.cc:1275] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Refusing update from remote peer d2125841728845849d019dcf41500f09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:09.427663 16036 consensus_queue.cc:1048] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:09.434996 15942 raft_consensus.cc:1275] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Refusing update from remote peer 07fd5c48d9bc4793a2260eb5bcbd93d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:09.437826 16038 consensus_queue.cc:1048] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:09.438810 15867 raft_consensus.cc:1275] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Refusing update from remote peer d2125841728845849d019dcf41500f09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:09.440950 16036 consensus_queue.cc:1048] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:09.445570 15795 raft_consensus.cc:1275] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Refusing update from remote peer 07fd5c48d9bc4793a2260eb5bcbd93d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:09.447417 16019 consensus_queue.cc:1048] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:09.455636 15942 raft_consensus.cc:3060] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.463356 15942 raft_consensus.cc:1275] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Refusing update from remote peer 07fd5c48d9bc4793a2260eb5bcbd93d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:09.465279 16038 consensus_queue.cc:1048] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:09.536469 15942 raft_consensus.cc:1275] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Refusing update from remote peer 07fd5c48d9bc4793a2260eb5bcbd93d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:09.538293 16038 consensus_queue.cc:1048] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:09.550525 15795 raft_consensus.cc:1275] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Refusing update from remote peer 07fd5c48d9bc4793a2260eb5bcbd93d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:09.551906 15993 consensus_queue.cc:1048] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:09.555948 15867 raft_consensus.cc:1275] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Refusing update from remote peer d2125841728845849d019dcf41500f09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:09.557958 15942 raft_consensus.cc:1275] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Refusing update from remote peer d2125841728845849d019dcf41500f09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:09.559784 16036 consensus_queue.cc:1048] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:09.560413 15987 consensus_queue.cc:1048] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:09.568284 15868 raft_consensus.cc:1275] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Refusing update from remote peer d2125841728845849d019dcf41500f09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:09.570955 16037 consensus_queue.cc:1048] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:09.582101 15942 raft_consensus.cc:1275] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Refusing update from remote peer d2125841728845849d019dcf41500f09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:09.584779 15987 consensus_queue.cc:1048] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:09.868427 15795 raft_consensus.cc:1275] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Refusing update from remote peer 07fd5c48d9bc4793a2260eb5bcbd93d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:09.870687 16076 consensus_queue.cc:1048] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:09.882697 15942 raft_consensus.cc:1275] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Refusing update from remote peer 07fd5c48d9bc4793a2260eb5bcbd93d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:09.884577 16076 consensus_queue.cc:1048] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:11.881659 15692 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58026:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:11.884698 15692 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:11.937565 15781 tablet_service.cc:1511] Processing CreateTablet for tablet a0a458df2344444daab8ecaf20d448f4 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:11.938853 15781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a458df2344444daab8ecaf20d448f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.939256 15854 tablet_service.cc:1511] Processing CreateTablet for tablet a0a458df2344444daab8ecaf20d448f4 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:11.940600 15854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a458df2344444daab8ecaf20d448f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.941969 15784 tablet_service.cc:1511] Processing CreateTablet for tablet a7c87f110fe24eb88a972f9cef7bc1a3 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:11.943271 15784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c87f110fe24eb88a972f9cef7bc1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.943549 15926 tablet_service.cc:1511] Processing CreateTablet for tablet a0a458df2344444daab8ecaf20d448f4 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:11.944605 15926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a458df2344444daab8ecaf20d448f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.944478 15932 tablet_service.cc:1511] Processing CreateTablet for tablet a7c87f110fe24eb88a972f9cef7bc1a3 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:11.945798 15932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c87f110fe24eb88a972f9cef7bc1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.951005 15858 tablet_service.cc:1511] Processing CreateTablet for tablet a7c87f110fe24eb88a972f9cef7bc1a3 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:11.952369 15858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c87f110fe24eb88a972f9cef7bc1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.975358 15782 tablet_service.cc:1511] Processing CreateTablet for tablet b7fc02bad1a5417c88748b1e544d9003 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:11.976334 16095 tablet_bootstrap.cc:492] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:11.976815 15782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7fc02bad1a5417c88748b1e544d9003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.982167 16096 tablet_bootstrap.cc:492] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:11.983242 16095 tablet_bootstrap.cc:654] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.984042 16097 tablet_bootstrap.cc:492] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:11.988579 16096 tablet_bootstrap.cc:654] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.989348 15854 tablet_service.cc:1511] Processing CreateTablet for tablet b7fc02bad1a5417c88748b1e544d9003 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:11.990818 15854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7fc02bad1a5417c88748b1e544d9003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.003590 15926 tablet_service.cc:1511] Processing CreateTablet for tablet b7fc02bad1a5417c88748b1e544d9003 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:12.004062 15784 tablet_service.cc:1511] Processing CreateTablet for tablet 7d9e2f4d86f241d7a01d1d23bd3237a3 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:12.005007 15926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7fc02bad1a5417c88748b1e544d9003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.005977 15784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d9e2f4d86f241d7a01d1d23bd3237a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.010382 16097 tablet_bootstrap.cc:654] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.026172 16096 tablet_bootstrap.cc:492] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:12.026821 16096 ts_tablet_manager.cc:1403] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.010s
I20260709 13:18:12.027338 16097 tablet_bootstrap.cc:492] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:12.029934 16096 raft_consensus.cc:359] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.030725 15860 tablet_service.cc:1511] Processing CreateTablet for tablet 7d9e2f4d86f241d7a01d1d23bd3237a3 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:12.032083 15860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d9e2f4d86f241d7a01d1d23bd3237a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.030802 16096 raft_consensus.cc:385] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.033479 16096 raft_consensus.cc:740] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.029543 16097 ts_tablet_manager.cc:1403] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.003s
I20260709 13:18:12.037689 16097 raft_consensus.cc:359] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.038419 16097 raft_consensus.cc:385] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.034291 15926 tablet_service.cc:1511] Processing CreateTablet for tablet 7d9e2f4d86f241d7a01d1d23bd3237a3 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:12.038709 16097 raft_consensus.cc:740] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.034245 16096 consensus_queue.cc:260] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.039647 15926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d9e2f4d86f241d7a01d1d23bd3237a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.046836 16095 tablet_bootstrap.cc:492] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:12.048138 16097 consensus_queue.cc:260] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.049877 15781 tablet_service.cc:1511] Processing CreateTablet for tablet 938727ad2d8048ada12908312d4afccf (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:12.050892 16097 ts_tablet_manager.cc:1434] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:18:12.051146 15781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938727ad2d8048ada12908312d4afccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.051925 16097 tablet_bootstrap.cc:492] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:12.057080 15927 tablet_service.cc:1511] Processing CreateTablet for tablet fb3cdc33d24f40db996a1bb31d23cf0c (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:12.058061 16096 ts_tablet_manager.cc:1434] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.004s
I20260709 13:18:12.058984 15780 tablet_service.cc:1511] Processing CreateTablet for tablet fb3cdc33d24f40db996a1bb31d23cf0c (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:12.059738 16097 tablet_bootstrap.cc:654] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.060300 15780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb3cdc33d24f40db996a1bb31d23cf0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.060931 15854 tablet_service.cc:1511] Processing CreateTablet for tablet 938727ad2d8048ada12908312d4afccf (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:12.063476 15927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb3cdc33d24f40db996a1bb31d23cf0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.064184 16096 tablet_bootstrap.cc:492] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:12.067469 15932 tablet_service.cc:1511] Processing CreateTablet for tablet 938727ad2d8048ada12908312d4afccf (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:12.070345 15932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938727ad2d8048ada12908312d4afccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.078244 15782 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb73b286b93435b9982cd822dc4d1e6 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:12.079564 15782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb73b286b93435b9982cd822dc4d1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.082230 15858 tablet_service.cc:1511] Processing CreateTablet for tablet fb3cdc33d24f40db996a1bb31d23cf0c (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:12.088527 15855 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb73b286b93435b9982cd822dc4d1e6 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:12.088569 15930 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb73b286b93435b9982cd822dc4d1e6 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:12.090930 15930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb73b286b93435b9982cd822dc4d1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.095157 16084 raft_consensus.cc:493] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.095279 15779 tablet_service.cc:1511] Processing CreateTablet for tablet a4a1a4f5de12499da45dfcbc94771726 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:12.095765 16084 raft_consensus.cc:515] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.096626 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a1a4f5de12499da45dfcbc94771726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.097316 15859 tablet_service.cc:1511] Processing CreateTablet for tablet a4a1a4f5de12499da45dfcbc94771726 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:12.098029 16084 leader_election.cc:290] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:12.100975 15867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a458df2344444daab8ecaf20d448f4" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:12.101486 15854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938727ad2d8048ada12908312d4afccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.101727 15867 raft_consensus.cc:2468] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 0.
I20260709 13:18:12.102173 15858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb3cdc33d24f40db996a1bb31d23cf0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.103142 15859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a1a4f5de12499da45dfcbc94771726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.103901 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a458df2344444daab8ecaf20d448f4" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:12.103163 15908 leader_election.cc:304] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b; no voters: 
I20260709 13:18:12.105099 15855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb73b286b93435b9982cd822dc4d1e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:12.105408 15907 leader_election.cc:343] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2125841728845849d019dcf41500f09 (127.4.254.1:38511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.109324 16084 raft_consensus.cc:2804] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.109866 16084 raft_consensus.cc:493] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.110212 16084 raft_consensus.cc:3060] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.120275 16097 tablet_bootstrap.cc:492] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:12.120961 16097 ts_tablet_manager.cc:1403] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.000s
I20260709 13:18:12.047463 16095 ts_tablet_manager.cc:1403] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.071s	user 0.021s	sys 0.044s
I20260709 13:18:12.070672 16096 tablet_bootstrap.cc:654] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.073076 15928 tablet_service.cc:1511] Processing CreateTablet for tablet 9702d92a4d3f43ac9df920d55fcc85ab (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:12.074730 15784 tablet_service.cc:1511] Processing CreateTablet for tablet 9702d92a4d3f43ac9df920d55fcc85ab (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:12.124451 15928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9702d92a4d3f43ac9df920d55fcc85ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.124523 15784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9702d92a4d3f43ac9df920d55fcc85ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.125720 16084 raft_consensus.cc:515] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.074494 15857 tablet_service.cc:1511] Processing CreateTablet for tablet 9702d92a4d3f43ac9df920d55fcc85ab (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:12.129536 16084 leader_election.cc:290] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:12.129920 15857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9702d92a4d3f43ac9df920d55fcc85ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.130128 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a458df2344444daab8ecaf20d448f4" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:12.130795 15867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a458df2344444daab8ecaf20d448f4" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:12.131397 15867 raft_consensus.cc:3060] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:12.131789 15907 leader_election.cc:343] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d2125841728845849d019dcf41500f09 (127.4.254.1:38511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.133252 15927 tablet_service.cc:1511] Processing CreateTablet for tablet a4a1a4f5de12499da45dfcbc94771726 (DEFAULT_TABLE table=soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:12.138617 15867 raft_consensus.cc:2468] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 1.
I20260709 13:18:12.140100 15908 leader_election.cc:304] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b; no voters: d2125841728845849d019dcf41500f09
I20260709 13:18:12.140003 16097 raft_consensus.cc:359] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.141098 16097 raft_consensus.cc:385] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.141502 16097 raft_consensus.cc:740] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.143019 16096 tablet_bootstrap.cc:492] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:12.143549 16096 ts_tablet_manager.cc:1403] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.005s
I20260709 13:18:12.131789 16095 raft_consensus.cc:359] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.144047 16095 raft_consensus.cc:385] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.146692 16095 raft_consensus.cc:740] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.147531 16095 consensus_queue.cc:260] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.148214 16096 raft_consensus.cc:359] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.142412 16097 consensus_queue.cc:260] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.148972 16096 raft_consensus.cc:385] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.149360 16096 raft_consensus.cc:740] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.150206 16096 consensus_queue.cc:260] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.157317 16084 raft_consensus.cc:2804] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.158320 16097 ts_tablet_manager.cc:1434] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.037s	user 0.001s	sys 0.006s
I20260709 13:18:12.159951 15927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a1a4f5de12499da45dfcbc94771726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.169723 16076 raft_consensus.cc:493] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.170361 16076 raft_consensus.cc:515] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.171518 16095 ts_tablet_manager.cc:1434] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:18:12.172627 16076 leader_election.cc:290] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:12.172808 16095 tablet_bootstrap.cc:492] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:12.174567 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c87f110fe24eb88a972f9cef7bc1a3" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:12.175333 15795 raft_consensus.cc:2468] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 0.
I20260709 13:18:12.175344 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c87f110fe24eb88a972f9cef7bc1a3" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
W20260709 13:18:12.177906 15836 leader_election.cc:343] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.178365 16097 tablet_bootstrap.cc:492] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:12.178714 15833 leader_election.cc:304] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:12.180423 16076 raft_consensus.cc:2804] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.180790 16076 raft_consensus.cc:493] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.181141 16076 raft_consensus.cc:3060] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.195871 16097 tablet_bootstrap.cc:654] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.198309 16076 raft_consensus.cc:515] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.226711 16096 ts_tablet_manager.cc:1434] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.083s	user 0.011s	sys 0.006s
I20260709 13:18:12.221438 16084 raft_consensus.cc:697] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Becoming Leader. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:12.207624 16095 tablet_bootstrap.cc:654] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.228546 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c87f110fe24eb88a972f9cef7bc1a3" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:12.230511 15795 raft_consensus.cc:3060] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.228818 16076 leader_election.cc:290] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:12.228575 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c87f110fe24eb88a972f9cef7bc1a3" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:12.232126 16096 tablet_bootstrap.cc:492] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
W20260709 13:18:12.232260 15836 leader_election.cc:343] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.230531 16084 consensus_queue.cc:237] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.238286 15795 raft_consensus.cc:2468] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 1.
I20260709 13:18:12.238737 16096 tablet_bootstrap.cc:654] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.239871 15833 leader_election.cc:304] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:12.241101 16097 tablet_bootstrap.cc:492] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:12.241261 16106 raft_consensus.cc:2804] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.243026 16106 raft_consensus.cc:697] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Becoming Leader. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:12.243919 16097 ts_tablet_manager.cc:1403] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.083s	user 0.035s	sys 0.003s
I20260709 13:18:12.243984 16106 consensus_queue.cc:237] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.251247 16097 raft_consensus.cc:359] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.252115 16097 raft_consensus.cc:385] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.252494 16097 raft_consensus.cc:740] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.253440 16097 consensus_queue.cc:260] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.256146 16097 ts_tablet_manager.cc:1434] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:18:12.257371 16097 tablet_bootstrap.cc:492] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:12.261077 16095 tablet_bootstrap.cc:492] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:12.262471 16095 ts_tablet_manager.cc:1403] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.090s	user 0.008s	sys 0.010s
I20260709 13:18:12.263230 15691 catalog_manager.cc:5697] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b reported cstate change: term changed from 0 to 1, leader changed from <none> to b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.265100 16097 tablet_bootstrap.cc:654] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.267340 16095 raft_consensus.cc:359] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.275278 16095 raft_consensus.cc:385] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.275621 16095 raft_consensus.cc:740] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.273893 16096 tablet_bootstrap.cc:492] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:12.276558 16096 ts_tablet_manager.cc:1403] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.014s
I20260709 13:18:12.279129 16096 raft_consensus.cc:359] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.279914 16096 raft_consensus.cc:385] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.280192 16096 raft_consensus.cc:740] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.280660 16095 consensus_queue.cc:260] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.281091 16096 consensus_queue.cc:260] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.283298 16095 ts_tablet_manager.cc:1434] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:18:12.283772 16096 ts_tablet_manager.cc:1434] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:12.284828 16096 tablet_bootstrap.cc:492] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:12.286458 16095 tablet_bootstrap.cc:492] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:12.291725 16096 tablet_bootstrap.cc:654] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.294672 16095 tablet_bootstrap.cc:654] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.303881 16096 tablet_bootstrap.cc:492] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:12.304217 16095 tablet_bootstrap.cc:492] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:12.304454 16096 ts_tablet_manager.cc:1403] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:18:12.304847 16095 ts_tablet_manager.cc:1403] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:18:12.307905 16095 raft_consensus.cc:359] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.307622 16096 raft_consensus.cc:359] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.308610 16095 raft_consensus.cc:385] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.308740 16096 raft_consensus.cc:385] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.309000 16095 raft_consensus.cc:740] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.310005 16095 consensus_queue.cc:260] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.312776 16095 ts_tablet_manager.cc:1434] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:18:12.309166 16096 raft_consensus.cc:740] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.313823 16096 consensus_queue.cc:260] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.316284 16096 ts_tablet_manager.cc:1434] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:18:12.317654 16096 tablet_bootstrap.cc:492] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:12.318428 16095 tablet_bootstrap.cc:492] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:12.324860 16096 tablet_bootstrap.cc:654] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.325716 16095 tablet_bootstrap.cc:654] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.326740 16084 raft_consensus.cc:493] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.327294 16084 raft_consensus.cc:515] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.329707 16084 leader_election.cc:290] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:12.331024 15867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3cdc33d24f40db996a1bb31d23cf0c" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:12.331729 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3cdc33d24f40db996a1bb31d23cf0c" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:12.332033 16097 tablet_bootstrap.cc:492] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:12.332542 16097 ts_tablet_manager.cc:1403] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.075s	user 0.027s	sys 0.038s
W20260709 13:18:12.332924 15908 leader_election.cc:343] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:12.333746 15907 leader_election.cc:343] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2125841728845849d019dcf41500f09 (127.4.254.1:38511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.334260 15907 leader_election.cc:304] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b; no voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09
I20260709 13:18:12.335687 16084 raft_consensus.cc:2749] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.336500 16097 raft_consensus.cc:359] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.337620 16097 raft_consensus.cc:385] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.338047 16097 raft_consensus.cc:740] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.339202 16097 consensus_queue.cc:260] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.340418 15692 catalog_manager.cc:5697] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.342530 16097 ts_tablet_manager.cc:1434] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:18:12.343669 16097 tablet_bootstrap.cc:492] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:12.344391 16095 tablet_bootstrap.cc:492] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:12.344679 16096 tablet_bootstrap.cc:492] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:12.344962 16095 ts_tablet_manager.cc:1403] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.004s
I20260709 13:18:12.345355 16096 ts_tablet_manager.cc:1403] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.008s
I20260709 13:18:12.349246 16096 raft_consensus.cc:359] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.350194 16097 tablet_bootstrap.cc:654] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.350687 16095 raft_consensus.cc:359] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.351536 16095 raft_consensus.cc:385] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.351902 16095 raft_consensus.cc:740] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.350442 16096 raft_consensus.cc:385] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.352758 16096 raft_consensus.cc:740] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.353470 16095 consensus_queue.cc:260] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.355141 16096 consensus_queue.cc:260] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.356767 16095 ts_tablet_manager.cc:1434] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:18:12.357990 16095 tablet_bootstrap.cc:492] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:12.364037 16096 ts_tablet_manager.cc:1434] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.005s
I20260709 13:18:12.366107 16095 tablet_bootstrap.cc:654] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.367316 16096 tablet_bootstrap.cc:492] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:12.377079 16097 tablet_bootstrap.cc:492] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:12.409104 16106 raft_consensus.cc:493] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.455741 16106 raft_consensus.cc:515] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.407833 16107 raft_consensus.cc:493] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.406920 16084 raft_consensus.cc:493] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.456995 16107 raft_consensus.cc:515] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.457824 16084 raft_consensus.cc:515] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.458832 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9e2f4d86f241d7a01d1d23bd3237a3" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:12.459481 15795 raft_consensus.cc:2468] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 0.
I20260709 13:18:12.460186 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9e2f4d86f241d7a01d1d23bd3237a3" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:12.460651 15833 leader_election.cc:304] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:12.460896 15791 raft_consensus.cc:2468] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 0.
I20260709 13:18:12.461073 16107 leader_election.cc:290] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:12.462291 16106 leader_election.cc:290] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:12.461997 15867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9e2f4d86f241d7a01d1d23bd3237a3" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:12.455731 16097 ts_tablet_manager.cc:1403] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.112s	user 0.027s	sys 0.019s
I20260709 13:18:12.462047 15907 leader_election.cc:304] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:12.463470 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7fc02bad1a5417c88748b1e544d9003" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:12.464279 15795 raft_consensus.cc:2468] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 0.
I20260709 13:18:12.399340 16081 raft_consensus.cc:493] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.465356 16081 raft_consensus.cc:515] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.465734 16097 raft_consensus.cc:359] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.466454 16097 raft_consensus.cc:385] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.466725 16097 raft_consensus.cc:740] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.467156 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7fc02bad1a5417c88748b1e544d9003" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:12.467798 15869 raft_consensus.cc:2468] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 0.
I20260709 13:18:12.467410 16097 consensus_queue.cc:260] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.468120 16081 leader_election.cc:290] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:12.462100 16111 raft_consensus.cc:2804] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.469174 16111 raft_consensus.cc:493] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.469250 16096 tablet_bootstrap.cc:654] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.469465 16097 ts_tablet_manager.cc:1434] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.005s
I20260709 13:18:12.469200 15908 leader_election.cc:304] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b; no voters: 
I20260709 13:18:12.470737 16097 tablet_bootstrap.cc:492] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:12.469611 16111 raft_consensus.cc:3060] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.467495 16107 raft_consensus.cc:2804] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.472384 16107 raft_consensus.cc:493] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.472750 16107 raft_consensus.cc:3060] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.473009 16103 raft_consensus.cc:2804] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.473479 16103 raft_consensus.cc:493] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.473784 16103 raft_consensus.cc:3060] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.477236 16097 tablet_bootstrap.cc:654] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.478344 15943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a458df2344444daab8ecaf20d448f4" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
I20260709 13:18:12.483393 16107 raft_consensus.cc:515] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.483978 16103 raft_consensus.cc:515] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.484227 16111 raft_consensus.cc:515] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.486855 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9e2f4d86f241d7a01d1d23bd3237a3" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:12.486855 16095 tablet_bootstrap.cc:492] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:12.489683 15795 raft_consensus.cc:3060] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.489980 16095 ts_tablet_manager.cc:1403] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.132s	user 0.033s	sys 0.034s
I20260709 13:18:12.490312 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7fc02bad1a5417c88748b1e544d9003" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:12.490895 15869 raft_consensus.cc:3060] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.492235 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9e2f4d86f241d7a01d1d23bd3237a3" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:12.493552 16095 raft_consensus.cc:359] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.494485 16095 raft_consensus.cc:385] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.494496 16107 leader_election.cc:290] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:12.487890 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7fc02bad1a5417c88748b1e544d9003" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:12.495576 15791 raft_consensus.cc:3060] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.497107 15795 raft_consensus.cc:2468] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 1.
I20260709 13:18:12.497323 16097 tablet_bootstrap.cc:492] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:12.485747 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9e2f4d86f241d7a01d1d23bd3237a3" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
I20260709 13:18:12.497920 16097 ts_tablet_manager.cc:1403] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.027s	user 0.001s	sys 0.016s
I20260709 13:18:12.498278 15944 raft_consensus.cc:2393] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in current term 1: Already voted for candidate b45ae26ee8b34e5189409e5c34ccd82b in this term.
I20260709 13:18:12.499008 15907 leader_election.cc:304] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 07fd5c48d9bc4793a2260eb5bcbd93d7
I20260709 13:18:12.499857 15867 raft_consensus.cc:2393] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b45ae26ee8b34e5189409e5c34ccd82b in current term 1: Already voted for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in this term.
I20260709 13:18:12.501034 16097 raft_consensus.cc:359] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.494906 16095 raft_consensus.cc:740] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.501874 16104 raft_consensus.cc:2804] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.485483 16084 leader_election.cc:290] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:12.502528 16095 consensus_queue.cc:260] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.503983 15791 raft_consensus.cc:2468] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 1.
I20260709 13:18:12.504341 15869 raft_consensus.cc:2468] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 1.
I20260709 13:18:12.504981 16095 ts_tablet_manager.cc:1434] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:18:12.505396 15907 leader_election.cc:304] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:12.506222 16095 tablet_bootstrap.cc:492] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:12.506525 16084 raft_consensus.cc:2804] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.506592 16103 leader_election.cc:290] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:12.507141 16084 raft_consensus.cc:697] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Becoming Leader. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:12.508026 16084 consensus_queue.cc:237] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.508857 16097 raft_consensus.cc:385] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.509302 16097 raft_consensus.cc:740] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.513931 16096 tablet_bootstrap.cc:492] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:12.513643 16081 raft_consensus.cc:493] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.514518 16096 ts_tablet_manager.cc:1403] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.148s	user 0.014s	sys 0.004s
I20260709 13:18:12.514855 16111 leader_election.cc:290] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:12.514779 16081 raft_consensus.cc:515] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.516083 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9e2f4d86f241d7a01d1d23bd3237a3" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:12.516909 16081 leader_election.cc:290] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:12.519280 16097 consensus_queue.cc:260] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.510545 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a458df2344444daab8ecaf20d448f4" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:12.518002 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9e2f4d86f241d7a01d1d23bd3237a3" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:12.520787 15869 raft_consensus.cc:2393] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2125841728845849d019dcf41500f09 in current term 1: Already voted for candidate b45ae26ee8b34e5189409e5c34ccd82b in this term.
I20260709 13:18:12.520872 15791 raft_consensus.cc:2393] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in current term 1: Already voted for candidate b45ae26ee8b34e5189409e5c34ccd82b in this term.
I20260709 13:18:12.522042 15759 leader_election.cc:304] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2125841728845849d019dcf41500f09; no voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:12.523600 16081 raft_consensus.cc:3060] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.523821 16095 tablet_bootstrap.cc:654] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.518052 15943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3cdc33d24f40db996a1bb31d23cf0c" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
I20260709 13:18:12.519717 15867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3cdc33d24f40db996a1bb31d23cf0c" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:12.522311 16097 ts_tablet_manager.cc:1434] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:18:12.517663 16096 raft_consensus.cc:359] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.527410 16096 raft_consensus.cc:385] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.527554 15943 raft_consensus.cc:2468] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 0.
I20260709 13:18:12.527935 16096 raft_consensus.cc:740] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.528927 16096 consensus_queue.cc:260] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.532871 15761 leader_election.cc:304] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:12.533910 16120 raft_consensus.cc:2804] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.534286 16120 raft_consensus.cc:493] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.534590 16120 raft_consensus.cc:3060] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.537616 16097 tablet_bootstrap.cc:492] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:12.535630 16104 raft_consensus.cc:697] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Becoming Leader. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
W20260709 13:18:12.538892 15759 leader_election.cc:343] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.534793 16096 ts_tablet_manager.cc:1434] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 13:18:12.539794 16081 raft_consensus.cc:2749] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.540712 16096 tablet_bootstrap.cc:492] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:12.540557 16104 consensus_queue.cc:237] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.544922 16120 raft_consensus.cc:515] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.551083 16095 tablet_bootstrap.cc:492] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:12.551703 16095 ts_tablet_manager.cc:1403] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.002s
I20260709 13:18:12.556485 16097 tablet_bootstrap.cc:654] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.554421 15867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3cdc33d24f40db996a1bb31d23cf0c" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:12.554782 16095 raft_consensus.cc:359] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.557727 16095 raft_consensus.cc:385] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.558109 16095 raft_consensus.cc:740] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
W20260709 13:18:12.558368 15759 leader_election.cc:343] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.559062 16095 consensus_queue.cc:260] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.554124 16096 tablet_bootstrap.cc:654] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.559667 15836 leader_election.cc:304] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7; no voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09
I20260709 13:18:12.560599 16111 raft_consensus.cc:2749] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.561719 16095 ts_tablet_manager.cc:1434] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.001s
I20260709 13:18:12.562772 16095 tablet_bootstrap.cc:492] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:12.563880 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3cdc33d24f40db996a1bb31d23cf0c" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:12.563580 15690 catalog_manager.cc:5697] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b reported cstate change: term changed from 0 to 1, leader changed from <none> to b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.564707 15944 raft_consensus.cc:3060] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.569022 16095 tablet_bootstrap.cc:654] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.570071 16097 tablet_bootstrap.cc:492] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:12.570665 16097 ts_tablet_manager.cc:1403] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.002s
I20260709 13:18:12.574195 16097 raft_consensus.cc:359] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.574992 16097 raft_consensus.cc:385] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.575347 16097 raft_consensus.cc:740] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.576090 16097 consensus_queue.cc:260] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.578418 16097 ts_tablet_manager.cc:1434] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:12.579469 16097 tablet_bootstrap.cc:492] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:12.580209 15944 raft_consensus.cc:2468] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 1.
I20260709 13:18:12.581547 16120 leader_election.cc:290] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 election: Requested vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:12.584417 15761 leader_election.cc:304] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 07fd5c48d9bc4793a2260eb5bcbd93d7
I20260709 13:18:12.585458 16096 tablet_bootstrap.cc:492] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:12.585870 16120 raft_consensus.cc:2804] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.586304 16096 ts_tablet_manager.cc:1403] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.046s	user 0.025s	sys 0.007s
I20260709 13:18:12.586445 16120 raft_consensus.cc:697] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Becoming Leader. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:12.587894 16097 tablet_bootstrap.cc:654] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.587468 16120 consensus_queue.cc:237] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.590580 16096 raft_consensus.cc:359] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.591976 16096 raft_consensus.cc:385] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.592427 16096 raft_consensus.cc:740] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.593055 15692 catalog_manager.cc:5697] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b reported cstate change: term changed from 0 to 1, leader changed from <none> to b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3). New cstate: current_term: 1 leader_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.593588 16096 consensus_queue.cc:260] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.597453 16096 ts_tablet_manager.cc:1434] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:18:12.597675 16119 raft_consensus.cc:493] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.598227 16119 raft_consensus.cc:515] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.599097 16111 raft_consensus.cc:493] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.599630 16111 raft_consensus.cc:515] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.600484 16119 leader_election.cc:290] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:12.601723 16111 leader_election.cc:290] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:12.602003 16104 raft_consensus.cc:493] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.602478 16104 raft_consensus.cc:515] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.604561 16104 leader_election.cc:290] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:12.604976 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb73b286b93435b9982cd822dc4d1e6" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
I20260709 13:18:12.605666 15944 raft_consensus.cc:2468] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 0.
I20260709 13:18:12.606387 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb73b286b93435b9982cd822dc4d1e6" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:12.608412 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb73b286b93435b9982cd822dc4d1e6" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:12.599126 16096 tablet_bootstrap.cc:492] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:12.609398 15836 leader_election.cc:304] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b; no voters: 
W20260709 13:18:12.610522 15907 leader_election.cc:343] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2125841728845849d019dcf41500f09 (127.4.254.1:38511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.612270 15868 raft_consensus.cc:2468] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 0.
I20260709 13:18:12.613984 15908 leader_election.cc:304] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b; no voters: d2125841728845849d019dcf41500f09
I20260709 13:18:12.615368 16111 raft_consensus.cc:2804] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.616083 16095 tablet_bootstrap.cc:492] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:12.616636 16095 ts_tablet_manager.cc:1403] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.018s
I20260709 13:18:12.617668 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb73b286b93435b9982cd822dc4d1e6" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
W20260709 13:18:12.619343 15833 leader_election.cc:343] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2125841728845849d019dcf41500f09 (127.4.254.1:38511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.620266 16095 raft_consensus.cc:359] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.621137 16095 raft_consensus.cc:385] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.621531 16095 raft_consensus.cc:740] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.622720 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a1a4f5de12499da45dfcbc94771726" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
I20260709 13:18:12.622408 16095 consensus_queue.cc:260] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.623986 16104 raft_consensus.cc:2804] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:18:12.624207 15761 leader_election.cc:343] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.624421 16104 raft_consensus.cc:493] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.624781 16104 raft_consensus.cc:3060] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.627379 16084 raft_consensus.cc:493] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.623469 16111 raft_consensus.cc:493] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.628089 16084 raft_consensus.cc:515] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.629066 16111 raft_consensus.cc:3060] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.631036 16084 leader_election.cc:290] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:12.634428 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702d92a4d3f43ac9df920d55fcc85ab" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:12.637595 15867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a1a4f5de12499da45dfcbc94771726" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:12.635632 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702d92a4d3f43ac9df920d55fcc85ab" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:12.638692 15867 raft_consensus.cc:2468] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 0.
W20260709 13:18:12.637691 15908 leader_election.cc:343] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:12.639873 15907 leader_election.cc:343] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2125841728845849d019dcf41500f09 (127.4.254.1:38511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.640230 15759 leader_election.cc:304] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:12.640489 15907 leader_election.cc:304] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b; no voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09
I20260709 13:18:12.642495 16084 raft_consensus.cc:2749] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.642836 16119 raft_consensus.cc:2804] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.643488 16119 raft_consensus.cc:493] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.643764 16095 ts_tablet_manager.cc:1434] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.005s
I20260709 13:18:12.643940 16119 raft_consensus.cc:3060] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.645612 16095 tablet_bootstrap.cc:492] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:12.654366 16095 tablet_bootstrap.cc:654] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.617683 16096 tablet_bootstrap.cc:654] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.667924 16104 raft_consensus.cc:515] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.664332 16111 raft_consensus.cc:515] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.673226 16119 raft_consensus.cc:515] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.674219 16111 leader_election.cc:290] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:12.675189 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb73b286b93435b9982cd822dc4d1e6" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:12.676517 15791 raft_consensus.cc:3060] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.678339 16095 tablet_bootstrap.cc:492] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:12.679237 16119 leader_election.cc:290] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 election: Requested vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:12.679831 15867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a1a4f5de12499da45dfcbc94771726" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:12.680371 15867 raft_consensus.cc:3060] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.680642 15943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a1a4f5de12499da45dfcbc94771726" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:12.680749 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb73b286b93435b9982cd822dc4d1e6" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:12.681582 15944 raft_consensus.cc:2393] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in current term 1: Already voted for candidate b45ae26ee8b34e5189409e5c34ccd82b in this term.
W20260709 13:18:12.682519 15761 leader_election.cc:343] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.683022 15690 catalog_manager.cc:5697] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2125841728845849d019dcf41500f09 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "d2125841728845849d019dcf41500f09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.683923 16084 consensus_queue.cc:1048] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.684926 15944 raft_consensus.cc:3060] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.688191 16097 tablet_bootstrap.cc:492] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:12.679867 16095 ts_tablet_manager.cc:1403] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.004s
I20260709 13:18:12.690323 16097 ts_tablet_manager.cc:1403] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.111s	user 0.037s	sys 0.024s
I20260709 13:18:12.697340 15791 raft_consensus.cc:2468] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 1.
I20260709 13:18:12.699302 15833 leader_election.cc:304] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:12.700286 15867 raft_consensus.cc:2468] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 1.
I20260709 13:18:12.708993 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb73b286b93435b9982cd822dc4d1e6" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:12.709168 16097 raft_consensus.cc:359] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.700835 16076 raft_consensus.cc:2804] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.701299 16084 raft_consensus.cc:493] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.701083 16095 raft_consensus.cc:359] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.710734 16076 raft_consensus.cc:697] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Becoming Leader. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:12.711293 16095 raft_consensus.cc:385] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.711103 16084 raft_consensus.cc:515] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.711607 16095 raft_consensus.cc:740] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.712287 16095 consensus_queue.cc:260] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.714576 16095 ts_tablet_manager.cc:1434] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:18:12.714463 15759 leader_election.cc:304] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:12.714876 16084 leader_election.cc:290] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:12.715592 16095 tablet_bootstrap.cc:492] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09: Bootstrap starting.
I20260709 13:18:12.704101 16096 tablet_bootstrap.cc:492] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:12.716342 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c87f110fe24eb88a972f9cef7bc1a3" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" is_pre_election: true
I20260709 13:18:12.715982 16120 raft_consensus.cc:2804] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.717362 16120 raft_consensus.cc:697] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Becoming Leader. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:12.718223 16120 consensus_queue.cc:237] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.716511 16096 ts_tablet_manager.cc:1403] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.118s	user 0.010s	sys 0.004s
I20260709 13:18:12.709980 16097 raft_consensus.cc:385] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.716454 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c87f110fe24eb88a972f9cef7bc1a3" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:12.721266 16097 raft_consensus.cc:740] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.721678 15795 raft_consensus.cc:2468] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 1.
I20260709 13:18:12.722026 16097 consensus_queue.cc:260] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.723129 16096 raft_consensus.cc:359] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.723238 15907 leader_election.cc:304] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 07fd5c48d9bc4793a2260eb5bcbd93d7
I20260709 13:18:12.723945 16096 raft_consensus.cc:385] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.724139 16097 ts_tablet_manager.cc:1434] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:18:12.725035 16095 tablet_bootstrap.cc:654] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.725687 16097 tablet_bootstrap.cc:492] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7: Bootstrap starting.
I20260709 13:18:12.712044 16076 consensus_queue.cc:237] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.724403 16084 raft_consensus.cc:2804] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:12.727008 16084 raft_consensus.cc:493] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.727452 16084 raft_consensus.cc:3060] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.739390 16096 raft_consensus.cc:740] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.701467 16111 consensus_queue.cc:1048] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:18:12.706033 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb73b286b93435b9982cd822dc4d1e6" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:12.742652 16107 consensus_queue.cc:1048] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.705149 16104 leader_election.cc:290] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:12.743516 16096 consensus_queue.cc:260] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.753119 15791 raft_consensus.cc:2393] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b45ae26ee8b34e5189409e5c34ccd82b in current term 1: Already voted for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in this term.
I20260709 13:18:12.756523 16097 tablet_bootstrap.cc:654] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.756814 16122 raft_consensus.cc:493] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.757330 16122 raft_consensus.cc:515] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.760571 16122 leader_election.cc:290] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:12.762920 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938727ad2d8048ada12908312d4afccf" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
I20260709 13:18:12.774317 16096 ts_tablet_manager.cc:1434] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 13:18:12.775799 16096 tablet_bootstrap.cc:492] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b: Bootstrap starting.
I20260709 13:18:12.763643 15944 raft_consensus.cc:2468] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 0.
I20260709 13:18:12.782215 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938727ad2d8048ada12908312d4afccf" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:12.782930 15795 raft_consensus.cc:2468] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 0.
I20260709 13:18:12.784946 16095 tablet_bootstrap.cc:492] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09: No bootstrap required, opened a new log
I20260709 13:18:12.785651 16095 ts_tablet_manager.cc:1403] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09: Time spent bootstrapping tablet: real 0.070s	user 0.020s	sys 0.006s
I20260709 13:18:12.789922 15833 leader_election.cc:304] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:12.790201 16111 consensus_queue.cc:1048] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.791381 16122 raft_consensus.cc:2804] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.791977 16122 raft_consensus.cc:493] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.792388 16122 raft_consensus.cc:3060] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.792642 16095 raft_consensus.cc:359] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.793380 16095 raft_consensus.cc:385] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.793654 16095 raft_consensus.cc:740] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.794278 16095 consensus_queue.cc:260] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.796257 16095 ts_tablet_manager.cc:1434] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:18:12.798379 16084 raft_consensus.cc:515] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.799561 15943 raft_consensus.cc:1240] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Rejecting Update request from peer 07fd5c48d9bc4793a2260eb5bcbd93d7 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:18:12.801384 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c87f110fe24eb88a972f9cef7bc1a3" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:12.802024 15795 raft_consensus.cc:3060] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.807305 16111 consensus_queue.cc:1059] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.808145 16111 raft_consensus.cc:3055] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:12.808841 15795 raft_consensus.cc:2468] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 2.
I20260709 13:18:12.808440 16111 raft_consensus.cc:740] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:12.812587 15907 leader_election.cc:304] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:12.813254 16111 consensus_queue.cc:260] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.812376 15791 raft_consensus.cc:1240] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Rejecting Update request from peer 07fd5c48d9bc4793a2260eb5bcbd93d7 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:18:12.813866 16084 leader_election.cc:290] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 2 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:12.813934 16107 raft_consensus.cc:2804] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:12.814544 16107 raft_consensus.cc:697] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 LEADER]: Becoming Leader. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:12.815389 16107 consensus_queue.cc:237] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.816322 16122 raft_consensus.cc:515] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.818437 16122 leader_election.cc:290] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:12.819306 16111 raft_consensus.cc:3060] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.820159 16096 tablet_bootstrap.cc:654] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.822558 15943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938727ad2d8048ada12908312d4afccf" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:12.823992 15943 raft_consensus.cc:3060] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.822659 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c87f110fe24eb88a972f9cef7bc1a3" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:12.828640 15908 leader_election.cc:304] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b; no voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09
I20260709 13:18:12.830838 15868 raft_consensus.cc:2410] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b45ae26ee8b34e5189409e5c34ccd82b for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:18:12.831086 16084 raft_consensus.cc:2749] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.821053 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938727ad2d8048ada12908312d4afccf" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:12.835835 15794 raft_consensus.cc:3060] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.826797 15693 catalog_manager.cc:5697] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.839936 16097 tablet_bootstrap.cc:492] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7: No bootstrap required, opened a new log
I20260709 13:18:12.840499 16097 ts_tablet_manager.cc:1403] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.011s
I20260709 13:18:12.840319 15943 raft_consensus.cc:2468] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 1.
I20260709 13:18:12.841257 15690 catalog_manager.cc:5697] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2125841728845849d019dcf41500f09 (127.4.254.1). New cstate: current_term: 1 leader_uuid: "d2125841728845849d019dcf41500f09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.843101 15836 leader_election.cc:304] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b; no voters: 
I20260709 13:18:12.848985 16111 raft_consensus.cc:2804] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.849684 16111 raft_consensus.cc:697] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Becoming Leader. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:12.850505 16111 consensus_queue.cc:237] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.852958 15692 catalog_manager.cc:5697] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b reported cstate change: term changed from 1 to 2, leader changed from 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2) to b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.858700 16097 raft_consensus.cc:359] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.871711 16097 raft_consensus.cc:385] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.872155 16097 raft_consensus.cc:740] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.873106 16097 consensus_queue.cc:260] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.878268 16097 ts_tablet_manager.cc:1434] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.004s
I20260709 13:18:12.885809 16096 tablet_bootstrap.cc:492] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b: No bootstrap required, opened a new log
I20260709 13:18:12.886152 15794 raft_consensus.cc:2468] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 1.
I20260709 13:18:12.886376 16096 ts_tablet_manager.cc:1403] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent bootstrapping tablet: real 0.111s	user 0.020s	sys 0.032s
I20260709 13:18:12.889357 16096 raft_consensus.cc:359] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.889094 15690 catalog_manager.cc:5697] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.890015 16096 raft_consensus.cc:385] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.890334 16096 raft_consensus.cc:740] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.890985 16096 consensus_queue.cc:260] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:12.892913 16096 ts_tablet_manager.cc:1434] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
W20260709 13:18:12.906256 15741 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:12.947634 16107 consensus_queue.cc:1048] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.957828 16104 consensus_queue.cc:1048] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:13.007603 16107 consensus_queue.cc:1048] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:13.020195 16125 consensus_queue.cc:1048] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:13.020960 16111 raft_consensus.cc:493] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.021572 16111 raft_consensus.cc:515] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.025763 16111 leader_election.cc:290] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:13.026002 15943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702d92a4d3f43ac9df920d55fcc85ab" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" is_pre_election: true
I20260709 13:18:13.026677 15943 raft_consensus.cc:2468] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 0.
I20260709 13:18:13.026966 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702d92a4d3f43ac9df920d55fcc85ab" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09" is_pre_election: true
I20260709 13:18:13.027657 15794 raft_consensus.cc:2468] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 0.
I20260709 13:18:13.027915 15836 leader_election.cc:304] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b; no voters: 
I20260709 13:18:13.028824 16111 raft_consensus.cc:2804] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:13.029239 16111 raft_consensus.cc:493] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.029536 16111 raft_consensus.cc:3060] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.036108 16111 raft_consensus.cc:515] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.038163 16111 leader_election.cc:290] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:13.038805 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702d92a4d3f43ac9df920d55fcc85ab" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:13.039245 15943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9702d92a4d3f43ac9df920d55fcc85ab" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:13.039511 15794 raft_consensus.cc:3060] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.039887 15943 raft_consensus.cc:3060] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.046757 15794 raft_consensus.cc:2468] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 1.
I20260709 13:18:13.046757 15943 raft_consensus.cc:2468] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 1.
I20260709 13:18:13.048138 15833 leader_election.cc:304] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:13.048826 16111 raft_consensus.cc:2804] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:13.049331 16111 raft_consensus.cc:697] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Becoming Leader. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:13.050062 16111 consensus_queue.cc:237] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.057196 15690 catalog_manager.cc:5697] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2). New cstate: current_term: 1 leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.104177 15943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0a458df2344444daab8ecaf20d448f4"
dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
mode: GRACEFUL
new_leader_uuid: "d2125841728845849d019dcf41500f09"
 from {username='slave'} at 127.0.0.1:50528
I20260709 13:18:13.104696 15943 raft_consensus.cc:606] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Received request to transfer leadership to TS d2125841728845849d019dcf41500f09
I20260709 13:18:13.109424 15943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7c87f110fe24eb88a972f9cef7bc1a3"
dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
mode: GRACEFUL
new_leader_uuid: "d2125841728845849d019dcf41500f09"
 from {username='slave'} at 127.0.0.1:50528
I20260709 13:18:13.109923 15943 raft_consensus.cc:606] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 LEADER]: Received request to transfer leadership to TS d2125841728845849d019dcf41500f09
I20260709 13:18:13.114403 15943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7fc02bad1a5417c88748b1e544d9003"
dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
mode: GRACEFUL
new_leader_uuid: "d2125841728845849d019dcf41500f09"
 from {username='slave'} at 127.0.0.1:50528
I20260709 13:18:13.114919 15943 raft_consensus.cc:606] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Received request to transfer leadership to TS d2125841728845849d019dcf41500f09
I20260709 13:18:13.119392 15943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d9e2f4d86f241d7a01d1d23bd3237a3"
dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
mode: GRACEFUL
new_leader_uuid: "d2125841728845849d019dcf41500f09"
 from {username='slave'} at 127.0.0.1:50528
I20260709 13:18:13.119844 15943 raft_consensus.cc:606] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Received request to transfer leadership to TS d2125841728845849d019dcf41500f09
I20260709 13:18:13.127151 15794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb3cdc33d24f40db996a1bb31d23cf0c"
dest_uuid: "d2125841728845849d019dcf41500f09"
mode: GRACEFUL
new_leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
 from {username='slave'} at 127.0.0.1:55510
I20260709 13:18:13.127780 15794 raft_consensus.cc:606] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Received request to transfer leadership to TS 07fd5c48d9bc4793a2260eb5bcbd93d7
I20260709 13:18:13.136737 16111 consensus_queue.cc:1048] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:13.138413 15794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4a1a4f5de12499da45dfcbc94771726"
dest_uuid: "d2125841728845849d019dcf41500f09"
mode: GRACEFUL
new_leader_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
 from {username='slave'} at 127.0.0.1:55510
I20260709 13:18:13.139019 15794 raft_consensus.cc:606] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Received request to transfer leadership to TS b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:13.148885 16111 consensus_queue.cc:1048] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:13.153376 16119 consensus_queue.cc:1048] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:13.153976 16120 consensus_queue.cc:1048] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:13.165649 15943 raft_consensus.cc:3060] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.170987 15868 raft_consensus.cc:3060] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.175838 16081 consensus_queue.cc:1048] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:13.180617 16119 consensus_queue.cc:1048] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:13.188789 16081 raft_consensus.cc:993] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09: : Instructing follower b45ae26ee8b34e5189409e5c34ccd82b to start an election
I20260709 13:18:13.189407 16120 raft_consensus.cc:1081] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Signalling peer b45ae26ee8b34e5189409e5c34ccd82b to start an election
I20260709 13:18:13.191442 15943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4a1a4f5de12499da45dfcbc94771726"
dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
 from {username='slave'} at 127.0.0.1:50514
I20260709 13:18:13.192117 15943 raft_consensus.cc:493] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.192513 15943 raft_consensus.cc:3060] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.196506 16119 raft_consensus.cc:993] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09: : Instructing follower 07fd5c48d9bc4793a2260eb5bcbd93d7 to start an election
I20260709 13:18:13.197036 16120 raft_consensus.cc:1081] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Signalling peer 07fd5c48d9bc4793a2260eb5bcbd93d7 to start an election
I20260709 13:18:13.198851 15868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb3cdc33d24f40db996a1bb31d23cf0c"
dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
 from {username='slave'} at 127.0.0.1:53524
I20260709 13:18:13.199417 15868 raft_consensus.cc:493] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.199797 15868 raft_consensus.cc:3060] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.199908 15943 raft_consensus.cc:515] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.202890 15943 leader_election.cc:290] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 2 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:13.203018 15791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a1a4f5de12499da45dfcbc94771726" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:13.203657 15791 raft_consensus.cc:3055] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:13.203967 15791 raft_consensus.cc:740] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:13.204756 15867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a1a4f5de12499da45dfcbc94771726" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:13.204753 15791 consensus_queue.cc:260] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.205528 15867 raft_consensus.cc:3060] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.206174 15791 raft_consensus.cc:3060] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.206590 15868 raft_consensus.cc:515] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.209646 15868 leader_election.cc:290] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 2 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:13.210785 15794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3cdc33d24f40db996a1bb31d23cf0c" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:13.211419 15794 raft_consensus.cc:3055] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:13.211752 15794 raft_consensus.cc:740] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:13.212531 15794 consensus_queue.cc:260] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.213183 15791 raft_consensus.cc:2468] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 2.
I20260709 13:18:13.213879 15794 raft_consensus.cc:3060] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.214457 15907 leader_election.cc:304] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:13.215387 16125 raft_consensus.cc:2804] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:13.215852 16125 raft_consensus.cc:697] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 LEADER]: Becoming Leader. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:13.216632 16125 consensus_queue.cc:237] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.217563 15867 raft_consensus.cc:2468] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 2.
I20260709 13:18:13.218870 15943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3cdc33d24f40db996a1bb31d23cf0c" candidate_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:13.219465 15943 raft_consensus.cc:3060] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.221457 15794 raft_consensus.cc:2468] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 2.
I20260709 13:18:13.222981 15833 leader_election.cc:304] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:13.224133 16076 raft_consensus.cc:2804] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:13.224673 16076 raft_consensus.cc:697] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 LEADER]: Becoming Leader. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:13.225441 16076 consensus_queue.cc:237] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.226384 15690 catalog_manager.cc:5697] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b reported cstate change: term changed from 1 to 2, leader changed from d2125841728845849d019dcf41500f09 (127.4.254.1) to b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3). New cstate: current_term: 2 leader_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.228008 15943 raft_consensus.cc:2468] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fd5c48d9bc4793a2260eb5bcbd93d7 in term 2.
I20260709 13:18:13.232710 15692 catalog_manager.cc:5697] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 reported cstate change: term changed from 1 to 2, leader changed from d2125841728845849d019dcf41500f09 (127.4.254.1) to 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2). New cstate: current_term: 2 leader_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.246649 15794 raft_consensus.cc:1275] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Refusing update from remote peer b45ae26ee8b34e5189409e5c34ccd82b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:13.247932 16125 consensus_queue.cc:1048] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:13.257412 16104 raft_consensus.cc:993] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b: : Instructing follower d2125841728845849d019dcf41500f09 to start an election
I20260709 13:18:13.257879 16104 raft_consensus.cc:1081] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 LEADER]: Signalling peer d2125841728845849d019dcf41500f09 to start an election
I20260709 13:18:13.259029 16084 raft_consensus.cc:993] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b: : Instructing follower d2125841728845849d019dcf41500f09 to start an election
I20260709 13:18:13.259451 16084 raft_consensus.cc:1081] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Signalling peer d2125841728845849d019dcf41500f09 to start an election
I20260709 13:18:13.259604 15791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7c87f110fe24eb88a972f9cef7bc1a3"
dest_uuid: "d2125841728845849d019dcf41500f09"
 from {username='slave'} at 127.0.0.1:55500
I20260709 13:18:13.262282 15795 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0a458df2344444daab8ecaf20d448f4"
dest_uuid: "d2125841728845849d019dcf41500f09"
 from {username='slave'} at 127.0.0.1:55500
I20260709 13:18:13.262848 15795 raft_consensus.cc:493] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.263162 15791 raft_consensus.cc:493] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.263688 15791 raft_consensus.cc:3060] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.263231 15795 raft_consensus.cc:3060] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.265895 15867 raft_consensus.cc:1275] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Refusing update from remote peer b45ae26ee8b34e5189409e5c34ccd82b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:18:13.266310 15867 pending_rounds.cc:85] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Aborting all ops after (but not including) 0
I20260709 13:18:13.266517 15867 pending_rounds.cc:107] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:18:13.266772 15867 raft_consensus.cc:2889] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:13.269279 16104 consensus_queue.cc:1048] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:13.273196 15791 raft_consensus.cc:515] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.274891 15795 raft_consensus.cc:515] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.278167 15791 leader_election.cc:290] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 3 election: Requested vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:13.278283 15867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c87f110fe24eb88a972f9cef7bc1a3" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:13.278996 15867 raft_consensus.cc:3060] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.279359 15943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c87f110fe24eb88a972f9cef7bc1a3" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:13.280001 15943 raft_consensus.cc:3055] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:13.281729 15943 raft_consensus.cc:740] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:13.281876 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a458df2344444daab8ecaf20d448f4" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:13.282509 15868 raft_consensus.cc:3060] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.282699 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a458df2344444daab8ecaf20d448f4" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:13.283329 15944 raft_consensus.cc:3055] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:13.283638 15944 raft_consensus.cc:740] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:13.281282 15795 leader_election.cc:290] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 2 election: Requested vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:13.284451 15944 consensus_queue.cc:260] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.282719 15943 consensus_queue.cc:260] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.285774 15944 raft_consensus.cc:3060] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.286556 15943 raft_consensus.cc:3060] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.289928 15868 raft_consensus.cc:2468] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 2.
I20260709 13:18:13.291306 15759 leader_election.cc:304] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:13.292224 16120 raft_consensus.cc:2804] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:13.292709 16120 raft_consensus.cc:697] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Becoming Leader. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:13.294198 15943 raft_consensus.cc:2468] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 3.
I20260709 13:18:13.294428 16120 consensus_queue.cc:237] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.295224 15867 raft_consensus.cc:2468] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 3.
I20260709 13:18:13.295504 15761 leader_election.cc:304] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:13.295779 15944 raft_consensus.cc:2468] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 2.
I20260709 13:18:13.296463 16081 raft_consensus.cc:2804] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:13.296949 16081 raft_consensus.cc:697] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 3 LEADER]: Becoming Leader. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:13.297789 16081 consensus_queue.cc:237] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.302853 15692 catalog_manager.cc:5697] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 reported cstate change: term changed from 1 to 2, leader changed from b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3) to d2125841728845849d019dcf41500f09 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "d2125841728845849d019dcf41500f09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.307251 16076 consensus_queue.cc:1048] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:13.317796 16122 consensus_queue.cc:1048] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:13.317996 15692 catalog_manager.cc:5697] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 reported cstate change: term changed from 2 to 3, leader changed from b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3) to d2125841728845849d019dcf41500f09 (127.4.254.1). New cstate: current_term: 3 leader_uuid: "d2125841728845849d019dcf41500f09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.369067 16125 raft_consensus.cc:993] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b: : Instructing follower d2125841728845849d019dcf41500f09 to start an election
I20260709 13:18:13.369560 16104 raft_consensus.cc:1081] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Signalling peer d2125841728845849d019dcf41500f09 to start an election
I20260709 13:18:13.371086 15795 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7fc02bad1a5417c88748b1e544d9003"
dest_uuid: "d2125841728845849d019dcf41500f09"
 from {username='slave'} at 127.0.0.1:55500
I20260709 13:18:13.371601 15795 raft_consensus.cc:493] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.371941 15795 raft_consensus.cc:3060] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.376433 15795 raft_consensus.cc:515] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.377956 15795 leader_election.cc:290] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 2 election: Requested vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:13.378787 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7fc02bad1a5417c88748b1e544d9003" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:13.379128 15944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7fc02bad1a5417c88748b1e544d9003" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:13.379448 15868 raft_consensus.cc:3060] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.379801 15944 raft_consensus.cc:3055] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:13.380164 15944 raft_consensus.cc:740] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:13.380959 15944 consensus_queue.cc:260] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.382292 15944 raft_consensus.cc:3060] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.385778 15868 raft_consensus.cc:2468] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 2.
I20260709 13:18:13.386819 15759 leader_election.cc:304] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:13.387564 16120 raft_consensus.cc:2804] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:13.388019 16120 raft_consensus.cc:697] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Becoming Leader. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:13.388818 16120 consensus_queue.cc:237] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.389524 15944 raft_consensus.cc:2468] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 2.
I20260709 13:18:13.395653 15690 catalog_manager.cc:5697] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 reported cstate change: term changed from 1 to 2, leader changed from b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3) to d2125841728845849d019dcf41500f09 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "d2125841728845849d019dcf41500f09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.499337 16125 raft_consensus.cc:993] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b: : Instructing follower d2125841728845849d019dcf41500f09 to start an election
I20260709 13:18:13.499821 16125 raft_consensus.cc:1081] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Signalling peer d2125841728845849d019dcf41500f09 to start an election
I20260709 13:18:13.501622 15795 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d9e2f4d86f241d7a01d1d23bd3237a3"
dest_uuid: "d2125841728845849d019dcf41500f09"
 from {username='slave'} at 127.0.0.1:55500
I20260709 13:18:13.502171 15795 raft_consensus.cc:493] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.502524 15795 raft_consensus.cc:3060] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.510166 15795 raft_consensus.cc:515] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.512674 15795 leader_election.cc:290] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 2 election: Requested vote from peers 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099), b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3:43907)
I20260709 13:18:13.513306 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9e2f4d86f241d7a01d1d23bd3237a3" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:13.513242 15943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9e2f4d86f241d7a01d1d23bd3237a3" candidate_uuid: "d2125841728845849d019dcf41500f09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
I20260709 13:18:13.514132 15943 raft_consensus.cc:3055] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:13.514544 15943 raft_consensus.cc:740] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:13.515450 15943 consensus_queue.cc:260] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.517059 15943 raft_consensus.cc:3060] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.517458 15868 raft_consensus.cc:3060] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.523874 15943 raft_consensus.cc:2468] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 2.
I20260709 13:18:13.523924 15868 raft_consensus.cc:2468] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2125841728845849d019dcf41500f09 in term 2.
I20260709 13:18:13.526005 15761 leader_election.cc:304] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:13.526808 16081 raft_consensus.cc:2804] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:13.526624 16122 consensus_queue.cc:1048] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:13.527307 16081 raft_consensus.cc:697] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Becoming Leader. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:13.528091 16081 consensus_queue.cc:237] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:13.538645 15690 catalog_manager.cc:5697] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 reported cstate change: term changed from 1 to 2, leader changed from b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3) to d2125841728845849d019dcf41500f09 (127.4.254.1). New cstate: current_term: 2 leader_uuid: "d2125841728845849d019dcf41500f09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.553494 16122 consensus_queue.cc:1048] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:13.622342 15795 raft_consensus.cc:1275] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Refusing update from remote peer b45ae26ee8b34e5189409e5c34ccd82b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.623580 16125 consensus_queue.cc:1048] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.632658 15867 raft_consensus.cc:1275] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Refusing update from remote peer b45ae26ee8b34e5189409e5c34ccd82b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.634281 16125 consensus_queue.cc:1048] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.679919 15867 raft_consensus.cc:1275] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 3 FOLLOWER]: Refusing update from remote peer d2125841728845849d019dcf41500f09: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:13.681173 16081 consensus_queue.cc:1048] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.689188 15944 raft_consensus.cc:1275] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 3 FOLLOWER]: Refusing update from remote peer d2125841728845849d019dcf41500f09: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:13.690886 16120 consensus_queue.cc:1048] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.692476 15944 raft_consensus.cc:1275] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Refusing update from remote peer 07fd5c48d9bc4793a2260eb5bcbd93d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.699712 16111 consensus_queue.cc:1048] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.709460 15791 raft_consensus.cc:1275] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Refusing update from remote peer 07fd5c48d9bc4793a2260eb5bcbd93d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.711265 16076 consensus_queue.cc:1048] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.722071 15867 raft_consensus.cc:1275] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Refusing update from remote peer d2125841728845849d019dcf41500f09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.723372 16120 consensus_queue.cc:1048] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.731464 15944 raft_consensus.cc:1275] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Refusing update from remote peer d2125841728845849d019dcf41500f09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.733309 16081 consensus_queue.cc:1048] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.785468 15943 raft_consensus.cc:1275] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Refusing update from remote peer d2125841728845849d019dcf41500f09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.786682 16081 consensus_queue.cc:1048] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.797081 15867 raft_consensus.cc:1275] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Refusing update from remote peer d2125841728845849d019dcf41500f09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.799203 16120 consensus_queue.cc:1048] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:14.040414 15943 raft_consensus.cc:1275] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Refusing update from remote peer d2125841728845849d019dcf41500f09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:14.041908 16120 consensus_queue.cc:1048] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:14.054769 15867 raft_consensus.cc:1275] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Refusing update from remote peer d2125841728845849d019dcf41500f09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:14.056164 16120 consensus_queue.cc:1048] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:16.142740 15692 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58026:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:18:16.165925 15692 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58026:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:18:16.192931  5112 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:16.457957 16214 tablet.cc:1724] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:16.459764 16187 log.cc:927] Time spent T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:18:16.476646 15759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.2:33099, user_credentials={real_user=slave}} blocked reactor thread for 96726.6us
I20260709 13:18:16.511942 15793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa"
dest_uuid: "d2125841728845849d019dcf41500f09"
mode: GRACEFUL
new_leader_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
 from {username='slave'} at 127.0.0.1:43690
I20260709 13:18:16.516019 15793 raft_consensus.cc:606] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Received request to transfer leadership to TS b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:16.596082 16221 tablet.cc:1724] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.608583 16220 tablet.cc:1724] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:16.611718 16216 log.cc:927] Time spent T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:18:16.618358 16224 tablet.cc:1724] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:16.632012 16207 log.cc:927] Time spent T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Append to log took a long time: real 0.101s	user 0.002s	sys 0.002s
I20260709 13:18:16.647663 16235 tablet.cc:1724] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:16.657828 16212 log.cc:927] Time spent T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:18:16.664484 16222 log.cc:927] Time spent T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
W20260709 13:18:16.694269 16229 log.cc:927] Time spent T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:18:16.700134 16214 tablet.cc:1724] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.645566 16234 tablet.cc:1724] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.720240 16238 tablet.cc:1724] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.731312 16241 tablet.cc:1724] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.741958 16215 raft_consensus.cc:993] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09: : Instructing follower b45ae26ee8b34e5189409e5c34ccd82b to start an election
I20260709 13:18:16.742580 16215 raft_consensus.cc:1081] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Signalling peer b45ae26ee8b34e5189409e5c34ccd82b to start an election
I20260709 13:18:16.757938 16237 tablet.cc:1724] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.766436 16233 tablet.cc:1724] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.767397 16241 tablet.cc:1724] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.776263 16221 tablet.cc:1724] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.785449 15943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa"
dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
 from {username='slave'} at 127.0.0.1:50514
I20260709 13:18:16.786361 15943 raft_consensus.cc:493] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:16.786836 15943 raft_consensus.cc:3060] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.673870 16236 tablet.cc:1724] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.795488 16241 tablet.cc:1724] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.828327 16239 tablet.cc:1724] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.840590 15943 raft_consensus.cc:515] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:16.844894 15943 leader_election.cc:290] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 3 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:16.846053 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:16.846846 15795 raft_consensus.cc:3055] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:16.847124 15795 raft_consensus.cc:740] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2125841728845849d019dcf41500f09, State: Running, Role: LEADER
I20260709 13:18:16.849293 15795 consensus_queue.cc:260] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:16.852430 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7621f8dc45a74b1692dea1d9ab45abfa" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:16.853092 15870 raft_consensus.cc:3060] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.853787 15795 raft_consensus.cc:3060] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.863866 16214 tablet.cc:1724] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.863135 16239 tablet.cc:1724] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.869761 15870 raft_consensus.cc:2468] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 3.
I20260709 13:18:16.832242 16235 tablet.cc:1724] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.871434 15908 leader_election.cc:304] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07fd5c48d9bc4793a2260eb5bcbd93d7, b45ae26ee8b34e5189409e5c34ccd82b; no voters: 
I20260709 13:18:16.872618 16169 raft_consensus.cc:2804] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:16.873121 16169 raft_consensus.cc:697] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 3 LEADER]: Becoming Leader. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:16.874150 16169 consensus_queue.cc:237] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } }
I20260709 13:18:16.876874 16239 tablet.cc:1724] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.878118 16220 tablet.cc:1724] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.847658 16233 tablet.cc:1724] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.882707 15795 raft_consensus.cc:2468] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 3.
I20260709 13:18:16.885210 16234 tablet.cc:1724] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:16.887883 15833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.254.1:38511, user_credentials={real_user=slave}} blocked reactor thread for 80530.2us
I20260709 13:18:16.899955 16236 tablet.cc:1724] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.906422 15870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d77018beecd941398c8e0bcc7c8a92fa"
dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
mode: GRACEFUL
new_leader_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
 from {username='slave'} at 127.0.0.1:56814
I20260709 13:18:16.907150 15870 raft_consensus.cc:606] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 LEADER]: Received request to transfer leadership to TS b45ae26ee8b34e5189409e5c34ccd82b
I20260709 13:18:16.911686 16224 tablet.cc:1724] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.916239 16221 tablet.cc:1724] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.916765 16237 tablet.cc:1724] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:16.925312 15690 catalog_manager.cc:5697] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b reported cstate change: term changed from 2 to 3, leader changed from d2125841728845849d019dcf41500f09 (127.4.254.1) to b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3). New cstate: current_term: 3 leader_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.940892  5112 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:16.941622  5112 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:16.944566 16245 raft_consensus.cc:993] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7: : Instructing follower b45ae26ee8b34e5189409e5c34ccd82b to start an election
I20260709 13:18:16.945150 16245 raft_consensus.cc:1081] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 LEADER]: Signalling peer b45ae26ee8b34e5189409e5c34ccd82b to start an election
I20260709 13:18:16.949393 15942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d77018beecd941398c8e0bcc7c8a92fa"
dest_uuid: "b45ae26ee8b34e5189409e5c34ccd82b"
 from {username='slave'} at 127.0.0.1:50516
I20260709 13:18:16.949935 15942 raft_consensus.cc:493] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:16.950263 15942 raft_consensus.cc:3060] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.983336 15942 raft_consensus.cc:515] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:16.985889 15795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77018beecd941398c8e0bcc7c8a92fa" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d2125841728845849d019dcf41500f09"
I20260709 13:18:16.986245 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77018beecd941398c8e0bcc7c8a92fa" candidate_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7"
I20260709 13:18:16.986454 15795 raft_consensus.cc:3060] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.986892 15870 raft_consensus.cc:3055] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:16.987236 15870 raft_consensus.cc:740] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 07fd5c48d9bc4793a2260eb5bcbd93d7, State: Running, Role: LEADER
I20260709 13:18:16.988091 15870 consensus_queue.cc:260] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:16.989295 15870 raft_consensus.cc:3060] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.993897 15795 raft_consensus.cc:2468] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 3.
I20260709 13:18:16.995452 15907 leader_election.cc:304] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45ae26ee8b34e5189409e5c34ccd82b, d2125841728845849d019dcf41500f09; no voters: 
I20260709 13:18:16.996398 16169 raft_consensus.cc:2804] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:16.996891 15870 raft_consensus.cc:2468] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45ae26ee8b34e5189409e5c34ccd82b in term 3.
I20260709 13:18:16.996905 16169 raft_consensus.cc:697] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 3 LEADER]: Becoming Leader. State: Replica: b45ae26ee8b34e5189409e5c34ccd82b, State: Running, Role: LEADER
I20260709 13:18:16.998399 15942 leader_election.cc:290] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [CANDIDATE]: Term 3 election: Requested vote from peers d2125841728845849d019dcf41500f09 (127.4.254.1:38511), 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099)
I20260709 13:18:16.998293 16169 consensus_queue.cc:237] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } }
I20260709 13:18:17.013993 15693 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5: soft_deleted_table [id=6855a0abddd640b099b2e23760d4c6f0] alter complete (version 1)
I20260709 13:18:17.027994 15693 catalog_manager.cc:5697] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b reported cstate change: term changed from 2 to 3, leader changed from 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2) to b45ae26ee8b34e5189409e5c34ccd82b (127.4.254.3). New cstate: current_term: 3 leader_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45ae26ee8b34e5189409e5c34ccd82b" member_type: VOTER last_known_addr { host: "127.4.254.3" port: 43907 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.296239 15870 raft_consensus.cc:1275] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 3 FOLLOWER]: Refusing update from remote peer b45ae26ee8b34e5189409e5c34ccd82b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:17.297542 16169 consensus_queue.cc:1048] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:17.307904 15795 raft_consensus.cc:1275] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 3 FOLLOWER]: Refusing update from remote peer b45ae26ee8b34e5189409e5c34ccd82b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:17.310130 16191 consensus_queue.cc:1048] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:17.409435 15870 raft_consensus.cc:1275] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 3 FOLLOWER]: Refusing update from remote peer b45ae26ee8b34e5189409e5c34ccd82b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:17.410683 16191 consensus_queue.cc:1048] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fd5c48d9bc4793a2260eb5bcbd93d7" member_type: VOTER last_known_addr { host: "127.4.254.2" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:17.419060 15795 raft_consensus.cc:1275] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 3 FOLLOWER]: Refusing update from remote peer b45ae26ee8b34e5189409e5c34ccd82b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:17.420933 16256 consensus_queue.cc:1048] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2125841728845849d019dcf41500f09" member_type: VOTER last_known_addr { host: "127.4.254.1" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:17.995939  5112 tablet_server.cc:179] TabletServer@127.4.254.1:0 shutting down...
W20260709 13:18:18.016033 15833 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20260709 13:18:18.020174 15833 consensus_peers.cc:597] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 -> Peer d2125841728845849d019dcf41500f09 (127.4.254.1:38511): Couldn't send request to peer d2125841728845849d019dcf41500f09. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.027694  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:18.028542  5112 tablet_replica.cc:333] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.029309  5112 raft_consensus.cc:2243] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.029805  5112 raft_consensus.cc:2272] T 9702d92a4d3f43ac9df920d55fcc85ab P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.031968  5112 tablet_replica.cc:333] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.032613  5112 raft_consensus.cc:2243] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.033066  5112 raft_consensus.cc:2272] T 938727ad2d8048ada12908312d4afccf P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.035696  5112 tablet_replica.cc:333] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.036558  5112 raft_consensus.cc:2243] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.037565  5112 raft_consensus.cc:2272] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.040725  5112 tablet_replica.cc:333] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.041698  5112 raft_consensus.cc:2243] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.042687  5112 raft_consensus.cc:2272] T b7fc02bad1a5417c88748b1e544d9003 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.045437  5112 tablet_replica.cc:333] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.046255  5112 raft_consensus.cc:2243] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.046875  5112 raft_consensus.cc:2272] T b76dbdecebd545e89831e7ffff29e8b3 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.050096  5112 tablet_replica.cc:333] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.050889  5112 raft_consensus.cc:2243] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.051397  5112 raft_consensus.cc:2272] T d77018beecd941398c8e0bcc7c8a92fa P d2125841728845849d019dcf41500f09 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.054767  5112 tablet_replica.cc:333] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.055647  5112 raft_consensus.cc:2243] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.056213  5112 raft_consensus.cc:2272] T a4a1a4f5de12499da45dfcbc94771726 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.059032  5112 tablet_replica.cc:333] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.059844  5112 raft_consensus.cc:2243] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.060351  5112 raft_consensus.cc:2272] T 968f5a4c174c4e0baf9c60b1f7e69880 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.063162  5112 tablet_replica.cc:333] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.063920  5112 raft_consensus.cc:2243] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.064847  5112 raft_consensus.cc:2272] T 61bd2943bcf541a5b79d0456bbea0683 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.067620  5112 tablet_replica.cc:333] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.068123  5112 raft_consensus.cc:2243] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.068526  5112 raft_consensus.cc:2272] T 6f076fbe245547a68263c6793250c813 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.070592  5112 tablet_replica.cc:333] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.071079  5112 raft_consensus.cc:2243] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.071800  5112 raft_consensus.cc:2272] T 8ba8da1cbcf840f5a523e4482cda8ae8 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.074023  5112 tablet_replica.cc:333] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.074585  5112 raft_consensus.cc:2243] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.075003  5112 raft_consensus.cc:2272] T 2fb73b286b93435b9982cd822dc4d1e6 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.077071  5112 tablet_replica.cc:333] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.077637  5112 raft_consensus.cc:2243] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.078397  5112 raft_consensus.cc:2272] T a0a458df2344444daab8ecaf20d448f4 P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.080437  5112 tablet_replica.cc:333] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.080962  5112 raft_consensus.cc:2243] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.081440  5112 raft_consensus.cc:2272] T 8bdfdebfb9124e8191cf7c8f952ef4ea P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.083596  5112 tablet_replica.cc:333] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.084136  5112 raft_consensus.cc:2243] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.084558  5112 raft_consensus.cc:2272] T fb3cdc33d24f40db996a1bb31d23cf0c P d2125841728845849d019dcf41500f09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.086583  5112 tablet_replica.cc:333] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.087103  5112 raft_consensus.cc:2243] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.088101  5112 raft_consensus.cc:2272] T 726f9d99397d4d7ca425ce99b0de38e5 P d2125841728845849d019dcf41500f09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.090845  5112 tablet_replica.cc:333] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.091437  5112 raft_consensus.cc:2243] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:18:18.092141 15907 consensus_peers.cc:597] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b -> Peer d2125841728845849d019dcf41500f09 (127.4.254.1:38511): Couldn't send request to peer d2125841728845849d019dcf41500f09. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.092319  5112 raft_consensus.cc:2272] T a7c87f110fe24eb88a972f9cef7bc1a3 P d2125841728845849d019dcf41500f09 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.094645  5112 tablet_replica.cc:333] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09: stopping tablet replica
I20260709 13:18:18.095132  5112 raft_consensus.cc:2243] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.095536  5112 raft_consensus.cc:2272] T 7621f8dc45a74b1692dea1d9ab45abfa P d2125841728845849d019dcf41500f09 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:18.112510 15833 consensus_peers.cc:597] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 -> Peer d2125841728845849d019dcf41500f09 (127.4.254.1:38511): Couldn't send request to peer d2125841728845849d019dcf41500f09. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.137064  5112 tablet_server.cc:196] TabletServer@127.4.254.1:0 shutdown complete.
I20260709 13:18:18.177692  5112 tablet_server.cc:179] TabletServer@127.4.254.2:0 shutting down...
I20260709 13:18:18.209102  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:18.209926  5112 tablet_replica.cc:333] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.210834  5112 raft_consensus.cc:2243] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.211676  5112 raft_consensus.cc:2272] T 9702d92a4d3f43ac9df920d55fcc85ab P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.213837  5112 tablet_replica.cc:333] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.214780  5112 raft_consensus.cc:2243] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.215678  5112 raft_consensus.cc:2272] T 938727ad2d8048ada12908312d4afccf P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.217777  5112 tablet_replica.cc:333] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.218389  5112 raft_consensus.cc:2243] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.218827  5112 raft_consensus.cc:2272] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.220815  5112 tablet_replica.cc:333] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.221459  5112 raft_consensus.cc:2243] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.221900  5112 raft_consensus.cc:2272] T b7fc02bad1a5417c88748b1e544d9003 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.223829  5112 tablet_replica.cc:333] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.224419  5112 raft_consensus.cc:2243] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.224829  5112 raft_consensus.cc:2272] T d77018beecd941398c8e0bcc7c8a92fa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.227299  5112 tablet_replica.cc:333] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.227869  5112 raft_consensus.cc:2243] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.228317  5112 raft_consensus.cc:2272] T a7c87f110fe24eb88a972f9cef7bc1a3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.230305  5112 tablet_replica.cc:333] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.230870  5112 raft_consensus.cc:2243] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.231315  5112 raft_consensus.cc:2272] T 7621f8dc45a74b1692dea1d9ab45abfa P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.234014  5112 tablet_replica.cc:333] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.234593  5112 raft_consensus.cc:2243] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.235405  5112 raft_consensus.cc:2272] T b76dbdecebd545e89831e7ffff29e8b3 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.238013  5112 tablet_replica.cc:333] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.238575  5112 raft_consensus.cc:2243] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.239338  5112 raft_consensus.cc:2272] T 2fb73b286b93435b9982cd822dc4d1e6 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.241760  5112 tablet_replica.cc:333] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.242414  5112 raft_consensus.cc:2243] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.243124  5112 raft_consensus.cc:2272] T a0a458df2344444daab8ecaf20d448f4 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.245278  5112 tablet_replica.cc:333] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.245841  5112 raft_consensus.cc:2243] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.246685  5112 raft_consensus.cc:2272] T 8bdfdebfb9124e8191cf7c8f952ef4ea P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.248766  5112 tablet_replica.cc:333] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.249373  5112 raft_consensus.cc:2243] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.250159  5112 raft_consensus.cc:2272] T 6f076fbe245547a68263c6793250c813 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.252115  5112 tablet_replica.cc:333] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.252640  5112 raft_consensus.cc:2243] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.253083  5112 raft_consensus.cc:2272] T 8ba8da1cbcf840f5a523e4482cda8ae8 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.255157  5112 tablet_replica.cc:333] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.255676  5112 raft_consensus.cc:2243] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.256116  5112 raft_consensus.cc:2272] T a4a1a4f5de12499da45dfcbc94771726 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.258050  5112 tablet_replica.cc:333] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.258571  5112 raft_consensus.cc:2243] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.259037  5112 raft_consensus.cc:2272] T 61bd2943bcf541a5b79d0456bbea0683 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.261173  5112 tablet_replica.cc:333] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.261695  5112 raft_consensus.cc:2243] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.262135  5112 raft_consensus.cc:2272] T 968f5a4c174c4e0baf9c60b1f7e69880 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.264034  5112 tablet_replica.cc:333] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.264519  5112 raft_consensus.cc:2243] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.265262  5112 raft_consensus.cc:2272] T fb3cdc33d24f40db996a1bb31d23cf0c P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.267102  5112 tablet_replica.cc:333] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7: stopping tablet replica
I20260709 13:18:18.267565  5112 raft_consensus.cc:2243] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.267987  5112 raft_consensus.cc:2272] T 726f9d99397d4d7ca425ce99b0de38e5 P 07fd5c48d9bc4793a2260eb5bcbd93d7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:18.278630 15908 consensus_peers.cc:597] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b -> Peer 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099): Couldn't send request to peer 07fd5c48d9bc4793a2260eb5bcbd93d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.299172 15907 consensus_peers.cc:597] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b -> Peer d2125841728845849d019dcf41500f09 (127.4.254.1:38511): Couldn't send request to peer d2125841728845849d019dcf41500f09. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:38511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.308039  5112 tablet_server.cc:196] TabletServer@127.4.254.2:0 shutdown complete.
W20260709 13:18:18.339454 15908 consensus_peers.cc:597] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b -> Peer 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099): Couldn't send request to peer 07fd5c48d9bc4793a2260eb5bcbd93d7. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.344628  5112 tablet_server.cc:179] TabletServer@127.4.254.3:0 shutting down...
I20260709 13:18:18.375186  5112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:18.376075  5112 tablet_replica.cc:333] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
W20260709 13:18:18.376312 15907 consensus_peers.cc:597] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b -> Peer d2125841728845849d019dcf41500f09 (127.4.254.1:38511): Couldn't send request to peer d2125841728845849d019dcf41500f09. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:38511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.376978  5112 raft_consensus.cc:2243] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.377663  5112 raft_consensus.cc:2272] T 938727ad2d8048ada12908312d4afccf P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.380425  5112 tablet_replica.cc:333] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.381258  5112 raft_consensus.cc:2243] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.381871  5112 raft_consensus.cc:2272] T 9702d92a4d3f43ac9df920d55fcc85ab P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:18.382038 15908 consensus_peers.cc:597] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b -> Peer 07fd5c48d9bc4793a2260eb5bcbd93d7 (127.4.254.2:33099): Couldn't send request to peer 07fd5c48d9bc4793a2260eb5bcbd93d7. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.2:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.384649  5112 tablet_replica.cc:333] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.385545  5112 raft_consensus.cc:2243] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:18.386039 15907 consensus_peers.cc:597] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b -> Peer d2125841728845849d019dcf41500f09 (127.4.254.1:38511): Couldn't send request to peer d2125841728845849d019dcf41500f09. Status: Network error: Client connection negotiation failed: client connection to 127.4.254.1:38511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.386054  5112 raft_consensus.cc:2272] T 7d9e2f4d86f241d7a01d1d23bd3237a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.388242  5112 tablet_replica.cc:333] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.388851  5112 raft_consensus.cc:2243] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.389384  5112 raft_consensus.cc:2272] T a7c87f110fe24eb88a972f9cef7bc1a3 P b45ae26ee8b34e5189409e5c34ccd82b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.391314  5112 tablet_replica.cc:333] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.391918  5112 raft_consensus.cc:2243] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.392351  5112 raft_consensus.cc:2272] T b7fc02bad1a5417c88748b1e544d9003 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.394289  5112 tablet_replica.cc:333] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.394805  5112 raft_consensus.cc:2243] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.395524  5112 raft_consensus.cc:2272] T d77018beecd941398c8e0bcc7c8a92fa P b45ae26ee8b34e5189409e5c34ccd82b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.397775  5112 tablet_replica.cc:333] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.398303  5112 raft_consensus.cc:2243] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.398748  5112 raft_consensus.cc:2272] T 2fb73b286b93435b9982cd822dc4d1e6 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.400591  5112 tablet_replica.cc:333] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.401182  5112 raft_consensus.cc:2243] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.401635  5112 raft_consensus.cc:2272] T a0a458df2344444daab8ecaf20d448f4 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.403436  5112 tablet_replica.cc:333] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.404032  5112 raft_consensus.cc:2243] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.404445  5112 raft_consensus.cc:2272] T 8bdfdebfb9124e8191cf7c8f952ef4ea P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.406886  5112 tablet_replica.cc:333] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.407406  5112 raft_consensus.cc:2243] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.407831  5112 raft_consensus.cc:2272] T b76dbdecebd545e89831e7ffff29e8b3 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.410053  5112 tablet_replica.cc:333] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.410818  5112 raft_consensus.cc:2243] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.411782  5112 raft_consensus.cc:2272] T a4a1a4f5de12499da45dfcbc94771726 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.413789  5112 tablet_replica.cc:333] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.414232  5112 raft_consensus.cc:2243] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.414625  5112 raft_consensus.cc:2272] T 61bd2943bcf541a5b79d0456bbea0683 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.416352  5112 tablet_replica.cc:333] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.416805  5112 raft_consensus.cc:2243] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.417606  5112 raft_consensus.cc:2272] T 968f5a4c174c4e0baf9c60b1f7e69880 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.419519  5112 tablet_replica.cc:333] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.419992  5112 raft_consensus.cc:2243] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.420358  5112 raft_consensus.cc:2272] T fb3cdc33d24f40db996a1bb31d23cf0c P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.422204  5112 tablet_replica.cc:333] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.422858  5112 raft_consensus.cc:2243] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.423262  5112 raft_consensus.cc:2272] T 726f9d99397d4d7ca425ce99b0de38e5 P b45ae26ee8b34e5189409e5c34ccd82b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.425203  5112 tablet_replica.cc:333] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.425653  5112 raft_consensus.cc:2243] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.426026  5112 raft_consensus.cc:2272] T 8ba8da1cbcf840f5a523e4482cda8ae8 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.427832  5112 tablet_replica.cc:333] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.428267  5112 raft_consensus.cc:2243] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.428633  5112 raft_consensus.cc:2272] T 6f076fbe245547a68263c6793250c813 P b45ae26ee8b34e5189409e5c34ccd82b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.430557  5112 tablet_replica.cc:333] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b: stopping tablet replica
I20260709 13:18:18.430991  5112 raft_consensus.cc:2243] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.431706  5112 raft_consensus.cc:2272] T 7621f8dc45a74b1692dea1d9ab45abfa P b45ae26ee8b34e5189409e5c34ccd82b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.470500  5112 tablet_server.cc:196] TabletServer@127.4.254.3:0 shutdown complete.
I20260709 13:18:18.503259  5112 master.cc:562] Master@127.4.254.62:35311 shutting down...
I20260709 13:18:18.524070  5112 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.524572  5112 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.524837  5112 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8fa5044281d3475fa1d17f5bd8ff93d5: stopping tablet replica
I20260709 13:18:18.545222  5112 master.cc:584] Master@127.4.254.62:35311 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11879 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24503 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (302296 ms total)
[  PASSED  ] 8 tests.
I20260709 13:18:18.600127  5112 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 400 messages since previous log ~14 seconds ago
I20260709 13:18:18.600404  5112 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 400 messages since previous log ~14 seconds ago
I20260709 13:18:18.600601  5112 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 399 messages since previous log ~14 seconds ago
I20260709 13:18:18.600813  5112 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:18:18.601006  5112 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:18:18.601215  5112 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 2 messages since previous log ~104 seconds ago
I20260709 13:18:18.601413  5112 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~147 seconds ago
I20260709 13:18:18.601608  5112 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 2 messages since previous log ~147 seconds ago
I20260709 13:18:18.601805  5112 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~115 seconds ago
I20260709 13:18:18.602059  5112 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20260709 13:18:18.602367  5112 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 123 messages since previous log ~32 seconds ago
